V&V Standards Coverage
Verification & validation across IMO, RiMEA, NIST TN 1822 and ISO 20414. Generated 2026-09-16 13:10 UTC from standards/coverage.json + the latest V&V run.
42Pass
0Notebook
6XFail
3Skip
14Pending
0Fail
IMO MSC.1/Circ.1533 — 6/11 covered
Revised Guidelines for Evacuation Analysis for New and Existing Passenger Ships · pytest-asserted
| Test | Name | Criterion | Status |
|---|---|---|---|
| IMO 1 | Walking speed in a corridor | Evacuation time ~ d/v +/- 20% | PASS |
| IMO 2 | Walking speed up stairs | Maintain assigned speed upstairs Not implemented as an IMO-tier test; stair speed is covered by RiMEA-02 / NIST-2.2. | PENDING |
| IMO 3 | Walking speed down stairs | Maintain assigned speed downstairs Not implemented as an IMO-tier test; covered by RiMEA-03 / NIST-2.2. | PENDING |
| IMO 4 | Exit flow rate | Flow through a 1 m exit is physically plausible | PASS |
| IMO 5 | Response time | Agents respect an assigned pre-movement distribution Covered by RiMEA-05 / NIST-1.1; no IMO-tier test. | PENDING |
| IMO 6 | Rounding corners | Navigate a 90-degree corner, stay in geometry | PASS |
| IMO 7 | Assignment of population demographics | All agents evacuate within [25 s, 120 s] | PASS |
| IMO 8 | Counterflow | Counterflow increases evacuation time | PASS |
| IMO 9 | Exit-count sensitivity | Halving the exits increases evacuation time | PASS |
| IMO 10 | Exit route allocation | Agents use assigned escape routes RE-03 is declared in test_imo_room_evacuation.py but not implemented; route allocation is covered by RiMEA-10 / NIST-3.1. | PENDING |
| IMO 11 | Congestion / flow on stairs | Congestion forms at flow constraints Covered by RiMEA-16 / NIST-5.1; no IMO-tier test. | PENDING |
RiMEA 4.1.1 — 16/19 covered
Guideline for Microscopic Evacuation Analysis (RiMEA), section 4.1.1 verification tests · pytest-asserted
| Test | Name | Criterion | Status |
|---|---|---|---|
| Test 1 | Speed in a corridor | Travel time at 1.33 m/s in [26, 34] s | PASS |
| Test 2 | Speed up stairs | Walking speed maintained upstairs | PASS |
| Test 3 | Speed down stairs | Walking speed maintained downstairs | PASS |
| Test 4 | Fundamental diagram | Speed-density relation matches empirical data Placeholder: requires measurement areas + density sweeps. | SKIP |
| Test 5 | Pre-movement time | Agents respect assigned pre-movement delay | PASS |
| Test 6 | Corner movement | Navigate a corner without wall penetration | PASS |
| Test 7 | Demographic parameters | Speed distribution matches the age-based table | PASS |
| Test 8 | Parameter study | Evacuation time varies with parameters Placeholder: requires a parameter sweep harness. | SKIP |
| Test 9 | Large public space | Closing 2/4 exits increases evacuation time | PASS |
| Test 10 | Route allocation | Agents use assigned escape routes | PASS |
| Test 11 | Escape route choice | Agents prefer the closer exit Placeholder: requires route-choice modeling. | SKIP |
| Test 12a | Goal position | Closer goal yields shorter evacuation | PASS |
| Test 12b | Bottleneck length | Longer bottleneck increases evacuation time | PASS |
| Test 12c | Congestion influence | Measure congestion influence at bottlenecks | PASS |
| Test 12d | Bottleneck width | Wider bottleneck yields faster evacuation | PASS |
| Test 13 | Fundamental diagram on stairs | Down-stair speed > up-stair speed | PASS |
| Test 14 | Route choice | Document short vs long route preference | PASS |
| Test 15 | Large crowd around a corner | Corner slows evacuation vs a straight path | PASS |
| Test 16 | 1D fundamental diagram | 1D speed-density within the empirical envelope | PASS |
NIST TN 1822 — 9/18 covered
The Process of Verification and Validation of Building Fire Evacuation Models (Ronchi et al., 2013) · pytest-asserted
| Test | Name | Criterion | Status |
|---|---|---|---|
| Verif.1.1 | Pre-evacuation time distributions | KS p > 0.05 for uniform/gamma/lognormal/weibull | PASS |
| Verif.2.1 | Speed in a corridor | Walking speed 1.0 +/- 0.05 m/s over the 40 m segment | PASS |
| Verif.2.2 | Speed on stairs (up) | Stair speed 1.0 +/- 0.05 m/s upward over 100 m | PASS |
| Verif.2.2 | Speed on stairs (down) | Stair speed 1.0 +/- 0.05 m/s downward over 100 m | PASS |
| Verif.2.3 | Movement around a corner | All 20 agents evacuate; no boundary penetration | PASS |
| Verif.2.4 | Assigned demographics | Gaussian(1.2, 0.2) desired-speed distribution configured | PASS |
| Verif.2.5 | Reduced visibility vs walking speed | Smoke-driven speed reduction Needs smoke / extinction-coefficient handling. | PENDING |
| Verif.2.6 | Agent incapacitation (FED) | FED-driven incapacitation Needs an FED sub-model. | PENDING |
| Verif.2.7 | Elevator usage | Agents evacuate via elevator Needs an elevator component. | PENDING |
| Verif.2.8 | Horizontal counter-flows | Primary completions non-increasing as counterflow grows (equal budget) | PASS |
| Verif.2.9 | Group behaviours | Group 1 arrival spread <= 10 s CollisionFreeSpeedModel has no group-cohesion model (spread ~24 s). | XFAIL |
| Verif.2.10 | Agents with movement disabilities | Reduced-mobility agent profiles Needs reduced-mobility / agent-size profiles. | PENDING |
| Verif.3.1 | Exit route allocation | Each of 13 agents reaches its allocated exit | PASS |
| Verif.3.2 | Social influence | Exit choice shifts under social influence Needs a social-influence component. | PENDING |
| Verif.3.3 | Affiliation | Agents prefer familiar exits Needs an affiliation component. | PENDING |
| Verif.4.1 | Dynamic availability of exits | Agents reroute when an exit closes at runtime Needs runtime exit toggling. | PENDING |
| Verif.5.1 | Congestion | Peak density at the room exit > corridor midsection | PASS |
| Verif.5.2 | Maximum flow rates | Sustained specific flow <= 1.33 p/m/s (IMO) CollisionFreeSpeedModel has no door-flow limiter (emergent ~5 p/m/s). | XFAIL |
ISO 20414:2020 — 11/17 covered
Fire safety engineering - Verification and validation protocol for building fire evacuation models · pytest-asserted
| Test | Name | Criterion | Status |
|---|---|---|---|
| Test 1 | Pre-evacuation time assignment | Start times fit the assigned distribution (two-sample KS, alpha=0.05) | PASS |
| Test 2 | Walking speed in a corridor | Walking speed 1.0 +/- 0.05 m/s over the 40 m segment | PASS |
| Test 3 | Walking speed on stairs | Stair speed 0.5 +/- 0.05 m/s in the speed-factor zone | PASS |
| Test 4 | Movement around a corner | All agents evacuate; no boundary penetration | PASS |
| Test 5 | Assigned occupant demographics | Realized speeds match Gaussian(1.2, 0.2) (pooled mean/std + KS) | PASS |
| Test 6 | Horizontal counter-flows | Crossing time increases with counterflow No lane formation in CollisionFreeSpeedModel; the primary crowd deadlocks at >= 50 counterflow agents, so the crossing time is undefined. | XFAIL |
| Test 7 | Occupant incapacitation | FED-driven incapacitation Not shipped; needs an FED sub-model. | PENDING |
| Test 8 | Exit route allocation | Every agent reaches its allocated exit | PASS |
| Test 9 | Elevator usage | Agents evacuate via elevator Not shipped; needs an elevator component. | PENDING |
| Test 10 | Congestion in front of a stair | Peak density at the room->neck entrance and stair base exceeds the mid-corridor | PASS |
| Test 11 | Maximum flow rates at an exit | Sustained specific flow <= 1.33 p/m/s (IMO) CollisionFreeSpeedModel has no door-flow limiter (emergent ~5 p/m/s). | XFAIL |
| Test 12 | Stair flow rates | Flow rate increases with stair width (positive slope) | PASS |
| Test 13 | Flow, density and speed in a corridor | Zone-2 speed stays within the assigned free speed CollisionFreeSpeedModel does not reproduce an empirical fundamental diagram; zone-2 speeds exceed the 1.0 m/s free speed. | XFAIL |
| Test 14 | Group behaviour | The homogeneous fast group reaches the exit together (spread <= 10 s) | PASS |
| Test 15 | Social influence on exit choice | A deterministic exit-2 occupant raises free occupants' exit-2 usage CollisionFreeSpeedModel has no social-influence model; exit-2 usage is unchanged. | XFAIL |
| Test 16 | Affiliation to familiar exits | Journey-weighted affiliation biases exit choice (80/20 -> exit 2 preferred) | PASS |
| Test 17 | Route choice from geometric layout | Agents prefer the geometrically shorter route | PASS |
PASS criterion asserted & met · XFAIL criterion asserted but blocked by a model limitation · NOTEBOOK demonstrated in a notebook (no automated assert) · SKIP placeholder test · PENDING defined by the standard, not implemented · FAIL asserted & failing