  Crowd simulation is rapidly becoming a standard tool for evacuation planning
and evaluation. However, the many crowd models in the literature are
structurally different, and few have been rigorously calibrated against
real-world egress data, especially in emergency situations. In this paper we
describe a procedure to quantitatively compare different crowd models or
between models and real-world data. We simulated three models: (1) the lattice
gas model, (2) the social force model, and (3) the RVO2 model, and obtained the
distributions of six observables: (1) evacuation time, (2) zoned evacuation
time, (3) passage density, (4) total distance traveled, (5) inconvenience, and
(6) flow rate. We then used the DISTATIS procedure to compute the compromise
matrix of statistical distances between the three models. Projecting the three
models onto the first two principal components of the compromise matrix, we
find the lattice gas and RVO2 models are similar in terms of the evacuation
time, passage density, and flow rates, whereas the social force and RVO2 models
are similar in terms of the total distance traveled. Most importantly, we find
that the zoned evacuation times of the three models to be very different from
each other. Thus we propose to use this variable, if it can be measured, as the
key test between different models, and also between models and the real world.
Finally, we compared the model flow rates against the flow rate of an emergency
evacuation during the May 2008 Sichuan earthquake, and found the social force
model agrees best with this real data.
