  This paper examines the safety performance of the Waymo Driver, an SAE level
4 automated driving system (ADS) used in a rider-only (RO) ride-hailing
application without a human driver, either in the vehicle or remotely. ADS
crash data was derived from NHTSA's Standing General Order (SGO) reporting over
7.14 million RO miles through the end of October 2023 in Phoenix, AZ, San
Francisco, CA, and Los Angeles, CA. This study is one of the first to compare
overall crashed vehicle rates using only RO data (as opposed to ADS testing
with a human behind the wheel) to a human benchmark that also corrects for
biases caused by underreporting and unequal reporting thresholds reported in
the literature. When considering all locations together, the
any-injury-reported crashed vehicle rate was 0.41 incidents per million miles
(IPMM) for the ADS vs 2.78 IPMM for the human benchmark, an 85% reduction or a
6.8 times lower rate. Police-reported crashed vehicle rates for all locations
together were 2.1 IPMM for the ADS vs. 4.85 IPMM for the human benchmark, a 57%
reduction or 2.3 times lower rate. Police-reported and any-injury-reported
crashed vehicle rate reductions for the ADS were statistically significant when
compared in San Francisco and Phoenix as well as combined across all locations.
The comparison in Los Angeles, which to date has low mileage and no reported
events, was not statistically significant. In general, the Waymo ADS had a
lower any property damage or injury rate than the human benchmarks. Given
imprecision in the benchmark estimate and multiple potential sources of
underreporting biasing the benchmarks, caution should be taken when
interpreting the results of the any property damage or injury comparison.
Together, these crash-rate results should be interpreted as a directional and
continuous confidence growth indicator, together with other methodologies, in a
safety case approach.
