  Scenario-based testing is a promising approach to solve the challenge of
proving the safe behavior of vehicles equipped with automated driving systems.
Since an infinite number of concrete scenarios can theoretically occur in
real-world road traffic, the extraction of scenarios relevant in terms of the
safety-related behavior of these systems is a key aspect for their successful
verification and validation. Therefore, a method for extracting multimodal
urban traffic scenarios from naturalistic road traffic data in an unsupervised
manner, minimizing the amount of (potentially biased) prior expert knowledge,
is proposed. Rather than an (elaborate) rule-based assignment by extracting
concrete scenarios into predefined functional scenarios, the presented method
deploys an unsupervised machine learning pipeline. The approach allows
exploring the unknown nature of the data and their interpretation as test
scenarios that experts could not have anticipated. The method is evaluated for
naturalistic road traffic data at urban intersections from the inD and the
Silicon Valley Intersections datasets. For this purpose, it is analyzed with
which clustering approach (K-Means, hierarchical clustering, and DBSCAN) the
scenario extraction method performs best (referring to an elaborate rule-based
implementation). Subsequently, using hierarchical clustering the results show
both a jump in overall accuracy of around 20% when moving from 4 to 5 clusters
and a saturation effect starting at 41 clusters with an overall accuracy of
84%. These observations can be a valuable contribution in the context of the
trade-off between the number of functional scenarios (i.e., clustering
accuracy) and testing effort. Possible reasons for the observed accuracy
variations of different clusters, each with a fixed total number of given
clusters, are discussed.
