Towards a Multivariate Scoring Metric for the Evaluation of Simulation Scenarios in Automated Driving

Stadler C, German R, Djanatliev A (2022)

Publication Type: Conference contribution

Publication year: 2022

Publisher: Institute of Electrical and Electronics Engineers Inc.

Book Volume: 2022-October

Pages Range: 2508-2513

Conference Proceedings Title: IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC

Event location: Macau CN

ISBN: 9781665468800

DOI: 10.1109/ITSC55140.2022.9922082

Abstract

Due to the immense testing effort, the development and release of automated driving functions is increasingly dependent on simulations in addition to real world testing. In order to trust the simulation results, the deviations have to be quantified compared to tests on real roads. That is a prerequisite to decide if the required simulation fidelity is achieved or not. Therefore, several single quantitative and qualitative metrics are combined in this work to a multivariate scoring value for scenario-based testing in virtual environments. The approach focuses on deviations of the driven trajectories as well as the conducted maneuvers and the criticality in the traffic situations. However, the built framework for quantifying the gap compared to real world testing is generally formulated to be extendable for further features. Furthermore, scoring levels are introduced for classification. The practicable usage of the defined metric is demonstrated based on a resimulation of a scenario extracted from real driving data. The results are classified and thus the deviations are interpretable according to the used weighting factors.

Authors with CRIS profile

Reinhard German Computer Science 7 (Computer Networks and Communication Systems) Anatoli Djanatliev Computer Science 7 (Computer Networks and Communication Systems)

Involved external institutions

Audi AG DE Germany (DE)

How to cite

APA:

Stadler, C., German, R., & Djanatliev, A. (2022). Towards a Multivariate Scoring Metric for the Evaluation of Simulation Scenarios in Automated Driving. In IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC (pp. 2508-2513). Macau, CN: Institute of Electrical and Electronics Engineers Inc..

MLA:

Stadler, Christoph, Reinhard German, and Anatoli Djanatliev. "Towards a Multivariate Scoring Metric for the Evaluation of Simulation Scenarios in Automated Driving." Proceedings of the 25th IEEE International Conference on Intelligent Transportation Systems, ITSC 2022, Macau Institute of Electrical and Electronics Engineers Inc., 2022. 2508-2513.

BibTeX: Download