Redundant Sensor-Based Perception Sensor Reliability Estimation from Field Tests without Reference Truth

Kryda M, Qiu M, Berk M, Buschardt B, Straub D (2023)

Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2023

Journal

SAE Technical Papers Society of Automotive Engineers

DOI: 10.4271/2023-01-5078

Abstract

The introduction of autonomous vehicles has gained significant attention due to its potential to revolutionize mobility and safety. A critical aspect underpinning the functionality of these autonomous vehicles is their sensor perception system. Demonstrating the reliability of the environment perception sensors and sensor fusion algorithms is, therefore, a necessary step in the development of automated vehicles. Field tests offer testing conditions that come closest to the environment of an automated vehicle in the future. However, a significant challenge in field tests is to obtain a reference truth of the surrounding environment. Here, we propose a pipeline to assess the sensor reliabilities without the need for a reference truth. The pipeline uses a model to estimate the reliability of redundant sensors. To do this, it relies on a binary representation of the surrounding area, which indicates either the presence or absence of an object. Therefore, the pipeline includes another step to convert object lists into this binary representation. Using the pipeline, we estimate the sensor reliabilities from object data derived from the Waymo dataset. Even though we are capable of obtaining close estimates of the sensor reliabilities we find out that the estimation of the sensor reliabilities is not robust for different parameter sets.

Authors with CRIS profile

Minhao Qiu Computer Science 7 (Computer Networks and Communication Systems)

Related research project(s)

Reliability design of multi-sensor systems Jan. 1, 2020 - June 30, 2023

Involved external institutions

Audi AG DE Germany (DE) Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Kryda, M., Qiu, M., Berk, M., Buschardt, B., & Straub, D. (2023). Redundant Sensor-Based Perception Sensor Reliability Estimation from Field Tests without Reference Truth. SAE Technical Papers. https://doi.org/10.4271/2023-01-5078

MLA:

Kryda, Marco, et al. "Redundant Sensor-Based Perception Sensor Reliability Estimation from Field Tests without Reference Truth." SAE Technical Papers (2023).

BibTeX: Download