Indoor Synthetic Data Generation: A Systematic Review

Schieber H, Demir K, Kleinbeck C, Yang SH, Roth D (2024)

Publication Type: Journal article

Publication year: 2024

Journal

Computer Vision and Image Understanding Elsevier

Book Volume: 240

Article Number: 103907

DOI: 10.1016/j.cviu.2023.103907

Abstract

Objective: Deep learning-based object recognition, 6D pose estimation, and semantic scene understanding require a large amount of training data to achieve generalization. Time-consuming annotation processes, privacy, and security aspects lead to a scarcity of real-world datasets. To overcome this lack of data, synthetic data generation has been proposed, including multiple facets in the area of domain randomization to extend the data distribution. The objective of this review is to identify methods applied for synthetic data generation aiming to improve 6D pose estimation, object recognition, and semantic scene understanding in indoor scenarios. We further review methods used to extend the data distribution and discuss best practices to bridge the gap between synthetic and real-world data. Methods: We adhered to the guidelines of the systematic PRISMA technique. Three databases, IEEE Xplore, Springer Link, and ACM, and an additional manual search were conducted. In total, we identified 241 studies and included 34 in our systematic review. Conclusion: In summary, synthetic data generation has been performed using crop-out methods, graphic APIs, 3D modeling or authoring tools, or game engine-based methods. To extend the data distribution, varying scene parameters, i.e., lighting conditions or textures and the use of distracting objects in the scene are promising.

Authors with CRIS profile

Kubilay Demir Lehrstuhl für Informatik 5 (Mustererkennung) Seung Hee Yang Professur für Artificial Intelligence in Biomedical Speech Processing (Stiftungsprofessur)

Involved external institutions

Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Schieber, H., Demir, K., Kleinbeck, C., Yang, S.H., & Roth, D. (2024). Indoor Synthetic Data Generation: A Systematic Review. Computer Vision and Image Understanding, 240. https://dx.doi.org/10.1016/j.cviu.2023.103907

MLA:

Schieber, Hannah, et al. "Indoor Synthetic Data Generation: A Systematic Review." Computer Vision and Image Understanding 240 (2024).

BibTeX: Download