3D Rendering Framework for Data Augmentation in Optical Character Recognition

Spruck A, Hawesch M, Maier A, Rieß C, Seiler J, Kaup A (2021)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Publisher: Institute of Electrical and Electronics Engineers Inc.

Conference Proceedings Title: ISSCS 2021 - International Symposium on Signals, Circuits and Systems

Event location: Iasi, Romania (virtual) RO

ISBN: 978-1-6654-4942-7

URI: https://arxiv.org/abs/2209.14970

DOI: 10.1109/ISSCS52333.2021.9497438

Abstract

In this paper, we propose a data augmentation framework for Optical Character Recognition (OCR). The proposed framework is able to synthesize new viewing angles and illumination scenarios, effectively enriching any available OCR dataset. Its modular structure allows to be modified to match individual user requirements. The framework enables to comfortably scale the enlargement factor of the available dataset. Furthermore, the proposed method is not restricted to single frame OCR but can also be applied to video OCR. We demonstrate the performance of our framework by augmenting a 15% subset of the common Brno Mobile OCR dataset. Our proposed framework is capable of leveraging the performance of OCR applications especially for small datasets. Applying the proposed method, improvements of up to 2.79 percentage points in terms of Character Error Rate (CER), and up to 7.88 percentage points in terms of Word Error Rate (WER) are achieved on the subset. Especially the recognition of challenging text lines can be improved. The CER may be decreased by up to 14.92 percentage points and the WER by up to 18.19 percentage points for this class. Moreover, we are able to achieve smaller error rates when training on the 15% subset augmented with the proposed method than on the original nonaugmented full dataset.

Authors with CRIS profile

Andreas Spruck Lehrstuhl für Multimediakommunikation und Signalverarbeitung Maximiliane Gruber Lehrstuhl für Multimediakommunikation und Signalverarbeitung Anatol Maier Lehrstuhl für Informatik 1 (IT-Sicherheitsinfrastrukturen) Christian Rieß Lehrstuhl für Informatik 1 (IT-Sicherheitsinfrastrukturen) Jürgen Seiler Lehrstuhl für Multimediakommunikation und Signalverarbeitung Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung

Related research project(s)

Digital Forensics: Recognition of License Plates via Superresolution and Artificial Intelligence (SUREK) June 1, 2020 - May 31, 2022

How to cite

APA:

Spruck, A., Hawesch, M., Maier, A., Rieß, C., Seiler, J., & Kaup, A. (2021). 3D Rendering Framework for Data Augmentation in Optical Character Recognition. In ISSCS 2021 - International Symposium on Signals, Circuits and Systems. Iasi, Romania (virtual), RO: Institute of Electrical and Electronics Engineers Inc..

MLA:

Spruck, Andreas, et al. "3D Rendering Framework for Data Augmentation in Optical Character Recognition." Proceedings of the 2021 International Symposium on Signals, Circuits and Systems (ISSCS), Iasi, Romania (virtual) Institute of Electrical and Electronics Engineers Inc., 2021.

BibTeX: Download