Deep learning for terahertz image denoising in nondestructive historical document analysis

Dutta B, Root K, Ullmann I, Wagner F, Mayr M, Seuret M, Thies M, Stromer D, Christlein V, Schür J, Maier A, Huang Y (2022)


Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2022

Journal

Book Volume: 12

Pages Range: 1-11

Article Number: 22554

URI: https://www.nature.com/articles/s41598-022-26957-7

DOI: 10.1038/s41598-022-26957-7

Open Access Link: https://www.nature.com/articles/s41598-022-26957-7

Abstract

Historical documents contain essential information about the past, including places, people, or events. Many of these valuable cultural artifacts cannot be further examined due to aging or external influences, as they are too fragile to be opened or turned over, so their rich contents remain hidden. Terahertz (THz) imaging is a nondestructive 3D imaging technique that can be used to reveal the hidden contents without damaging the documents. As noise or imaging artifacts are predominantly present in reconstructed images processed by standard THz reconstruction algorithms, this work intends to improve THz image quality with deep learning. To overcome the data scarcity problem in training a supervised deep learning model, an unsupervised deep learning network (CycleGAN) is first applied to generate paired noisy THz images from clean images (clean images are generated by a handwriting generator). With such synthetic noisy-to-clean paired images, a supervised deep learning model using Pix2pixGAN is trained, which is effective to enhance real noisy THz images. After Pix2pixGAN denoising, 99% characters written on one-side of the Xuan paper can be clearly recognized, while 61% characters written on one-side of the standard paper are sufficiently recognized. The average perceptual indices of Pix2pixGAN processed images are 16,83, which is very close to the average perceptual index 16.19 of clean handwriting images. Our work has important value for THz-imaging-based nondestructive historical document analysis.

Authors with CRIS profile

Related research project(s)

How to cite

APA:

Dutta, B., Root, K., Ullmann, I., Wagner, F., Mayr, M., Seuret, M.,... Huang, Y. (2022). Deep learning for terahertz image denoising in nondestructive historical document analysis. Scientific Reports, 12, 1-11. https://dx.doi.org/10.1038/s41598-022-26957-7

MLA:

Dutta, Balaka, et al. "Deep learning for terahertz image denoising in nondestructive historical document analysis." Scientific Reports 12 (2022): 1-11.

BibTeX: Download