A Thermal Infrared Face Database with Facial Landmarks and Emotion Labels
Kopaczka M, Kolk R, Schock J, Burkhard F, Merhof D (2019)
Publication Type: Journal article
Publication year: 2019
Journal
Book Volume: 68
Pages Range: 1389-1401
Article Number: 8584115
Journal Issue: 5
Abstract
Thermal infrared imaging is an emerging modality that has gained increasing interest in recent years, mostly due to technical advances resulting in the availability of affordable microbolometer-based IR imaging sensors. However, while sensors are widely available, algorithms for thermal image processing still lack robustness and accuracy when compared to their RGB counterparts. Current methods developed for RGB data make use of machine learning algorithms that require large amounts of labeled images which are currently not available for the thermal domain. In this paper, we address the question whether providing a large number of labeled images would allow the application of current image processing methods on the example of solving challenging face analysis tasks. We introduce a high-resolution thermal facial image database with extensive manual annotations and explore how it can be used to adapt methods from the visual domain for infrared images. In addition, we extend existing approaches for infrared landmark detection with a head pose estimation for improved robustness and analyze the performance of a deep learning method on this task. An evaluation of algorithm performance shows that learning algorithms either outperform available solutions or allow completely new applications that could previously not be addressed. As a conclusion, we prove that investing the effort into acquiring appropriate training data and adapting competitive algorithms is not only a viable approach in analysing thermal infrared images but can also allow outperforming specific task-designed solutions. The database is freely available for academic use at https://github.com/marcinkopaczka/thermalfaceproject.
Involved external institutions
Germany (DE)How to cite
APA:
Kopaczka, M., Kolk, R., Schock, J., Burkhard, F., & Merhof, D. (2019). A Thermal Infrared Face Database with Facial Landmarks and Emotion Labels. IEEE Transactions on Instrumentation and Measurement, 68(5), 1389-1401. https://doi.org/10.1109/TIM.2018.2884364
MLA:
Kopaczka, Marcin, et al. "A Thermal Infrared Face Database with Facial Landmarks and Emotion Labels." IEEE Transactions on Instrumentation and Measurement 68.5 (2019): 1389-1401.
BibTeX: Download