ArtFacePoints: High-resolution Facial Landmark Detection in Paintings and Prints

Sindel A, Maier A, Christlein V (2023)

Publication Language: English

Publication Status: Accepted

Publication Type: Conference contribution, Conference Contribution

Future Publication Type: Conference contribution

Publication year: 2023

Publisher: Springer Cham

Edited Volumes: Computer Vision – ECCV 2022 Workshops

Pages Range: 298–313

Conference Proceedings Title: Computer Vision – ECCV 2022 Workshops. ECCV 2022

Event location: Tel Aviv IL

URI: https://arxiv.org/pdf/2210.09204.pdf

DOI: 10.1007/978-3-031-25056-9_20

Abstract

Facial landmark detection plays an important role for the similarity analysis in artworks to compare portraits of the same or similar artists. With facial landmarks, portraits of different genres, such as paintings and prints, can be automatically aligned using control-point-based image registration. We propose a deep-learning-based method for facial landmark detection in high-resolution images of paintings and prints. It divides the task into a global network for coarse landmark prediction and multiple region networks for precise landmark refinement in regions of the eyes, nose, and mouth that are automatically determined based on the predicted global landmark coordinates. We created a synthetically augmented facial landmark art dataset including artistic style transfer and geometric landmark shifts. Our method demonstrates an accurate detection of the inner facial landmarks for our high-resolution dataset of artworks while being comparable for a public low-resolution artwork dataset in comparison to competing methods.

Authors with CRIS profile

Aline Sindel Lehrstuhl für Informatik 5 (Mustererkennung) Andreas Maier Lehrstuhl für Informatik 5 (Mustererkennung) Vincent Christlein Lehrstuhl für Informatik 5 (Mustererkennung)

Related research project(s)

Similarity learning for art analysis Critical Catalogue of Luther Portraits (1519-1530) June 1, 2018 - Feb. 28, 2021

How to cite

APA:

Sindel, A., Maier, A., & Christlein, V. (2023). ArtFacePoints: High-resolution Facial Landmark Detection in Paintings and Prints. In Computer Vision – ECCV 2022 Workshops. ECCV 2022 (pp. 298–313). Tel Aviv, IL: Springer Cham.

MLA:

Sindel, Aline, Andreas Maier, and Vincent Christlein. "ArtFacePoints: High-resolution Facial Landmark Detection in Paintings and Prints." Proceedings of the Vision for Art (VISART VI) 2022 at European Conference on Computer Vision (ECCV) 2022, Tel Aviv Springer Cham, 2023. 298–313.

BibTeX: Download