ICC++: Explainable Feature Learning for Art History using Image Compositions
Madhu P, Marquart T, Kosti RV, Suckow D, Bell P, Maier A, Christlein V (2022)
Publication Type: Journal article
Publication year: 2022
Journal
Original Authors: Prathmesh Madhu, Tilman Marquart, Ronak Kosti, Dirk Suckow, Peter Bell, Andreas Maier, Vincent Christlein
Pages Range: 109153
Article Number: 109153
DOI: 10.1016/j.patcog.2022.109153
Abstract
Image compositions are helpful in the study of image structures and assist in discovering the semantics of the underlying scene portrayed across art forms and styles. With the digitization of artworks in recent years, thousands of images of a particular scene or narrative could potentially be linked together. However, manually linking this data with consistent objectiveness can be a highly challenging and time-consuming task. In this work, we present a novel approach called Image Composition Canvas (ICC) to compare and retrieve images having similar compositional elements. ICC is an improvement over ICC, specializing in generating low and high-level features (compositional elements) motivated by Max Imdahl’s work. To this end, we present a rigorous quantitative and qualitative comparison of our approach with traditional and state-of-the-art (SOTA) methods showing that our proposed method outperforms all of them. In combination with deep features, our method outperforms the best deep learning-based method, opening the research direction for explainable machine learning for digital humanities. We will release the code and the data post-publication.
Authors with CRIS profile
Prathmesh Madhu
Lehrstuhl für Informatik 5 (Mustererkennung)
Ronak Vijaypal Kosti
Lehrstuhl für Informatik 5 (Mustererkennung)
Dirk Suckow
Juniorprofessur für Digital Humanities mit Schwerpunkt Kunstgeschichte
Andreas Maier
Lehrstuhl für Informatik 5 (Mustererkennung)
Vincent Christlein
Lehrstuhl für Informatik 5 (Mustererkennung)
Involved external institutions
Germany (DE)How to cite
APA:
Madhu, P., Marquart, T., Kosti, R.V., Suckow, D., Bell, P., Maier, A., & Christlein, V. (2022). ICC++: Explainable Feature Learning for Art History using Image Compositions. Pattern Recognition, 109153. https://doi.org/10.1016/j.patcog.2022.109153
MLA:
Madhu, Prathmesh, et al. "ICC++: Explainable Feature Learning for Art History using Image Compositions." Pattern Recognition (2022): 109153.
BibTeX: Download