Non-Contact Infant Sleep Monitoring via Deep Learning-Based Facial Behavior Analysis

Garcia Gamarra GG, Wahab F, Franke J, Reitelshöfer S (2026)

Publication Type: Conference contribution

Publication year: 2026

Publisher: IEEE Computer Society

Pages Range: 71-76

Conference Proceedings Title: 2026 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO)

Event location: Vienna AT

ISBN: 9798331564452

DOI: 10.1109/ARSO68304.2026.11536128

Abstract

Sleep is essential for infant health and development, yet assessing infant sleep remains challenging because internal states must be inferred from observable behavior. This work presents a non-contact method for sleep-related behavioral inference based on facial analysis from video data. Unlike contact-based sensors or handcrafted feature approaches, the proposed system learns eye and mouth behavior directly from facial imagery and integrates these cues over time. Video frames are processed using facial region detection and landmark extraction, followed by MobileNet-based convolutional neural networks for binary classification of eye and mouth states. Frame-level predictions are aggregated through temporal decision logic to estimate sleep-related behavioral states, with blink dynamics and yawning serving as complementary indicators of transitional phases. Leveraging transfer learning enables efficient and robust inference suitable for real-world settings. Experimental results show reliable estimation of eye and mouth states and stable sleep-related behavioral inference. The proposed framework provides a practical, non-contact alternative to traditional infant sleep monitoring systems. Future work will address dataset expansion, robustness to occlusions and lighting variability, and the integration of multimodal inputs.

Authors with CRIS profile

Gabriela Mariel Garcia Gamarra Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Jörg Franke Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Sebastian Reitelshöfer Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS)

How to cite

APA:

Garcia Gamarra, G.G., Wahab, F., Franke, J., & Reitelshöfer, S. (2026). Non-Contact Infant Sleep Monitoring via Deep Learning-Based Facial Behavior Analysis. In 2026 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO) (pp. 71-76). Vienna, AT: IEEE Computer Society.

MLA:

Garcia Gamarra, Gabriela García, et al. "Non-Contact Infant Sleep Monitoring via Deep Learning-Based Facial Behavior Analysis." Proceedings of the 2026 IEEE International Conference on Advanced Robotics and its Social Impacts, ARSO 2026, Vienna IEEE Computer Society, 2026. 71-76.

BibTeX: Download