Majumdar S, Gamarra GG, Franke J, Reitelshöfer S (2025)
Publication Type: Conference contribution, Original article
Publication year: 2025
Publisher: Institute of Electrical and Electronics Engineers Inc.
Conference Proceedings Title: 3rd International Conference on Integrated Systems in Medical Technologies, ISMT 2025 - Conference Proceedings
Event location: Erlangen, DEU
ISBN: 9798331557157
DOI: 10.1109/ISMT68188.2025.11488076
Emotional health is becoming increasingly important in senior care as our global population ages. While advancements in digital technology have improved health monitoring and support systems, creating robots that possess emotional intelligence has been quite challenging. To enhance emotional interactions between humans and robots in senior care facilities, this work introduces a modular social robot architecture based on Robot Operating System 2 (ROS2) that features real-time facial emotion recognition. The system uses the Sophisticated High-speed Object Recognition Engine (SHORE) software by Fraunhofer IIS to detect emotion, age, and gender. It features a multi-layer modular architecture comprising acquisition, preprocessing, emotion recognition, a prioritization layer for user selection, an emotion relay layer for tracking, a deliberative layer employing Hidden Markov Models (HMM), and a reactive override layer for safety-critical events. The architecture supports diverse input modalities, including static images, prerecorded videos, and live camera feeds, with affective responses visualized via Blender-based LED facial expressions. Evaluation results demonstrate successful multi-user handling, temporal emotion stabilization, and real-time prioritization, indicating strong potential for enhancing empathetic and interpretable robotic behavior in elderly care settings.
APA:
Majumdar, S., Gamarra, G.G., Franke, J., & Reitelshöfer, S. (2025). Towards Emotion-Driven Human-Robot Interaction for Elderly Care Using ROS2 and SHORE. In 3rd International Conference on Integrated Systems in Medical Technologies, ISMT 2025 - Conference Proceedings. Erlangen, DEU: Institute of Electrical and Electronics Engineers Inc..
MLA:
Majumdar, Sagni, et al. "Towards Emotion-Driven Human-Robot Interaction for Elderly Care Using ROS2 and SHORE." Proceedings of the 3rd International Conference on Integrated Systems in Medical Technologies, ISMT 2025, Erlangen, DEU Institute of Electrical and Electronics Engineers Inc., 2025.
BibTeX: Download