Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle
Gomaa A, Reyes G, Alles A, Rupp L, Feld M (2020)
Publication Type: Conference contribution
Publication year: 2020
Publisher: Association for Computing Machinery, Inc
Pages Range: 501-509
Conference Proceedings Title: ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction
Event location: Virtual, Online, NLD
ISBN: 9781450375818
Abstract
Hand pointing and eye gaze have been extensively investigated in automotive applications for object selection and referencing. Despite significant advances, existing outside-the-vehicle referencing methods consider these modalities separately. Moreover, existing multimodal referencing methods focus on a static situation, whereas the situation in a moving vehicle is highly dynamic and subject to safety-critical constraints. In this paper, we investigate the specific characteristics of each modality and the interaction between them when used in the task of referencing outside objects (e.g. buildings) from the vehicle. We furthermore explore person-specific differences in this interaction by analyzing individuals' performance for pointing and gaze patterns, along with their effect on the driving task. Our statistical analysis shows significant differences in individual behaviour based on object's location (i.e. driver's right side vs. left side), object's surroundings, driving mode (i.e. autonomous vs. normal driving) as well as pointing and gaze duration, laying the foundation for a user-adaptive approach.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Gomaa, A., Reyes, G., Alles, A., Rupp, L., & Feld, M. (2020). Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle. In ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 501-509). Virtual, Online, NLD: Association for Computing Machinery, Inc.
MLA:
Gomaa, Amr, et al. "Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle." Proceedings of the 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, Virtual, Online, NLD Association for Computing Machinery, Inc, 2020. 501-509.
BibTeX: Download