Ensuring a Robust Multimodal Conversational User Interface during Maintenance Work

Fleiner C, Riedel T, Beigl M, Ruoff M (2021)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2021

Publisher: Association for Computing Machinery

Pages Range: 79-91

Conference Proceedings Title: ACM International Conference Proceeding Series

Event location: Virtual DE

ISBN: 9781450386456

URI: https://dl.acm.org/doi/10.1145/3473856.3473871?cid=99659883531

DOI: 10.1145/3473856.3473871

Open Access Link: https://dx.doi.org/10.1145/3473856.3473871

Abstract

It has been shown that the provision of a conversational user interface proves beneficial in many domains. But, there are still many challenges when applied in production areas, e.g. as part of a virtual assistant to support workers in knowledge-intensive maintenance work. Regarding input modalities, touchscreens are failure-prone in wet environments and the quality of voice recognition is negatively affected by ambient noise. Augmenting a symmetric text- and voice-based user interface with gestural input poses a good solution to provide both efficiency and a robust communication. This paper contributes to this research area by providing results on the application of appropriate head and one-hand gestures during maintenance work. We conducted an elicitation study with 20 participants and present a gesture set as its outcome. To facilitate the gesture development and integration for application designers, a classification model for head gestures and one for one-hand gestures were developed. Additionally, a proof-of-concept for operators' acceptance regarding a multimodal conversational user interface with support of gestural input during maintenance work was demonstrated. It encompasses two usability testings with 18 participants in different realistic, but controlled settings: notebook repair (SUS: 82.1) and cutter head maintenance (SUS: 82.7).

Authors with CRIS profile

Christian Fleiner Lehrstuhl für Wirtschaftsinformatik, insbesondere Technische Informationssysteme

Related research project(s)

Methodik zur selbstorganisierten Aggregation interaktiver Komponenten (MOSAIK) May 1, 2019 - April 30, 2022

Involved external institutions

Karlsruhe Institute of Technology (KIT) DE Germany (DE)

How to cite

APA:

Fleiner, C., Riedel, T., Beigl, M., & Ruoff, M. (2021). Ensuring a Robust Multimodal Conversational User Interface during Maintenance Work. In Bastian Pfleging, Dagmar Kern, Stefan Schneegass (Eds.), ACM International Conference Proceeding Series (pp. 79-91). Virtual, DE: Association for Computing Machinery.

MLA:

Fleiner, Christian, et al. "Ensuring a Robust Multimodal Conversational User Interface during Maintenance Work." Proceedings of the 2021 Conference on Mensch und Computer, MuC 2021 - 2021 Conference on Humans and Computers, MuC 2021, Virtual Ed. Bastian Pfleging, Dagmar Kern, Stefan Schneegass, Association for Computing Machinery, 2021. 79-91.

BibTeX: Download