A multi-sensor approach to automatically recognize breaks and work activities of knowledge workers in academia

Di Lascio E, Gashi S, Hidalgo JS, Nale B, Debus M, Santini S (2020)

Publication Type: Journal article, Original article

Publication year: 2020

Journal

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Association for Computing Machinery (ACM)

Book Volume: 4

Article Number: 78

DOI: 10.1145/3411821

Abstract

Personal informatics systems for the work environment can help improving workers' well-being and productivity. Using both self-reported data logged manually by the users and information automatically inferred from sensor measurements, such systems may track users' activities at work and help them reflect on their work habits through insightful data visualizations. They can further support interventions like, e.g., blocking distractions during work activities or suggest the user to take a break. The ability to automatically recognize when the user is engaged in a work activity or taking a break is thus a fundamental primitive such systems need to implement. In this paper, we explore the use of data collected from personal devices -- smartwatches, laptops, and smartphones -- to automatically recognize when users are working or taking breaks. We collect a data set of of continuous streams of sensor data captured from personal devices along with labels indicating whether a user is working or taking a break. We use multiple instruments to facilitate the collection of users' self-reported labels and discuss our experience with this approach. We analyse the available data -- 449 labelled activities of nine knowledge workers collected during a typical work week -- using machine learning techniques and show that user-independent models can achieve a (F1 score) of 94% for the identification of work activities and of 69% for breaks, outperforming baseline methods by 5-10 and 12-54 percentage points, respectively.

Authors with CRIS profile

Maike Debus Juniorprofessur für Wirtschaftspsychologie

Involved external institutions

Università della Svizzera italiana (USI) CH Switzerland (CH) Deloitte Deutschland DE Germany (DE) ABB / Asea Brown Boveri Ltd CH Switzerland (CH)

How to cite

APA:

Di Lascio, E., Gashi, S., Hidalgo, J.S., Nale, B., Debus, M., & Santini, S. (2020). A multi-sensor approach to automatically recognize breaks and work activities of knowledge workers in academia. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4. https://dx.doi.org/10.1145/3411821

MLA:

Di Lascio, Elena, et al. "A multi-sensor approach to automatically recognize breaks and work activities of knowledge workers in academia." Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (2020).

BibTeX: Download