Uncertain yet Rational - Uncertainty as an Evaluation Measure of Rational Privacy Decision-Making in Conversational AI

Leschanowsky A, Popp B, Peters N (2023)


Publication Type: Conference contribution

Publication year: 2023

Journal

Original Authors: Anna Leschanowsky, Birgit Popp, Nils Peters

Pages Range: 203-220

Event location: Copenhagen DK

ISBN: 9783031359200

DOI: 10.1007/978-3-031-35921-7_14

Abstract

In today’s connected world, privacy decision-making is crucial for people to maintain control over their personal information and effectively manage their privacy. However, people’s decisions on privacy are likely to be subject to bias and can lead to frustration and regret. Privacy strategies in Conversational AI can aim at debiasing peoples’ choices by drawing from dual-process theory and triggering a more rational thinking process. Previous research on evaluation measures for such strategies has focused on minimizing regret or aligning user behaviour with their attitudes. In this paper, we propose a subjective measure of uncertainty to evaluate the effectiveness of debiasing strategies in a Conversational AI privacy scenario. We investigate two different scales of uncertainty - an adapted privacy uncertainty scale consisting of four subscales and the PANAS-X scale on the affective state of fear. We find that only one of the adapted subscales and the scale on fear showed sufficient reliability and validity results. Moreover, we did not find differences in uncertainty between our tested strategies. Finally, we propose alternative measures to investigate uncertainty and evaluate privacy strategies that promote rational thinking in the future.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Leschanowsky, A., Popp, B., & Peters, N. (2023). Uncertain yet Rational - Uncertainty as an Evaluation Measure of Rational Privacy Decision-Making in Conversational AI. In Proceedings of the HCII 2023: Design, Operation and Evaluation of Mobile Communications (pp. 203-220). Copenhagen, DK.

MLA:

Leschanowsky, Anna, Birgit Popp, and Nils Peters. "Uncertain yet Rational - Uncertainty as an Evaluation Measure of Rational Privacy Decision-Making in Conversational AI." Proceedings of the HCII 2023: Design, Operation and Evaluation of Mobile Communications, Copenhagen 2023. 203-220.

BibTeX: Download