Schneider L, Kharlamova M (2025)
Publication Language: English
Publication Type: Conference contribution, Conference Contribution
Publication year: 2025
Conference Proceedings Title: International Conference on Information Systems (ICIS)
Event location: Nashville
Generative AI offers unprecedented opportunities for offloading cognitive tasks, potentially enhancing human performance and productivity. However, realizing these benefits depends significantly on users’ ability to assess when to rely on generative AI. Over-reliance on generative AI can lead to immediate performance declines and may even contribute to long-term cognitive deskilling. To make accurate evaluations, individuals must monitor their own thought processes, known as metacognition, while simultaneously evaluating AI’s outputs and processes. Given these increased metacognitive demands, we investigate how the design of generative AI interfaces can be modified to enhance human metacognition and prevent overreliance on technology. In a pilot study, we examine how increasing the visual salience of ChatGPT’s disclaimer for potential errors affects users’ metacognition. Results show that heightened salience leads to longer response times and more self-regulatory actions, suggesting improved metacognitive monitoring and control. This study contributes to informing the responsible design and use of AI systems.
APA:
Schneider, L., & Kharlamova, M. (2025). Mind Over Machine: Navigating Human Metacognition When Using Generative AI. In International Conference on Information Systems (ICIS). Nashville.
MLA:
Schneider, Laura, and Maria Kharlamova. "Mind Over Machine: Navigating Human Metacognition When Using Generative AI." Proceedings of the International Conference on Information Systems (ICIS), Nashville 2025.
BibTeX: Download