A Solution for Automated Grading of QDA Homework

Kaufmann A, Riehle D, Krause J, Harutyunyan N (2023)


Publication Type: Conference contribution, Conference Contribution

Publication year: 2023

Series: Proceedings of the 56th Hawaii International Conference on System Sciences

Pages Range: 44-54

Conference Proceedings Title: HICSS Proceedings

Event location: Lahaina US

ISBN: 978-0-9981331-6-4

URI: https://hdl.handle.net/10125/102635

Abstract

Teaching research methods is important in any curriculum that prepares students for an academic career. While theoretical frameworks for qualitative theory building can be adequately conveyed through lecturing, the practices of qualitative data analysis (QDA) cannot. However, using experiential learning techniques for teaching QDA methods to large numbers of students presents a challenge to the instructor due to the effort required for the grading of homework. Any homework involving the coding of qualitative data will result in a myriad of different interpretations of the same data with varying quality. Grading such assignments requires significant effort. We approached this problem by using methods of inter-rater agreement and a model solution as a proxy for the quality of the submission. The automated agreement data serves as the foundation for a semi-automated grading process. Within this paper, we demonstrate that this proxy has a high correlation with the manual grading of submissions.

Authors with CRIS profile

How to cite

APA:

Kaufmann, A., Riehle, D., Krause, J., & Harutyunyan, N. (2023). A Solution for Automated Grading of QDA Homework. In HICSS Proceedings (pp. 44-54). Lahaina, US.

MLA:

Kaufmann, Andreas, et al. "A Solution for Automated Grading of QDA Homework." Proceedings of the 56th Hawaii International Conference on System Sciences, Lahaina 2023. 44-54.

BibTeX: Download