Shopfloor Terminology for Retrieval-Augmented Generation (RAG): Aligning Operator Language with Engineering Knowledge

Streloke L, Rank Y, Bodendorf F, Franke J, Bründl P (2025)

Publication Type: Book chapter / Article in edited volumes

Publication year: 2025

Publisher: AHFE International

Edited Volumes: Human Factors in Design, Engineering, and Computing

Book Volume: 199

Abstract

As industrial work becomes increasingly digitalized, integrating human expertise into intelligent systems is essential for reliability and adaptability. This study investigates how curated terminology can improve Large Language Model-based Retrieval-Augmented Generation (RAG) systems for industrial knowledge management. It addresses a key linguistic issue that operators often use colloquial or locally coined terms that differ from standardized terminology found in technical documentation. This can lead to retrieval failures and inconsistent responses.A domain-specific dataset comprising 35 operator questions derived from a wire harness manufacturing manual is used to compare two types of RAG queries: natural-language operator queries and terminology-enhanced queries expanded with curated synonyms. Human evaluators assessed the correctness of generated answers. Terminology-enhanced queries achieved on average 67% correct answers compared to only 11% for nonterminology-enhanced ones.These results demonstrate the importance of terminology alignment for the reliable and effective use of LLMs in industrial contexts. Curated terminology bridges the gap between operator language and formal documentation, supporting tacit knowledge externalizationand improving retrieval reliability. This preliminary study highlights the feasibility and practical relevance of integrating terminology into RAG pipelines and outlines future directions towards adaptive, human-centered knowledge systems in manufacturing.

Authors with CRIS profile

Ludwig Streloke Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Yannick Rank Lehrstuhl für Wirtschaftsinformatik, insbesondere im Dienstleistungsbereich Freimut Bodendorf Department of Data Science Jörg Franke Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Patrick Bründl Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS)

How to cite

APA:

Streloke, L., Rank, Y., Bodendorf, F., Franke, J., & Bründl, P. (2025). Shopfloor Terminology for Retrieval-Augmented Generation (RAG): Aligning Operator Language with Engineering Knowledge. In Human Factors in Design, Engineering, and Computing. AHFE International.

MLA:

Streloke, Ludwig, et al. "Shopfloor Terminology for Retrieval-Augmented Generation (RAG): Aligning Operator Language with Engineering Knowledge." Human Factors in Design, Engineering, and Computing. AHFE International, 2025.

BibTeX: Download