A Reference Architecture for Deploying Large Language Model Applications in Industrial Environments

Mahr F, Angeli G, Sindel T, Schmidt K, Franke J (2024)

Publication Type: Conference contribution

Publication year: 2024

Publisher: IEEE

Pages Range: 19-23

Conference Proceedings Title: 2024 IEEE 30th International Symposium for Design and Technology in Electronic Packaging (SIITME)

Event location: Sibiu RO

DOI: 10.1109/SIITME63973.2024.10814877

Abstract

Integrating Large Language Models (LLMs) into industrial environments presents numerous challenges. Firstly, understanding the term LLM, its required components for implementation, and the various types of LLMs demands research effort. Furthermore, the processing of textual data involves enormous data volumes, and executing large language models requires substantial computational power. A significant challenge in model deployment on the shopfloor is the stringent data security measures, which often prohibit direct internet access to the cloud.To address these challenges, a reference architecture was developed to give an overview of the components for integrating LLM applications in industry. This architecture covers all essential steps of LLM applications, including data preparation, model training, model evaluation, model deployment, and prompt engineering. For model deployment, two possible locations were distinguished: the digital workplace, such as the office, and the shopfloor. In addition to model deployment, data preparation and model evaluation are emphasized as critical elements for the success of Large Language Model Operations (LLMOps) applications.This reference architecture enables project teams to better understand the elements involved in the LLM integration process. Furthermore, the universal approach helps in standardizing the associated processes, facilitating a more effective acceptance of LLMs in industrial environments.

Authors with CRIS profile

Felix Mahr Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Till Sindel Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Konstantin Schmidt Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS) Jörg Franke Lehrstuhl für Fertigungsautomatisierung und Produktionssystematik (FAPS)

Involved external institutions

Siemens AG DE Germany (DE)

How to cite

APA:

Mahr, F., Angeli, G., Sindel, T., Schmidt, K., & Franke, J. (2024). A Reference Architecture for Deploying Large Language Model Applications in Industrial Environments. In 2024 IEEE 30th International Symposium for Design and Technology in Electronic Packaging (SIITME) (pp. 19-23). Sibiu, RO: IEEE.

MLA:

Mahr, Felix, et al. "A Reference Architecture for Deploying Large Language Model Applications in Industrial Environments." Proceedings of the 2024 IEEE 30th International Symposium for Design and Technology in Electronic Packaging (SIITME), Sibiu IEEE, 2024. 19-23.

BibTeX: Download