Home Publications Research Grants Inventions & Patents Awards Additional Research Activities Faculties & Institutions Research Areas

Process Data Properties Matter: Introducing Gated Convolutional Neural Networks (GCNN) and Key-Value-Predict Attention Networks (KVP) for Next Event Prediction with Deep Learning

Heinrich K, Zschech P, Janiesch C, Bonin M (2021)

---

Publication Language: English

Publication Type: Journal article

Publication year: 2021

Journal

Pages Range: 113494

Article Number: 113494

URI: https://www.sciencedirect.com/science/article/pii/S016792362100004X?via=ihub

DOI: 10.1016/j.dss.2021.113494

Open Access Link: https://doi.org/10.1016/j.dss.2021.113494

Abstract

Predicting next events in predictive process monitoring enables companies to manage and control processes at an early stage and reduce their action distance. In recent years, approaches have steadily moved from classical statistical methods towards the application of deep neural network architectures, which outperform the former and enable analysis without explicit knowledge of the underlying process model. While the focus of prior research was on the long short-term memory network architecture, more deep learning architectures offer promising extensions that have proven useful for other applications of sequential data. In our work, we introduce a gated convolutional neural network and a key-value-predict attention network to the task of next event prediction. In a comprehensive evaluation study on 11 real-life benchmark datasets, we show that these two novel architectures surpass prior work in 34 out of 44 metric-dataset combinations. For our evaluation, we consider the effects of process data properties, such as sparsity, variation, and repetitiveness, and discuss their impact on the prediction quality of the different deep learning architectures. Similarly, we evaluate their classification properties in terms of generalization and handling class imbalance. Our results provide guidance for researchers and practitioners alike on how to select, validate, and comprehensively benchmark (novel) predictive process monitoring models. In particular, we highlight the importance of sufficiently diverse process data properties in event logs and the comprehensive reporting of multiple performance indicators to achieve meaningful results.

Authors with CRIS profile

Additional Organisation(s)

Involved external institutions

How to cite

APA:

Heinrich, K., Zschech, P., Janiesch, C., & Bonin, M. (2021). Process Data Properties Matter: Introducing Gated Convolutional Neural Networks (GCNN) and Key-Value-Predict Attention Networks (KVP) for Next Event Prediction with Deep Learning. Decision Support Systems, 113494. https://dx.doi.org/10.1016/j.dss.2021.113494

MLA:

Heinrich, Kai, et al. "Process Data Properties Matter: Introducing Gated Convolutional Neural Networks (GCNN) and Key-Value-Predict Attention Networks (KVP) for Next Event Prediction with Deep Learning." Decision Support Systems (2021): 113494.

BibTeX: Download