A Systematic Analysis of Problems in Open Collaborative Data Engineering

Heltweg P, Riehle D (2023)

Publication Language: English

Publication Type: Journal article

Publication year: 2023


Book Volume: 6

Pages Range: 1-30

Issue: 3-4

Journal Issue: 3-4

DOI: 10.1145/3629040


Collaborative workflows are common in open-source software development. They reduce individual costs and improve the quality of work results. Open data shares many characteristics with open-source software, as it can be used, modified, and redistributed by anyone, for free. However, in contrast to open-source software engineering, collaborative data engineering on open data lacks a shared understanding of processes, methods, and tools.

This article presents a systematic literature review of collaboration processes, methods, and tools in data engineering as performed by open data users. An additional interview study with practitioners confirms and enhances the findings and strengthens the resulting insights.

We find an ecosystem with heterogeneous participants and no standardized processes, methods, and tools. Participants face a variety of technical and social challenges during their work. Our work provides a structured overview of collaboration systems in open collaborative data engineering, enabling further research. Additionally, we contribute preliminary guidelines for successful open collaborative data engineering projects and recommendations to increase its adoption for open data ecosystems.

Authors with CRIS profile

How to cite


Heltweg, P., & Riehle, D. (2023). A Systematic Analysis of Problems in Open Collaborative Data Engineering. ACM Transactions on Social Computing, 6(3-4), 1-30. https://doi.org/10.1145/3629040


Heltweg, Philip, and Dirk Riehle. "A Systematic Analysis of Problems in Open Collaborative Data Engineering." ACM Transactions on Social Computing 6.3-4 (2023): 1-30.

BibTeX: Download