Consensus measurement in Delphi studies: Review and implications for future quality assurance

von der Gracht H (2012)


Publication Type: Journal article, Original article

Subtype: other

Publication year: 2012

Journal

Book Volume: 79

Pages Range: 1525-1536

Journal Issue: 8

URI: http://www.sciencedirect.com/science/article/pii/S0040162512001023

DOI: 10.1016/j.techfore.2012.04.013

Abstract

Consensus measurement plays an important role in Delphi research. Although it is not the technique's aim, the measurement has to be considered an important component of Delphi analyses and data interpretation. During the past 60years, the Delphi multi-round survey procedure has been widely and successfully used to aggregate expert opinions on future developments and incidents. This paper is dedicated to how consensus (and dissent) has been measured since the technique's emergence in the 1960s and which criteria have been used. The review also includes a description of its relationship with the measurement of stability over Delphi rounds, although the major focus lies on the concept of consensus. In an extensive literature review, 15 types of measure were identified and classified for measuring consensus (and/or stability) in detail. The research reveals that there are obvious deficits in the practice and rigour of consensus measurement for Delphi research: mistakes in statistical tests or their premises have even been made. This article gives a broad understanding of the consensus concept, shows strengths and weaknesses as well as premises of different types of measure and concludes with lessons learned. Its major contribution is therefore on improving the future quality of consensus-oriented Delphi studies.

Authors with CRIS profile

How to cite

APA:

von der Gracht, H. (2012). Consensus measurement in Delphi studies: Review and implications for future quality assurance. Technological Forecasting and Social Change, 79(8), 1525-1536. https://dx.doi.org/10.1016/j.techfore.2012.04.013

MLA:

von der Gracht, Heiko. "Consensus measurement in Delphi studies: Review and implications for future quality assurance." Technological Forecasting and Social Change 79.8 (2012): 1525-1536.

BibTeX: Download