#EEGManyLabs: Investigating the replicability of influential EEG experiments

Pavlov YG, Adamian N, Appelhoff S, Arvaneh M, Benwell CS, Beste C, Bland AR, Bradford DE, Bublatzky F, Busch NA, Clayson PE, Cruse D, Czeszumski A, Dreber A, Dumas G, Ehinger B, Ganis G, He X, Hinojosa JA, Huber-Huber C, Inzlicht M, Jack BN, Johannesson M, Jones R, Kalenkovich E, Kaltwasser L, Karimi-Rouzbahani H, Keil A, König P, Kouara L, Kulke L, Ladouceur CD, Langer N, Liesefeld HR, Luque D, MacNamara A, Mudrik L, Muthuraman M, Neal LB, Nilsonne G, Niso G, Ocklenburg S, Oostenveld R, Pernet CR, Pourtois G, Ruzzoli M, Sass SM, Schaefer A, Senderecka M, Snyder JS, Tamnes CK, Tognoli E, van Vugt MK, Verona E, Vloeberghs R, Welke D, Wessel JR, Zakharov I, Mushtaq F (2021)

Publication Type: Journal article

Publication year: 2021

Journal

DOI: 10.1016/j.cortex.2021.03.013

Abstract

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Authors with CRIS profile

Involved external institutions

The University of Texas of the Permian Basin (UTPB) United States (USA) (US) Tel Aviv University Israel (IL) Texas A&M University United States (USA) (US) Universität Bremen Germany (DE) Johannes Gutenberg-Universität Mainz (JGU) Germany (DE) Ruhr-Universität Bochum (RUB) Germany (DE) Karolinska Institute Sweden (SE) Universidad Autónoma de Madrid (UAM) Spain (ES) Radboud University Nijmegen Netherlands (NL) University of Edinburgh United Kingdom (GB) Indiana University United States (USA) (US) Katholieke Universiteit Leuven (KUL) / Catholic University of Leuven Belgium (BE) Jagiellonian University / Uniwersytet Jagielloński (UJ) Poland (PL) University of Leeds United Kingdom (GB) University of Iowa Hospitals and Clinics (UIHC) United States (USA) (US) University of South Florida (USF) United States (USA) (US) Russian Academy of Education (RAE) / России академия образования Russian Federation (RU) University of Glasgow United Kingdom (GB) University of Nevada, Reno United States (USA) (US) Monash University Malaysia Malaysia (MY) Florida Atlantic University United States (USA) (US) The University of Texas at Tyler (UTT) United States (USA) (US) Universiteit Gent (UGent) / Ghent University Belgium (BE) University of Groningen / Rijksuniversiteit Groningen Netherlands (NL) University of Oslo Norway (NO) Max-Planck-Institut für Empirische Ästhetik / Max Planck Institute for Empirical Aesthetics (MPIEA) Germany (DE) University of Aberdeen United Kingdom (GB) University of Sheffield United Kingdom (GB) National Research University - Higher School of Economics (HSE) / Высшая школа экономики Russian Federation (RU) Max-Planck-Institut für Bildungsforschung (MPIB) / Max Planck Institute for Human Development Germany (DE) University of Miami United States (USA) (US) Universität Stuttgart Germany (DE) University of Birmingham United Kingdom (GB) University of Zurich / Universität Zürich (UZH) Switzerland (CH) Stockholm School of Economics (SSE) / Handelshögskolan i Stockholm (HHS) Sweden (SE) Australian National University (ANU) Australia (AU) Universität Osnabrück Germany (DE) Manchester Metropolitan University (MMU) United Kingdom (GB) University of Winchester United Kingdom (GB) Eberhard Karls Universität Tübingen Germany (DE) Ruprecht-Karls-Universität Heidelberg Germany (DE) University of Cambridge United Kingdom (GB) University of Plymouth United Kingdom (GB) University of Pittsburgh United States (USA) (US) Bournemouth University United Kingdom (GB) Universidad Complutense de Madrid (UCM) Spain (ES) Université de Montréal Canada (CA) University of Florida United States (USA) (US) Westfälische Wilhelms-Universität (WWU) Münster Germany (DE) University of Dundee United Kingdom (GB) Humboldt-Universität zu Berlin Germany (DE) University of Toronto Canada (CA) Technische Universität Dresden Germany (DE)

How to cite

APA:

Pavlov, Y.G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C.S., Beste, C.,... Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex. https://doi.org/10.1016/j.cortex.2021.03.013

MLA:

Pavlov, Yuri G., et al. "#EEGManyLabs: Investigating the replicability of influential EEG experiments." Cortex (2021).

BibTeX: Download