Beyond single paradigms, pipelines, and outcomes: Embracing multiverse analyses in psychophysiology.

Publisher: Elsevier Country of Publication: Netherlands NLM ID: 8406214 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1872-7697 (Electronic) Linking ISSN: 01678760 NLM ISO Abbreviation: Int J Psychophysiol Subsets: MEDLINE

Original Publication: Amsterdam ; New York : Elsevier, [c1983-

Psychophysiology*/methods ; Evoked Potentials*/physiology; Humans ; Brain ; Research Design

Psychophysiological research is an inherently complex undertaking due to the nature of the data, and its analysis is characterized by many decision points that shape the final dataset and a study's findings. These decisions create a "multiverse" of possible outcomes, and each decision from study conceptualization to statistical analysis can lead to different results and interpretations. This review describes the concept of multiverse analyses, a methodological approach designed to understand the impact of different decisions on the robustness of a study's findings and interpretation. The emphasis is on transparently showcasing different reasonable approaches for constructing a final dataset and on highlighting the influence of various decision points, from experimental design to data processing and outcome selection. For example, the choice of an experimental task can significantly impact event-related brain potential (ERP) scores or skin conductance responses (SCRs), and different tasks might elicit unique variances in each measure. This review underscores the importance of transparently embracing the flexibility inherent in psychophysiological research and the potential consequences of not understanding the fragility or robustness of experimental findings. By navigating the intricate terrain of the psychophysiological multiverse, this review serves as an introduction, helping researchers to make informed decisions, improve the collective understanding of psychophysiological findings, and push the boundaries of the field.
(Copyright © 2024 The Author. Published by Elsevier B.V. All rights reserved.)

Keywords: Analytic flexibility; Event-related potentials (ERPs); Experimental design; Garden of forking paths; Open science; Skin conductance responses (SCRs)

Date Created: 20240131 Date Completed: 20240220 Latest Revision: 20240220

20240220

10.1016/j.ijpsycho.2024.112311

38296000