A data multiverse analysis investigating non-model based SCR quantification approaches.

Publisher: Blackwell Country of Publication: United States NLM ID: 0142657 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1540-5958 (Electronic) Linking ISSN: 00485772 NLM ISO Abbreviation: Psychophysiology Subsets: MEDLINE

Publication: Malden, MA : Blackwell
Original Publication: Baltimore, Williams & Wilkins.

Conditioning, Classical*/physiology ; Galvanic Skin Response*; Humans ; Fear/physiology ; Arousal ; Extinction, Psychological/physiology

Electrodermal signals are commonly used outcome measures in research on arousal, emotion, and habituation. Recently, we reported on heterogeneity in skin conductance response quantification approaches and its impact on replicability. Here we provide complementary work focusing on within-approach heterogeneity of specifications for skin conductance response quantification. We focus on heterogeneity within the baseline-correction approach (BLC) which appeared as particularly heterogeneous-for instance with respect to the pre-CS baseline window duration, the start, and end of the peak detection window. We systematically scrutinize the robustness of results when applying different BLC approach specifications to one representative pre-existing data set (N = 118) in a (partly) pre-registered study. We report high agreement between different BLC approaches for US and CS+ trials, but moderate to poor agreement for CS- trials. Furthermore, a specification curve of the main effect of CS discrimination during fear acquisition training from all potential and reasonable combinations of specifications (N = 150) and a prototypical trough-to-peak (TTP) approach indicates that resulting effect sizes are largely comparable. A second specification curve (N = 605 specific combinations) highlights a strong impact of different transformation types. Crucially, however, we show that BLC approaches often misclassify the peak value-particularly for CS- trials, leading to stimulus-specific biases and challenges for post-processing and replicability of CS discrimination across studies applying different approaches. Lastly, we investigate how negative skin conductance values in BLC, appearing most frequently for CS- (CS- > CS+ > US), correspond to values in TTP quantification. We discuss the results considering prospects and challenges of the multiverse approach and future directions.
(© 2022 The Authors. Psychophysiology published by Wiley Periodicals LLC on behalf of Society for Psychophysiological Research.)

Ahmed, O., & Lovibond, P. F. (2019). Rule-based processes in generalisation and peak shift in human fear conditioning. Quarterly Journal of Experimental Psychology, 72(2), 118-131. https://doi.org/10.1177/1747021818766461.
Alday, P. M. (2019). How much baseline correction do we need in ERP research? Extended GLM model can replace baseline correction while lifting its limits. Psychophysiology, 56(12), e13451. https://doi.org/10.1111/psyp.13451.
Alexander, D. M., Trengove, C., Johnston, P., Cooper, T., August, J. P., & Gordon, E. (2005). Separating individual skin conductance responses in a short interstimulus-interval paradigm. Journal of Neuroscience Methods, 146(1), 116-123. https://doi.org/10.1016/j.jneumeth.2005.02.001.
Bach, D. R., Castegnetti, G., Korn, C. W., Gerster, S., Melinscak, F., & Moser, T. (2018). Psychophysiological modeling: Current state and future directions. Psychophysiology, 55(11), e13214. https://doi.org/10.1111/psyp.13209.
Bach, D. R., Melinščak, F., Fleming, S. M., & Voelkle, M. C. (2020). Calibrating the experimental measurement of psychological attributes. Nature Human Behaviour, 4(12), 1229-1235. https://doi.org/10.1038/s41562-020-00976-8.
Benedek, M., & Kaernbach, C. (2010). A continuous measure of phasic electrodermal activity. Journal of Neuroscience Methods, 190(1), 80-91. https://doi.org/10.1016/j.jneumeth.2010.04.028.
Boucsein, W. (2012). Electrodermal activity (2nd ed.). Springer.
Boucsein, W., Fowles, D. C., Grimnes, S., Ben-Shakhar, G., Roth, W. T., Dawson, M. E., & Filion, D. L. (2012). Publication recommendations for electrodermal measurements. Psychophysiology, 49(8), 1017-1034. https://doi.org/10.1111/j.1469-8986.2012.01384.x.
Braithwaite, J. J., Watson, D. G., Jones, R., & Rowe, M. (2013). A guide for Analysing electrodermal activity (EDA) & Skin Conductance Responses (SCRs) for Psychological Experiments. Psychophysiology, 42, 1-43.
Brunson, J. C. (2020). Ggalluvial: Layered grammar for alluvial plots. Journal of Open Source Software, 5(49), 2017. https://doi.org/10.21105/joss.02017.
Dawson, M. E., Schell, A. M., Filion, D. L., & Berntson, G. G. (2007). The electrodermal system. In J. T. Cacioppo, L. G. Tassinary, & G. Berntson (Eds.), Handbook of psychophysiology (3rd ed., pp. 157-181). Cambridge University Press. https://doi.org/10.1017/CBO9780511546396.007.
Del Giudice, M., & Gangestad, S. W. (2021). A Traveler's guide to the multiverse: Promises, pitfalls, and a framework for the evaluation of analytic decisions. Advances in Methods and Practices in Psychological Science, 4(1), 251524592095492. https://doi.org/10.1177/2515245920954925.
Fredrikson, M., Annas, P., Georgiades, A., Hursti, T., & Tersman, Z. (1993). Internal consistency and temporal stability of classically conditioned skin conductance responses. Biological Psychology, 35(2), 153-163. https://doi.org/10.1016/0301-0511(93)90011-V.
Geller, D. A., McGuire, J. F., Orr, S. P., Small, B. J., Murphy, T. K., Trainor, K., Porth, R., Wilhelm, S., & Storch, E. A. (2019). Fear extinction learning as a predictor of response to cognitive behavioral therapy for pediatric obsessive compulsive disorder. Journal of Anxiety Disorders, 64, 1-8. https://doi.org/10.1016/j.janxdis.2019.02.005.
Gollwitzer, M. (2020). DFG priority program SPP 2317 proposal: A META-scientific program to analyze and optimize replicability in the behavioral, social, and cognitive sciences (META-REP). https://doi.org/10.23668/PSYCHARCHIVES.3010.
Grings, W. W. (1974). Recording of electrodermal phenomena. In R. F. Thompson, & M. M. Patterson (Eds.), Methods in physiological psychology: Vol. 1. Bioelectric recording techniques, Part C: Receptor and effector processes (pp. 273-296). Academic Press.
Gruss, L. F., & Keil, A. (2019). Sympathetic responding to unconditioned stimuli predicts subsequent threat expectancy, orienting, and visuocortical bias in human aversive Pavlovian conditioning. Biological Psychology, 140, 64-74. https://doi.org/10.1016/j.biopsycho.2018.11.009.
Krippendorff, K. (2004). Reliability in content analysis.: Some common misconceptions and recommendations. Human Communication Research, 30(3), 411-433. https://doi.org/10.1111/j.1468-2958.2004.tb00738.x.
Kuhn, M., Gerlicher, A. M. V., & Lonsdorf, T. B. (2022). Navigating the manyverse of skin conductance response quantification approaches - A direct comparison of trough-to-peak, baseline correction, and model-based approaches in Ledalab and PsPM. Psychophysiology, e14058. https://doi.org/10.1111/psyp.14058.
Kurayama, T., Matsuzawa, D., Hirano, Y., & Shimizu, E. (2019). Insensitivity of auditory mismatch negativity to classical fear conditioning and extinction in healthy humans. NeuroReport, 5, 468-472. https://doi.org/10.1097/WNR.0000000000001221.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159. https://doi.org/10.2307/2529310.
LeBel, E. P., McCarthy, R. J., Earp, B. D., Elson, M., & Vanpaemel, W. (2018). A unified framework to quantify the credibility of scientific findings. Advances in Methods and Practices in Psychological Science, 1(3), 389-402. https://doi.org/10.1177/2515245918787489.
LeBel, E. P., Vanpaemel, W., Cheung, I., & Campbell, L. (2019). A brief guide to evaluate replications. Meta-Psychology, 3, 1-9. https://doi.org/10.15626/MP.2018.843.
Lee, J. C., Hayes, B. K., & Lovibond, P. F. (2018). Peak shift and rules in human generalization. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(12), 1955-1970. https://doi.org/10.1037/xlm0000558.
Lee, J. C., Lovibond, P. F., Hayes, B. K., & Navarro, D. J. (2019). Negative evidence and inductive reasoning in generalization of associative learning. Journal of Experimental Psychology: General, 148(2), 289-303. https://doi.org/10.1037/xge0000496.
Levinson, D. F., & Edelberg, R. (1985). Scoring criteria for response latency and habituation in electrodermal research: A critique. Psychophysiology, 22(4), 417-426. https://doi.org/10.1111/j.1469-8986.1985.tb01626.x.
Lipp, O. V. (2006). Human fear learning: Contemporary procedures and measurement. In M. G. Craske & D. Hermans (Eds.), Fear and learning-From basic processes to clinical implications (p. S. 48). American Psychological Association.
Lonsdorf, T. B., Gerlicher, A., Klingelhofer-Jens, M., & Krypotos, A. M. (2022). Multiverse analyses in fear conditioning research. Behaviour Research and Therapy, 153, 104072. https://doi.org/10.1016/j.brat.2022.104072.
Lonsdorf, T. B., Klingelhöfer-Jens, M., Andreatta, M., Beckers, T., Chalkia, A., Gerlicher, A., Jentsch, V. L., Meir Drexler, S., Mertens, G., Richter, J., Sjouwerman, R., Wendt, J., & Merz, C. J. (2019). Navigating the garden of forking paths for data exclusions in fear conditioning research. eLife, 8, e52465. https://doi.org/10.7554/eLife.52465.
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., Meir Drexler, S., Meulders, A., Nees, F., Pittig, A., Richter, J., Römer, S., Shiban, Y., Schmitz, A., Straube, B., … Merz, C. J. (2017). Don't fear ‘fear conditioning’: Methodological considerations for the design and analysis of studies on human fear acquisition, extinction, and return of fear. Neuroscience & Biobehavioral Reviews, 77, 247-285. https://doi.org/10.1016/j.neubiorev.2017.02.026.
Lonsdorf, T. B., Merz, C. J., & Fullana, M. A. (2019). Fear extinction retention: Is it what we think it is? Biological Psychiatry, 85(12), 1074-1082. https://doi.org/10.1016/j.biopsych.2019.02.011.
Lykken, D. T. (1972). Range correction applied to heart rate and to GSR data. Psychophysiology, 9(3), 373-379. https://doi.org/10.1111/j.1469-8986.1972.tb03222.x.
Lykken, D. T., & Venables, P. H. (1971). Direct measurement of skin conductance: a proposal for standardization. Psychophysiology, 8(5), 656-672. https://doi.org/10.1111/j.1469-8986.1971.tb00501.x.
Marin, M., Barbey, F., Rosenbaum, B. L., Hammoud, M. Z., Orr, S. P., & Milad, M. R. (2020). Absence of conditioned responding in humans: A bad measure or individual differences? Psychophysiology, 57(1), 1-10. https://doi.org/10.1111/psyp.13350.
Mathôt, S., Fabius, J., Van Heusden, E., & Van der Stigchel, S. (2018). Safe and sensible preprocessing and baseline correction of pupil-size data. Behavior Research Methods, 50(1), 94-106. https://doi.org/10.3758/s13428-017-1007-2.
McGlade, A. L., Zbozinek, T. D., Treanor, M., & Craske, M. G. (2019). Pilot for novel context generalization paradigm. Journal of Behavior Therapy and Experimental Psychiatry, 62, 49-56. https://doi.org/10.1016/j.jbtep.2018.08.009.
Mertens, G., Leer, A., van Dis, E. A. M., Vermeer, L., Steenhuizen, A., van der Veen, L., & Engelhard, I. M. (2019). Secondary extinction reduces reinstatement of threat expectancy and conditioned skin conductance responses in human fear conditioning. Journal of Behavior Therapy and Experimental Psychiatry, 62, 103-111. https://doi.org/10.1016/j.jbtep.2018.09.007.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097.
Morey, R. D., & Rouder, J. N. (2018). BayesFactor: Computation of Bayes factors for common designs. https://CRAN.R-project.org/package=BayesFactor.
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600-2606. https://doi.org/10.1073/pnas.1708274114.
Öhman, A. (1972). Factor analytically derived components of orienting, defensive, and conditioned behavior in electrodermal conditioning. Psychophysiology, 9(2), 199-209. https://doi.org/10.1111/j.1469-8986.1972.tb00754.x.
Ooms, J. (2021). Magick: Advanced graphics and image-processing in R. https://CRAN.R-project.org/package=magick.
Patel, C. J., Burford, B., & Ioannidis, J. P. A. (2015). Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. Journal of Clinical Epidemiology, 68(9), 1046-1058. https://doi.org/10.1016/j.jclinepi.2015.05.029.
Pedersen, T. L. (2020). Patchwork: The composer of plots. https://CRAN.R-project.org/package=patchwork.
Pineles, S. L., Orr, M. R., & Orr, S. P. (2009). An alternative scoring method for skin conductance responding in a differential fear conditioning paradigm with a long-duration conditioned stimulus. Psychophysiology, 46(5), 984-995. https://doi.org/10.1111/j.1469-8986.2009.00852.x.
Privratsky, A. A., Bush, K. A., Bach, D. R., Hahn, E. M., & Cisler, J. M. (2020). Filtering and model-based analysis independently improve skin-conductance response measures in the fMRI environment: Validation in a sample of women with PTSD. International Journal of Psychophysiology, 158, 86-95. https://doi.org/10.1016/j.ijpsycho.2020.09.015.
Prokasy, W. F., & Ebel, H. C. (1967). Three components of the classically conditioned GSR in human subjects. Journal of Experimental Psychology, 73(2), 247-256. https://doi.org/10.1037/h0024108.
Prokasy, W. F., & Kupfer, K. L. (1973). Classical conditioning. In W. F. Prokasy & D. C. Raskin (Eds.), Electrodermal activity in psychological research (pp. 157-202). Academic Press.
Rattel, J. A., Wegerer, M., Miedl, S. F., Blechert, J., Grünberger, L. M., Craske, M. G., & Wilhelm, F. H. (2019). Peritraumatic unconditioned and conditioned responding explains sex differences in intrusions after analogue trauma. Behaviour Research and Therapy, 116, 19-29. https://doi.org/10.1016/j.brat.2019.01.009.
Scheveneels, S., Boddez, Y., De Ceulaer, T., & Hermans, D. (2019). Ruining the surprise: The effect of safety information before extinction on return of fear. Journal of Behavior Therapy and Experimental Psychiatry, 63, 73-78. https://doi.org/10.1016/j.jbtep.2018.11.001.
Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahník, Š., Bai, F., Bannard, C., Bonnier, E., Carlsson, R., Cheung, F., Christensen, G., Clay, R., Craig, M. A., Dalla Rosa, A., Dam, L., Evans, M. H., Flores Cervantes, I., … Nosek, B. A. (2018). Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), 337-356. https://doi.org/10.1177/2515245917747646.
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2020). Specification curve analysis. Nature human. Behaviour, 4(11), 1208-1214. https://doi.org/10.1038/s41562-020-0912-z.
Sjouwerman, R. (2022). Rsjouwerman/repl-ttp-blc: (version v2) [computer software]. Zenodo. https://doi.org/10.5281/ZENODO.5895098.
Sjouwerman, R., & Lonsdorf, T. B. (2019). Latency of skin conductance responses across stimulus modalities. Psychophysiology, 56(4), e13307. https://doi.org/10.1111/psyp.13307.
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing transparency through a multiverse analysis. Perspectives on Psychological Science, 11(5), 702-712. https://doi.org/10.1177/1745691616658637.
Stewart, M. A., Stern, J. A., Winokur, G., & Fredman, S. (1961). An analysis of GSR conditioning. Psychological Review, 68(1), 60-67. https://doi.org/10.1037/h0048816.
Venables, P. H., & Christie, M. J. (1980). Electrodermal activity. In I. Martin & P. H. Venables (Eds.), Thechniques in psychophysiology. Wiley.
Vogel, S., Klumpers, F., Kroes, M. C. W., Oplaat, K. T., Krugers, H. J., Oitzl, M. S., Joëls, M., & Fernández, G. (2015). A stress-induced shift from trace to delay conditioning depends on the mineralocorticoid receptor. Biological Psychiatry, 78(12), 830-839. https://doi.org/10.1016/j.biopsych.2015.02.014.
Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer-Verlag https://ggplot2.tidyverse.org.
Yoshiike, T., Honma, M., Yamada, N., Kim, Y., & Kuriyama, K. (2018). Effects of bright light exposure on human fear conditioning, extinction, and associated prefrontal activation. Physiology & Behavior, 194, 268-276. https://doi.org/10.1016/j.physbeh.2018.06.015.
Zapf, A., Castell, S., Morawietz, L., & Karch, A. (2016). Measuring inter-rater reliability for nominal data-Which coefficients and confidence intervals are appropriate? BMC Medical Research Methodology, 16(1), 93. https://doi.org/10.1186/s12874-016-0200-9.

Keywords: SCL; SCR; baseline correction; multiverse; specification curve; transformations; trough-to-peak

Date Created: 20220702 Date Completed: 20221110 Latest Revision: 20230324

20230324

10.1111/psyp.14130

35780077