- Tytuł:
- Many Labs 2 : investigating variation in replicability across samples and settings
- Autorzy:
-
Kamiloglu, Roza G.
Bocian, Konrad
Davis, William
Krueger, Lacy E.
Lakens, Daniël
Coen, Sharon
Murphy, Sean C.
Frankowska, Natalia
Pogge, Gabrielle
Kneževic, Goran
Theriault, Jordan
Vaughn, Leigh Ann
Gomez, Angel
Nelson, Anthony J.
Mallett, Robyn K.
van ’t Veer, Anna Elisabeth
Ocampo, Aaron
Szeto, Stephanie
John, Melissa-Sue
Tear, Morgan J.
Cicero, David
Haines, Elizabeth
van der Hulst, Marije
Lazarevic, Ljiljana B
Galliani, Elisa
Conway, Morgan
Chen, Eva
Spachtholz, Philipp
Smith, Michael A.
Berry, Daniel, R
Finck, Carolyn
Aveyard, Mark
Torres, David
Packard, Grant
Grahek, Ivan
Ghoshal, Tanuka
Babalola, Mayowa
Lewis, Jr., Neil A.
Vázquez, Alexandra
Bahník, Štěpán
Vásquez- Echeverría, Alejandro
Maassen, Esther
Innes-Ker, Ase
Haigh, Matthew
Schönbrodt, Felix D.
Doğulu, Canay
Collisson, Brian
Cemalcilar, Zeynep
Vranka, Marek A.
Neto, Félix
Devos, Thierry
de Bruijn, Maike
Huntsinger, Jeffrey
Skorinko, Jeanine L. M.
Malingumu, Winfrida
Chandler, Jesse
Curran, Paul
Stouten, Jeroen
Huynh, Ho
Maitner, Angela T.
Carmichael, Cheryl
Kovac, Carrie
Cambier, Fanny
Sobkow, Agata
Tang, Andrew C. W.
Alper, Sinan
Eller, Anija
Williams, Lisa A.
Cushman, Fiery
Bernstein, Michael
Easterbrook, Matthew
Morris, Wendy L
Bialobrzeska, Olga
Joy-Gaba, Jennifer A.
Brandt, Mark
Cantarero, Katarzyna
Oikawa, Haruka
Rutchick, Abraham M.
Saavedra, Patricio
Cheong, Winne
Losee, Joy E.
Axt, Jordan
Marotta, Satia A.
Vega, Luis Diego
Grahe, Jon
Kurtz, Jamie
Berkics, Mihaly
Dunham, Yarow
Giessner, Steffen
Welch, Cheryl
Tanzer, Norbert
Pilati, Ronaldo
Smolders, Karin C. H. J.
Nosek, Brian A.
Smith-Castro, Vanessa
Pérez-Sánchez, Rolando
Lins, Samuel
Podesta, Lysandra
Ebersole, Charles
van Lange, Paul A. M.
Klein, Richard A.
Medjedovic, Janko
van Assen, Marcel A. L. M.
Szumowska, Ewa
Hall, Michael
Karick, Haruna
Neave, Nick
Adams, Byron
Karabati, Serdar
Oikawa, Masanori
Ong, Elsie
Cai, Huajian
Kende, Anna
Petrovic, Boban
Gonzalez, Roberto
Pollmann, Monique M. H.
Saeri, Alexander K.
Kurapov, German
Sowden, Walter
Chang, Jen-Ho
Zelenski, John M.
de Vries, Marieke
Friedman, Mike
Osowiecka, Malgorzata
Hai, Kakul
Hicks, Josua
Coleman, Jennifer
Dozo, Nerisa
Nichols, Austin Lee
Freyre, Miguel-Angel
Ujhelyi, Adrienn
Vianello, Michelangelo
Gnambs, Timo
Heffernan, Marie
Sekerdej, Maciej
Gill, Tripat
Verschoor, Mark
Wichman, Aaron L.
Inbar, Yoel
Busching, Robert
Keller, Victor N.
Wronska, Marta K.
Steiner, Troy G.
Salomon, Erika
Sirlopú, David
Levitan, Carmel A.
Edlund, John
Dukes, Kristin
Young, Liane
Mena-Pacheco, Fernando
Verniers, Catherine
Durrheim, Kevin
van Aert, Robbie C. M.
Neijenhuijs, Koen
Srivastava, Manini
Wood, Michael
Tybur, Joshua M.
Chatard, Armand
Kappes, Heather Barry
Corker, Katherine
Traczyk, Jakub
Lipsey, Nikolette P.
Green, Eva
O’Donnell, Susan L.
Voermans, Ingrid P. J.
IJzerman, HansInbar
Adams, Jr., Reginald B
Thomae, Manuela
Houdek, Petr
Dalgar, Ilker
Pinter, Brad
Schmidt, Kathleen
Graham, Jesse
Myachykov, Andriy
Jimenez-Leal, William
Kervyn, Nicolas
Street, Chris N. H.
Woodzicka, Julie A
Orosz, Gábor
Sundfelt, Oskar K.
Hasselman, Fred
English, Alexander
Zhijia, Zeng
Milfont, Taciano L. - Opis:
- We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was administered to approximately half of 125 samples that comprised 15,305 participants from 36 countries and territories. Using the conventional criterion of statistical significance (p < .05), we found that 15 (54%) of the replications provided evidence of a statistically significant effect in the same direction as the original finding. With a strict significance criterion (p < .0001), 14 (50%) of the replications still provided such evidence, a reflection of the extremely highpowered design. Seven (25%) of the replications yielded effect sizes larger than the original ones, and 21 (75%) yielded effect sizes smaller than the original ones. The median comparable Cohen’s ds were 0.60 for the original findings and 0.15 for the replications. The effect sizes were small (< 0.20) in 16 of the replications (57%), and 9 effects (32%) were in the direction opposite the direction of the original effect. Across settings, the Q statistic indicated significant heterogeneity in 11 (39%) of the replication effects, and most of those were among the findings with the largest overall effect sizes; only 1 effect that was near zero in the aggregate showed significant heterogeneity according to this measure. Only 1 effect had a tau value greater than .20, an indication of moderate heterogeneity. Eight others had tau values near or slightly above .10, an indication of slight heterogeneity. Moderation tests indicated that very little heterogeneity was attributable to the order in which the tasks were performed or whether the tasks were administered in lab versus online. Exploratory comparisons revealed little heterogeneity between Western, educated, industrialized, rich, and democratic (WEIRD) cultures and less WEIRD cultures (i.e., cultures with relatively high and low WEIRDness scores, respectively). Cumulatively, variability in the observed effect sizes was attributable more to the effect being studied than to the sample or setting in which it was studied.
- Dostawca treści:
- Repozytorium Uniwersytetu Jagiellońskiego
Artykuł