Many Labs 2: Investigating Variation in Replicability Across Samples and Settings

Richard A. Klein, Michelangelo Vianello, Fred Hasselman, Byron G. Adams, Reginald B. Adams, Sinan Alper, Mark Aveyard, Jordan R. Axt, Mayowa T. Babalola, Štěpán Bahník, Rishtee Batra, Mihály Berkics, Michael J. Bernstein, Daniel R. Berry, Olga Bialobrzeska, Evans Dami Binan, Konrad Bocian, Mark J. Brandt, Robert Busching, Anna Cabak Rédei, Huajian Cai, Fanny Cambier, Katarzyna Cantarero, Cheryl L. Carmichael, Francisco Ceric, Jesse Chandler, Jen-Ho Chang, Armand Chatard, Eva E. Chen, Winnee Cheong, David C. Cicero, Sharon Coen, Jennifer A. Coleman, Brian Collisson, Morgan A. Conway, Katherine S. Corker, Paul G. Curran, Fiery Cushman, Zubairu K. Dagona, Ilker Dalgar, Anna Dalla Rosa, William E. Davis, Maaike de Bruijn, Leander De Schutter, Thierry Devos, Marieke de Vries, Canay Doğulu, Nerisa Dozo, Kristin Nicole Dukes, Yarrow Dunham, Kevin Durrheim, Charles R. Ebersole, John E. Edlund, Anja Eller, Alexander Scott English, Carolyn Finck, Natalia Frankowska, Miguel-Ángel Freyre, Mike Friedman, Elisa Maria Galliani, Joshua C. Gandi, Tanuka Ghoshal, Steffen R. Giessner, Tripat Gill, Timo Gnambs, Ángel Gómez, Roberto González, Jesse Graham, Jon E. Grahe, Ivan Grahek, Eva G. T. Green, Kakul Hai, Matthew Haigh, Elizabeth L. Haines, Michael P. Hall, Marie E. Heffernan, Joshua A. Hicks, Petr Houdek, Jeffrey R. Huntsinger, Ho Phi Huynh, Hans IJzerman, Yoel Inbar, Åse H. Innes-Ker, William Jiménez-Leal, Melissa-Sue John, Jennifer A. Joy-Gaba, Roza G. Kamiloğlu, Heather Barry Kappes, Serdar Karabati, Haruna Karick, Victor N. Keller, Anna Kende, Nicolas Kervyn, Goran Knežević, Carrie Kovacs, Lacy E. Krueger, German Kurapov, Jamie Kurtz, Daniël Lakens, Ljiljana B. Lazarević, Carmel A. Levitan, Neil A. Lewis, Samuel Lins, Nikolette P. Lipsey, Joy E. Losee, Esther Maassen, Angela T. Maitner, Winfrida Malingumu, Robyn K. Mallett, Satia A. Marotta, Janko Međedović, Fernando Mena-Pacheco, Taciano L. Milfont, Wendy L. Morris, Sean C. Murphy, Andriy Myachykov, Nick Neave, Koen Neijenhuijs, Anthony J. Nelson, Félix Neto, Austin Lee Nichols, Aaron Ocampo, Susan L. O'Donnell, Haruka Oikawa, Masanori Oikawa, Elsie Ong, Gábor Orosz, Malgorzata Osowiecka, Grant Packard, Rolando Pérez-Sánchez, Boban Petrović, Ronaldo Pilati, Brad Pinter, Lysandra Podesta, Gabrielle Pogge, Monique M. H. Pollmann, Abraham M. Rutchick, Patricio Saavedra, Alexander K. Saeri, Erika Salomon, Kathleen Schmidt, Felix D. Schönbrodt, Maciej B. Sekerdej, David Sirlopú, Jeanine L. M. Skorinko, Michael A. Smith, Vanessa Smith-Castro, Karin C. H. J. Smolders, Agata Sobkow, Walter Sowden, Philipp Spachtholz, Manini Srivastava, Troy G. Steiner, Jeroen Stouten, Chris N. H. Street, Oskar K. Sundfelt, Stephanie Szeto, Ewa Szumowska, Andrew C. W. Tang, Norbert Tanzer, Morgan J. Tear, Jordan Theriault, Manuela Thomae, David Torres, Jakub Traczyk, Joshua M. Tybur, Adrienn Ujhelyi, Robbie C. M. van Aert, Marcel A. L. M. van Assen, Marije van der Hulst, Paul A. M. van Lange, Anna Elisabeth van 't Veer, Alejandro Vásquez- Echeverría, Leigh Ann Vaughn, Alexandra Vázquez, Luis Diego Vega, Catherine Verniers, Mark Verschoor, Ingrid P. J. Voermans, Marek A. Vranka, Cheryl Welch, Aaron L. Wichman, Lisa A. Williams, Michael Wood, Julie A. Woodzicka, Marta K. Wronska, Liane Young, John M. Zelenski, Zeng Zhijia, Brian A. Nosek

Advances in Methods and Practices in Psychological Science, 2018. DOI 10.1177/2515245918810225

Has this study been replicated?

This paper is itself a replication attempt, targeting 24 studies, listed below.

Studies replicated

Incidental environmental anchors, Critcher & Gilovich (2007). Journal of Behavioral Decision Making. View paper
Living in the north is not necessarily favorable: Different metaphoric associations between cardinal direction and valence in Hong Kong and in the United States, Huang et al. (2014). European Journal of Social Psychology. View paper
The "false consensus effect": An egocentric bias in social perception and attribution processes, Ross et al. (1977). Journal of Experimental Social Psychology. View paper
High in the hierarchy: How vertical location and judgments of leaders' power are interrelated, Giessner & Schubert (2007). Organizational Behavior and Human Decision Processes. View paper
Development of prosocial, individualistic, and competitive orientations: Theory and preliminary evidence, Van Lange et al. (1997). Journal of Personality and Social Psychology. View paper
Cultural variation in correspondence bias: The critical role of attitude diagnosticity of socially constrained behavior, Miyamoto & Kitayama (2002). Journal of Personality and Social Psychology. View paper
Why people are reluctant to tempt fate, Risen & Gilovich (2008). Journal of Personality and Social Psychology. View paper
Overcoming intuition: Metacognitive difficulty activates analytic reasoning, Alter et al. (2007). Journal of Experimental Psychology: General. View paper
Moral typecasting: Divergent perceptions of moral agents and moral patients, Gray & Wegner (2009). Journal of Personality and Social Psychology. View paper
Disgust sensitivity predicts intuitive disapproval of gays, Inbar et al. (2009). Emotion. View paper
A functional basis for structure-seeking: Exposure to structure promotes willingness to engage in motivated action, Kay et al. (2014). Journal of Experimental Psychology: General. View paper
How warm days increase belief in global warming, Zaval et al. (2014). Nature Climate Change. View paper
Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis, Schwarz et al. (1991). Public Opinion Quarterly. View paper
Intentional action and side effects in ordinary language, Knobe (2003). Analysis. View paper
Money, Kisses, and Electric Shocks: On the Affective Psychology of Risk, Rottenstreich & Hsee (2001). Psychological Science. View paper
A Dissociation Between Moral Judgments and Justifications, HAUSER et al. (2007). Mind & Language. View paper
Washing Away Your Sins: Threatened Morality and Physical Cleansing, Zhong & Liljenquist (2006). Science. View paper
The Framing of Decisions and the Psychology of Choice, Tversky & Kahneman (1981). Science. View paper
What Counts as a Choice?, Savani et al. (2010). Psychological Science. View paper
Cuing Consumerism, Bauer et al. (2012). Psychological Science. View paper
The Local-Ladder Effect, Anderson et al. (2012). Psychological Science. View paper
Choosing versus rejecting: Why some options are both better and worse than others, Shafir (1993). Memory & Cognition. View paper
Studies of Similarity, Tversky & Gati (1978). Cognition and Categorization. View paper
Less is better: when low-value options are valued more highly than high-value options, Hsee (1998). Journal of Behavioral Decision Making. View paper

Cite this record

Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., Batra, R., Berkics, M., Bernstein, M. J., Berry, D. R., Bialobrzeska, O., Binan, E. D., Bocian, K., Brandt, M. J., Busching, R., … Nosek, B. A. (2018). Many Labs 2: Investigating Variation in Replicability Across Samples and Settings. Advances in Methods and Practices in Psychological Science, 1(4), 443–490. https://doi.org/10.1177/2515245918810225

Other studies in the atlas

Failed replications · Successful replications · All browse pages