Eleven years of student replication projects provide evidence on the correlates of replicability in psychology

Veronica Boyce, Maya Mathur, Michael C. Frank

Royal Society Open Science, 2023. DOI 10.1098/rsos.231240

Has this study been replicated?

This paper is itself a replication attempt, targeting 138 studies, listed below.

Studies replicated

Choice Boosts Curiosity, Romero Verdugo et al. (2022). Psychological Science. View paper
Schema induction and analogical transfer, Gick & Holyoak (1983). Cognitive Psychology. View paper
The seductive allure is a reductive allure: People prefer scientific explanations that contain logically irrelevant reductive information, Hopkins et al. (2016). Cognition. View paper
A familiar-size Stroop effect in the absence of basic-level recognition, Long & Konkle (2017). Cognition. View paper
Choosing what is best for one's children? Experimental evidence on parents' responsiveness to childcare subsidies and their preferences for different childcare arrangements, Zangger & Widmer (2020). Early Childhood Research Quarterly. View paper
Perceived partner responsiveness promotes intellectual humility, Reis et al. (2018). Journal of Experimental Social Psychology. View paper
Perceiving economic inequality in everyday life decreases tolerance to inequality, García-Castro et al. (2020). Journal of Experimental Social Psychology. View paper
From deficit to benefit: Highlighting lower-SES students' background-specific strengths reinforces their academic persistence, Hernandez et al. (2021). Journal of Experimental Social Psychology. View paper
Roosters, robins, and alarm clocks: Aptness and conventionality in metaphor comprehension, Jones & Estes (2006). Journal of Memory and Language. View paper
Modulation of emotion by cognition and cognition by emotion, Blair et al. (2007). NeuroImage. View paper
Neural mechanisms of attentional shifts due to irrelevant spatial and numerical cues, Ranzini et al. (2009). Neuropsychologia. View paper
Cheating more when the spoils are split, Wiltermuth (2011). Organizational Behavior and Human Decision Processes. View paper
Limits on theory of mind use in adults, Keysar et al. (2003). Cognition. View paper
Deviance or uniqueness, harmony or conformity? A cultural analysis, Kim & Markus (1999). Journal of Personality and Social Psychology. View paper
Opening the mind to close it: Considering a message in light of important values increases message processing and later resistance to change, Blankenship & Wegener (2008). Journal of Personality and Social Psychology. View paper
Selective exposure and information quantity: How different information quantities moderate decision makers' preference for consistent and inconsistent information, Fischer et al. (2008). Journal of Personality and Social Psychology. View paper
The effects of an implemental mind-set on attitude strength, Henderson et al. (2008). Journal of Personality and Social Psychology. View paper
Not so innocent: Does seeing one's own capability for wrongdoing predict forgiveness?, Exline et al. (2008). Journal of Personality and Social Psychology. View paper
The rejection of moral rebels: Resenting those who do the right thing, Monin et al. (2008). Journal of Personality and Social Psychology. View paper
Why people are reluctant to tempt fate, Risen & Gilovich (2008). Journal of Personality and Social Psychology. View paper
Now you see it, now you don't: Repetition blindness for nonwords, Morris & Still (2008). Journal of Experimental Psychology: Learning, Memory, and Cognition. View paper
Increasing and decreasing motor and cognitive output: A model of general action and inaction goals, Albarracín et al. (2008). Journal of Personality and Social Psychology. View paper
Seeing meaning in action: A bidirectional link between visual perspective and action identification level, Libby et al. (2009). Journal of Experimental Psychology: General. View paper
The fluency of social hierarchy: The ease with which hierarchical relationships are seen, remembered, learned, and liked, Zitek & Tiedens (2012). Journal of Personality and Social Psychology. View paper
Tradeoffs between sequences: Weighing accumulated outcomes against outcome-adjusted delays, Read & Scholten (2012). Journal of Experimental Psychology: Learning, Memory, and Cognition. View paper
Real-world objects are not represented as bound units: Independent forgetting of different object details from visual memory, Brady et al. (2013). Journal of Experimental Psychology: General. View paper
Paying it forward: Generalized reciprocity and the limits of generosity, Gray et al. (2014). Journal of Experimental Psychology: General. View paper
Is it better to select or to receive? Learning via active and passive hypothesis testing, Markant & Gureckis (2014). Journal of Experimental Psychology: General. View paper
The essence of innocence: Consequences of dehumanizing Black children, Goff et al. (2014). Journal of Personality and Social Psychology. View paper
Artful paltering: The risks and rewards of using truthful statements to mislead others, Rogers et al. (2017). Journal of Personality and Social Psychology. View paper
Mapping out past and future minds: The perceived trajectory of rationality versus emotionality over time, O'Brien (2015). Journal of Experimental Psychology: General. View paper
A linguistic signature of psychological distancing in emotion regulation, Nook et al. (2017). Journal of Experimental Psychology: General. View paper
Victims, perpetrators, or both? The vicious cycle of disrespect and cynical beliefs about human nature, Stavrova et al. (2020). Journal of Experimental Psychology: General. View paper
The origins of the shape bias: Evidence from the Tsimane', Jara-Ettinger et al. (2022). Journal of Experimental Psychology: General. View paper
Theta rhythmicity governs human behavior and hippocampal signals during memory-dependent tasks, ter Wal et al. (2021). Nature Communications. View paper
The statistical shape of geometric reasoning, Hart et al. (2018). Scientific Reports. View paper
Controlling for Participants' Viewing Distance in Large-Scale, Psychophysical Online Experiments Using a Virtual Chinrest, Li et al. (2020). Scientific Reports. View paper
Syntax-induced pattern deafness, Endress & Hauser (2009). Proceedings of the National Academy of Sciences. View paper
Higher social class predicts increased unethical behavior, Piff et al. (2012). Proceedings of the National Academy of Sciences. View paper
Disclosing information about the self is intrinsically rewarding, Tamir & Mitchell (2012). Proceedings of the National Academy of Sciences. View paper
Rational integration of noisy evidence and prior semantic expectations in sentence interpretation, Gibson et al. (2013). Proceedings of the National Academy of Sciences. View paper
Brief intervention to encourage empathic discipline cuts suspension rates in half among adolescents, Okonofua et al. (2016). Proceedings of the National Academy of Sciences. View paper
Objecting to experiments even while approving of the policies or treatments they compare, Heck et al. (2020). Proceedings of the National Academy of Sciences. View paper
The logic of universalization guides moral judgment, Levine et al. (2020). Proceedings of the National Academy of Sciences. View paper
You're the emotional one: the role of perspective for emotion processing in reading comprehension, Child et al. (2018). Language, Cognition and Neuroscience. View paper
Getting a Job: Is There a Motherhood Penalty?, Correll et al. (2007). American Journal of Sociology. View paper
Spontaneous Hedonic Reactions to Social Media Cues, van Koningsbruggen et al. (2017). Cyberpsychology, Behavior, and Social Networking. View paper
Are Older Adults More Willing to Donate? The Roles of Donation Form and Social Relationship, Gong et al. (2017). The Journals of Gerontology: Series B. View paper
Age and Time Horizons Are Associated With Preferences for Helping Colleagues, Shavit et al. (2022). Work, Aging and Retirement. View paper
Transient Spatial Attention Degrades Temporal Resolution, Yeshurun & Levy (2003). Psychological Science. View paper
Stable Causal Relationships Are Better Causal Relationships, Vasilyeva et al. (2018). Cognitive Science. View paper
COLLEGE CHOICE AS A COLLECTIVE DECISION, Huntington‐Klein (2017). Economic Inquiry. View paper
The Curse of Knowledge in Reasoning About False Beliefs, Birch & Bloom (2007). Psychological Science. View paper
The Value Heuristic in Judgments of Relative Frequency, Dai et al. (2008). Psychological Science. View paper
Loving Those Who Justify Inequality, Lau et al. (2008). Psychological Science. View paper
Sleep Preferentially Enhances Memory for Emotional Components of Scenes, Payne et al. (2008). Psychological Science. View paper
With a Clean Conscience, Schnall et al. (2008). Psychological Science. View paper
Seeking Confirmation Is Rational for Deterministic Hypotheses, Austerweil & Griffiths (2011). Cognitive Science. View paper
The Cognitive Dynamics of Negated Sentence Verification, Dale & Duran (2011). Cognitive Science. View paper
Reflection and Reasoning in Moral Judgment, Paxton et al. (2011). Cognitive Science. View paper
The Psychological Consequences of Money, Vohs et al. (2006). Science. View paper
Poverty Impedes Cognitive Function, Mani et al. (2013). Science. View paper
Just think: The challenges of the disengaged mind, Wilson et al. (2014). Science. View paper
Gender-Inclusive Design, Metaxa-Kakavouli et al. (2018). Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. View paper
AI-Mediated Communication, Jakesch et al. (2019). Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. View paper
Cognitive Control Predicts Use of Model-based Reinforcement Learning, Otto et al. (2015). Journal of Cognitive Neuroscience. View paper
Too Good to Hire? Capability and Inferences about Commitment in Labor Markets, Galperin et al. (2019). Administrative Science Quarterly. View paper
Connective-Collective Action on Social Media: Moderated Mediation of Cognitive Elaboration and Perceived Source Credibility on Personalness of Source, Nekmat et al. (2015). Communication Research. View paper
When Being a Model Minority Is Good . . . and Bad: Realistic Threat Explains Negativity Toward Asian Americans, Maddux et al. (2008). Personality and Social Psychology Bulletin. View paper
My Mother and Me, Fu & Markus (2014). Personality and Social Psychology Bulletin. View paper
Using High-Level Construal and Perceptions of Changeability to Promote Self-Change Over Self-Protection Motives in Response to Negative Feedback, Belding et al. (2015). Personality and Social Psychology Bulletin. View paper
What Counts as a Choice?, Savani et al. (2010). Psychological Science. View paper
Hierarchical Encoding in Visual Working Memory, Brady & Alvarez (2011). Psychological Science. View paper
Emotion-Regulation Choice, Sheppes et al. (2011). Psychological Science. View paper
Can an Agentic Black Woman Get Ahead? The Impact of Race and Interpersonal Dominance on Perceptions of Female Leaders, Livingston et al. (2012). Psychological Science. View paper
A Choice Mind-Set Increases the Acceptance and Maintenance of Wealth Inequality, Savani & Rattan (2012). Psychological Science. View paper
The Faintest Speck of Dirt, Sherman et al. (2012). Psychological Science. View paper
The Moral Roots of Environmental Attitudes, Feinberg & Willer (2012). Psychological Science. View paper
Aging 5 Years in 5 Minutes, Hughes et al. (2013). Psychological Science. View paper
The Price Had Better Be Right, Vohs et al. (2013). Psychological Science. View paper
Racial Progress as Threat to the Status Hierarchy, Wilkins & Kaiser (2013). Psychological Science. View paper
On the Precipice of a "Majority-Minority" America, Craig & Richeson (2014). Psychological Science. View paper
Free Will and Punishment: A Mechanistic View of Human Nature Reduces Retribution, Shariff et al. (2014). Psychological Science. View paper
The Working Memory Stroop Effect: When Internal Representations Clash With External Stimuli, Kiyonaga & Egner (2014). Psychological Science. View paper
Object Persistence Enhances Spatial Navigation, Liverence & Scholl (2015). Psychological Science. View paper
The Sound of Power, Ko et al. (2014). Psychological Science. View paper
What Is Typical Is Good, Sofer et al. (2014). Psychological Science. View paper
Anchors Weigh More Than Power, Schaerer et al. (2014). Psychological Science. View paper
Saving-Enhanced Memory, Storm & Stone (2014). Psychological Science. View paper
How Will I Be Remembered? Conserving the Environment for the Sake of One's Legacy, Zaval et al. (2015). Psychological Science. View paper
Anticipating Divine Protection? Reminders of God Can Increase Nonmoral Risk Taking, Kupor et al. (2015). Psychological Science. View paper
Scarcity Frames Value, Shah et al. (2015). Psychological Science. View paper
Failing to Forget, Catarino et al. (2015). Psychological Science. View paper
When Does the Future Begin? Time Metrics Matter, Connecting Present and Future Selves, Lewis & Oyserman (2015). Psychological Science. View paper
Capacity for Visual Features in Mental Rotation, Xu & Franconeri (2015). Psychological Science. View paper
When Knowledge Knows No Bounds, Atir et al. (2015). Psychological Science. View paper
A Gender Bias in the Attribution of Creativity, Proudfoot et al. (2015). Psychological Science. View paper
Opportunity Cost Neglect Attenuates the Effect of Choices on Preferences, Greenberg & Spiller (2015). Psychological Science. View paper
Beyond Faces and Expertise, Zhao et al. (2015). Psychological Science. View paper
Does Seeing Faces of Young Black Boys Facilitate the Identification of Threatening Stimuli?, Todd et al. (2016). Psychological Science. View paper
Economic Insecurity Increases Physical Pain, Chou et al. (2016). Psychological Science. View paper
Attention Alters Perceived Attractiveness, Störmer & Alvarez (2016). Psychological Science. View paper
Parents' Views of Failure Predict Children's Fixed and Growth Intelligence Mind, Haimovitz & Dweck (2016). Psychological Science. View paper
More Similar but Less Satisfying, Huh et al. (2016). Psychological Science. View paper
Why Do People Tend to Infer "Ought" From "Is"? The Role of Biases in Explanation, Tworek & Cimpian (2016). Psychological Science. View paper
The Effect of Relative Encoding on Memory-Based Judgments, Sharif & Oppenheimer (2016). Psychological Science. View paper
Your Understanding Is My Understanding, Sloman & Rabb (2016). Psychological Science. View paper
A Tale of Two Types of Perspective Taking, Tarampi et al. (2016). Psychological Science. View paper
From Power to Inaction, Durso et al. (2016). Psychological Science. View paper
The Relationship Between Mental Representations of Welfare Recipients and Attitudes Toward Welfare, Brown-Iannuzzi et al. (2016). Psychological Science. View paper
Black and White Lies: Race-Based Biases in Deception Judgments, Lloyd et al. (2017). Psychological Science. View paper
Healthy Out-Group Members Are Represented Psychologically as Infected In-Group Members, Petersen (2017). Psychological Science. View paper
The Link Between Self-Dehumanization and Immoral Behavior, Kouchaki et al. (2018). Psychological Science. View paper
In Defense of the Commons: Young Children Negatively Evaluate and Sanction Free Riders, Yang et al. (2018). Psychological Science. View paper
Implicit Theories of Interest: Finding Your Passion or Developing It?, O'Keefe et al. (2018). Psychological Science. View paper
Inferring Whether Officials Are Corruptible From Looking at Their Faces, Lin et al. (2018). Psychological Science. View paper
People Make the Same Bayesian Judgment They Criticize in Others, Cao et al. (2018). Psychological Science. View paper
You That Read Wrong Again! A Transposed-Word Effect in Grammaticality Judgments, Mirault et al. (2018). Psychological Science. View paper
The Zero-Sum Fallacy in Evidence Evaluation, Pilditch et al. (2018). Psychological Science. View paper
Challenging Moral Attitudes With Moral Messages, Luttrell et al. (2019). Psychological Science. View paper
Specks of Dirt and Tons of Pain: Dosage Distinguishes Impurity From Harm, Rottman & Young (2019). Psychological Science. View paper
The Illusion of Consensus: A Failure to Distinguish Between True and False Consensus, Yousif et al. (2019). Psychological Science. View paper
Development of Holistic Episodic Recollection, Ngo et al. (2019). Psychological Science. View paper
Affective Arousal Links Sound to Meaning, Aryani et al. (2020). Psychological Science. View paper
Biasing and debiasing health decisions with bar graphs: Costs and benefits of graph literacy, Okan et al. (2018). Quarterly Journal of Experimental Psychology. View paper
How Quick Decisions Illuminate Moral Character, Critcher et al. (2012). Social Psychological and Personality Science. View paper
Gay Asian Americans Are Seen as More American Than Asian Americans Who Are Presumed Straight, Semrow et al. (2019). Social Psychological and Personality Science. View paper
Why Won't You Listen to Me? Measuring Receptiveness to Opposing Views, Minson et al. (2020). Management Science. View paper
A Founding Penalty: Evidence from an Audit Study on Gender, Entrepreneurship, and Future Employment, Kacperczyk & Younkin (2022). Organization Science. View paper
Underestimating Calorie Content When Healthy Foods Are Present: An Averaging Effect or a Reference-Dependent Anchoring Effect?, Forwood et al. (2013). PLoS ONE. View paper
Reasoning in Reference Games: Individual- vs. Population-Level Probabilistic Modeling, Franke & Degen (2016). PLOS ONE. View paper
Once again on norms and comparison classes, Tribushinina (2011). Linguistics. View paper
Data quality of platforms and panels for online behavioral research, Peer et al. (2021). Behavior Research Methods. View paper
Cognitive vs. emotive factives: {A}n experimental differentiation, Dj{\"a}rv et al. (2018). Proceedings of Sinn und Bedeutung. View paper
The first crank of the cultural ratchet: Learning and transmitting concepts through language, Chopra et al. (2019). Proceedings of the 41st Annual Meeting of the Cognitive Science Society. View paper
You Call It "Self-Exuberance"; I Call It "Bragging", Scopelliti et al. (2015). Psychological Science. View paper
Inferring Identity From Language, Porter et al. (2015). Psychological Science. View paper
Why Do We Hate Hypocrites? Evidence for a Theory of False Signaling, Jordan et al. (2017). Psychological Science. View paper

Cite this record

Boyce, V., Mathur, M., & Frank, M. C. (2023). Eleven years of student replication projects provide evidence on the correlates of replicability in psychology. Royal Society Open Science, 10(11). https://doi.org/10.1098/rsos.231240 Individual report available at https://osf.io/wdp9b

Other studies in the atlas

Failed replications · Successful replications · All browse pages