Open Science

Psychologists Are Open to Change, yet Wary of Rules

Psychologists must change the way they conduct and report their research—this notion has been the topic of much debate in recent years. One article recently published in Psychological Science proposing six requirements for researchers concerning data …

Psychology as a Robust Science

Is psychology a robust science? To answer such a question, this course will encourage you to think critically about how psychological research is conducted and how conclusions are drawn. To enable you to truly understand how psychology functions as …

Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis

Psychology advances knowledge by testing statistical hypotheses using empirical observations and data. The expectation is that most statistically significant findings can be replicated in new data and in new laboratories, but in practice many …

Psychology's renaissance

In 2010–2012, a few largely coincidental events led experimental psychologists to realize that their approach to collecting, analyzing, and reporting data made it too easy to publish false-positive findings. This sparked a period of methodological …

Psychology's Replication Crisis and the Grant Culture: Righting the Ship

The past several years have been a time for soul searching in psychology, as we have gradually come to grips with the reality that some of our cherished findings are less robust than we had assumed. Nevertheless, the replication crisis highlights the …

Psychology’s Credibility Revolution

In 2011, Daryl Bem published a paper that seemed to demonstrate evidence for extra sensory perception (ESP). Four years later, the Open Science Collaboration failed to replicate 67 of 100 published psychological studies. These results and others have …

Publication bias and the canonization of false facts.

Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this imply that many scientific facts are false as well? To find out, we explore the process by which a claim becomes …

Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated?

Few models of self-control have generated as much scientific interest as has the limited strength model. One of the entailments of this model, the depletion effect, is the expectation that acts of self-control will be less effective when they follow …

Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

Background: The p value obtained from a significance test provides no information about the magnitude or importance of the underlying phenomenon. Therefore, additional reporting of effect size is often recommended. Effect sizes are theoretically …

Publication bias in the social sciences: Unlocking the file drawer

We studied publication bias in the social sciences by analyzing a known population of conducted studies—221 in total—in which there is a full accounting of what is published and unpublished. We leveraged Time-sharing Experiments in the Social …