Replication Research

 

Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study in deficiencies in modal research practice.

In this methodological commentary, we use Bem’s (2011) recent article reporting experimental evidence for psi as a case study for discussing important deficiencies in modal research practice in empirical psychology. We focus on (a) overemphasis on …

Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration

Social scientists generally enjoy substantial latitude in selecting measures and models for hypothesis testing. Coupled with publication and related biases, this latitude raises the concern that researchers may intentionally or unintentionally select …

HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?

The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on comprehensive meta-analyses and reviews in applied …

How scientists can stop fooling themselves

Sampling simulated data can reveal common ways in which our cognitive biases mislead us.

Identifying Participants in the Personal Genome Project by Name

We linked names and contact information to publicly available profiles in the Personal Genome Project. These profiles contain medical and genomic information, including details about medications, procedures and diseases, and demographic information, …

Improving (Our) Science: Reproducibility, Reporting, and Openness

The goal of the course is to become a better scientist. You will learn about newest standards for scientific openness, and how they influence the reporting and interpretation of empirical evidence. One component of the course is an intervention to …

Increasing transparency through a multiverse analysis.

Empirical research inevitably includes constructing a data set by processing raw data into a form ready for statistical analysis. Data processing often involves choices among several reasonable options for excluding, transforming, and coding data. We …

Instead of “playing the game” it is time to change the rules: Registered Reports at AIMS Neuroscience and beyond.

The last ten years have witnessed increasing awareness of questionable research practices (QRPs) in the life sciences [1,2], including p-hacking [3], HARKing [4], lack of replication [5], publication bias [6], low statistical power [7] and lack of …

Intellectual humility is central to science

Transparency is indispensable for accuracy and correction in science, and is discussed frequently in the credibility revolution. A less often mentioned aspect of credibility is the need for intellectual humility: When scientific communication is …

Is Psychology Suffering From a Replication Crisis? What Does “Failure to Replicate” Really Mean?

Psychology has recently been viewed as facing a replication crisis because efforts to replicate past study findings frequently do not show the same result. Often, the first study showed a statistically significant result but the replication does not. …
JUST-OS