Replication Research

 

Best practices in data analysis and sharing in neuroimaging using MRI

Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results reporting, and algorithm and data sharing to promote transparency, reliability and collaboration. We describe insights …

Promoting an open research culture

Author guidelines for journals could help to promote transparency, openness, and reproducibility

Replicating Studies in Which Samples of Participants Respond to Samples of Stimuli

In a direct replication, the typical goal is to reproduce a prior experimental result with a new but comparable sample of participants in a high-powered replication study. Often in psychology, the research to be replicated involves a sample of …

Strong inference

certain systematic methods of scientific thinking may produce much more rapid progress than others.

Using prediction markets to estimate the reproducibility of scientific research

Concerns about a lack of reproducibility of statistically significant results have recently been raised in many fields, and it has been argued that this lack comes at substantial economic costs. We here report the results from prediction markets set …

Conservative tests under satisficing models of publication bias.

Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. We calculate critical values for statistical significance that could help to adjust after the fact for the …

Investigation and its discontents: Some constraints on progress in psychological research.

Examines several prominent trends in the conduct of psychological research and considers how they may limit progress in the field. Failure to appreciate important differences in temperament among researchers, and differences in the particular talents …

Short, Sweet, and Problematic? The Rise of the Short Report in Psychological Science

Our field has witnessed a rapid increase in the appeal and prevalence of the short report format over the last two decades. In this article, we discuss both the benefits and drawbacks of the trend toward shorter and faster publications. Although the …

‘‘Positive’’ Results Increase Down the Hierarchy of the Sciences

The hypothesis of a Hierarchy of the Sciences with physical sciences at the top, social sciences at the bottom, and biological sciences in-between is nearly 200 years old. This order is intuitive and reflected in many features of academic life, but …

Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency

Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for badges that accompanied published articles. Before badges, less than 3% of Psychological Science articles reported open …
JUST-OS