Replication Research

 

Change starts with journal editors: In response to Makel (2014).

The editors of the Journal of Advanced Academics comment on Makel (2014). The replicability crisis in psychology is summarized in terms of three focal issues: the “file drawer” problem, lack of replication studies, and the null hypothesis …

Continuously Cumulating Meta-Analysis and Replicability

The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and Kahneman (1971), who noted that even sophisticated researchers believe in the fallacious Law of Small Numbers—erroneous …

Empirical Evaluation of Very Large Treatment Effects of Medical Interventions

Context Most medical interventions have modest effects, but occasionally some clinical trials may find very large effects for benefits or harms. Objective To evaluate the frequency and features of very large effects in medicine. Data Sources Cochrane …

Excess Success for Psychology Articles in the Journal Science

This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of experimental psychology articles published in the journal Science between 2005–2012. When the success rate of a set of …

Instead of “playing the game” it is time to change the rules: Registered Reports at AIMS Neuroscience and beyond.

The last ten years have witnessed increasing awareness of questionable research practices (QRPs) in the life sciences [1,2], including p-hacking [3], HARKing [4], lack of replication [5], publication bias [6], low statistical power [7] and lack of …

Logical and methodological issues affecting genetic studies of humans reported in top neuroscience journals.

Genetics and neuroscience are two areas of science that pose particular methodological problems because they involve detecting weak signals (i.e., small effects) in noisy data. In recent years, increasing numbers of studies have attempted to bridge …

Open Science in Sport and Exercise Psychology: Review of Current Approaches and Considerations for Qualitative Inquiry

Open science practices including open access (OA) publication, open methods, study preregistration, and open data are gaining acceptance across diverse fields of research. These practices are promoted as strategies to improve the reproducibility of …

Open Science: What, Why, and How

Open Science is a collection of actions designed to make scientific processes more transparent and results more accessible. Its goal is to build a more replicable and robust science; it does so using new technologies, altering incentives, and …

Registered Replication Report: Rand, Greene, and Nowak (2012).

In an anonymous 4-person economic game, participants contributed more money to a common project (i.e., cooperated) when required to decide quickly than when forced to delay their decision (Rand, Greene & Nowak, 2012), a pattern consistent with the …

RIPOSTE: A Framework for Improving the Design and Analysis of Laboratory-Based Research

Lack of reproducibility is an ongoing problem in some areas of the biomedical sciences. Poor experimental design and a failure to engage with experienced statisticians at key stages in the design and analysis of experiments are two factors that …
JUST-OS