Reproducibility and Replicability Knowledge

 

Let’s Put Our Money Where Our Mouth Is: If Authors Are to Change Their Ways, Reviewers (and Editors) Must Change With Them

A number of scholars recently have argued for fundamental changes in the way psychological scientists conduct and report research. The behavior of researchers is influenced partially by incentive structures built into the manuscript evaluation …

Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

Background: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has increased over time. Methods: We identified all large NHLBI supported RCTs between 1970 and 2012 evaluating drugs or …

Logical and methodological issues affecting genetic studies of humans reported in top neuroscience journals.

Genetics and neuroscience are two areas of science that pose particular methodological problems because they involve detecting weak signals (i.e., small effects) in noisy data. In recent years, increasing numbers of studies have attempted to bridge …

Making Prospective Registration of Observational Research a Reality

The vast majority of health-related observational studies are not prospectively registered and the advantages of registration have not been fully appreciated. Nonetheless, international standards require approval of study protocols by an independent …

Making replication mainstream

Many philosophers of science and methodologists have argued that the ability to repeat studies and obtain similar results is an essential component of science. A finding is elevated from single observation to scientific evidence when the procedures …

Managing Qualitative Social Science Data

A website with modules and lessons on qualitative research and data management

Many Labs 3: Evaluating participant pool quality across the academic semester via replication.

The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual …

Mapping open and internationally relevant open science capacity building and training modules to support the implementation of the UNESCO Recommendation on Open Science

Map of open and internationally relevant open science capacity building and training modules to support the implementation of the UNESCO Recommendation on Open Science

Materials scientist explains why he started commenting on PubPeer

n.a.

Maximizing the Reproducibility of Your Research

A chapter to discuss maximising the reproducibility of research