Reproducibility and Replicability Knowledge

 

Diversifying Research Methods Syllabi

This is a collection of research methodology articles, which are first- or senior-authored by women, to promote diverse perspectives in teaching students about research methods and contributing to improving research practices.

Eleven strategies for making reproducible research and open science training the norm at research institutions

Reproducible research and open science practices have the potential to accelerate scientific progress by allowing others to reuse research outputs, and by promoting rigorous research that is more likely to yield trustworthy results. However, these …

Experimenter as automaton; experimenter as human: Exploring the position of the researcher in scientific research

The crisis of confidence in the social sciences has many corollaries which impact our research practices. One of these is a push towards maximal and mechanical objectivity in quantitative research. This stance is reinforced by major journals and …

Good clinical practice improves rigor and transparency: Lessons from the ACTIVE trial

Clinical trials are governed by principles of good clinical practice (GCP), which can strengthen the achievement of rigor, reproducibility, and transparency in scientific research. Rigor, reproducibility, and transparency are key for producing …

History repeating: Guidelines to address common problems in psychedelic science

Research in the last decade has expressed considerable optimism about the clinical potential of psychedelics for the treatment of mental disorders. This optimism is reflected in an increase in research papers, investments by pharmaceutical companies, …

How to Test AI Research Tools: A Repeatability Worksheet and Worked Example

A free teaching activity for evaluating AI literature-search assistants through repeated use rather than one polished response. Learners run the same scholarly-search task three times, preserve visible sources, log test conditions and access …

Investigating Variation in Replicability: A “Many Labs” Replication Project

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In …

It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science

Psychology is in the early stages of examining a crisis of replicability stemming from several high-profile failures to replicate studies in experimental psychology. This important conversation has largely been focused on social psychology, with some …

Joy and rigor in behavioral science

In the past decade, behavioral science has seen the introduction of beneficial reforms to reduce false positive results. Serving as the motivational backdrop for the present research, we wondered whether these reforms might have unintended negative …

Logical and methodological issues affecting genetic studies of humans reported in top neuroscience journals.

Genetics and neuroscience are two areas of science that pose particular methodological problems because they involve detecting weak signals (i.e., small effects) in noisy data. In recent years, increasing numbers of studies have attempted to bridge …
JUST-OS