Reproducibility and Replicability Knowledge

 

Constraints on generality statements are needed to define direct replication

Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of flexibility in how procedural differences are interpreted. Specifying constraints on generality in original articles can …

Continuously Cumulating Meta-Analysis and Replicability

The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and Kahneman (1971), who noted that even sophisticated researchers believe in the fallacious Law of Small Numbers—erroneous …

Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods

Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical approaches to correct for such overestimation. However, it is not …

COS 10 Year Anniversary: Starting, Scaling and Sustaining Improvements to Research Credibility and Trustworthiness

The session was part of the COS 10 Year Anniversary, which took place in Washington, DC on May 8, 2023.

Course materials | Project TIER

Learn about courses, in a wide range of fields at a variety of institutions, where principles and resources from Project TIER have been used to teach transparent research methods.

Course on Open Science 101

These lectures and tutorials introduce students to the scientific process and open research practices, in order to ensure that psychological research is as rigorous, transparent and, ultimately, as reproducible as possible. We also consider …

Credibility of preprints: an interdisciplinary survey of researchers

Preprints increase accessibility and can speed scholarly communication if researchers view them as credible enough to read and use. Preprint services do not provide the heuristic cues of a journal's reputation, selection, and peer-review processes …

Credible science course

Methods for efficient, reliable, and reproducible science This course is designed to bolster the work of early-career scientists, including first year graduate students, by providing them with guidance to create a precise and personalized pipeline …

CREP tutorials

This playlist was created to help students and their instructors complete CREP projects.

Critical Metascience Articles

Metascience is the science of science. Critical metascience takes a step back to question some common assumptions, approaches, problems, and solutions in metascience. Hence, it has also been described as meta-meta-science! The following is a …