Reproducibility and Replicability Knowledge

 

On Not Confusing the Tree of Trustworthy Statistics with the Greater Forest of Good Science: A Comment on Simmons et al.’s Perspective on Pre-registration

In this commentary on Simmons, Nelson, and Simonsohn (this issue), we examine their rationale for pre-registration within the broader perspective of what good science is. We agree that there is potential benefit in a system of pre-registration if …

On the plurality of (methodological) worlds: estimating the analytic flexibility of fMRI experiments

How likely are published findings in the functional neuroimaging literature to be false? According to a recent mathematical model, the potential for false positives increases with the flexibility of analysis methods. Functional MRI (fMRI) experiments …

On the reproducibility of meta-analyses: six practical recommendations

Background: Meta-analyses play an important role in cumulative science by combining information across multiple studies and attempting to provide effect size estimates corrected for publication bias. Research on the reproducibility of meta-analyses …

On the reproducibility of psychological science

Investigators from a large consortium of scientists recently performed a multi-year study in which they replicated 100 psychology experiments. Although statistically significant results were reported in 97% of the original studies, statistical …

On the Use and Misuses of Preregistration: A Reply to Klonsky (2024)

In his commentary, Klonsky (2024) outlines several arguments for why preregistration mandates (PRMs) will have a negative impact on the field. Klonsky’s overarching concern is that when preregistration ceases to be a tool for research and becomes an …

Open and Reproducible Methods Syllabus

This course will examine current controversies and new developments in research methods in psychology. The goal of the course is to learn to think critically about how psychological science is conducted and how conclusions are drawn. We will cover …

Open and Reproducible Research in Psychology

Psychological research is in the midst of what has been called the “replication crisis”, in which questions have been raised about the validity of even seminal research findings. How can we tell if the research we’re reading and doing is rigorous and …

Open and reproducible science

This course is designed to be delivered to master and doctoral students at the Universidade Federaldo Rio Grande do Sul (UFRGS). The structure is organized to (1) provide basic skills to enhance overall transparency and methodological …

Open and Reproducible Science Syllabus

To provide educators with an example of how they can draw resources from FORRT’s educational nexus to integrate open scholarship into their teaching, FORRT has developed an Open and Reproducible Science 101 syllabus. FORRT’s syllabus was developed …

Open and Reproducible Science Syllabus

The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research workflow. By the end of this course students will be familiar with documenting their research workflow (e.g., idea …