Reproducibility and Replicability Knowledge

 

Many Labs 3: Evaluating participant pool quality across the academic semester via replication.

The university participant pool is a key resource for behavioral research, and data quality is believed to vary over the course of the academic semester. This crowdsourced project examined time of semester variation in 10 known effects, 10 individual …

Materials scientist explains why he started commenting on PubPeer

News article from C&EN (June 2024) in which Angus Wilkinson, a materials scientist at the University of Oxford, reflects on his first six months as a part-time research sleuth commenting on PubPeer.

News at a glance: Planning for mentoring, tracking replications, and deracializing lung tests

On Not Confusing the Tree of Trustworthy Statistics with the Greater Forest of Good Science: A Comment on Simmons et al.’s Perspective on Pre-registration

In this commentary on Simmons, Nelson, and Simonsohn (this issue), we examine their rationale for pre-registration within the broader perspective of what good science is. We agree that there is potential benefit in a system of pre-registration if …

On the reproducibility of meta-analyses: six practical recommendations

Background: Meta-analyses play an important role in cumulative science by combining information across multiple studies and attempting to provide effect size estimates corrected for publication bias. Research on the reproducibility of meta-analyses …

Open and Reproducible Methods Syllabus

This course will examine current controversies and new developments in research methods in psychology. The goal of the course is to learn to think critically about how psychological science is conducted and how conclusions are drawn. We will cover …

Open Lab

The Open Lab platform empowers researchers to collect rich datasets by combining lab.js tasks with Open Lab's own study-building logic and participant-management system: lab.js provides the interactive tasks and surveys, while Open Lab adds the study …

Open Science 2.0: Towards a truly collaborative research ecosystem

Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon. Our efforts towards openness therefore need to increase in scale and aim for a more ambitious target. We need an …

Open science saves lives: lessons from the COVID-19 pandemic

In the last decade Open Science principles have been successfully advocated for and are being slowly adopted in different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of Open …

Open, rigorous and reproducible research: A practitioner’s handbook

This book starts from the premise that there is a lot we can all do to increase the benefits of research. Let’s consider the main limitations of research that is not carried out and shared in an open, transparent, and reproducible way: If papers …
JUST-OS