Preregistration

Issues in the Registration of Clinical Trials

Public concerns about the perils associated with incomplete or delayed reporting of results from clinical trials has heightened interest in trial registries and results databases. Here we review the current status of trial registration efforts and …

Leonardo da Vinci, preregistration and the Architecture of Science: Towards a More Open and Transparent Research Culture

There has been much talk of psychological science undergoing a renaissance with recent years being marked by dramatic changes in research practices and to the publishing landscape. This article briefly summarises a number of the ways in which …

Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

Background: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has increased over time. Methods: We identified all large NHLBI supported RCTs between 1970 and 2012 evaluating drugs or …

Making ERP research more transparent: Guidelines for preregistration

A combination of confirmation bias, hindsight bias, and pressure to publish may prompt the (unconscious) exploration of various methodological options and reporting only the ones that lead to a (statistically) significant outcome. This undisclosed …

Methodological Advances in Behavioral Research: Crowdsourcing Science

The results of many published studies across many scientific domains are not easily reproduced by independent laboratories. For example, an initiative by Bayer Healthcare to replicate 67 pre-clinical studies led to a reproducibility rate of 20-25% …

Methods for Reliable, Transparent, and Open Science

A syllabus about the methods for reliable, transparent and open science

Mini course on reproducibility & open research

This mini course was designed to introduce Psychology undergraduate students at the University of Edinburgh (who are working on their dissertation in the academic year 2021-2022) to open research principles and practices. The course contains 5 …

Mitigating Illusory Results through Preregistration in Education

Like performance-enhancing drugs inflating apparent athletic achievements, several common social science practices contribute to the production of illusory results. In this article, we examine the processes that lead to illusory findings and describe …

On Not Confusing the Tree of Trustworthy Statistics with the Greater Forest of Good Science: A Comment on Simmons et al.’s Perspective on Pre-registration

In this commentary on Simmons, Nelson, and Simonsohn (this issue), we examine their rationale for pre-registration within the broader perspective of what good science is. We agree that there is potential benefit in a system of pre-registration if …

On the Use and Misuses of Preregistration: A Reply to Klonsky (2024)

In his commentary, Klonsky (2024) outlines several arguments for why preregistration mandates (PRMs) will have a negative impact on the field. Klonsky’s overarching concern is that when preregistration ceases to be a tool for research and becomes an …