Preregistration

 

Pre-Analysis Plans: An Early Stocktaking

Pre-analysis plans (PAPs) have been championed as a solution to the problem of research credibility, but without any evidence that PAPs actually bolster the credibility of research. We analyze a representative sample of 195 PAPs registered on the …

Preregistration Does Not Improve the Transparent Evaluation of Severity in Popper’s Philosophy of Science or When Deviations are Allowed

One justification for preregistering research hypotheses, methods, and analyses is that it improves the transparent evaluation of the severity of hypothesis tests. In this article, I consider two cases in which preregistration does not improve this …

Preregistration is not a panacea, but why? A rejoinder to Chen & Li's (2024) “infusing preregistration into tourism research”

A viewpoint published in Tourism Management articulates the potential benefits of preregistration and ‘debunking myths' surrounding this controversial open-science practice (Chen and Li, 2024). This rejoinder critically examines six key arguments …

Preregistration: the good, the bad, and the confusing

Preregistration is a tool to enhance the reliability of science that has been promoted as a normative requirement for the award of grants or the acceptance of publications. I argue that: (a) preregistration addresses an important need, (b) it offers …

Reflections on the Unintended Consequences of the Science Reform Movement

n.a.

Research Integrity and Open Science I (PSYC123)

Psychologists engage in the scientific process with the intention of developing and testing theories that explain and understand human psychology and behaviour. This module introduces students to scientific process and practices, in order to ensure …

Responsible Research Assessment Should Prioritize Theory Development and Testing Over Ticking Open Science Boxes

We appreciate the initiative to seek for ways to improve academic assessment by broadening the range of relevant research contributions and by considering a candidate’s scientific rigor. Evaluating a candidate's ability to contribute to science is a …

RIOT science club

A videos that discusses world-leading open science

Teaching the why and how of replication studies

Psychological science is in the midst of a “credibility crisis” in which its practitioners re-examine their practices and re-define what constitutes study rigor. Replication studies have formed a critical role in motivating this sense of crisis – a …

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but …
JUST-OS