Preregistration

 

The Costs of HARKing

Kerr ([1998]) coined the term ‘HARKing’ to refer to the practice of ‘hypothesizing after the results are known’. This questionable research practice has received increased attention in recent years because it is thought to have contributed to low …

The effect of horizontal eye movements on free recall: A preregistered adversarial collaboration.

A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free recall and recognition memory tasks. Nevertheless, a minority of studies have failed to replicate this effect. This …

The need for public opinion and survey methodology research to embrace preregistration and replication, exemplified by a team’s failure to replicate their own findings on visual cues in grid-type questions

Survey researchers take great care to measure respondents’ answers in an unbiased way; but, how successful are we as a field at remedying unintended and intended biases in our research? The validity of inferences drawn from studies has been found to …

The Preregistration Prescriptiveness Trade-Off and Unknown Unknowns in Science: Comments on Van Drimmelen (2023)

I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process. In particular, I consider his evidence that researchers’ discretion over research decisions is unavoidable when they follow …

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but …

The value of preregistration for psychological science: A conceptual analysis

For over two centuries researchers have been criticized for using research practices that makes it easier to present data in line with what they wish to be true. With the rise of the internet it has become easier to preregister the theoretical and …

Tie my hands loosely: Pre-analysis plans in political science

In this short article, I want to provide some of my thoughts on these developments from the perspective of someone who writes PAPs and reads them as a reviewer, as well as from the perspective of a journal editor.

Ulysses' pact or Ulysses' raft: Using pre-analysis plans in experimental and nonexperimental research

Economists have recently adopted pre-analysis plans in response to concerns about robustness and transparency in research. The increased use of registered pre-analysis plans has raised competing concerns that detailed plans are costly to create, …

Update on Trial Registration 11 Years after the ICMJE Policy Was Established

Laws and policies to establish a global trial reporting system have greatly increased the transparency and accountability of the clinical research enterprise. The three components of the trial reporting system are trial registration, reporting of …

Using Pre-Analysis Plans in Qualitative Research

In the last decade, there has been a significant push for greater transparency in the social sciences. For example, epistemological and methodological debates have addressed the scope, meaning, and appropriateness of research transparency, and …
JUST-OS