P-Hacking

Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices

Recent research in psychology has highlighted a number of replication problems in the discipline, with publication bias – the preference for publishing original and positive results, and a resistance to publishing negative results and replications- …

Do Pre-Registration and Pre-Analysis Plans Reduce p-Hacking and Publication Bias?

Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-registration and pre-analysis plans (PAPs) promoted as important in ensuring the credibility of findings. We investigate whether these tools reduce the extent of …

Does preregistration improve the credibility of research findings?

Preregistration entails researchers registering their planned research hypotheses, methods, and analyses in a time-stamped document before they undertake their data collection and analyses. This document is then made available with the published …

Mitigating Illusory Results through Preregistration in Education

Like performance-enhancing drugs inflating apparent athletic achievements, several common social science practices contribute to the production of illusory results. In this article, we examine the processes that lead to illusory findings and describe …

Opinion: Promoting open science

Many scientific fields are facing a reproducibility crisis, revealed where replication fails to reproduce findings from previous work. This irreproducibility leads to the promulgation of inappropriate evidence.

p-Hacking: Its Costs and When It Is Warranted

p-Hacking, the use of analytic techniques that may lead to distorted research results, is widely condemned on epistemic and practical grounds. The prevalent position on this questionable research practice is that p-hacking should be avoided because …

Preregistration Does Not Improve the Transparent Evaluation of Severity in Popper’s Philosophy of Science or When Deviations are Allowed

One justification for preregistering research hypotheses, methods, and analyses is that it improves the transparent evaluation of the severity of hypothesis tests. In this article, I consider two cases in which preregistration does not improve this …

Preregistration of Machine Learning Research

It is interesting to note that human intelligence thrives on what Peirce called abductive inferences (Peirce and Turrisi 1997, 241-56), which are neither inductive nor deductive. Abductive inferencing basically entails an informed guess as to the …

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but …