Replication Crisis

Multi-Site Replications in Social Psychology: Reflections, Implications, and Future Directions

Social psychology findings have fared poorly in multi-site replication attempts. This article considers and evaluates multiple factors that may contribute to such failures, other than the “crisis” assumption that most of the field’s published …

Open science, the replication crisis, and environmental public health

Concerns about a crisis of mass irreplicability across scientific fields (“the replication crisis”) have stimulated a movement for open science, encouraging or even requiring researchers to publish their raw data and analysis code. Recently, a rule …

Preregistration of Modeling Exercises May Not Be Useful

This is a commentary on Lee et al.’s (2019) article encouraging preregistration of model development, fitting, and evaluation. While we are in general agreement with Lee et al.’s characterization of the modeling process, we disagree on whether …

Questionable Metascience Practices

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned …

The Problem of New Evidence: P-Hacking and Pre-Analysis Plans

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but …

The psychological reality of the learned “p < .05” boundary

The .05 boundary within Null Hypothesis Statistical Testing (NHST) “has made a lot of people very angry and been widely regarded as a bad move” (to quote Douglas Adams). Here, we move past meta-scientific arguments and ask an empirical question: What …

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent …

The replication crisis is less of a “crisis” in Lakatos’ philosophy of science than it is in Popper’s

Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a philosophical basis for the ensuing science reform movement. However, adherence to Popper’s approach may also be at …

The replication crisis is less of a “crisis” in the Lakatosian approach than it is in the Popperian and naïve methodological falsificationism approaches

Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a philosophical basis for the ensuing science reform movement. However, adherence to Popper’s approach may also be at …

The Tone Debate: Knowledge, Self, and Social Order

In the replication crisis in psychology, a “tone debate” has developed. It concerns the question of how to conduct scientific debate effectively and ethically. How should scientists give critique without unnecessarily damaging relations? The …