Replication Crisis

 

A reading list for the Replicability Crisis

This is a partial reading list meant to be shared with those just learning about the replication crisis. Entries will be added over time.

Growth from uncertainty: understanding the replication 'crisis' in infant psychology

Psychology is a discipline that has a high number of failed replications, which has been characterised as a ‘crisis’ on the assumption that failed replications are indicative of untrustworthy research. This paper uses Chang’s concept of epistemic …

Multi-Site Replications in Social Psychology: Reflections, Implications, and Future Directions

Social psychology findings have fared poorly in multi-site replication attempts. This article considers and evaluates multiple factors that may contribute to such failures, other than the “crisis” assumption that most of the field’s published …

Open science, the replication crisis, and environmental public health

Concerns about a crisis of mass irreplicability across scientific fields (“the replication crisis”) have stimulated a movement for open science, encouraging or even requiring researchers to publish their raw data and analysis code. Recently, a rule …

Type I Error Rates are Not Usually Inflated

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high …

How to Produce, Identify, and Motivate Robust Psychological Science: A Roadmap and a Response to Vize et al.

Some wish to mandate preregistration as a response to the replication crisis, while I and others caution that such mandates inadvertently cause harm and distract from more critical reforms. In this article, after briefly critiquing a recently …

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent …

Getting ontologically serious about the replication crisis in psychology.

Discussions of the so-called replication crisis (RC) in psychology have focused on methodological–epistemological considerations. In this article, I follow a speculative approach within analytic philosophy to focus on ontological considerations, as …

Questionable Metascience Practices

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned …

The replication crisis is less of a “crisis” in Lakatos’ philosophy of science than it is in Popper’s

Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a philosophical basis for the ensuing science reform movement. However, adherence to Popper’s approach may also be at …
JUST-OS