Replication Research

 

Scientific apophenia in strategic management research: Significance tests & mistaken inference

This article uses distributional matching and posterior predictive checks to estimate the extent of false and inflated findings in empirical research on strategic management. Based on a sample of 300 papers in top outlets for research on strategic …

Scientific Utopia II. Restructuring incentives and practices to promote truth over publishability.

An academic scientist’s professional success depends on publishing. Publishing norms emphasize novel, positive results. As such, disciplinary incentives encourage design, analysis, and reporting decisions that elicit positive results and ignore …

Scientific Utopia: I. Opening Scientific Communication

Existing norms for scientific communication are rooted in anachronistic practices of bygone eras making them needlessly inefficient. We outline a path that moves away from the existing model of scientific communication to improve the efficiency in …

Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science

A paper about social, behavioural economic perspective on reproducible science

Sources of nonreplicability in aging ethnoracial health disparities research

The older adult population in the U.S. is becoming increasingly diverse across a constellation of factors including ethnoracial group, socioeconomic status, and immigration status. However, our understanding of the consequences of this diversity for …

Star wars: The empirics strike back

Using 50,000 tests published in the AER, JPE, and QJE, we identify a residual in the distribution of tests that cannot be explained solely by journals favoring rejection of the null hypothesis. We observe a two-humped camel shape with missing …

Statistical Procedures and the Justification of Knowledge in Psychological Science

Justification, in the vernacular language of philosophy of science, refers to the evaluation, defense, and confirmation of claims of truth. In this article, we examine some aspects of the rhetoric of justification, which in part draws on statistical …

Stereotype threat

A podcast about stereotype threat and replication

Teaching replication

Replication is held as the gold standard for ensuring the reliability of published scientific literature. But conducting direct replications is expensive, time-consuming, and unrewarded under current publication practices. So who will do them? Our …

Teaching Replication to Graduate Students

Replicating published studies promotes active learning of quantitative research skills. Drawing on experiences from a replication course, we provide practical tips and reflections for teachers who consider incorporating replication in their courses. …
JUST-OS