Replication Markets

Definition: A replication market is an environment where users bet on the replicability of certain effects. Forecasters are incentivized to make accurate predictions and the top successful forecasters receive monetary compensation or contributorship for their bets. The rationale behind a replication market is that it leverages the collective wisdom of the scientific community to predict which effect will most likely replicate, thus encouraging researchers to channel their limited resources to replicating these effects.

Related terms: Citizen science, Crowdsourcing, Replicability, Reproducibility

References: Liu et al. (2020), Tierney et al. (2020), Tierney et al. (2021), &

Drafted and Reviewed by: Ali H. Al-Hoorie, Mahmoud Elsherif, Leticia Micheli, Sam Parsons

Note that we are currently working on an automated mechanism to link references cited above with their full-length version that can be found at with all references used so far.