Replicability

Definition: An umbrella term, used differently across fields, covering concepts of: direct and conceptual replication, computational reproducibility/replicability, generalizability analysis and robustness analyses. Some of the definitions used previously include: a different team arriving at the same results using the original author’s artifacts (Barba 2018); a study arriving at the same conclusion after collecting new data (Claerbout and Karrenbach, 1992); as well as studies for which any outcome would be considered diagnostic evidence about a claim from prior research (Nosek & Errington, 2020).

Related terms: Conceptual replication, Direct Replication, Generalizability, Reproducibility, Reliability, Robustness (analyses)

References: Barba (2018), CrĂŒwell et al. (2019), King (1996), National Academies of Sciences et al. (2011), & Nosek and Errington (2020)

Drafted and Reviewed by: Mahmoud Elsherif, Jamie P. Cockcroft, Adrien Fillon, Gilad Feldman, Annalise A. LaPlume, Tina B. Lonsdorf, Sam Parsons, Eike Mark Rinke, Tobias Wingen

We are currently working to link the references directly. For now, the complete reference list can be viewed here.