Definition: An umbrella term, used differently across fields, covering concepts of: direct and conceptual replication, computational reproducibility/replicability, generalizability analysis and robustness analyses. Some of the definitions used previously include: a different team arriving at the same results using the original author’s artifacts (Barba 2018); a study arriving at the same conclusion after collecting new data (Claerbout and Karrenbach, 1992); as well as studies for which any outcome would be considered diagnostic evidence about a claim from prior research (Nosek & Errington, 2020).

Related terms: Conceptual replication, Direct Replication, Generalizability, Reliability, Reproducibility, Robustness (analyses)

References: Barba (2018), Crüwell et al. (2019), King (1996), National Academies of Sciences et al. (2011), & Nosek and Errington (2020)

Drafted and Reviewed by: Mahmoud Elsherif, Jamie P. Cockcroft, Adrien Fillon, Gilad Feldman, Annalise A. LaPlume, Tina B. Lonsdorf, Sam Parsons, Eike Mark Rinke, Tobias Wingen

Note that we are currently working on an automated mechanism to link references cited above with their full-length version that can be found at with all references used so far.