Many Labs

Definition: A crowdsourcing initiative led by the Open Science Collaboration (2015) whereby several hundred separate research groups from various universities run replication studies of published effects. This initiative is also known as “Many Labs I” and was subsequently followed by a “Many Labs II” project that assessed variation in replication results across samples and settings. Similar projects include ManyBabies, EEGManyLabs, and the Psychological Science Accelerator.

Related terms: Collaboration, Many analysts, Many Labs I, Many Labs II, Open Science Collaboration, Replication

References: Ebersole et al. (2016), Frank et al. (2017), Klein et al. (2014), Klein et al. (2018), Moshontz et al. (2018), Open Science Collaboration (2015), & Pavlov et al. (2020)

Drafted and Reviewed by: Sam Parsons, Helena Hartmann, Charlotte R. Pennington, Mirela Zaneva

Note that we are currently working on an automated mechanism to link references cited above with their full-length version that can be found at with all references used so far.