Welcome to the FORRT Replication Hub! This is a collection of research projects, services, and resources surrounding replication research maintained by FORRT and the Münster Center for Open Science.

Summary

In the social, cognitive, and behavioral sciences, replication studies, that is, the repeated execution of studies with new data, have gained importance over the last decade. Our vision is for the Replication Hub to serve as a nexus for interdisciplinary replication research.

Publications

• Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., … & Evans, T. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1(1), 3. https://doi.org/10.1038/s44271-023-00003-2

• Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., Albayrak-Aydemir, N., Aldoh, A., Al-Hoorie, A. H., Azevedo, F., Baker, B. J., Barth, C. L., Beitner, J., Brick, C., Brohmer, H., Chandrashekar, S. P., Chung, K. L., Cockcroft, J. P., Cummins, J., Diveica, V., Dumbalska, T., Efendic, E., Elsherif, M., Evans, T., Feldman, G., Fillon, A., Förster, N., Frese, J., Genschow, O., Giannouli, V., Gjoneska, B., Gnambs, T., Gourdon-Kanhukamwe, A., Graham, C. J., Hartmann, H., Haviva, C., Herderich, A., Hilbert, L. P., Holgado, D., Hussey, I., Ilchovska, Z. G., Kalandadze, T., Karhulahti, V.-M., Kasseckert, L., Klingelhöfer-Jens, M., Koppold, A., Korbmacher, M., Kulke, L., Kuper, N., LaPlume, A., Leech, G., Lohkamp, F., Lou, N. M., Lynott, D., Maier, M., Meier, M., Montefinese, M., Moreau, D., Mrkva, K., Nemcova, M., Oomen, D., Packheiser, J., Pandey, S., Papenmeier, F., Paruzel-Czachura, M., Pavlov, Y. G., Pavlović, Z., Pennington, C. R., Pittelkow, M.-M., Plomp, W., Plonski, P. E., Pronizius, E., Pua, A. A., Pypno-Blajda, K., Rausch, M., Rebholz, T. R., Richert, E., Röer, J. P., Ross, R., Schmidt, K., Skvortsova, A., Sperl, M. F. J., Tan, A. W. M., Thürmer, J. L., Tołopiło, A., Vanpaemel, W., Vaughn, L. A., Verheyen, S., Wallrich, L., Weber, L., Wolska, J. K., Zaneva, M., & Zhang, Y. (2024). The Replication Database: Documenting the Replicability of Psychological Science. Journal of Open Psychology Data, 12(8), 1–23. https://doi.org/10.5334/jopd.101

Pre-Prints

• Röseler, L., Gendlina, T., Krapp, J., Labusch, N., & Schütz, A. (2022). Successes and Failures of Replications: A Meta-Analysis of Independent Replication Studies Based on the OSF Registries. https://dx.doi.org/10.31219/osf.io/8psw2

Projects

• FORRT’s Replications and Reversals is a crowdsourced list of studies that have been replicated, not replicated, or reversed (i.e., replication results were the opposite of original results) for pedagogical purposes. It stopped updating in late 2023 as it was merged into FReD.
• FORRT’s Replication Database (FReD) is a community-augmented, quantitative, meta-analytical interface of one of the most comprehensive collections of original and replication findings, including Replications and Reversals and large scale projects such as Many Labs or Registered Replication Reports. Via ReD, students, researchers, and applicants can create summaries of replication findings, search replications, investigate correlates of replicability, and automatically check for replications in reference lists.

Partner Projects

• The Collaborative Replication and Education Project (CREP) is an initiative designed to organize and structure replication efforts of highly-cited empirical studies in psychology to satisfy the dual needs for more high-quality direct replications and more training in empirical research techniques for psychology students. CREP aims to address the need for replications of highly cited studies, and to provide training, support and professional growth opportunities for academics completing replication projects.
• The Institute for Replication (I4R) organizes replication games to conduct replications and reproductions. It provides replication and teaching resources and helps researchers disseminate and publish replications and reproductions.
• The Center for Open Science’s projects to Systematizing Confidence in Open Research and Evidence (SCORE) include prediction markets, machine-learning, and replication efforts.
• The project Improving Reproducibility in Science (iRise) identifies, tracks, and evaluates discipline-wide open science interventions and develops tools to improve reproducibility.
• The Replication Wiki provides teaching resource for replication research and a database with reproductions and replications from the social sciences (particularly economics).

Support Us

https://opencollective.com/forrt

Searching Replications

FORRT Replication Database (FReD)

FORRT’s Replication Database is a community-augmented, quantitative, meta-analytical interface of one of the most comprehensive collections of original and replication findings, including FORRT’s original Replications and Reversals project, the Replication Database, and large scale projects such as Many Labs or Registered Replication Reports. Via FReD, students, researchers, educators, and practitioners can create summaries of replication findings, search replications, investigate correlates of replicability, and automatically check for replications in uploadable reference lists.

References Annotator

Do you have a list of references and want to check, which of them have been subject to replication attempts? We have you covered: Copy your list into the FReD References Annotator. The algorithm will search for each entry in the FORRT Replication Database and return all linked replication findings. Of course it could be that some replication findings are not yet listed in our database. If you notice that is the case, please submit that study to the database.

Replications and Reversals (legacy)

FORRT’s Replications and Reversals is a crowdsourced list of studies that have been replicated, not replicated, or reversed (i.e., replication results were the opposite of original results) for pedagogical purposes. You can browse it here. Please note that the project is now part of the FORRT Replication Database. Thus, this project has not been updated since late 2023 and will stay frozen for now.

List of Large-Scale Replication Projects

Here you can find a list of completed and ongoing projects that summarize replication efforts throughout sciences and humanities.