FORRT’s Research, Scholarship & Resources

Peer-reviewed research, tools, data, teaching materials, and policy resources advancing open and reproducible science.


Citation Chart
Details on Google Scholar

This page showcases the diverse scholarly and public-facing outputs produced by FORRT and its community—including peer-reviewed publications, preprints, policy briefs, opinion pieces, interactive apps, datasets, and open-source tools. It reflects our ongoing efforts to contribute to scientific discourse, inform policy, and promote open, inclusive, and transparent research practices. Whether you’re a researcher, educator, or policymaker, this hub provides access to FORRT’s evolving body of work. Dive in to discover, cite, or collaborate.

Filter by Content Type
All Publications Preprints Policy Briefs Op-Eds Teaching Materials Interactive Tools / Apps Data, Code & Packages Working Papers & Ongoing Projects Affiliated Projects

Filter by Research Area
All Areas Meta-Research & Scientific Reform Equity, Diversity & Social Justice Community, Governance & Sustainability Education & Pedagogy

Academic peer-reviewed publications


Publications Meta-Research & Scientific Reform
2026

No room at the inn? The case for dedicated replication journals

Reed, W. R., Röseler, L., Saam, M., & Wallrich, L.
Journal of Behavioral and Experimental Economics Published

Replication is widely recognized as essential for scientific self-correction, yet published replications remain exceedingly rare in both economics and psychology. At the same time, large-scale collaborative replication efforts and growing attention to research transparency have revealed widespread reproducibility failures across empirical research. This article reviews evidence on the scarcity of published replications, examines why traditional journals continue to resist publishing them, and evaluates the “first-best” proposal that journals should publish replications of their own articles. It then surveys alternative models that journals have adopted, such as dedicated replication sections and special replication issues, and considers their limitations in overcoming structural barriers to replication. Because these approaches have not meaningfully expanded the publication of replications, the article argues that dedicated replication journals offer an essential and complementary solution. By providing a stable, credible, and visible home for replication work, these journals supply critical infrastructure for the self-correcting function of science.

Cite:
Reed, W. R., Röseler, L., Saam, M., and Wallrich, L. (2026). No room at the inn? The case for dedicated replication journals. Journal of Behavioral and Experimental Economics, 120, 102502. https://doi.org/10.1016/j.socec.2025.102502
Publications Community, Governance & Sustainability
2025

Mapping Open Science Communities in Psychology: A Systematic Narrative Review

Skubera Magda, Korbmacher Max, Evans Thomas Rhys, Azevedo Flavio and Pennington Charlotte R.
Royal Society Open Science Published

We have written a manuscript, entitled International Initiatives to Enhance Awareness and Uptake of Open Research in Psychology: A Systematic Mapping Review, which outlines the global landscape of Open Science initiatives within psychology. This postprint provides a systematic review of 187 initiatives, categorized into procedural, structural, and community-based changes.

Cite:
Skubera, M., Korbmacher, M., Evans, T. R., Azevedo, F., and Pennington, C. R. (2025). International initiatives to enhance awareness and uptake of open research in psychology: a systematic mapping review. R. Soc. Open Sci., 12, 241726. https://doi.org/10.1098/rsos.241726
Publications Meta-Research & Scientific Reform
2025

A Community Model for Rigorous and Inclusive Scholarship

Röseler, L., Wallrich, L., Adler, S., Oppong Boakye, P., Evans, T. R., Goltermann, J., Haven, T., Horstmann, J., Korbmacher, M., Müller, M., Verheyen, S., Visser, I., & Azevedo, F.
Replication Research Published

Reproducibility and replicability are vital for trustworthy, cumulative research, yet remain undervalued in most areas of academic publishing. Replication Research (R2) is a Diamond Open Access journal dedicated to publishing high-quality reproductions, replications, and related methodological work across disciplines. With robust standards for transparency, open peer review, and social responsibility, R2 offers practical guidance and support for authors. We aim to rebalance research culture by valuing diligence and robustness alongside innovation, thereby increasing confidence in research findings. We invite researchers to contribute to and benefit from an open, community-driven journal designed to elevate the status and impact of replications (repeated studies of published findings with different data) and reproductions (repeated tests of published findings with the same data). In this editorial, we introduce the aims, policies, and scope of Replication Research, outlining how the journal will operate and the values that guide it.

Cite:
Röseler, L., Wallrich, L., Adler, S., Oppong Boakye, P., Evans, T. R., Goltermann, J., Haven, T., Horstmann, J., Korbmacher, M., Müller, M., Verheyen, S., Visser, I., & Azevedo, F. (2025). A Community Model for Rigorous and Inclusive Scholarship: Inaugural Editorial of Replication Research (R2). Replication Research, 1. https://doi.org/10.17879/replicationresearch-2025-9022
Publications Equity, Diversity & Social Justice
2025

Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education

Phan, J. M., Middleton, S. L., Azevedo, F., Iley, B. J., Grose-Hodge, M., Tyler, S. L., Kapp, S. K., Yeung, S. K., Shaw, J. J., Hartmann, H., & FORRT.
Journal of Social Issues Published

Not all people conform to socially constructed norms, nor should they have to. Neurodiversity, the natural variation in human brains and cognition, is fundamental to understanding human behavior, yet neurodivergent individuals in academia are often stigmatized, undervalued, or pressured to mask their differences. This position statement, authored predominantly by neurodivergent scholars, explores how aligning the values of the neurodiversity movement with practices of Open Scholarship (OSch) can foster greater research integrity, rigor, social responsibility and justice, diversity, equity, inclusivity, and accessibility in academia. We review systemic barriers faced by neurodivergent researchers—from disclosure dilemmas and hidden curriculum expectations to intersectional disadvantages—and identify how OSch principles (transparency, accessibility, collaboration) can help mitigate these challenges. Drawing on lived experiences and current research, we propose concrete reforms, including adopting universal design in scholarly communication, promoting participatory research methods, and enacting supportive policies (e.g., flexible work arrangements, inclusive codes of conduct). By leveraging shared values of openness and neuro-inclusion, academia can become more just and epistemically equitable. Our recommendations chart a path toward an academic culture where neurodivergent scholars can thrive openly, to the benefit of scientific rigor and social justice alike.

Cite:
Phan, J. M., et al. (2025). Bridging neurodiversity and open scholarship: How shared values can guide best practices for research integrity, social justice, and principled education. Journal of Social Issues, 81(4), e70035. https://doi.org/10.1111/josi.70035
Publications Equity, Diversity & Social Justice
2024

An annotated introductory reading list for neurodiversity

Mirela Zaneva, Tao Coll-MartĂ­n, Yseult HĂ©jja-Brichard, Tamara Kalandadze, Andrea Kis, Alicja Koperska, Marie Adrienne Robles Manalili, … Alyssa Hillary Zisk
eLife Published

Since its inception, the concept of neurodiversity has been defined in a number of different ways, which can cause confusion among those hoping to educate themselves about the topic. To address such barriers, we present an annotated reading list that was developed collaboratively by a neurodiverse group of researchers.

Cite:
Zaneva, M., et al. (2024). An annotated introductory reading list for neurodiversity. eLife, 13, e102467. https://doi.org/10.7554/eLife.102467
Publications
2024

The Replication Database: Documenting the Replicability of Psychological Science

Röseler, L., Kaiser, L., Doetsch, C., Klett, N., Seida, C., SchĂĽtz, A., Aczel, B., … & Zhang, Y.
Journal of Open Psychology Data Published

We have written a manuscript about documenting and tracking replication efforts. In psychological science, replicability is critical for affirming the validity of scientific findings. Addressing this crucial gap, we present the Replication Database, a novel platform hosting >1,200 original findings paired with replication findings.

Cite:
Röseler, L., et al. (2024). The replication database: Documenting the replicability of psychological science. Journal of Open Psychology Data, 12(8), 1–23. https://doi.org/10.5334/jopd.101
Publications
2023

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes

Pownall, M., Azevedo, F., König, L. M., Slack, H. R., Evans, T. R., Flack, Z., … & FORRT.
Royal Society Open Science Published

In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students’ scientific literacies (i.e. students’ understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students’ attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.

Cite:
Pownall, M., et al. (2023). Teaching open and reproducible scholarship: A critical review of the evidence base for current pedagogical methods and their outcomes. Royal Society Open Science, 10(5), 221255. https://doi.org/10.1098/rsos.221255
Publications
2023

Improvements since the Replication Crisis: The Structural, Procedural, and Community Changes

Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., … & Evans, T.
Communications Psychology Published

We have written a manuscript entitled The replication crisis has led to positive structural, procedural, and community changes. This manuscript reviews how research structures, procedures and communities have changed in response to the replication crisis, showing that the replication ‘crisis’ has been a positive credibility revolution.

Cite:
Korbmacher, M., et al. (2023). The replication crisis has led to positive structural, procedural, and community changes. Communications Psychology, 1, 3. https://doi.org/10.1038/s44271-023-00003-2
Publications
2023

Participatory Research Primer

Gourdon-Kanhukamwe, A., Kalandadze, T., Yeung, S., Azevedo, F., Iley, B. J., Phan, J. M., … Elsherif, M. M.
The Cognitive Psychology Bulletin Published

We have written a manuscript entitled Opening up understanding of neurodiversity: A call for applying participatory and open scholarship practices. This manuscript gives a brief overview of what participatory research methods are and why they are important for promoting neurodiversity in academia.

Cite:
Gourdon-Kanhukamwe, A., et al. (2023). Opening up understanding of neurodiversity: A call for applying participatory and open scholarship practices. The Cognitive Psychology Bulletin, 8, 23-27. https://doi.org/10.53841/bpscog.2023.1.8.23
Publications
2022

FORRT’s Glossary

Parsons, S., Azevedo, F., Elsherif, M. M., Guay, S., Shahim, O. N., Govaart, G. H., … Aczel, B.
Nature Human Behaviour Published

In response to the varied and plural new terminology introduced by the open scholarship movement, we have produced a community and consensus-based Glossary to facilitate education and effective communication. This manuscript presents the beta 0.1 version of our glossary.

Cite:
Parsons, S., et al. (2022). A community-sourced glossary of open scholarship terms. Nature Human Behaviour, 6(3), 312-318. https://doi.org/10.1038/s41562-021-01269-4
Publications
2021

The Role of Pedagogical Communities

Azevedo, F., Liu, M., Pennington, C. R., Pownall, M., Evans, T. R., Parsons, S., … & FORRT.
BMC Research Notes Published

We have written a manuscript entitled Towards a culture of open scholarship: The role of pedagogical communities describing the need to integrate open scholarship principles into research training within higher education.

Cite:
Azevedo, F., et al. (2021). Towards a culture of open scholarship: The role of pedagogical communities. BMC Research Notes, 15(1), 1-5. https://doi.org/10.1186/s13104-022-05944-1
Publications
2021

FORRT’s Lesson Plans

Pownall, M., Azevedo, F., Aldoh, A., Elsherif, M. M., Vasilev, M. R., Pennington, C. R., … Parsons, S.
Scholarship of Teaching and Learning in Psychology Published

We compiled lesson plans and activities, and categorized them based on their theme, learning outcome, and method of delivery, which are made publicly available.

Cite:
Pownall, M., et al. (2021). Embedding open and reproducible science into teaching: A bank of lesson plans and resources. Scholarship of Teaching and Learning in Psychology. https://doi.org/10.1037/stl0000307

Preprints


Preprints
2025

In Pursuit of Citational Justice: A Toolkit for Equitable Scholarship

Sauvé, S. A., Middleton, S. L., Gellersen, H., & Azevedo, F.
MetaArxiv Preprint

This paper unpacks the concept of citation politics and its role in sustaining epistemic hierarchies within scholarly communities. We introduce a comprehensive and openly accessible Citational Justice Toolkit.

Cite:
Sauvé, S. A., Middleton, S. L., Gellersen, H., and Azevedo, F. (2025). In pursuit of citational justice: A toolkit for equitable scholarship. MetaArXiv. https://doi.org/10.31222/osf.io/qjecy_v2
Preprints
2025

Tracking and mainstreaming replications in the social, cognitive, and behavioral sciences

Hartmann H, Azevedo F, Röseler L, Wallrich L, Aldoh A, Elsherif MM, et al.
MetaArXiv Published

Replicability is a cornerstone of scientific progress. Yet, replications are often undervalued, and are sometimes seen as redundant, unimportant, or lacking novelty. This impedes their broader adoption in research and beyond. In response, the credibility revolution calls for slower, more deliberate science and greater responsiveness to fallibility. In this perspective piece, we argue that (a) replications are essential for validating scientific claims, (b) replications need to be made more visible, recognized, and integrated into research and educational practices, and (c) we can change the way we view and judge replication results. We propose a framework where replication studies can be systematically tracked and normalized through the Replication Hub as part of the Framework for Open and Reproducible Research Training (FORRT) initiative, with the goal of enhancing the visibility, integration, and cumulative impact of replication research across disciplines.

Cite:
Hartmann H, Azevedo F, Röseler L, Wallrich L, Aldoh A, Elsherif MM, et al. Tracking and mainstreaming replications in the social, cognitive, and behavioral sciences. MetaArXiv. https://doi.org/10.31222/osf.io/ad2w6_v1
Preprints
2025

How to Develop and Use Open Educational Resources

Azevedo, F., Friedel, E., Ashcroft-Jones, S., Korbmacher, M., Lloyd, K., Mudahera, D. R., Kravesta, A., Resulbegoviq, H., Andreolli, G., Micheli, L., & Silverstein, P.
MetaArxiv Preprint

This chapter explores the critical role of Open Educational Resources (OERs) in advancing open science and promoting educational equity. OERs are freely-available teaching and learning materials that can be reused and adapted, making them powerful tools for democratising access to knowledge. Drawing on principles from critical pedagogy, feminist, and decolonial scholarship, we position OERs not only as cost-saving tools but as instruments of epistemic justice and inclusion. This chapter outlines five foundational principles for OER development—accessibility, inclusivity, collaboration, sustainability, and social justice—and offers a step-by-step framework for creating, implementing, and sustaining high-quality OERs. Case studies are presented to demonstrate participatory and community-driven approaches to OER creation. We also examine common challenges such as structural inequality and linguistic barriers, providing actionable strategies for addressing each. By embedding values of openness, fairness, and co-creation, we show how OERs can help reshape curricula and cultivate more inclusive academic ecosystems.

Cite:
Azevedo, F., Friedel, E., Ashcroft-Jones, S., Korbmacher, M., Lloyd, K., Mudahera, D. R., Kravesta, A., Resulbegoviq, H., Andreolli, G., Micheli, L., & Silverstein, P. (2025, Sept 30). How to Develop and Use Open Educational Resources. In Pennington, C. & Pownall, M. (Eds.), Teaching Open Science. Edward Elgar Publishing.
Preprints
2022

Neurodiversity & Open Scholarship in Academia

Elsherif, M. M., Middleton, S. L., Phan, J. M., Azevedo, F., Iley, B. J., Grose-Hodge, M., … Dokovova, M.
MetaArxiv Preprint

We have written a manuscript entitled Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education explaining that Neurodiversity is fundamental to the understanding of human behaviour and cognition.

Cite:
Elsherif, M. M., et al. (2022). Bridging neurodiversity and open scholarship: How shared values can guide best practices for research integrity, social justice, and principled education. MetaArXiv. https://doi.org/10.31222/osf.io/k7a9p
Preprints
2019

FORRT’s Manifesto

Azevedo, F., Parsons, S., Micheli, L., Strand, J., Rinke, E., … & FORRT
OSF Preprints preprint

We have written a manuscript entitled Introducing a Framework for Open and Reproducible Research Training (FORRT) describing the importance of integrating open scholarship into higher education.

Cite:
Azevedo, F., et al. (2019). Introducing a framework for open and reproducible research training (FORRT). OSF Preprints. https://doi.org/10.31219/osf.io/bnh7p

Op-Eds and Other Media


Op-Eds
2024

Unveiling the Truth in Science

Azevedo, F., Hartmann, H., Röseler, L., Wallrich, L., & Micheli, L.
Official PLOS Blog Op-Ed

For the Official PLoS Blog, on creating a comprehensive, dynamic database cataloging scientific claims and subsequent replication attempts across various disciplines of social, cognitive, and behavioral sciences.

Cite:
Azevedo, F., et al. (2024). Unveiling the truth in science. The Official PLOS Blog. https://theplosblog.plos.org/2024/02/unveiling-the-truth-in-science-the-quest-for-reliable-knowledge/
Op-Eds
2023

Open Scholarship Pedagogical Communities

Azevedo, F.
The Psychologist Op-Ed

For The Psychologist, on open scholarship pedagogical communities.

Cite:
Azevedo, F. (2023). Open scholarship pedagogical communities. The Psychologist. https://www.bps.org.uk/psychologist/open-scholarship-pedagogical-communities
Op-Eds
2023

Letter to UNESCO’s Principles of Open Science Monitoring

FORRT
UNESCO Letter

The Letter to UNESCO’s Principles of Open Science Monitoring.

Cite:
FORRT. (2023). Letter to UNESCO’s Principles of Open Science Monitoring. UNESCO. https://www.unesco.org/education/letter-to-unescos-principles-of-open-science-monitoring
Op-Eds
2022

Navigating Academia as Neurodivergent Researchers

Azevedo, F., Middleton, S., Mai Phan, J., Kapp, S., Gourdon-Kanhukamwe, A., Iley, B., Elsherif, M., & Shaw, J. J.
APS Observer Op-Ed

For the Observer, of the Association for Psychological Science, on Navigating Academia as Neurodivergent Researchers.

Cite:
Azevedo, F., et al. (2022). Navigating academia as neurodivergent researchers: Promoting neurodiversity within open scholarship. APS Observer. https://www.psychologicalscience.org/observer/gs-navigating-academia-as-neurodivergent-researchers
Op-Eds
2022

What is ‘Open Science’? And why does it need a glossary?

Azevedo, F., Baum, M., Hartmann, H., Micheli, L., Spitzer, L., & Wingen, T.
In-Mind Magazine Op-Ed

For In-Mind Magazine, on What is Open Science and Why Does It Need a Glossary.

Cite:
Azevedo, F., et al. (2022). What is ‘Open Science’? And why does it need a glossary? In-Mind Magazine. https://de.in-mind.org/blog/post/was-ist-offene-wissenschaft-und-warum-braucht-sie-ein-woerterbuch
Op-Eds
2022

Educating in the Open Scholarship Era

Azevedo, F.
Center for Open Science Blog Op-Ed

For the Center of Open Science Blog, on Integrating Open and Reproducible Science Principles into Higher Education.

Cite:
Azevedo, F. (2022). Educating in the open scholarship era. Center for Open Science (COS). https://www.cos.io/blog/educating-in-the-open-scholarship-eara

Policy Briefs


Policy Briefs
2023

Open Scholarship in QAA Briefing

Azevedo, F., DeBruine, L., Evans, T. R.
QAA / UKRN Policy Brief

FORRT was asked by the UK’s Quality Assurance Agency for Higher Education (QAA) to produce a short briefing note in collaboration with the UK Reproducibility Network (UKRN).

Cite:
Azevedo, F., DeBruine, L., and Evans, T. R. (2023). Open scholarship in QAA briefing. QAA/UKRN. https://www.qaa.ac.uk/forrt-open-scholarship-in-qaa-briefing
Policy Briefs
2021

Building Community (UK Parliament)

Azevedo, F., Liu, M., Pennington, C. R., … & FORRT.
UK Parliament Science & Technology Policy Brief

FORRT responded to the call from the UK House of Commons Science and Technology Committee for evidence on reproducibility and research integrity.

Cite:
Azevedo, F., et al. (2021). Towards a culture of open scholarship: The role of pedagogical communities. UK Parliament Science & Technology Committee, Report No. RRE0080. https://www.parliament.uk/documents/science-and-technology-committee/2021-22/21-22-0080/
Policy Briefs
2020

Briefing Note for Degree Accrediting Societies

Parsons, S., Azevedo, F., & FORRT
UKRN / BPS Policy Brief

We have written to UKRN (UK’s Reproducibility Network) and the British Psychological Society (BPS) a short note on our organization and goals.

Cite:
Parsons, S., Azevedo, F., and FORRT (2020). Briefing note for degree accrediting societies. Framework for Open and Reproducible Research Training. https://forrt.org/

FORRT affiliated projects


Affiliated Projects
2025

A scoping review on metrics to quantify reproducibility

Heyard Rachel, Pawel Samuel, Frese Joris, … and Zellers Stephanie
Royal Society Open Science Published

Since no standardized approach to measuring reproducibility exists, a diverse set of metrics has emerged and a comprehensive overview is needed. We conducted a scoping review to identify large-scale replication projects that used metrics and methodological papers that proposed or discussed metrics.

Cite:
Heyard, R., et al. (2025). A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics. R. Soc. Open Sci., 12, 242076. https://doi.org/10.1098/rsos.242076
Affiliated Projects
2024

The Potential of Preregistration in Psychology

van den Akker, O. R., Bakker, M., van Assen, M. A. L. M., … Wicherts, J. M.
Psychological Methods Published

We used an extensive protocol to assess the producibility of preregistrations and the consistency between preregistrations and their corresponding papers for 300 psychology studies.

Cite:
van den Akker, O. R., et al. (2024). The potential of preregistration in psychology: Assessing preregistration producibility and preregistration-study consistency. Psychological Methods. https://doi.org/10.1037/met0000687
Affiliated Projects
2024

Towards FAIRification of learning resources and catalogues—lessons learnt from research communities

Provost, L., Bezuidenhout, L., Venkataraman, S., van der Lek, I., van Gelder, C., Kuchma, I., Leenarts, E., Azevedo, F., Brvar, I. V., Paladin, L., Clare, H., and Braukmann, R.
Frontiers in Education Published

Since the introduction of the FAIR (Findable, Accessible, Interoperable and Reusable) data principles in 2016, discussions have evolved beyond the original focus on research data to include learning resources. In 2020, a set of simple rules to FAIRify learning resources was proposed, building on existing expertise within the training community. Disciplinary communities have played an important role in advancing FAIR principles for learning resources, although they have approached FAIRification activities in different ways. These communities range from volunteer-led to funded and independent organisations, however commonly include activities such as organising training and capacity building, and coordinated discussions on disciplinary-focused FAIR best practices and standards.

Cite:
Provost, L., Bezuidenhout, L., Venkataraman, S., van der Lek, I., van Gelder, C., Kuchma, I., Leenarts, E., Azevedo, F., Brvar, I. V., Paladin, L., Clare, H., and Braukmann, R. (2024). Towards FAIRification of learning resources and catalogues—lessons learnt from research communities. Frontiers in Education, 9, 1390444. https://doi.org/10.3389/feduc.2024.1390444

Work in Progress


Working Papers & Ongoing Projects
In Prep

Open Social Psychology

Rahal, R.-M.
Open Educational Resource Work in Progress

Social psychology is built on a strong set of classical research paradigms and findings… This book is dedicated to tracing some of these changes, and to offering a version of record of the changing perceptions and interpretations of classic social psychology.

Cite:
Rahal, R.-M. (in preparation). Open Social Psychology. https://forrt.org/open-social-psychology/

Find More About Ongoing Projects


We are currently preparing additional manuscripts on a range of topics. To find out more about what we're working on and how you can contribute, visit our Get Involved page.

Stay updated

Subscribe to our newsletter from FORRT to get the latest news about our initiatives.

JUST-OS Open in new tab