Love Replications Week — March 2-6

Join us for daily online Brown Bag Lunch talks. Scroll down to see the full program.

WHAT IS THE LOVE REPLICATIONS WEEK?

In the Love Replications Week, you can learn how to do reproduction and replication studies yourself, submit your own local or virtual events, and show your love for replications — regardless of the type of research that you do!

Why is that important?

A central feature of research is that others should be able to repeat the procedure and arrive at the same conclusions. In practice, this can be a reproduction - repeating a test using the same data - or a replication - repeating a test with different data. Historically, these repetitions have been deemed important but rarely conducted, leading to problems of repeatability in many areas across the social sciences, digital humanities, linguistics, and natural sciences.

How can I contribute?

Register for the core program below. To submit your own events, please reach out to lukas.roeseler[at]uni-muenster[dot]de.

Core Program: Lunch Talks

Each day, there will be a 15 minutes online presentation on a specific topic, followed by 15 minutes for Q&A. To receive the Zoom link for these daily talks, please register here.

Date (CET) Presenter Name Topic
March 2, 1:00 pm Lenka Fiala Reproducibility Study Speedrun
March 3, 1:00 pm CET Daniel Nüst How to get your reproducibility certificate with CODECHECK
March 4, 1:00 pm CET Lukas Wallrich How to find a replication target
March 5, 1:00 pm CET Lukas Röseler Getting your replication report ready for submission
March 6, 1:00 pm CET Susanne Adler Cooperation with Students to Conduct Replication Studies

Full Program with Abstracts

Monday, March 2nd

  • Reproducibility in the language sciences: What, why and how by Elen Le Foll and Mara van der Ploeg (10:00 - 11:30 am, online), registration required

  • Reproducibility Study Speedrun by Lenka Fiala (1:00 - 1:30 pm CET, online), registration required
    To investigate the transparency, correctness, and generalizability of a study, researcher can attempt to reproduce the results. Participants will be guided through an example reproduction study.

  • Multiverse Analysis for Reporting Robustness to Analytical Flexibility by Cassie Short (3:00 - 3:45 pm CET, online), registration required

    Multiverse analysis is a comprehensive and systematic approach to reporting the robustness of results across the defensible “garden of forking paths.” It does so by systematically specifying and computing all defensible combinations of analytic decisions applied to a single dataset, and reporting the result obtained from each. By explicitly acknowledging analytical uncertainty, multiverse analysis increases transparency and reduces the risk of overstating robustness and reproducibility.

Tuesday, March 3rd

  • The ReproCheck project – Supporting economics journals with data policies and reproducibility checks by Marianne Saam and Sven Vlaeminck (10:15 - 11:00 am CET, online), no registration required [Zoom link]
    The ZBW – Leibniz Information Centre for Economics hosts the Journal Data Archive, a service for journals. Since 2025, the archive is developing a pilot service that aims at supporting journals with upgrading data policies and introducing reproducibility checks. The project is funded by Volkswagen Foundation. We will present the project approach and first experiences.
  • Conducting Computational Reproductions: A Guide for Teachers and Students by Nate Breznau (11:15 am - 12:00 CET, online), registration required
    How to engage in a computational replication of pre-existing results? Provides reasons for doing the computational reproduction, reasonable expectations to have, reasons to adjust or expand the reproduction into a re-analysis, a reasonable timeline, tips for engaging with the original authors and how to publish results.
  • How to get your reproducibility certificate with CODECHECK by Daniel Nüst (1:00 - 1:30 pm CET, online), registration required
    CODECHECK *provides an approach for independent execution of computations underlying research articles. During the publication process, one reviewer - the codechecker - certifies that they was able to execute relevant parts of a computational workflow. This certificate becomes part of the public record.

Wednesday, March 4th

Thursday, March 5th

  • Getting your replication report ready for submission by Lukas Röseler (1:00 - 1:30 pm CET, online), registration required

    Reports of reproduction or replication studies are fundamentally different from traditional articles in that there is always a predecessor or target study. To facilitate transparent and comprehensive reporting, participants will learn about manuscript templates and examples of best practices for reporting replications and reproductions.

  • Large scale replications vs. Meta-analyses: Lessons learned in developmental science by Christina Bergmann (2:30 - 3:30 pm CET, online), registration required
    In developmental science, we typically test small samples of a very noisy population, so both meta-analyses and replications seem like a logical answer to the question, how robust results really are. But what can we learn from each and how do both fare when combined?

  • Getting started: Writing reproducible manuscripts using R Markdown by Maren Klingelhöfer-Jens (4:00 - 5:00 pm CET, online), registration required

    This introductory session provides an overview of the basics of R Markdown, including how to create, format, and render documents, as well as integrate code, data, figures, tables, and references. In addition, participants will be guided through specific R Markdown templates that can be used to create APA-compliant, publication-ready manuscripts. Some prior knowledge of R programming will be helpful for following this session.

Friday, March 6th

  • Cooperation with students to conduct replication studies by Susanne Adler (1:00 - 1:30 pm CET, online), registration required

    Replication studies are a superb way to train (under-)graduate students in research methods. The thorough evaluation of the original study, the use of contemporary statistical methods, and practical applications of preregistration and data management provide students with a profound understanding of empirical research. The acquired skills do not just shape how future scientists and practitioners approach research, but the gathered evidence also contributes to strengthening a research field’s knowledge base. This talk outlines how state-of-the-art replication studies can be integrated into a seminar, what to look out for as a lecturer during these seminars, and describes an example study.

  • Workshop: Promoting Robust Science Through Reanalyses by Nina Ehmann and Alexandra Sarafoglou (1:30 - 3:00 pm CET, online), no registration required, join directly here
    In published empirical studies, it often remains unclear to what extent the conclusions depend on the chosen analysis pipeline. To address this, we founded the Journal of Robustness Reports (JRR), a diamond open-access journal that publishes concise re-analyses of potentially impactful empirical findings. In this workshop, participants will re-analyze a published study and begin drafting a Robustness Report that they can later submit to the journal.

Partners

Organizers