Love Replications Week — March 2-6
Join us for daily online Brown Bag Lunch talks. Scroll down to see the full program.
WHAT IS THE LOVE REPLICATIONS WEEK?
In the Love Replications Week, you can learn how to do reproduction and replication studies yourself, submit your own local or virtual events, and show your love for replications — regardless of the type of research that you do!
Why is that important?
A central feature of research is that others should be able to repeat the procedure and arrive at the same conclusions. In practice, this can be a reproduction - repeating a test using the same data - or a replication - repeating a test with different data. Historically, these repetitions have been deemed important but rarely conducted, leading to problems of repeatability in many areas across the social sciences, digital humanities, linguistics, and natural sciences.
How can I contribute?
Register for the core program below. To submit your own events, please reach out to lukas.roeseler[at]uni-muenster[dot]de.
Core Program: Lunch Talks
Each day, there will be a 15 minutes online presentation on a specific topic, followed by 15 minutes for Q&A. To receive the Zoom link for these daily talks, please register here.
| Date (CET) | Presenter | Name | Topic |
|---|---|---|---|
| March 2, 1:00 pm |  |
Lenka Fiala | Reproducibility Study Speedrun |
| March 3, 1:00 pm CET |  |
Daniel Nüst | How to get your reproducibility certificate with CODECHECK |
| March 4, 1:00 pm CET |  |
Lukas Wallrich | How to find a replication target |
| March 5, 1:00 pm CET |  |
Lukas Röseler | Getting your replication report ready for submission |
| March 6, 1:00 pm CET |  |
Susanne Adler | Cooperation with Students to Conduct Replication Studies |
Full Program with Abstracts
Monday, March 2nd
- Reproducibility Study Speedrun by Lenka Fiala (1:00 - 1:30 pm CET, online), registration required
To investigate the transparency, correctness, and generalizability of a study, researcher can attempt to reproduce the results. Participants will be guided through an example reproduction study. - Multiverse Analysis for Reporting Robustness to Analytical Flexibility by Cassie Short (3:00 - 3:45 pm CET, online), registration required
Multiverse analysis is a comprehensive and systematic approach to reporting the robustness of results across the defensible “garden of forking paths.” It does so by systematically specifying and computing all defensible combinations of analytic decisions applied to a single dataset, and reporting the result obtained from each. By explicitly acknowledging analytical uncertainty, multiverse analysis increases transparency and reduces the risk of overstating robustness and reproducibility.
Tuesday, March 3rd
- Conducting Computational Reproductions: A Guide for Teachers and Students by Nate Breznau (11:15 am - 12:00 CET, online), registration required
How to engage in a computational replication of pre-existing results? Provides reasons for doing the computational reproduction, reasonable expectations to have, reasons to adjust or expand the reproduction into a re-analysis, a reasonable timeline, tips for engaging with the original authors and how to publish results. - How to get your reproducibility certificate with CODECHECK by Daniel Nüst (1:00 - 1:30 pm CET, online), registration required
CODECHECK *provides an approach for independent execution of computations underlying research articles. During the publication process, one reviewer - the codechecker - certifies that they was able to execute relevant parts of a computational workflow. This certificate becomes part of the public record.
Wednesday, March 4th
- How to find a replication target by Lukas Wallrich (1:00 - 1:30 pm CET, online), registration required
Most published studies have not been subject to replication attempts yet and given limited resources for replication research, we need to priotize what to replicate (first). This walk will run participant through several criteria that can help researchers choosing what to replicate.
- Replication Journal Showcase by Thomas Evans, Etienne Roesch, Alexandra Sarafoglou, Marianne Saam, Lukas Röseler (4:00 - 5:00 pm CET, online), registration required
*Learn about academic journals that have a strong focus on reproduction and replication studies. Members of the respective editorial boards will present Rescience C, Rescience X, the Journal of Comments and Replications in Economics, the Journal of Robustness Reports, the Journal of Open Psychology Data, and Replication Research.
Thursday, March 5th
- Getting your replication report ready for submission by Lukas Röseler (1:00 - 1:30 pm CET, online), registration required
Reports of reproduction or replication studies are fundamentally different from traditional articles in that there is always a predecessor or target study. To facilitate transparent and comprehensive reporting, participants will learn about manuscript templates and examples of best practices for reporting replications and reproductions. - Getting started: Writing reproducible manuscripts using R Markdown by Maren Klingelhöfer-Jens (4:00 - 5:00 pm CET, online), registration required
This introductory session provides an overview of the basics of R Markdown, including how to create, format, and render documents, as well as integrate code, data, figures, tables, and references. In addition, participants will be guided through specific R Markdown templates that can be used to create APA-compliant, publication-ready manuscripts. Some prior knowledge of R programming will be helpful for following this session.
Friday, March 6th
- Cooperation with students to conduct replication studies by Susanne Adler (1:00 - 1:30 pm CET, online), registration required
Replication studies are a superb way to train (under-)graduate students in research methods. The thorough evaluation of the original study, the use of contemporary statistical methods, and practical applications of preregistration and data management provide students with a profound understanding of empirical research. The acquired skills do not just shape how future scientists and practitioners approach research, but the gathered evidence also contributes to strengthening a research field’s knowledge base. This talk outlines how state-of-the-art replication studies can be integrated into a seminar, what to look out for as a lecturer during these seminars, and describes an example study.
Partners
Organizers
