Reproducibility and Replicability Knowledge

 

When is science (un)reliable?

In this course, we will explore the so‐called “reproducibility crisis” that has struck fields from psychology and economics to ecology and cancer biology. You will learn statistical principles at the heart of the reproducibility crisis, how disregard …

Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011).

Does psi exist? D. J. Bem (2011) conducted 9 studies with over 1,000 participants in an attempt to demonstrate that future events retroactively affect people's responses. Here we discuss several limitations of Bem's experiments on psi; in particular, …

With Low Power Comes Low Credibility? Toward a Principled Critique of Results From Underpowered Tests

Researchers should be motivated to adequately power statistical tests because tests with low power have a low probability of detecting true effects. However, it is also often claimed that significant results obtained by underpowered tests are less …

Computational social science is growing up: why puberty consists of embracing measurement validation, theory development, and open science practices

Puberty is a phase in which individuals often test the boundaries of themselves and surrounding others and further define their identity – and thus their uniqueness compared to other individuals. Similarly, as Computational Social Science (CSS) grows …

Credible science course

Methods for efficient, reliable, and reproducible science This course is designed to bolster the work of early-career scientists, including first year graduate students, by providing them with guidance to create a precise and personalized pipeline …

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

Background and objective: Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health …

Managing Qualitative Social Science Data

A website with modules and lessons on qualitative research and data management

Open and Reproducible Science Syllabus

To provide educators with an example of how they can draw resources from FORRT’s educational nexus to integrate open scholarship into their teaching, FORRT has developed an Open and Reproducible Science 101 syllabus. FORRT’s syllabus was developed …

Opening open science to all: Demystifying reproducibility and transparency practices in linguistic research

In recent years, numerous fields of research have seen a push for increased reproducibility and transparency practices. As a result, specific transparency practices have emerged, such as open access publishing, preregistration, sharing data, …

p-Hacking: Its Costs and When It Is Warranted

p-Hacking, the use of analytic techniques that may lead to distorted research results, is widely condemned on epistemic and practical grounds. The prevalent position on this questionable research practice is that p-hacking should be avoided because …
JUST-OS