Reproducibility and Replicability Knowledge

Best practices in data analysis and sharing in neuroimaging using MRI

Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results reporting, and algorithm and data sharing to promote transparency, reliability and collaboration. We describe insights …

Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science.

In recent years, a robust movement has emerged within psychology to increase the evidentiary value of our science. This movement, which has analogs throughout the empirical sciences, is broad and diverse, but its primary emphasis has been on the …

Big team science initiatives: A catalyst for trustworthy advancements in IO psychology

Keener et al. (2023) raise concerns about the trustworthiness of Industrial/Organizational (IO) Psychology research and related fields due to the low reproducibility and replicability of research findings. The authors provide various solutions to …

Bite-Size Science and Its Undesired Side Effects

Short and rapid publication of research findings has many advantages. However, there is another side of the coin that needs careful consideration. We argue that the most dangerous aspect of a shift toward “bite-size” publishing is the relationship …

Boas práticas em ciência

Reprodutibilidade e replicabilidade de estudos científicos. Randomização, cegamento, planejamento amostral e pré-registro de projeto. Diferença entre estudos exploratórios e confirmatórios, P hacking, HARKing e double dipping. Práticas de …

Bounded research ethicality: researchers rate themselves and their field as better than others at following good research practice

Bounded ethicality refers to people’s limited capacity to consistently behave in line with their ethical standards. Here, we present results from a pre-registered, large-scale (N = 11,050) survey of researchers in Sweden, suggesting that researchers …

Building reproducible bridges to cross the “valley of death”

Research is cumulative. New investigations build on, challenge, or qualify claims based on prior evidence. When we have limited evidence, it is normal that some explanations are wrong and need to be refined or reconsidered. This self-corrective …

Building transparency and reproducibility into the practice of pharmacoepidemiology and outcomes research

Real-world evidence (RWE) studies are increasingly used to inform policy and clinical decisions. However, there remain concerns about the credibility and reproducibility of RWE studies. While there is universal agreement on the critical importance of …

Campbell Open and Reproducible Science Syllabus

The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research workflow. By the end of this course students will be familiar with documenting their research workflow (e.g., idea …

Campbell’s Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating

Campbell’s Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became …