Reproducibility and Replicability Knowledge

 

The Open Science Training Handbook

A collection about open science

The poor availability of psychological research data for reanalysis.

The origin of the present comment lies in a failed attempt to obtain, through e-mailed requests, data reported in 141 empirical articles recently published by the American Psychological Association (APA). Our original aim was to reanalyze these data …

The relation between statistical power and inference in fMRI.

Statistically underpowered studies can result in experimental failure even when all other experimental considerations have been addressed impeccably. In fMRI the combination of a large number of dependent variables, a relatively small number of …

The Replication Crisis in Psychology

In science, replication is the process of repeating research to determine the extent to which findings generalize across time and across situations. Recently, the science of psychology has come under criticism because a number of research findings do …

The Reputational Consequences of Failed Replications and Wrongness Admission among Scientists

Scientists are dedicating more attention to replication efforts. While the scientific utility of replications is unquestionable, the impact of failed replication efforts and the discussions surrounding them deserve more attention. Specifically, the …

The State of Play of Reproducibility in Statistics: An Empirical Analysis

Reproducibility, the ability to reproduce the results of published papers or studies using their computer code and data, is a cornerstone of reliable scientific methodology. Studies where results cannot be reproduced by the scientific community …

The Web of Schizotypal Personality Traits: Frequentist Network Replication and Bayesian Network Re-Analysis

This thesis examines schizotypal personality traits, risk factors for schizophrenia, through both frequentist and Bayesian network models. It replicates a prior frequentist analysis by Dodell-Feder et al. (2019) and introduces a Bayesian re-analysis …

Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.

Theories in "soft" areas of psychology (e.g., clinical, counseling, social, personality, school, and community) lack the cumulative character of scientific knowledge because they tend neither to be refuted nor corroborated, but instead merely fade …

Theory-Testing in Psychology and Physics: A Methodological Paradox

Because physical theories typically predict numerical values, an improvement in experimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a …

Toolkit for Aligning Incentives 2.0

Colleges and universities largely exist to advance knowledge for the public good through research, teaching, and public service. Yet, for far too long academic incentive systems have been misaligned with the foundational values upon which …
JUST-OS