Reproducibility and Replicability Knowledge

 

Establishing trust in automated reasoning

Since its beginnings in the 1940s, automated reasoning by computers has become a tool of ever growing importance in scientific research.So far, the rules underlying automated reasoning have mainly beenformulated by humans, in the form of program …

Estimating the reproducibility of psychological science

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using high-powered …

Estimating the Unobserved: Hierarchical Bayesian Estimation of Evidence Accumulation Models with Missing or Contaminant Data

This student project involved creating likelihood functions for the Bayesian estimation of cognitive parameters behind choices and response times in R, for the R package EMC2 of the Amsterdam Mathematical Psychology Lab. Particularly, the likelihood …

Ethnography vs. zombie methodologies: What anthropology can teach psychology about nonreproducibility

Beginning in 2011, public scandals and high-visibility critiques of research methods in psychology fed a broader “replication crisis”: foundational experiments could not be replicated, and statistical methods in social psychology demonstrated …

Evading Open Science: The Black Box of Student Data Collection

While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency through preregistration), problematic behaviors during data collection are still almost impossible to detect and pose a …

Evading Open Science: The Black Box of Student Data Collection

While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency through preregistration), problematic behaviors during data collection are still almost impossible to detect and pose a …

Everything Hertz

A podcast about open science and psychology

Excess Success for Psychology Articles in the Journal Science

This article describes a systematic analysis of the relationship between empirical data and theoretical conclusions for a set of experimental psychology articles published in the journal Science between 2005–2012. When the success rate of a set of …

Expectations for Replications: Are Yours Realistic?

Failures to replicate published psychological research findings have contributed to a "crisis of confidence." Several reasons for these failures have been proposed, the most notable being questionable research practices and data fraud. We examine …

Experimenter as automaton; experimenter as human: Exploring the position of the researcher in scientific research

The crisis of confidence in the social sciences has many corollaries which impact our research practices. One of these is a push towards maximal and mechanical objectivity in quantitative research. This stance is reinforced by major journals and …