Reproducibility and Replicability Knowledge

Clusters

In order to teach Open and Reproducible Science effectively, educators need to make sense of almost a decade of literature, across several fields, and be informed about ongoing (and often dynamic) debates. This is a tall ask for most educators. So …

Cognitive Science StackExchange site (for psychology Q&A)

A website about questions on psychology

Community consensus on core open science practices to monitor in biomedicine

The state of open science needs to be monitored to track changes over time and identify areas to create interventions to drive improvements. In order to monitor open science practices, they first need to be well defined and operationalized. To reach …

Computational social science is growing up: why puberty consists of embracing measurement validation, theory development, and open science practices

Puberty is a phase in which individuals often test the boundaries of themselves and surrounding others and further define their identity – and thus their uniqueness compared to other individuals. Similarly, as Computational Social Science (CSS) grows …

Conflicting Results and Statistical Malleability: Embracing Pluralism of Empirical Results

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. I discuss the …

Conservative tests under satisficing models of publication bias.

Publication bias leads consumers of research to observe a selected sample of statistical estimates calculated by producers of research. We calculate critical values for statistical significance that could help to adjust after the fact for the …

CONSORT statement adherence and risk of bias in randomized controlled trials on deep caries management: a meta-research

Background Recently, trials have supported changes in deep caries management. However, reporting might lack details, affecting interpretation and implementation. Thus, we aimed to evaluate the adherence to the CONSORT statement and the risk of bias …

Constraints on generality statements are needed to define direct replication

Whether or not a replication attempt counts as “direct” often cannot be determined definitively after the fact as a result of flexibility in how procedural differences are interpreted. Specifying constraints on generality in original articles can …

Continuously Cumulating Meta-Analysis and Replicability

The current crisis in scientific psychology about whether our findings are irreproducible was presaged years ago by Tversky and Kahneman (1971), who noted that even sophisticated researchers believe in the fallacious Law of Small Numbers—erroneous …

Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods

Publication bias and questionable research practices in primary research can lead to badly overestimated effects in meta-analysis. Methodologists have proposed a variety of statistical approaches to correct for such overestimation. However, it is not …