Real-world evidence (RWE) studies are increasingly used to inform policy and clinical decisions. However, there remain concerns about the credibility and reproducibility of RWE studies. While there is universal agreement on the critical importance of …
The purpose of this course is to acquaint students with recent developments in open science and reproducibility of the research workflow. By the end of this course students will be familiar with documenting their research workflow (e.g., idea …
Campbell’s Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became …
The replication crisis threatens to seriously impact theory development in the cognitive, behavioral, and social sciences. We
canvas three desiderata of scientific theories (explanation, prediction, and unification) and argue that the extent to which …
How do psychologists determine what is true and what is false about human behavior, affect, and cognition? The question encompasses more than we can know from a single study or even a single research paper, and the issues run deeper than just …
The biomedical sciences must maintain and enhance a research culture that prioritizes rigour and transparency. The US National Institute of Neurological Disorders and Stroke convened a workshop entitled ‘Catalyzing Communities of Research Rigor …
The editors of the Journal of Advanced Academics comment on Makel (2014). The replicability crisis in psychology is summarized in terms of three focal issues: the “file drawer” problem, lack of replication studies, and the null hypothesis …
Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. Randomized, tightly controlled experiments are enshrined as the gold standard of psychological research, and there are …