Conceptual and Statistical Knowledge

 

The Bayes Factor

In this episode JP and Alex interview Zoltan Dienes. They discuss Zoltan's passion for the martial arts, why Bayesian inference could be more Popperian than you might think, and the easiest way to start using Bayesian statistics in practice.

The Bayesfactor blog

Blog about Bayesfactor and statistics

The Bayesian Reproducibility Project

An abstract about bayesian reproducibility project

The case against statistical significance testing

In recent years the use of traditional statistical methods in educational research has increasingly come under attack. In this article, Ronald P. Carver exposes the fantasies often entertained by researchers about the meaning of statistical …

The default bayesian test is prejudiced against small effects

When considering any statistical tool I think it is useful to answer the following two practical questions: 1. "Does it give reasonable answers in realistic circumstances?" and 2. "Does it answer a question I am interested in?" In this post I explain …

The earth is round (p < .05).

After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a sacred .05 criterion) still persists. This article reviews the problems with this practice, including near universal …

The Empirical March: Making Science Better at Self-Correction

Psychology has been criticized recently for a range of research quality issues. The current article organizes these problems around the actions of the individual researcher and the existing norms of the field. Proposed solutions align the incentives …

The Extent and Consequences of P-Hacking in Science

A focus on novel, confirmatory, and statistically significant results leads to substantial bias in the scientific literature. One type of bias, known as "p-hacking," occurs when researchers collect or select data or statistical analyses until …

The fickle P value generates irreproducible results

The reliability and reproducibility of science are under scrutiny. However, a major cause of this lack of repeatability is not being considered: the wide sample-to-sample variability in the P value. We explain why P is fickle to discourage the …

The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time

Data-dependent analysis—a “garden of forking paths”— explains why many statistically significant comparisons don't hold up.