Conceptual and Statistical Knowledge

 

The ironic effect of significant results on the credibility of multiple-study articles.

Cohen (1962) pointed out the importance of statistical power for psychology as a science, but statistical power of studies has not increased, while the number of studies in a single article has increased. It has been overlooked that multiple studies …

The new statistics: Why and how

We need to make substantial changes to how we conduct research. First, in response to heightened concern that our published research literature is incomplete and untrustworthy, we need new requirements to ensure research integrity. These include …

The prevalence of statistical reporting errors in psychology (1985–2013)

This study documents reporting errors in a sample of over 250,000 p-values reported in eight major psychology journals from 1985 until 2013, using the new R package “statcheck.” statcheck retrieved null-hypothesis significance testing (NHST) results …

The statistical power of abnormal-social psychological research: A review.

An article about statistical power of abnormal and social psychology

Why most published research findings are false

There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of …

Abandon statistical significance.

We discuss problems the null hypothesis significance testing (NHST) paradigm poses for replication and more broadly in the biomedical and social sciences as well as how these problems remain unresolved by proposals involving modified p-value …

Effect sizes and p values: What should be reported and what should be replicated?

Despite publication of many well-argued critiques of null hypothesis testing (NHT), behavioral science researchers continue to rely heavily on this set of practices. Although we agree with most critics' catalogs of NHT's flaws, this article also …

Evolution of Reporting P Values in the Biomedical Literature, 1990-2015

Importance: The use and misuse of P values has generated extensive debates. Objective: To evaluate in large scale the P values reported in the abstracts and full text of biomedical research articles over the past 25 years and determine how frequently …

In Praise of the Null Hypothesis Statistical Test

Jacob Cohen (see record 1995-12080-001) raised a number of questions about the logic and information value of the null hypothesis statistical test (NHST). Specifically, he suggested that: (1) The NHST does not tell us what we want to know; (2) the …

Null Hypothesis Significance Testing. On the Survival of a Flawed Method

Null hypothesis significance testing (NHST) is the researcher's workhorse for making inductive inferences. This method has often been challenged, has occasionally been defended, and has persistently been used through most of the history of scientific …
JUST-OS