Conceptual and Statistical Knowledge

 

Mindless statistics

Statistical rituals largely eliminate statistical thinking in the social sciences. Rituals are indispensable for identification with social groups, but they should be the subject rather than the procedure of science. What I call the “null ritual” …

Mini Meta-Analysis of Your Own Studies: Some Arguments on Why and a Primer on How

We outline the need to, and provide a guide on how to, conduct a meta-analysis on one’s own studies within a manuscript. Although conducting a “mini meta” within one’s manuscript has been argued for in the past, this practice is still relatively rare …

Mission: P-curve

A blog about the p-curve

More than meets the ITT: A guide for anticipating and investigating nonsignificant results in survey experiments

Survey experiments often yield intention-to-treat effects that are either statistically and/or practically “non-significant.” There has been a commendable shift toward publishing such results, either to avoid the “file drawer problem” and/or to …

Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling

The main methods, techniques and issues for carrying out multilevel modeling and analysis are covered in this book. The book is an applied introduction to the topic, providing a clear conceptual understanding of the issues involved in multilevel …

Navigating the Science System: Research Integrity and Academic Survival Strategies

Research Integrity (RI) is high on the agenda of both institutions and science policy. The European Union as well as national ministries of science have launched ambitious initiatives to combat misconduct and breaches of research integrity. Often, …

Null hypothesis significance testing: a review of an old and continuing controversy

Null hypothesis significance testing (NHST) is arguably the most widely used approach to hypothesis evaluation among behavioral and social scientists. It is also very controversial. A major concern expressed by critics is that such testing is …

Null Hypothesis Significance Testing. On the Survival of a Flawed Method

Null hypothesis significance testing (NHST) is the researcher's workhorse for making inductive inferences. This method has often been challenged, has occasionally been defended, and has persistently been used through most of the history of scientific …

On the challenges of drawing conclusions from p-values just below 0.05

In recent years, researchers have attempted to provide an indication of the prevalence of inflated Type 1 error rates by analyzing the distribution of p-values in the published literature. De Winter & Dodou (2015) analyzed the distribution (and its …

On the origins of the .05 level of statistical significance

Examination of the literature in statistics and probability that predates Fisher's Statistical Methods for Research Workers indicates that although Fisher is responsible for the first formal statement of the .05 criterion for statistical …