Conceptual and Statistical Knowledge

 

Things I have learned (so far)

This is an account of what I have learned (so far) about the application of statistics to psychology and the other sociobiomedical sciences. It includes the principles "less is more" (fewer variables, more highly targeted issues, sharp rounding …

The what, why, and how of born-open data

Although many researchers agree that scientific data should be open to scrutiny to ferret out poor analyses and outright fraud, most raw data sets are not available on demand. There are many reasons researchers do not open their data, and one is …

A Power Primer

One possible reason for the continued neglect of statistical power analysis in research in the behavioral sciences is the inaccessibility of or difficulty with the standard material. A convenient, although not comprehensive, presentation of required …

Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs

Effect sizes are the most important outcome of empirical studies. Most articles on effect sizes highlight their importance to communicate the practical significance of results. For scientists themselves, effect sizes are most useful because they …

Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli

Researchers designing experiments in which a sample of participants responds to a sample of stimuli are faced with difficult questions about optimal study design. The conventional procedures of statistical power analysis fail to provide appropriate …

You Cannot Step Into the Same River Twice: When Power Analyses Are Optimistic

Statistical power depends on the size of the effect of interest. However, effect sizes are rarely fixed in psychological research: Study design choices, such as the operationalization of the dependent variable or the treatment manipulation, the …

Consequences of prejudice against the null hypothesis.

Examined the consequences of prejudice against accepting the null hypothesis through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of apparent erroneous rejections of the null hypothesis in …

P Values and Statistical Practice

An article about P Values and Statistical Practice

Redefine statistical signifcance

We propose to change the default P-value threshold for statistical signifcance from 0.05 to 0.005 for claims of new discoveries.

Sample Size in Psychological Research Over the Past 30 Years

The American Psychological Association (APA) Task Force on Statistical Inference was formed in 1996 in response to a growing body of research demonstrating methodological issues that threatened the credibility of psychological research, and made …
JUST-OS