Resources

A chapter about significance testing

Three mostly positive developments in academic psychology—the cognitive revolution, the virtual requirement for multiple study reports in our top journals, and the prioritization of mediational evidence in our data—have had the unintended effect of …

Low power in experimental psychology is an oft-discussed problem. We show in the context of the Replicability Project: Psychology (Open Science Collaboration, 2015) that sample sizes are so small in psychology that often one cannot detect even large …

Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results reporting, and algorithm and data sharing to promote transparency, reliability and collaboration. We describe insights …

Statistical power analysis provides the conventional approach to assess error rates when designing a research study. However, power analysis is flawed in that a narrow emphasis on statistical significance is placed as the primary focus of study …

Despite its potential to accelerate academic progress in psychological science, public data sharing remains relatively uncommon. In order to discover the perceived barriers to public data sharing and possible means for lowering them, we conducted a …

The effect size (ES) is the magnitude of a study outcome or research finding, such as the strength of the relationship obtained between an independent variable and a dependent variable. Two types of ES indicators are sampled here: the difference-type …

Social scientists generally enjoy substantial latitude in selecting measures and models for hypothesis testing. Coupled with publication and related biases, this latitude raises the concern that researchers may intentionally or unintentionally select …

Improved research practice is based on estimation of effect sizes rather than statistical significance. We discuss the challenging task of interpreting effect sizes in the research context, with particular attention to social psychological research. …

We outline the need to, and provide a guide on how to, conduct a meta-analysis on one’s own studies within a manuscript. Although conducting a “mini meta” within one’s manuscript has been argued for in the past, this practice is still relatively rare …