Conceptual and Statistical Knowledge

 

Experiments with More Than One Random Factor: Designs, Analytic Models, and Statistical Power.

Traditional methods of analyzing data from psychological experiments are based on the assumption that there is a single random factor (normally participants) to which generalization is sought. However, many studies involve at least two random factors …

Hail the impossible: p-values, evidence, and likelihood.

Significance testing based on p-values is standard in psychological research and teaching. Typically, research articles and textbooks present and use p as a measure of statistical evidence against the null hypothesis (the Fisherian interpretation), …

HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results?

The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on comprehensive meta-analyses and reviews in applied …

HARKing: Hypothesizing after the results are known

This article considers a practice in scientific communication termed HARKing (Hypothesizing After the Results are Known). HARKing is defined as presenting a post hoc hypothesis (i.e., one based on or informed by one's results) in one's research …

Heterogeneity in effect size estimates

A typical empirical study involves choosing a sample, a research design, and an analysis path. Variation in such choices across studies leads to heterogeneity in results that introduce an additional layer of uncertainty, limiting the generalizability …

History and Philosophy of Psychology

In this course, we will examine the on-going methodological controversies around psychology, cognitive science, and cognitive neuroscience. We will look at the question of replication, statistical reform, measurement of psychological attributes, …

Improving (Our) Science: Reproducibility, Reporting, and Openness

The goal of the course is to become a better scientist. You will learn about newest standards for scientific openness, and how they influence the reporting and interpretation of empirical evidence. One component of the course is an intervention to …

Inappropriate fiddling with statistical analyses to obtain a desirable p-value: tests to detect its presence in published literature.

Much has been written regarding p-values below certain thresholds (most notably 0.05) denoting statistical significance and the tendency of such p-values to be more readily publishable in peer-reviewed journals. Intuition suggests that there may be a …

Interpreting effect sizes: Toward a quantitative cumulative social psychology

Improved research practice is based on estimation of effect sizes rather than statistical significance. We discuss the challenging task of interpreting effect sizes in the research context, with particular attention to social psychological research. …

Introduction to Meta-Analysis

A book about meta analyses
JUST-OS