P-hacking

Definition: Exploiting techniques that may artificially increase the likelihood of obtaining a statistically significant result by meeting the standard statistical significance criterion (typically α = .05). For example, performing multiple analyses and reporting only those at p < .05, selectively removing data until p < .05, selecting variables for use in analyses based on whether those parameters are statistically significant.

Related terms: Analytic flexibility, Fishing, Garden of forking paths, HARKing, Questionable Research Practices or Questionable Reporting Practices (QRPs), Selective reporting

References:

  • Hardwicke et al. (2014)
  • Neuroskeptic (2012)

Originally drafted by: Mahmoud Elsherif

Reviewed by: Tamara Kalandadze, William Ngiam, Sam Parsons, Martin Vasilev