Definition: Exploiting techniques that may artificially increase the likelihood of obtaining a statistically significant result by meeting the standard statistical significance criterion (typically α = .05). For example, performing multiple analyses and reporting only those at p < .05, selectively removing data until p < .05, selecting variables for use in analyses based on whether those parameters are statistically significant.

Related terms: Analytic flexibility, Fishing, Garden of forking paths, HARKing, Questionable Research Practices or Questionable Reporting Practices (QRPs), Selective reporting

References: Hardwicke et al. (2014), & Neuroskeptic (2012)

Drafted and Reviewed by: Mahmoud Elsherif, Tamara Kalandadze, William Ngiam, Sam Parsons, Martin Vasilev

Note that we are currently working on an automated mechanism to link references cited above with their full-length version that can be found at https://forrt.org/glossary/references with all references used so far.