About this resource

    Type of resources
    Primary Source, Reading, Paper
    Education level(s)
    College / Upper Division (Undergraduates)
    Primary user(s)
    Student
    Subject area(s)
    Math & Statistics
    Language(s)
    English
    Cluster
    Conceptual and Statistical Knowledge
    Last updated
    29 October 2026

    The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time

    Open this resource

    Level College / Upper Division (Undergraduates) · For Student · Language English

    Abstract

    Data-dependent analysis—a “garden of forking paths”— explains why many statistically significant comparisons don’t hold up.