Specification Curve Analysis

Definition: An analytic approach that consists of identifying, calculating, visualising and interpreting results (through inferential statistics) for all reasonable specifications for a particular research question (see Simonsohn et al. 2015). Specification curve analysis helps make transparent the influence of presumably arbitrary decisions during the scientific progress (e.g., experimental design, construct operationalization, statistical models or several of these) made by a researcher by comprehensively reporting all non-redundant, sensible tests of the research question . Voracek et al. (2019) suggest that SCA differs from multiverse analysis with regards to the graphical displays (a specification curve plot rather than a histogram and tile plot) and the use of inferential statistics to interpret findings.

Related terms: Multiverse analysis, Research synthesis, Robustness (analyses), Selective reporting, Vibration of effects

Reference: Simonsohn et al. (2015); Simonsohn (2020); Voracek et al. (2019)

Drafted and Reviewed by: Bradley Baker, Tina B. Lonsdorf, Sam Parsons, Charlotte R. Penningto n

We are currently working to link the references directly. For now, the complete reference list can be viewed here.