分析灵活性 [Analytic Flexibility]

Also available in: Arabic | English | German | Turkish
 

定义: 分析灵活性是研究者自由度的一种（Simmons, Nelson, & Simonsohn, 2011），特指在数据预处理和统计分析期间研究者做出的大量选择。也即“不同的可接受的分析方法所产生的分析结果之间的差异范围”（Carp, 2012, p. 1）。分析灵活性可能会引发问题，因为分析策略的可变性可能会导致研究结果的可变性，尤其是在研究者尝试了多种分析策略但未透明报告的情况下（Masur, 2021）。

相关术语: Garden of forking paths, Multiverse analysis, Researcher degrees of freedom

参考文献:

  • Breznau, N. (2021). I saw you in the crowd: Credibility, reproducibility, and meta-utility. PS: Political Science & Politics, 54(2), 309–313. https://doi.org/10.1017/S1049096520000980
  • Carp, J. (2012). On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments. Frontiers in Neuroscience, 6, 149. https://doi.org/10.3389/fnins.2012.00149
  • Jones, A., Dr, J., Duckworth, & Christiansen, P. (2020). May I have your attention, please? Methodological and Analytical Flexibility in the Addiction Stroop. https://doi.org/10.31234/osf.io/ws8xp
  • Masur, P. K. (2020). Understanding the Effects of Analytical Choices on Finding the Privacy Paradox: A Specification Curve Analysis of Large-Scale Survey Data. Preprint. https://osf.io/m72gb/
  • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632

原稿作者: Mariella Paul

审阅者: Adrien Fillon, Bettina M. J . Kern, Adam Parker, Charlotte R. Pennington, Flávio Azevedo

翻译者: AI-driven translation tool "TransFlow" (developed by Jinbiao Yang and COSN OpenTransfer team)

译稿审阅者: Cathy Fang, Liangjie Chen, Ruoting Liu, Shuxian Jin