众包研究 [Crowdsourced Research]

Also available in: Arabic | English | German | Turkish
 

定义: 众包研究是一种科研组织模式，通过大规模合作的方式开展，让多个团队以独立而协调的方式进行一个或多个研究项目。众包研究旨在通过整合资源、提升透明度和包容性来提升效率和可扩展性，并通过增强统计效力和促进相互的社会审查来提高研究的严谨性、可靠性和可信度。这种模式与传统由个人或小型研究团队独立开展（“小科研”）的学术研究模式不同。众包研究的典型范例包括：“多实验室重复性研究”（Klein et al., 2018）、“多分析师同数据集研究”（Silberzahn et al., 2018）、分布式协作网络（Moshontz et al., 2018），以及大规模开放在线论文（MOOPs）等开放式协作写作项目（Himmelstein et al., 2019; Tennant et al., 2019）。另外，众包研究也可指通过Amazon Mechanical Turk或Prolific等在线劳动力市场雇用大量研究“众包工作者”进行数据收集，如进行内容分析（Benoit et al., 2016; Lind et al., 2017）或实验研究（Peer et al., 2017）。那些通过开放参与以及共享中间产出而实现开放的众包研究，被称为众包科学（Franzoni & Sauermann, 2014）。

相关术语: Citizen science, Collaboration, Crowdsourcing, Team science

参考文献:

  • Benoit, K., Conway, D., Lauderdale, B. E., Laver, M., & Mikhaylov, S. (2016). Crowd-sourced text analysis: Reproducible and agile production of political data. American Political Science Review, 110(2), 278–295. https://doi.org/10.1017/S0003055416000058
  • Breznau, N. (2021). I saw you in the crowd: Credibility, reproducibility, and meta-utility. PS: Political Science & Politics, 54(2), 309–313. https://doi.org/10.1017/S1049096520000980
  • Franzoni, C., & Sauermann, H. (2014). Crowd science: The organization of scientific research in open collaborative projects. Research Policy, 43(1), 1–20. https://doi.org/10.1016/j.respol.2013.07.005
  • Himmelstein, D. S., Rubinetti, V., Slochower, D. R., Hu, D., Malladi, V. S., Greene, C. S., & Gitter, A. (2019). Open collaborative writing with Manubot. PLOS Computational Biology, 15(6), e1007128. https://doi.org/10.1371/journal.pcbi.1007128
  • Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., & … Nosek, B. A. (2018). Many Labs 2: Investigating Variation in Replicability Across Samples and Settings. Advances in Methods and Practices in Psychological Science, 1(4), 443–490. https://doi.org/10.1177/2515245918810225
  • Lind, F., Gruber, M., & Boomgaarden, H. G. (2017). Content analysis by the crowd: Assessing the usability of crowdsourcing for coding latent constructs. Communication Methods and Measures, 11(3), 191–209. https://doi.org/10.1080/19312458.2017.1317338
  • Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., & Chartier, C. R. (2018). The Psychological Science Accelerator: Advancing psychology through a distributed collaborative network. Advances in Methods and Practices in Psychological Science, 1(4), 501–515. https://doi.org/10.1177/2515245918797607
  • Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017). Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology, 70, 153–163. https://doi.org/10.1016/j.jesp.2017.01.006
  • Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahník, Š., Bai, F., Bannard, C., Bonnier, E., & others. (2018). Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results. Advances in Methods and Practices in Psychological Science, 337–356. https://doi.org/10.1177/2515245917747646
  • Stewart, N., Chandler, J., & Paolacci, G. (2017). Crowdsourcing samples in cognitive science. Trends in Cognitive Sciences, 21(10), 736–748. https://doi.org/10.1016/j.tics.2017.06.007
  • Tennant, J., Bielczyk, N. Z., Cheplygina, V., Greshake Tzovaras, B., Hartgerink, C. H. J., Havemann, J., Masuzzo, P., & Steiner, T. (2019). Ten simple rules for researchers collaborating on Massively Open Online Papers (MOOPs). MetaArXiv. https://doi.org/10.31222/osf.io/et8ak
  • Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., McCarthy, R. J., Riegelman, A., Silberzahn, R., & Nosek, B. A. (2019). Scientific utopia III: Crowdsourcing science. Perspectives on Psychological Science, 14(5), 711–733. https://doi.org/10.1177/1745691619850561
  • Week, C. (2021). What is Crowdsourcing? https://crowdsourcingweek.com/what-is-crowdsourcing/

原稿作者: Eike Mark Rinke

审阅者: Ali H. Al-Hoorie, Sam Parsons, Charlotte R. Pennington, Suzanne L. K. Stewart, Flávio Azevedo

翻译者: AI-driven translation tool "TransFlow" (developed by Jinbiao Yang and COSN OpenTransfer team)

译稿审阅者: Cathy Fang, Liangjie Chen, Ruoting Liu, Shuxian Jin