The first workshop on Crowd Science was organized in conjunction with the 34th Conference on Neural Information Processing Systems (NeurIPS 2020). This workshop is the first in a series of events that has the goal of helping crowdsourcing “transition” from art to science, and tackles the research challenges that we face to make crowdsourcing a technology that users can easily access and leverage, and produces results that researchers and businesses can rely on. This workshop features five invited talks, seven paper presentations, and a panel discussion. We received 13 submissions, out of which 7 were accepted as the talks at the workshop after peer review. Only 6 papers were included in the proceedings as the authors of one accepted paper expressed their interest in non-archival talk. We thank all the authors for their contributions and the effort they put into it, and we are very grateful to the excellent work of our reviewers and program committee members. Last, but not least, we would like to thank NeurIPS workshop chairs for their assistance that made the workshop organization process a pleasure. The 2020 edition of the workshop took place remotely, and we look forward to the forthcoming (in-person) editions of the Crowd Science workshop.
Preface Conversational Crowdsourcing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 Sihang Qiu, Ujwal Gadiraju, Alessandro Bozzon and Geert-Jan Houben What Can Crowd Computing Do for the Next Generation of AI Systems? . . . . . . . . . . . . . . . . . . . . . . 7 Ujwal Gadiraju and Jie Yang Real-Time Crowdsourcing of Health Data in a Low-Income Country: A Case Study of Human Data Supply on Malaria First-Line Treatment Policy Tracking in Nigeria . . . . . . . . . . . . . . . . . . . . . . . . . . 14 Olubayo Adekanmbi, Wuraola Fisayo Oyewusi and Ezekiel Ogundepo Active Learning from Crowd in Document Screening . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 Evgeny Krivosheev, Burcu Sayin, Alessandro Bozzon and Zoltán Szlávik Human Computation Requires and Enables a New Approach to Ethics . . . . . . . . . . . . . . . . . . . . . . . . 26 Libuše H. Veprˇek, Patricia Seymour and Pietro Michelucci A Gamified Crowdsourcing Framework for Data-Driven Co-Creation of Policy Making and Social Foresight . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34 Andrea Tocchetti and Marco Brambilla
Boualem Benatallah Alessandro Bozzon Alessandro Checco Anna Lisa Gentile Gleb Gusev Evgeny Krivosheev Alexey Kushnir Anna Lioznova Lucas Maystre Svetlana Nikitina Maria Sagaidak Ivan Stelmakh Jie Yang Fedor Zhdanov Xiong Zhou
University of New South Wales Delft University of Technology University of Sheffield IBM Sberbank University of Trento Carnegie Mellon University Yandex Spotify University of Trento Yandex Carnegie Mellon University Delft University of Technology Amazon Amazon