CSW 2023
Crowd Science Workshop: Collaboration of Humans and Learning Algorithms for Data Labeling

Table of Contents

• Preface
  Summary: There were 6 papers submitted for peer-review to this workshop. Out of these, 5 papers were accepted for this volume, 4 as regular papers, 0 as short papers, and 1 as a non-archival talk.

Papers

• WSDM Cup 2023 Challenge on Visual Question Answering (invited paper) 1-7
  Dmitry Ustalov , Nikita Pavlichenko , Daniil Likhobaba , Alisa Smirnova
• To Aggregate or Not? Learning with Separate Noisy Labels 8-43
  Jiaheng Wei , Zhaowei Zhu , Tianyi Luo , Ehsan Amid , Abhishek Kumar , Yang Liu
• AI Decision Systems with Feedback Loop Active Learner 44-58
  Mert Kosan , Linyun He , Shubham Agrawal , Hongyi Liu , Chiranjeet Chetia
• The Determination of the Learning Performance based on Assessment Item Analysis 59-76
  Doru Anastasiu Popescu , Ovidiu Domsa , Nicolae Bold
• Utilising Crowdsourcing to Assess the Effectiveness of Item-based Explanations of Merchant Recommendations 77-86
  Denis Krasilnikov , Oleg Lashinin , Maksim Tsygankov , Marina Ananyeva , Sergey Kolesnikov