The fourth workshop on Crowd Science is organized in conjunction with the 16th International Conference on Web Search and Data Mining (WSDM 2023). This workshop is the fourth in a series of events that has the goal of helping crowdsourcing “transition” from art to science, and tackles the research challenges that we face to make crowdsourcing a technology that users can easily access and leverage, and produces results that researchers and businesses can rely on. This workshop features two invited talks and five paper presentations. We received six submissions, out of which five were accepted as the talks at the workshop after peer review. Besides the four of five accepted papers, 1 the volume contains an overview of the visual question answering challenge on a crowdsourced dataset that was part of WSDM Cup 2023. We thank all the authors for their contributions and the efort they put into it, and we are very grateful for the excellent work of our reviewers and program committee members. Last but not least, we would like to thank WSDM organizers for their assistance that made the workshop organization process a pleasure. The 2023 edition of the workshop took place in a hybrid format with roughly half of the participants being present at the conference venue in Singapore.
Program Committee • Ujwal Gadiraju, Delft University of Technology • Djellel Difallah, NYU Abu Dhabi • Doyin Afolabi, University of Lagos • Nazar Beknazarov, Toloka • Daryna Dementieva, Technical University of Munich • Ujwal Gadiraju, Delft University of Technology • Gaole He, Delft University of Technology • Daniil Likhobaba, Toloka • Shawn Ogunseye, Bentley University • Nikita Pavlichenko, Toloka • Andrew Ponomarev, SPC RAS • Sihang Qiu, National University of Defense Technology • Andrea Tocchetti, Politecnico of Milano Organizing Committee