This volume contains the papers presented at EVIA 2017: the 8th International Workshop on Evaluating Information Access, co-located with the 13th NTCIR Conference on the Evaluation of Information Access Technologies (NTCIR13) held in Tokoy, Japan, on December 5, 2017.
Information Access technologies provide the interface between human information needs and digital information resources. The reliable evaluation of these technologies has been recognized for decades as central to the advancement of the eld. As information retrieval technologies become more pervasive, the forms of retrieval more diverse, and retrieval tools richer, the importance of e ective, e cient, and innovative evaluation grows as well.
The goal of the workshop was to investigate how to improve information access evaluation, by bringing in new perspectives which have not been explored or fully addressed yet. Therefore, the workshop solicited the submission of contributions covering new approaches for: test collection formation; evaluation metrics; statistical issues in information retrieval evaluation; user studies and the evaluation of human-computer interaction in information retrieval (HCIR); evaluation methods for multilingual, multimedia, or mobile information access; vovel information access tasks and their evaluation; evaluation and assessment using implicit user feedback, crowdsourcing, living labs, or inferential methods; evaluation issues in industrial and enterprise retrieval systems; and, reproducibility issues in information retrieval evaluation.
The workshop received 10 submissions out of which 7 were accepted for publication and presentation: 4 full papers and 3 short papers. We would like to express our special thanks to the Program Committee members, the authors and all the attendees. Hsin-Hsi Chen, National Taiwan University, Taiwan Charles Clarke, University of Waterloo, Canada Atsushi Fujii, Tokyo Institute of Technology, Japan Donna Harman, National Institute of Standards and Technology (NIST), USA Gareth Jones, Dublin City University, Ireland Noriko Kando, National Institute of Informatics, Japan Evangelos Kanoulas, University of Amsterdam, The Netherlands Aldo Lipani, Vienna University of Technology, Austria Claudio Lucchese, Ca' Foscari University of Venice and ISTI CNR Pisa, Italy Maria Maistro, University of Padua, Italy Stefano Mizzaro, University of Udine, Italy Alistair Mo at, University of Melbourne, Australia Shahzad Rajput, National Institute of Standards and Technology (NIST), USA Tetsuya Sakai, Waseda University, Japan Mark Sanderson, RMIT University, Australia Falk Scholer, RMIT University, Australia Mark Smucker, University of Waterloo, Canada