=Paper=
{{Paper
|id=Vol-2008/EVIA2017_preface
|storemode=property
|title=None
|pdfUrl=https://ceur-ws.org/Vol-2008/EVIA2017_preface.pdf
|volume=Vol-2008
|authors=Nicola Ferro,Ian Soboroff
}}
==None==
<pdf width="1500px">https://ceur-ws.org/Vol-2008/EVIA2017_preface.pdf</pdf>
<pre>
                                  Preface

     This volume contains the papers presented at EVIA 2017: the 8th Interna-
tional Workshop on Evaluating Information Access, co-located with the 13th NT-
CIR Conference on the Evaluation of Information Access Technologies (NTCIR-
13) held in Tokoy, Japan, on December 5, 2017.
     Information Access technologies provide the interface between human infor-
mation needs and digital information resources. The reliable evaluation of these
technologies has been recognized for decades as central to the advancement of
the field. As information retrieval technologies become more pervasive, the forms
of retrieval more diverse, and retrieval tools richer, the importance of effective,
efficient, and innovative evaluation grows as well.
     The goal of the workshop was to investigate how to improve information ac-
cess evaluation, by bringing in new perspectives which have not been explored or
fully addressed yet. Therefore, the workshop solicited the submission of contribu-
tions covering new approaches for: test collection formation; evaluation metrics;
statistical issues in information retrieval evaluation; user studies and the evalua-
tion of human-computer interaction in information retrieval (HCIR); evaluation
methods for multilingual, multimedia, or mobile information access; vovel in-
formation access tasks and their evaluation; evaluation and assessment using
implicit user feedback, crowdsourcing, living labs, or inferential methods; eval-
uation issues in industrial and enterprise retrieval systems; and, reproducibility
issues in information retrieval evaluation.
     The workshop received 10 submissions out of which 7 were accepted for pub-
lication and presentation: 4 full papers and 3 short papers. We would like to
express our special thanks to the Program Committee members, the authors
and all the attendees.




                                                                   December, 2017


                                                    Nicola Ferro and Ian Soboroff
                                                             Workshop co-Chairs




                                         i
                    Program Commitee

Hsin-Hsi Chen, National Taiwan University, Taiwan
Charles Clarke, University of Waterloo, Canada
Atsushi Fujii, Tokyo Institute of Technology, Japan
Donna Harman, National Institute of Standards and Technology (NIST), USA
Gareth Jones, Dublin City University, Ireland
Noriko Kando, National Institute of Informatics, Japan
Evangelos Kanoulas, University of Amsterdam, The Netherlands
Aldo Lipani, Vienna University of Technology, Austria
Claudio Lucchese, Ca’ Foscari University of Venice and ISTI CNR Pisa, Italy
Maria Maistro, University of Padua, Italy
Stefano Mizzaro, University of Udine, Italy
Alistair Moffat, University of Melbourne, Australia
Shahzad Rajput, National Institute of Standards and Technology (NIST), USA
Tetsuya Sakai, Waseda University, Japan
Mark Sanderson, RMIT University, Australia
Falk Scholer, RMIT University, Australia
Mark Smucker, University of Waterloo, Canada




                                    ii

</pre>