=Paper=
{{Paper
|id=Vol-3689/WOWS_2024_keynotekeynote
|storemode=property
|title=Evaluation of Information Access Systems in the Generative Era - Abstract
|pdfUrl=https://ceur-ws.org/Vol-3689/WOWS_2024_keynote.pdf
|volume=Vol-3689
|authors=Negar Arabzadeh
|dblpUrl=https://dblp.org/rec/conf/wows/Arabzadeh24
}}
==Evaluation of Information Access Systems in the Generative Era - Abstract==
<pdf width="1500px">https://ceur-ws.org/Vol-3689/WOWS_2024_keynote.pdf</pdf>
<pre>
                         Evaluation of Information Access Systems in the
                         Generative Era
                         Negar Arabzadeh
                         University of Waterloo, Canada




                         Abstract
                         With the rapid advancement of information access systems, evaluating such systems presents both sig-
                         nificant challenges and opportunities. In this talk, we explore the forefront of evaluation methodologies
                         tailored for the generative era, emphasizing the multifaceted aspects of assessment and the urgent need
                         for robust, fair, and accurate evaluation strategies that keep pace with technological advancements.
                         Through this presentation, we aim to shed light on the process of quantitatively comparing the output
                         of one Large Language Model (LLM) with another, as well as with the output of a retrieval system.
                         We will explore methods to identify kernels of truth, aiming to provide an environment where correct
                         information is available, identifiable, and accessible.




                          WOWS 2024: Workshop on Open Web Search, 28 March 2024, Glasgow, UK
                          $ narabzad@uwaterloo.ca (N. Arabzadeh)
                          € https://www.negara.me/ (N. Arabzadeh)
                           0000-0002-4411-7089 (N. Arabzadeh)
                                  © 2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).


CEUR
                  ceur-ws.org
Workshop      ISSN 1613-0073
Proceedings

</pre>