BIR 2020 Workshop on Bibliometric-enhanced Information Retrieval Preface to the 10th Workshop on Bibliometric-enhanced Information Retrieval at ECIR 2020 Guillaume Cabanac1 , Ingo Frommholz2 , and Philipp Mayr3 1 University of Toulouse, Computer Science Department, IRIT UMR 5505, France guillaume.cabanac@univ-tlse3.fr 2 Institute for Research in Applicable Computing, University of Bedfordshire, Luton, UK, ifrommholz@acm.org 3 GESIS – Leibniz-Institute for the Social Sciences, Cologne, Germany, philipp.mayr@gesis.org 1 Introduction The Bibliometric-enhanced Information Retrieval workshop series (BIR) was launched at ECIR in 2014 [2] and was held at ECIR each year since then. As our workshop lies at the crossroads between IR and NLP, we also ran BIR as a joint workshop called BIRNDL (Bibliometric enhanced IR and NLP for Digital Libraries) at the JCDL and SIGIR conferences. This year we organize the 10th iteration of BIR [1]. All pointers to the past and future workshops and proceedings are hosted at https://sites.google.com/view/bir-ws/. 2 Overview of the papers This year eight papers were accepted as full papers for presentation and inclu- sion in the proceedings. In addition, the workshop featured one keynote talk and various greeting notes by senior researchers in the different BIR-related fields. Some greeting notes are given as short video recordings, some as written notes. All workshop contributions are documented in the workshop website4 . The fol- lowing section briefly lists the various contributions. 2.1 Keynote This year’s keynote was given by George Tsatsaronis: Metrics and trends in assessing the scientific impact. Copyright c 2020 for this paper by its authors. Use permitted under Creative Com- mons License Attribution 4.0 International (CC BY 4.0). BIR 2020, 14 April 2020, Lisbon, Portugal. 4 https://sites.google.com/view/bir-ws/bir-2020 1 BIR 2020 Workshop on Bibliometric-enhanced Information Retrieval 2.2 Research papers The following research papers were presented in 3 sessions.  Session: Expert finding and ranking models – Robin Brochier, Antoine Gourru, Adrien Guille and Julien Velcin: New Datasets and a Benchmark of Document Network Embedding Methods for Scientific Expert Finding – Christopher Michels, Mandy Neumann, Philipp Schaer and Ralf Schenkel: Conference Indexing in Digital Libraries: A Ranking Model and Case Study on dblp  Session: Citations, citations, citations – Gineke Wiggers and Suzan Verberne: Usage and Citation Metrics for Ranking Algorithms in Legal Information Retrieval Systems – Juan Pablo Bascur, Suzan Verberne, Nees Jan Van Eck and Ludo Waltman: Browsing citation clusters for academic literature search: A simulation study with systematic reviews – Michael Färber, Timo Klein and Joan Sigloch: Neural Citation Recommendation: A Reproducibility Study  Session: Learning to Rank and Evaluation – Daniel Kershaw, Benjamin Pettit, Maya Hristakeva and Kris Jack: Learning to Rank Research Articles: A case study of collaborative filtering and learning to rank in ScienceDirect – Rodrigo Nogueira, Zhiying Jiang, Kyunghyun Cho and Jimmy Lin: Evaluating Pretrained Transformer Models for Citation Recommendation – Timo Breuer, Philipp Schaer and Dirk Tunger: Relations Between Relevance Assessments, Bibliometrics and Altmetrics 2 BIR 2020 Workshop on Bibliometric-enhanced Information Retrieval 2.3 BIR greeting notes We asked researchers from the Scientometrics as well as Information Retrieval community to send their thoughts about the workshop series. The following videos (see playlist https://bit.ly/BIR-greetings) and our written greeting notes were submitted. – Andrea Scharnhorst (DANS, The Netherlands): Building bridges Companion video https://youtu.be/kNPVZZ7Mq0M – Dietmar Wolfram (University of Wisconsin-Milwaukee, USA) Video https://youtu.be/BKNDYq09_-M – Suzan Verberne (Leiden University, The Netherlands) Video https://youtu.be/eM1Kwevrdkc – Mike Thelwall (University of Wolverhampton, UK): Why we need another ten years of Bibliometric-enhanced Information Retrieval Companion video https://youtu.be/Ld1s6mEpA2Q – Iana Atanassova (Université Bourgogne Franche-Comté, France) and Marc Bertin (University of Lyon, France): BIR: A time and a place to envision concepts and tools around Bibliometrics Companion video https://youtu.be/hLgTB0av_b0 – Henry Small (SciTech Strategies, USA): Some questions for information science arising from the history and philosophy of science Companion video https://youtu.be/xOpFB0r0WPg – Staša Milojević (Indiana University, USA) Video https://youtu.be/N6WRjudG2G4 – Min-Yen Kan (National University of Singapore, Singapore) Video https://youtu.be/OpKXeUK3CJo – Ludo Waltman (Leiden University, The Netherlands) Video https://youtu.be/YHxzppJP5Js – Aparna Basu (South Asian University, India): Remembering Don Swanson: Link to Bibliometric-enhanced Information Retrieval Companion video https://youtu.be/tEPyL-x-R1o – Wolfgang Glänzel (KU Leuven, Belgium): Bibliometrics-aided retrieval: A success story Companion video https://youtu.be/GkN4ngT1RIs 3 BIR 2020 Workshop on Bibliometric-enhanced Information Retrieval – Akiko Aizawa (National Institute of Informatics, Japan) Video https://youtu.be/Tm9sJZ8X470 – Muthu Kumar Chandrasekaran (Amazon, USA) BIR and BIRNDL: A marathon towards a congregation of scientific document processing community Companion video https://youtu.be/V1zxs_3b_CI – Michel Zitt (INRA Nantes, France): Intrication between Information Retrieval and Bibliometrics: the case of scientific domain delineation – Howard D. White (Drexel University, USA): Anniversary Statement 3 Outlook and further reading Currently the BIR organizers edit a Special issue on “Bibliometrics and Infor- mation Retrieval” 5 in the journal Scientometrics (Springer). All accepted and published papers are listed on the SI page accordingly. Since 2016 we maintain the “Bibliometric-enhanced-IR Bibliography” 6 that collects scientific papers which appear in collaboration with the BIR/BIRNDL organizers. References 1. Cabanac, G., Frommholz, I., Mayr, P.: Bibliometric-Enhanced Information Re- trieval: 10th Anniversary Workshop Edition. In: Jose, J.M., Yilmaz, E., Magalhães, J., Castells, P., Ferro, N., Silva, M.J., Martins, F. (eds.) ECIR’20: Proceedings of the 42nd European Conference on Information Retrieval. LNCS, vol. 12036, p. to appear. Springer (2020), doi:10.1007/978-3-030-45442-5_85 2. Mayr, P., Scharnhorst, A., Larsen, B., Schaer, P., Mutschke, P.: Bibliometric- Enhanced Information Retrieval. In: 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings. pp. 798– 801. Springer International Publishing (2014), http://arxiv.org/abs/1310.8226, doi:10.1007/978-3-319-06028-6_99 5 https://sites.google.com/view/scientometrics-si2019-bir 6 https://github.com/PhilippMayr/Bibliometric-enhanced-IR_Bibliography/ 4