This is the 16th edition of the Forum for Information Retrieval Evaluation (FIRE 2024). Continuing the tradition of the last 15 years, the evaluation tracks at FIRE have expanded to encompass new domains and new languages. With ten (10) evaluation tracks and participation from over 50 teams, this is one of the biggest FIRE workshops to date. This year FIRE realized an interesting mix of tasks from IR/NLP viz. Information Retrieval in Software Engineering (IRSE), sentiment analysis, summarization on different kinds of datasets like social media, legal text, etc. in different languages including English, Dravidian, etc. Hate Speech and Offensive Content Identification in Indo-European Languages (HASOC), focused on identifying various categories of hate speech from social media posts. Indian Language Summarization (ILSUM) offered a test bed for summarization in Hindi, Gujarati and English. Information Retrieval in Software Engineering (IRSE) offered a task on the classification of source code. Sarcasm Identification of Dravidian Languages (Malayalam and Tamil) in DravidianCodeMix 2024 (DravidianCodeMix) provided a task to identify sarcasm and sentiment polarity of the code-mixed dataset of comments/posts in Tamil-English and Malayalam-English collected from social media. CoLI-Tunglish track was dedicated on Tulu language identification in Code-mixed Tulu texts last year and they added Kannada, Tamil, Malayalam in 2024.These tracks were continued from last year with similar to slightly modified problem statements. FIRE 2024 saw the induction of many new and interesting tracks. The Code-Mixed Information Retrieval (CMIR) track offered the IR task Bengali-English code-mixed language. The CryptOQA track presented a platform to analyze the opinions on cryptocurrencies. The SqCLIR track laid a platform for the evaluation of retrieval systems that receive a spoken query as input and search for answers in a document corpus. The PIR task prompted personalized Information Retrieval. To mark industry participation, TCS Research proposed an interesting track on the identification of GI tract cancers. The tracks, in general, received good and uniform participation from many research groups. Each track had a dedicated Program Committee (PC member names and affiliations are as below). We express our gratitude to all the track organizers for their efforts in organizing these tracks, as well as to the participants for their enthusiastic participation. A special thanks to our sponsor 'ACM SIGIR Special Interest Group on Information Retrieval' for the continued support.
Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages (HASOC)
Sarcasm Identification of Dravidian Languages Tamil & Malayalam (DravidianCodeMix) CoLI-Dravidian: Word-level Code-Mixed Language Identification in Dravidian Languages
Dr. Gabriella Pasi, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Dr. Marco Viviani, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Dr. Alessandro Raganato, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Dr. Sandip Modha, University of Milano-Bicocca, Italy & LDRP-ITR, Gandhinagar, India Georgios Peikos, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Gian Carlo Milanese, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Pranav Kasela, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Marco Braga, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy Effrosyni Sokli, Department of Informatics, Systems, and Communication (DISCo), University of Milano-Bicocca, Italy CryptOQA: Opinion Extraction and Question Answering from CryptoCurrency-Related
Dr. Kripabandhu Ghosh, IISER Kolkata, India Gourav Sen, IIT Jodhpur, India Sougata Sarkar, Deloitte, India Subham Kumar, IIT Kharagpur, India