Preface SemREC 2022 was the second edition of the Semantic Reasoning Evaluation Challenge (SemREC), co-located with the 21st International Semantic Web Conference (ISWC 2022). Despite the development of several ontology reasoning optimizations, the traditional methods either do not scale well or cover only a subset of OWL 2 language constructs. The performance of the SPARQL query engines that support reasoning is also limited. As an alternative, neuro-symbolic approaches are gaining significant attention. However, the existing methods can not deal with very expressive ontology languages. To find and improve the performance bottlenecks of the reasoners, we ideally need several real-world ontologies that span the broad spectrum in terms of their size and expressivity. However, that is often not the case. One of the potential reasons for ontology developers to not build ontologies that vary in terms of size and expressivity is the performance bottleneck of the reasoners. SemREC aims to deal with this chicken and egg problem. The second edition of this challenge included the following tasks. ● Task-1 - Ontologies. Submitting a real-world ontology that is a challenge in terms of the reasoning time or memory consumed during reasoning. ● Task-2 - Systems ○ Ontology/RDFS Reasoners. Submitting an ontology/RDFS reasoner that uses neural-symbolic techniques for reasoning and optimization. In terms of technique used, the submissions could fall under any of the below (or related) categories. ■ Using learning-based techniques for performance optimization of traditional reasoning algorithms [6]. ■ Inductive reasoning techniques based on a subsymbolic representation of entities and relations learned through the maximization of an objective function over triples [4, 5]. ■ Techniques that can learn deductive reasoning using ontology axioms [1, 2, 3]. ■ Neural Multi-hop reasoners [7, 8]. ○ SPARQL query engines that support entailment regimes such as RDF, RDFS, or OWL 2. There were four submissions to the challenge - two in each category. Task 1 1. Reasoning in the FIBO ontology -- A challenge. Pawel Garbacz and Eliza Kendall. 2. The Downgrading Axioms Challenge for Qualitative Composition of Food Ingredients. Bernd Krieg-Brückner, Mark Robin Nolte, Mihai Pomarlan and Michaela Kümpel. Task 2 1. Improving Transitive Embeddings in Neural Reasoning Tasks via Knowledge- Based Policy Networks. Shervin Mehryar and Remzi Celebi. 2. Memory Networks for RDFS reasoning: Experiments. Sulogna Chowdhury, Monireh Ebrahimi, Aaron Eberhart and Pascal Hitzler. Each submission was reviewed by at least three reviewers and their feedback was forwarded to the authors. Since this is a challenge, all the submissions were accepted. Evaluations For fair evaluation, we ran all the submissions on our server with an AMD Ryzen Threadripper 2990WX 32-Core Processor and 128GB of RAM. The server ran on a 5.3.0- 46-generic #38 18.04.1-Ubuntu SMP operating system. We use Java 1.8 and OWL API 5.1.11 in the experiments. We set the heap space to 24GB. We report the average time taken in 2 independent runs for the classification task. Both ontologies submitted under task 1 were evaluated in terms of the time taken (in seconds) Konclude 0.7.01 and Openllet 2.6.462. We set the heap space to 24GB. The time-out was set to 30 minutes. We reported the average time taken in 2 independent runs for the classification task. We could not evaluate the neuro-symbolic reasoners submitted under task 2 as the models were not provided. Also, this category had no winner because both submissions were based on different techniques. One was based on an end-to-end Memory Network (MemN2N) with attention that captures the most relevant information to conduct logical reasoning. The results were reported for a query-based task. The other one, called aTransE, extended TransE and rTransE by leveraging transitive relations and was designed for the link prediction task (subclass and type of relations). The results that were reported in the submissions were considered for our evaluation. For more details, refer to https://semrec.github.io/evaluation2022.html. Challenge Winners Task-1: Reasoning in the FIBO ontology -- A challenge (Pawel Garbacz and Eliza Kendall) Task-2: None 1 https://www.derivo.de/products/konclude/ 2 https://github.com/Galigator/openllet Organization In this section, we list the people who organized and contributed to the success of this event. Challenge Chairs ● Gunjan Singh, KRaCR Lab, IIIT-Delhi, India ● Raghava Mutharaju, KRaCR Lab, IIIT-Delhi, India ● Pavan Kapanipathi, IBM T.J. Watson Research Center, USA Challenge Program Committee Members The challenge program committee helped review the four submitted papers. The organizers would like to thank them for their valuable time. ● Monika Jain, IIIT-Delhi, India ● Sudip Mittal, Mississippi State University, USA ● Cogan Shimizu, Kansas State University, USA ● Monireh Ebrahimi, IBM Watson, USA ● Sumit Bhatia, Adobe Inc., India ● Manas Gaur, University of South Carolina, USA ● Md. Kamruzzaman Sarker, University of Hartford, USA ● Nidhi Goyal, IIIT-Delhi, India ● Fariz Darari, University of Indonesia, Indonesia Acknowledgements We thank the ISWC Semantic Web Challenge chairs, Catia Pesquita, and Daniele Dell’Aglio, and the ISWC organizing committee for their invaluable support. We would also like to thank the challenge participants who played a key role in the success of SemREC by submitting their quality work and informative presentations during the event. References 1. M. Ebrahimi, M.K. Sarker, F. Bianchi, N. Xie, D. Doran, and P. Hitzler, Reasoning over RDF knowledge bases using deep learning, arXiv preprint, arXiv:1811.04132, 2018. 2. P. Hohenecker and T. Lukasiewicz, Deep learning for ontology reasoning, CoRR, arXiv:1705.10342, 2017. 3. B. Makni and J. Hendler, Deep learning for noise-tolerant RDFS reasoning, SemanticWeb 10(5) (2019), 823–862. 4. J. Chen, P. Hu, E. Jimenez-Ruiz, O. M. Holter, D. Antonyrajah, and I. Horrocks, OWL2Vec*: embedding of OWL ontologies. Machine Learning, 2021. 5. S. Mondal, S. Bhatia, and R. Mutharaju. EmEL++: Embeddings for EL++ Description Logic. Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE), 2021. 6. R. Mehri, V. Haarslev, and H. R. Chinaei, A machine learning approach for optimizing heuristic decision‐ making in Web Ontology Language reasoners. Computational Intelligence. 37. 10.1111/coin.12404, 2020. 7. B. Peng, Z. Lu, H. Li, and K.-F.Wong, Towards neural network-based reasoning. arXiv preprint arXiv:1508.05508, 2015. 8. X. V. Lin, R. Socher, and C. Xiong, Multi-Hop Knowledge Graph Reasoning with Reward Shaping. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3243–3253, 2018.