<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Semantic Interoperability Issues in the Master's Curriculum in Artificial Intelligence at Sofia University</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Mathematics and Informatica, Sofia University St. Kliment Ohridski</institution>
        </aff>
      </contrib-group>
      <fpage>236</fpage>
      <lpage>243</lpage>
      <abstract>
        <p>In today's world of digital transformation and big data the issues related to the semantic interoperability of different information systems that support the decision making activities in the same or similar areas are becoming increasingly important. It is therefore natural for such issues to be in the focus of the education at master's level in a variety of professional fields. The paper discusses the experience in this regard of the Master's program in Artificial Intelligence at the Faculty of Mathematics and Informatics at Sofia University, focusing on some good examples of student projects.</p>
      </abstract>
      <kwd-group>
        <kwd>Semantic Interoperability</kwd>
        <kwd>Ontology</kwd>
        <kwd>Ontology Matching</kwd>
        <kwd>Semantic Enrichment</kwd>
        <kwd>Semantic Search</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In recent years, information systems have to process huge amounts of
heterogeneous data coming from different sources and in various formats. The
work with big heterogeneous datasets makes it necessary to use proper methods
and tools for data integration and achievement of semantic interoperability of the
respective software systems.</p>
      <p>The requirement for semantic interoperability of two information systems
supposes that each of them will understand the semantics of the information sent
or requested by the other, as well as the semantics of its information sources.
Currently ontologies underlie the only widely accepted paradigm for representing
and managing open knowledge that can be shared and reused in a way that allows
automatic interpretation and inference.</p>
      <p>Therefore, the study of ontology design methodologies and formal methods
for ontology matching as well as acquiring practical skills for using ontologies
in building different types of intelligent software systems is one of the important
goals of the university education at master’s level in the field of Artificial
Intelligence.</p>
    </sec>
    <sec id="sec-2">
      <title>Overview of the Master’s program in AI</title>
      <p>The master’s program inArtificial Intelligence (AI) has been operating successfully
at the Faculty of Mathematics and Informatics at Sofia University for nearly 20
years. Its educational objectives include mastering of deep theoretical knowledge
in the classical and some modern areas of Artificial Intelligence and acquisition of
various practical skills needed for the application of AI methods and techniques
in a wide range of fields of Informatics and Information Technologies. The
curriculum includes courses in fundamentals of Artificial Intelligence, knowledge
modeling and design of knowledge bases, machine learning (in particular deep
learning), information retrieval, data mining and knowledge discovery in large
datasets, natural language processing, image processing and pattern recognition,
embedded and autonomous systems, neural networks and genetic algorithms,
robot control, semantic technologies, recommender systems, legal and ethical
aspects of the development and use of AI systems, etc.</p>
      <p>The successful graduates of the master’s program in AI are able to apply
their knowledge and skills in research and educational organizations, as well as
in leading software companies in the development of, for example:
• software for data analysis and knowledge discovery in big data;
• software for semantic web and semantic network services;
• intelligent search engines;
• intelligent user interfaces;
• expert systems, recommender systems, intelligent virtual assistants,
intelligent learning environments and other types of knowledge-based
software systems;
• smart databases;
• image processing and image recognition tools;
• different types of intelligent embedded systems: intelligent robots, smart
home systems, etc.</p>
      <p>The education in the master’s program follows the good
methodological practices of combining the accumulation of abstract theoretical knowledge
through lectures and providing various opportunities for its understanding and
acquiring skills for its application in real problem situations through workshops,
homework assignments and especially in the development of appropriate course
projects, many of which act as bridges between different subjects.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Theoretical aspects – knowledge modeling and reasoning</title>
      <p>The curriculum of the master’s program includes two compulsory courses, whose
curricula consistently cover the theoretical foundations and some technological
issues of semantic interoperability.</p>
      <p>
        The Knowledge Representation and Engineering course has mostly abstract
content and introduces the fundamental principles of functioning and the modern
methods for creation of knowledge-based systems (KBS). Following the
methodology proposed by Brachman and Levesque in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], the course introduces the basic
principles of functioning and some advanced methods for design and
implementation of KBS. Special attention is paid to the problems of domain analysis and
the conceptualization of domain knowledge. The most important theoretical and
practical aspects of a set of classical and modern methods for knowledge
representation and reasoning are discussed. Students who have successfully passed the
course in Knowledge Representation and Engineering are expected to be able to
analyze and construct conceptual models of knowledge and to design KBS aimed
to solve complex tasks with various characteristics. The course syllabus covers
the following topics:
• Key concepts: knowledge, knowledge representation and reasoning.
      </p>
      <p>Knowledge-based systems. Knowledge engineering;
• The language of first-order logic (FOL). Syntax, semantics and
pragmatics of FOL;
• Resolution. Reasoning with Horn clauses;
• Production rule systems. RETE algorithm;
• Object-oriented knowledge representation. Frames;
• Structured description of knowledge. Computing entailments.
Taxonomies and classification;
• Inheritance. Strict inheritance. Strategies for defeasible inheritance;
• Default reasoning. Closed-world reasoning. Circumscription;
• Knowledge representation and reasoning with KRL;
• Concepts and language tools for describing information resources with</p>
      <p>RDF/RDFS;
• Ontologies – definition, classification, basic characteristics and
requirements, applications. Concepts and language tools for describing
ontologies with OWL.</p>
      <p>
        As basic readings we recommend the classic textbooks [
        <xref ref-type="bibr" rid="ref1 ref2 ref3">1 – 3</xref>
        ] as well as the
W3C standard recommendations [
        <xref ref-type="bibr" rid="ref4 ref5 ref6">4 – 6</xref>
        ].
      </p>
      <p>The Knowledge Bases course is the second one in the series shown in Fig.
1. It aims to acquaint students with the current state of research and practical
developments in the field of knowledge bases, focusing primarily on the study
of modern tools for creating knowledge bases with different characteristics and
their application in the development of various types of KBS. Issues related to the
basic principles and technologies of the Semantic Web, the semantic
interoperability of information systems, the creation of semantic digital libraries, etc. are
also studied. Here are some of the main topics covered by the course syllabus in
the context of semantic interoperability:
• Semantic web and semantic technologies. Language standards for the
Semantic web;
• Ontology engineering methodologies. Ontology mapping and merging;
• Cyc’s knowledge base – the world’s broadest and deepest commonsense
knowledge base. Cyc’s inference engines;
• Semantic databases. Tools for creating and using semantic databases;
• Semantic annotation. Semantic enhancement. Semantic search;
• Semantic digital libraries.</p>
      <p>The knowledge and skills gained through these compulsory courses are
upgraded by a number of elective courses, among which the most important in
terms of the topic discussed is the Semantic Web one.</p>
      <p>The Semantic Web course presents the basics of semantic technologies and
the work with RDF data and linked open data. The main types of ontologies
and examples of their application are discussed. Methods for implementation and
work with semantic knowledge graphs and their applications are presented. The
course has been taught by experts from the recognized leader in enterprise
knowledge graph technology and semantic database engines Ontotext1 and covers
several specific topics including
1
https://www.ontotext.com/
• Knowledge graphs;
• RDF data model and its serialization formats;
• Semantic integration of heterogeneous data;
• Linked open data;
• Data visualization.</p>
      <p>The issues related to the semantic interoperability and the reusability of
knowledge and data, in particular in unforeseen problem situations, connect these
courses and form one of the thematic areas of study in the master’s program in AI.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Practical aspects – course projects</title>
      <p>A significant part of the students’ independent work, aimed at understanding
and mastering the abstract theory, is related to the preparation of homework
assignments and the development of course projects.</p>
      <p>Most homework assignments and course projects have generic topics and
formulations that may be specified by the individual student depending on his/
her interests and preferences.</p>
      <p>Here are several examples in this regard.</p>
      <p>Example 1</p>
      <p>
        Design a knowledge base for a subject area of your choice. The concepts and
their properties (roles) should be described in terms of description logic (the DL
language [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]).
      </p>
      <p>
        Based on these descriptions, build a corresponding ontology implemented
with the means of Protégé/OWL [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] (concepts ↔ classes, roles ↔ properties,
constants ↔ individuals/instances).
      </p>
      <p>The knowledge base should include both atomic and different types of
nonatomic concepts (constructed by the operators EXISTS, FILLS, ALL, AND).
Provide appropriate statements of the three main types: d ⊑ e, d ≐ e, c → e.</p>
      <p>Quantitative characteristics:
• number of concepts (classes): at least 20,
• number of constants (individuals/instances): at least 10,
• roles (properties): at least 10. Include properties with different
characteristics (inverse, functional, transitive) and with appropriate and diverse
domains and ranges.</p>
      <p>Describe appropriate examples for automatic reasoning (using a reasoner of
your choice) on the knowledge base – at least one inference of the type KB ╞ (c
→ e) and at least one inference of the type KB ╞ (d ⊑ e).</p>
      <p>Describe at least one example of classification of the knowledge base. The
same example should be illustrated with Protégé/OWL.
Example 2</p>
      <p>Based on a series of paragraphs (one or more) in an article of your choice in
Wikipedia, create an ontology that presents the concepts, objects, and
relationships described in the text. Implement the ontology in Protégé/OWL or Apache
Jena/OWL2 and check its consistency.</p>
      <p>The paragraphs in the article should be selected so that the ontology contains
both primitive and defined classes.</p>
      <p>Describe an appropriate example for performing automatic reasoning based
on the created ontology.</p>
      <p>Example 3</p>
      <p>
        The project is aimed at in-memory implementation of the Web Annotation
Data Model [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. The task has a general formulation as follows.
      </p>
      <p>Write a program that implements semantic annotation of text with support
for the main elements of the annotation model (body, target, selector – for
example text position selector).</p>
      <p>Your program should read a short text (no longer than two paragraphs) and
annotate it based on a publicly available ontology of your choice, tailored to the
content of the text. The result of the work of the program should include finding
the location in the text of at least three previously known (explicitly stated)
concepts from the ontology.</p>
      <p>
        For the implementation of the project students may use technology of their
choice. A preferred option is the choice of the DBpedia ontology3, programming
in Java and presentation of the annotation in an open format, which facilitates
its use for various purposes – for example, presentation based on JSON-LD [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
Thus, in the process of developing their course project, students learn and master
the work with new technologies and software platforms.
      </p>
      <p>Usually many students take the opportunity to work on course projects on
topics suggested by themselves (and agreed with the professor) and often such
course projects grow into valuable master’s theses.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Research and development – good practices of master’s theses</title>
      <p>Traditionally, graduates of our master’s program in AI develop excellent
diploma projects in modern and complex areas. The results achieved in most of them
have been published by graduates and their supervisors in authoritative specialized
scientific journals. In most cases, reusability and semantic interoperability with
other systems are part of the characteristics of the developed software products.</p>
      <p>
        As an example of good practice in this regard, we can consider the master’s
thesis entitled “Virtual health assistant” [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], defended in March 2021.
https://jena.apache.org/documentation/inference/#owl
https://wiki.dbpedia.org/
      </p>
      <p>The aim of the thesis is to create a web-based virtual medical assistant that
provides users with fast and convenient health information related to the
symptoms and treatment of various socially significant diseases. For this purpose, the
healthcare assistant uses an appropriate knowledge base. It supports functionality
for automatic collection of data from verified sources on the Internet, processing
this data, and building and extending a knowledge graph, which is the main
component of the knowledge base.</p>
      <p>The health assistant provides a user-friendly interface and receives as input
a set of symptoms related to the condition and sufferings of the user. As a result,
the assistant generates an appropriate answer, indicating probable diagnoses and
detailed information about each of them, including a description of the disease,
its synonyms and symptoms, as well as medications that help to treat it.</p>
      <p>In addition to the information provided, the healthcare assistant asks
questions about more symptoms that the user may have missed. If the user indicates
other symptoms, the result of the assistant’s work can be updated. All components
of the health assistant can be easily expanded with additional functionalities.</p>
      <p>Another good example of a master’s thesis that successfully addresses most
issues of semantic interoperability is the one on “Intelligent system for answering
specialized questions about COVID-19”. It is aimed at development of a
question answering system based on information retrieval, natural language
processing and text mining techniques. For the implementation of the system and the
conduct of the planned experiments with it, the freely available COVID-19 Open
Research Dataset (CORD-19) presented in one of the Kaggle competitions4 has
been used. CORD-19 is prepared as a reliable set of more than 500,000
scholarly resources about COVID-19, SARS-CoV-2 and related coronaviruses in order
to assist the medical community in preparing answers to as many high-priority
questions related to COVID-19 as possible.</p>
      <p>
        After the necessary data processing, the system uses BERT [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] – a
pretrained model for recognizing the context of the words in the question and the
possible answers. BERT uses neural networks to find the most accurate answer
to a given question.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>The analysis of the experience of the master’s program in Artificial Intelligence at
Sofia University for nearly 20 years shows that the chosen approach of combining
lecture courses, providing deep theoretical knowledge at an abstract level, with
the challenge for students to acquire modern technological skills in the process
of developing proper course and diploma projects, gives very good results in
the education of specialists in AI at master’s level. It is particularly suitable for
4
training in a number of areas that underlie the acquisition of knowledge and skills
to create semantically interoperable information systems that can work flexibly
with large heterogeneous datasets.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgements</title>
      <p>The presented work has been supported by Project BG05M2P001-1.001-0004
“Universities for Science, Informatics and Technologies in the e-Society (UNITe)”
funded by Operational Program “Science and Education for Smart Growth”
cofunded by European Regional Development Fund.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Russell</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norvig</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Artificial Intelligence:
          <string-name>
            <given-names>A Modern</given-names>
            <surname>Approach</surname>
          </string-name>
          (3rd ed.).
          <source>Pearson Education Ltd</source>
          . (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Brachman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Levesque</surname>
          </string-name>
          , H.:
          <article-title>Knowledge Representation and Reasoning</article-title>
          . Elsevier (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Brachman</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Levesque</surname>
          </string-name>
          , H.:
          <article-title>Readings in Knowledge Representation</article-title>
          . Morgan Kaufmann (
          <year>1985</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <article-title>4. RDF 1.1 Concepts and Abstract Syntax</article-title>
          .
          <source>W3C Recommendation 25 February</source>
          <year>2014</year>
          . http://www. w3.org/TR/rdf11-concepts/,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <source>RDF Schema 1.1. W3C Recommendation 25 February</source>
          <year>2014</year>
          . http://www.w3.org/TR/rdf-schema,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <article-title>6. OWL 2 Web Ontology Language Document Overview (Second Edition)</article-title>
          .
          <source>W3C Recommendation 11 December</source>
          <year>2012</year>
          . http://www.w3.org/TR/owl2-overview/,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Horridge</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brandt</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>A Practical Guide to Building OWL Ontologies Using Protégé 4</article-title>
          and
          <string-name>
            <surname>CO-ODE</surname>
            <given-names>Tools</given-names>
          </string-name>
          ,
          <source>Edition</source>
          <volume>1</volume>
          .3. University of Manchester (
          <year>2011</year>
          ). http://owl.cs. manchester.ac.uk/research/co-ode,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Sanderson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ciccarese</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Young</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Web Annotation Data Model (W3C Recommendation 23 February</article-title>
          <year>2017</year>
          ). https://www.w3.org/TR/annotation-model/,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <article-title>9. JSON for Linking Data</article-title>
          . https://json-ld.org/,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Tsanova</surname>
          </string-name>
          , R.:
          <source>Virtual Health Assistant. Master Thesis. Faculty of Mathematics and Informatics</source>
          , Sofia University St. Kliment
          <string-name>
            <surname>Ohridski</surname>
          </string-name>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Devlin</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chang</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Toutanova</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          : BERT:
          <article-title>Pre-training of Deep Bidirectional Transformers for Language Understanding</article-title>
          .
          <source>Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies</source>
          , Vol.
          <volume>1</volume>
          , pp.
          <fpage>4171</fpage>
          -
          <lpage>4186</lpage>
          . Association for Computational Linguistics (
          <year>2019</year>
          ). https://www.aclweb. org/anthology/N19-1423.pdf,
          <source>last accessed</source>
          <year>2021</year>
          /03/30.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>