<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Athens, Greece
$ sefika.efeoglu@{fu-berlin.de,tu-berlin.de} (S. Efeoglu)</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>GraphMatcher System Presentation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sefika Efeoglu</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Freie Universität Berlin, Department of Computer Science</institution>
          ,
          <addr-line>Takustraße 9, 14195 Berlin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Technische Universität Berlin, Electrical Engineering and Computer Science Department</institution>
          ,
          <addr-line>Marchstraße 23, 10587 Berlin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2023</year>
      </pub-date>
      <volume>000</volume>
      <fpage>0</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>Ontology matching finds a relationship or correspondence between two or more entities in two or more ontologies. To solve the interoperability of the domain ontologies, semantically correspondence entities in these ontologies must be identified and aligned before merging them. GraphMatcher is an ontology matching system using a graph attention approach to compute higher-level representation of a class together with its surrounding terms.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;graph attention</kwd>
        <kwd>graph representation</kwd>
        <kwd>ontology matching</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        networks [
        <xref ref-type="bibr" rid="ref4 ref5 ref6">5, 6, 4</xref>
        ], to identify semantically corresponding concepts within the ontologies. The
graph attention mechanism computes the higher-level representation of a concept and its
surrounding concepts, and the model subsequently determines similarity scores between pairs
of concepts.
      </p>
    </sec>
    <sec id="sec-2">
      <title>1.2. Specific techniques used</title>
      <p>
        GraphMatcher [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] utilizes a graph representation learning approach employing graph
attention [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and a supervised machine learning algorithm with a network consisting of five layers.
The primary contribution is the adaptation of the graph attention mechanism to compute the
higher-level representation of the contextual embedding of the center class. It is important to
note that this year, we submitted the model that yielded the best performance results in its
hyperparameter tuning process. There have been no other improvements or changes to the
model.
      </p>
    </sec>
    <sec id="sec-3">
      <title>1.3. Adaptations made for the evaluation</title>
      <p>
        The GraphMatcher framework has been developed in Python using PyTorch and Ontospy, and
it is packaged by SEALS using MELT [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. However, because of the Universal Sentence Encoder’s
TensorFlow Hub dependency, the model might not run on machines that do not support this
library. In the case of this dependency issue, please use another sentence encoder.
      </p>
    </sec>
    <sec id="sec-4">
      <title>1.4. Parameter settings</title>
      <p>
        The model’s parameters include a learning rate of 0.01, five epochs, weight decay of 0.01, and a
batch size of 32. The threshold is computed from false positive alignments in the validation
data, following the approach proposed by the VeeAlign system [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] 1. These parameters were
determined through five-fold cross-validation. The code is available at https://github.com/
sefeoglu/gat_ontology_matching.
      </p>
      <sec id="sec-4-1">
        <title>2. Results</title>
        <p>The results of the GraphMatcher in the OAEI 2023 conference tracks are available at https:
//oaei.ontologymatching.org/2023/results/conference/.</p>
      </sec>
      <sec id="sec-4-2">
        <title>3. General Comments</title>
        <p>
          We plan to change the algorithm to an unsupervised machine learning approach in its next
version, as there is no explicit rule regarding the supervised machine learning approach in the
OAEI. In light of the study introducing the graph attention approach [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ], this algorithm has
also been adapted to the unsupervised approach.
1The project uses VeeAlign’s approach directly to compute the threshold with the permission of the first author.
        </p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Efeoglu</surname>
          </string-name>
          ,
          <article-title>Graphmatcher: A graph representation learning approach for ontology matching (</article-title>
          <year>2022</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>P.</given-names>
            <surname>Veličković</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Cucurull</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Casanova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Romero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Liò</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Bengio</surname>
          </string-name>
          , Graph attention networks (
          <year>2018</year>
          ). arXiv:
          <volume>1710</volume>
          .
          <fpage>10903</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>P.</given-names>
            <surname>Kolyvakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalousis</surname>
          </string-name>
          , D. Kiritsis,
          <article-title>DeepAlignment: Unsupervised ontology matching with refined word vectors</article-title>
          ,
          <source>in: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies</source>
          , Volume
          <volume>1</volume>
          (
          <string-name>
            <surname>Long</surname>
            <given-names>Papers)</given-names>
          </string-name>
          ,
          <source>ACL</source>
          ,
          <year>2018</year>
          , pp.
          <fpage>787</fpage>
          -
          <lpage>798</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>V.</given-names>
            <surname>Iyer1</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Agarwal</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Kumar</surname>
          </string-name>
          ,
          <article-title>Veealign: A supervised deep learning approach to ontology alignment (</article-title>
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Bento</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Zouaq</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gagnon</surname>
          </string-name>
          ,
          <article-title>Ontology matching using convolutional neural networks</article-title>
          ,
          <source>in: Proceedings of the 12th Language Resources and Evaluation Conference</source>
          , ELRA, Marseille, France,
          <year>2020</year>
          , pp.
          <fpage>5648</fpage>
          -
          <lpage>5653</lpage>
          . URL: https://www.aclweb.org/anthology/2020.lrec-
          <volume>1</volume>
          .
          <fpage>693</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>J.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Gu</surname>
          </string-name>
          ,
          <article-title>Adol: a novel framework for automatic domain ontology learning</article-title>
          ,
          <source>Super Computing</source>
          (
          <year>2021</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>S.</given-names>
            <surname>Hertling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Portisch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Paulheim</surname>
          </string-name>
          ,
          <article-title>Melt - matching evaluation toolkit</article-title>
          , in: M.
          <string-name>
            <surname>Acosta</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Cudré-Mauroux</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Maleshkova</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Pellegrini</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <string-name>
            <surname>Sack</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Sure-Vetter</surname>
          </string-name>
          (Eds.),
          <source>Semantic Systems. The Power of AI and Knowledge Graphs</source>
          , Springer International Publishing, Cham,
          <year>2019</year>
          , pp.
          <fpage>231</fpage>
          -
          <lpage>245</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>