<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>An Agent-Based Simulation Perspective for Learning/Merging Ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Adrian Giurca</string-name>
          <email>Giurca@tu-cottbus.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gerd Wagner</string-name>
          <email>G.Wagner@tu-cottbus.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Brandenburgische Technische Universit ̈at</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>Ontologies can be learned from various sources, be it databases, structured and
unstructured (Web) documents or even existing preliminaries such as
dictionaries and taxonomies. In addition, the distributed nature of ontology development
has led to a large number of different ontologies covering the same or overlapping
domains therefore the research community should deal with issues such as
ontology mapping and merging too. This topic is addressed by the cognitive science
community by means of language learning simulation. The problem of
ontology learning overlaps with the one of language learning: both of them address
the issues of learning from text, learning of concepts and taxonomies. Ontology
mapping can be viewed also as a language learning process since it defines in
fact a common vocabulary derived from the previous non-mapped
vocabularies. Our proposal is to investigate the potential of an agent-based discrete event
simulation framework to perform simulations resulting in language learning and
evolution and consequently offering other solutions to the ontology learning and
mapping problems and/or evaluating others solutions.</p>
      <p>
        Individual learning is the knowledge acquired in every situation in which an
agent reacts and processes data, including its beliefs about its actions in order to
improve the performance in similar situations in the future. Such process aims
to align the agent beliefs to the objective real world. Usually, in the initial state,
the agents will have no common lexicon and therefore no understanding of what
other agents say to them. The expectation is, that the agents will develop in
time a shared vocabulary and ultimately a shared ontology (see [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] and [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]).
Although agents start without any knowledge about the world, so that they
have no representations of meaning, the goal is to have a population evolving a
common language with which they can communicate.
      </p>
      <p>
        A comprehensive classification of ontology learning approaches and tools
before 2000 can be found in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The term ontology learning for the Semantic
Web was coined by Maedche and Staab [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and largely addressed in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. They
established a research direction and specified a first architecture for ontology
learning. After that a number of tools were created. Significantly we see: AIBF,
TextToOnto ([
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]), DFKI OntoLT ([
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]), DFKI RelExt ([
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]), but for sure there
are many others. A good reference about all these works is [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Recently an
Ontology Learning Layer Cake discussing learning of terms, synonyms, concepts,
taxonomies, relations and axioms/rules was introduced (see [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]).
      </p>
      <p>
        In the last ten years many researchers developed methodologies and tools for
ontology mapping and ontology merging, critical operations for information
exchange on the Semantic Web. A proposal for ontology mapping was introduced
in 2004 ([
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]). The work proposed to determine similarities through rules which
have been encoded by ontology experts. A more theoretical work ([
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]) proposed
an algebraic solution to capture merging of ontologies by pushouts construction
from category theory. They built this solution independent of a specific choice
of ontology representation. Another solution was proposed by the GLUE
system ([
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]) who introduced a machine learning approach to find ontology
mappings. Started in 2004, the Ontology Alignment Evaluation Initiative aims to
describe a form of consensus with respect of (a) assessing strength and weakness
of alignment/matching systems; (b) comparing performance of techniques, and
(c) improve evaluation techniques, through the controlled experimental
evaluation of the techniques performances. The initiative delivered an API for ontology
alignment ([
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and recently a book was published [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>An Agent-Based Discrete Event Simulation Framework</title>
      <p>
        AOR Simulation provides an agent-based discrete event simulation framework
(http://aor-simulation.org) based on a high-level rule-based simulation
language (AORSL) and an abstract simulator architecture and execution model
with a reference Java implementation. Its main concepts have been proposed in
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and a Java-based simulation tool (AOR-JavaSim) has been developed.
      </p>
      <p>A simulation scenario is expressed in the AOR Simulation Language (AORSL)
and then Java source code is generated, compiled to Java byte code and finally
executed. It consists of a simulation model, an initial state of the world and
possibly view definitions. The simulation model consists of: (1) an optional space
model (needed for physical objects/agents visualization); (2) a set of entity types,
including event types, messages, objects and agent types; (3) a set of
environment rules, which define causality laws governing the environment state changes.
A simulation can use various space models characterized by: (i) dimension (1D,
2D or 3D); (ii) discrete/continuous and (iii) geometry (Euclidean or Toroidal).</p>
      <p>An agent type is defined by means of: (1) a set of (objective) properties;
(2) a set of (subjective) self-belief properties; (3) a set of (subjective) belief
entity types; (4) a set of agent rules, which define the agent’s reactive behavior
in response to events and (5) an optional set of communication rules defining
the agent-to-agent communication capabilities. Agent beliefs might be defined
as knowledge of the entity about it self and/or about the external world: objects,
events or other agents. Therefore an agent may have two types of beliefs (Figure
1): (1) self beliefs properties - knowledge of the agent about it self; (2) belief
entities - knowledge of the agent about other agents, objects or events related
to its world during a simulation. The upper level ontological categories of AOR
Simulation are messages, events and objects. Objects include agents, physical
objects and physical agents.</p>
      <p>The ontology of event types (see Figure 2): (a) environment events types
(including exogenous events types, perception event types and action event types),
and (b) internal events (such as actual perception event types and periodic event
types) has been proven to be fundamental in AOR Simulation. Internal events
are those events that happen ”in the mind ” of the agent. For modeling distorted
perceptions, both a perception event type and the corresponding actual
perception event type can be defined and related with each other via actual perception
mapping rules. Both the behavior of the environment (its causality laws) and the
behavior of agents are modeled with the help of rules, thus supporting high-level
declarative behavior modeling.</p>
      <p>AOR Simulation supports the distinction between facts and beliefs, including
self-beliefs (the agent’s beliefs about itself).
3</p>
    </sec>
    <sec id="sec-3">
      <title>Research Opportunities</title>
      <p>
        The typical AOR scenario for ontology learning and merging/mapping consists
in a number of agent types, each of them having their own vocabulary about the
real world. The agents interactions are the only way to communicate knowledge.
A potential solution requires achievements on the following research questions:
1. AOR agents must be equipped with individual learning capabilities.
However, there are several ways of implementing learning capabilities. Which learning
capabilities should offer AOR? Can we use just the machine learning community
achievements as they are or specific solutions have to be considered? Looks like
the standard individual learning can be implemented through Reinforcement
Learning (RL), [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. However, since the agents reasoning is encoded by means
of rules the standard RL mechanics had to be adjusted accordingly. It seems
that we will not use an explicit reward function based on a crisp optimization
criterion. Our implicit reward does not reflect an objective function to be
optimized (as in typical evolutionary algorithm applications), nor a concrete task to
be performed optimally (as in evolutionary robotics). Our agents only need to
survive and communicate in their environment (as in some ALife systems).
      </p>
      <p>2. Is the agent memory necessary? Is this related just to the remembering of
the agents previous actions or it may be necessary a memory of its past beliefs
too? From the learning perspective, the agent needs a memory of its last
experience for every action, where experience means a positive reward, negative
reward or failed action. It, may need to remember all the perception events and
messages that were present at the time step of that last experience. This enables
agents to learn new mappings between state and actions by comparing previous
experiences.</p>
      <p>3. What kind of reasoning capabilities are necessary for the agent?
Evolutionary learning and individual learning should both be performed by the agent
reasoner. Hence, an agent can be created with a specific reasoner but change it
during its lifetime by performing lifetime learning.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>We have argued that the problem of merging ontologies by discovering ontology
mappings might be also addressed by using an agent-based simulation based
on existing literature, theories of learning, our experience, and an observational
case study. In this position paper we developed a number of research questions
that need to be investigated towards using cognitive science techniques to
perform ontology learning and merging. The simulation results can be used by
ontology engineers in the manual process of ontology learning/merging/refining
or might be integrated in other tools for semi-automatic processing. From the
main problem perspective, we see that the automated ontology learning/merging
is a complex task. Based on our investigation, the problems users experience go
beyond the processing of the algorithms. Users have to keep in mind what they
have looked at and executed, to understand output from different algorithms, to
be able to reverse their decisions, and to gather evidence to support their
decisions. We believe that all these problems have to be addressed in an agent-based
simulation and they constitute key assets for a successful solution.</p>
      <p>We look towards other researchers feedback including ones which are
interested to join our initiative.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Gopnik</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meltzoff</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          : Words, Thoughts, and
          <string-name>
            <surname>Theories</surname>
          </string-name>
          (Learning, Development, and Conceptual Change). Cambridge, MA, MIT Press (
          <year>1997</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Vogt</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>The emergence of compositional structures in perceptually grounded language games</article-title>
          .
          <source>Artificial Intelligence</source>
          <volume>167</volume>
          (
          <year>2005</year>
          )
          <fpage>206</fpage>
          -
          <lpage>242</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Staab</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Learning ontologies for the Semantic Web</article-title>
          .
          <source>In: In Proceedings of the Second International Workshop on the Semantic Web</source>
          . (
          <year>2001</year>
          )
          <fpage>200</fpage>
          -
          <lpage>210</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Staab</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Ontology learning for the semantic web</article-title>
          .
          <source>IEEE Intelligent Systems</source>
          <volume>16</volume>
          (
          <year>2001</year>
          )
          <fpage>72</fpage>
          -
          <lpage>79</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Ontology Learning for the Semantic Web</article-title>
          .
          <source>PhD thesis</source>
          , Universit¨at Karlsruhe (TH),
          <source>Universit¨at Karlsruhe (TH)</source>
          ,
          <string-name>
            <surname>Institut</surname>
            <given-names>AIFB</given-names>
          </string-name>
          , D-76128
          <string-name>
            <surname>Karlsruhe</surname>
          </string-name>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Maedche</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Staab</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Ontology Learning from Text</article-title>
          .
          <source>In: Natural Language Processing and Information Systems, 5th International Conference on Applications of Natural Language to Information Systems, NLDB 2000. Volume 1959 of Lecture Notes in Computer Science</source>
          ., Springer (
          <year>2000</year>
          )
          <fpage>364</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , V¨olker, J.:
          <source>Text2Onto. In: Natural Language Processing and Information Systems, 10th International Conference on Applications of Natural Language to Information Systems</source>
          ,
          <string-name>
            <surname>NLDB</surname>
          </string-name>
          <year>2005</year>
          . Volume
          <volume>3513</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2005</year>
          )
          <fpage>227</fpage>
          -
          <lpage>238</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Olejnik</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sintek</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>A protege plug-in for ontology extraction from text based on linguistic analysis</article-title>
          .
          <source>In: The Semantic Web: Research and Applications, First European Semantic Web Symposium</source>
          ,
          <string-name>
            <surname>ESWS</surname>
          </string-name>
          <year>2004</year>
          . Volume
          <volume>3053</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Schutz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>RelExt: A Tool for Relation Extraction from Text in Ontology Extension</article-title>
          . In: International Semantic Web Conference,
          <string-name>
            <surname>ISWC</surname>
          </string-name>
          <year>2005</year>
          . Volume
          <volume>3729</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2005</year>
          )
          <fpage>593</fpage>
          -
          <lpage>606</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Buitelaar</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Magnini</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Ontology Learning from Text: Methods, Evaluation and Applications</article-title>
          .
          <source>Frontiers in Artificial Intelligence and Applications</source>
          . IOS Press (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Cimiano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Ontology Learning and Population from Text</article-title>
          .
          <source>PhD thesis</source>
          , Universit¨at Karlsruhe (TH),
          <source>Universit¨at Karlsruhe (TH)</source>
          ,
          <string-name>
            <surname>Institut</surname>
            <given-names>AIFB</given-names>
          </string-name>
          , D-76128
          <string-name>
            <surname>Karlsruhe</surname>
          </string-name>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Ehrig</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sure</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Ontology mapping - an integrated approach</article-title>
          .
          <source>In: The Semantic Web: Research and Applications, First European Semantic Web Symposium</source>
          ,
          <string-name>
            <surname>ESWS</surname>
          </string-name>
          <year>2004</year>
          . Volume
          <volume>3053</volume>
          of Lecture Notes in Computer Science., Springer Verlag (
          <year>2004</year>
          )
          <fpage>76</fpage>
          -
          <lpage>91</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Hitzler</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , Kr¨otzsch,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Ehrig</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Sure</surname>
          </string-name>
          ,
          <string-name>
            <surname>Y.</surname>
          </string-name>
          :
          <article-title>What is ontology merging? - a category theoretic perspective using pushouts</article-title>
          .
          <source>In: In Proc. First International Workshop on Contexts and Ontologies: Theory, Practice and Applications</source>
          , AAAI Press (
          <year>2005</year>
          )
          <fpage>104</fpage>
          -
          <lpage>107</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Doan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Madhavan</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dhamankar</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Domingos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Halevy</surname>
            ,
            <given-names>A.Y.</given-names>
          </string-name>
          :
          <article-title>Learning to match ontologies on the Semantic Web</article-title>
          .
          <source>VLDB Journal</source>
          <volume>12</volume>
          (
          <year>2003</year>
          )
          <fpage>303</fpage>
          -
          <lpage>319</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>An api for ontology alignment</article-title>
          .
          <source>In: The Semantic Web - ISWC 2004: Third International Semantic Web Conference</source>
          . Volume
          <volume>3298</volume>
          of Lecture Notes in Computer Science., Springer (
          <year>2004</year>
          )
          <fpage>698</fpage>
          -
          <lpage>712</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Euzenat</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shvaiko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : Ontology matching. Springer-Verlag, Heidelberg (DE) (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Wagner</surname>
          </string-name>
          , G.:
          <article-title>AOR Modelling and Simulation - Towards a General Architecture for Agent-Based Discrete Event Simulation</article-title>
          .
          <source>In: Agent-Oriented Information Systems. Volume 3030 of LNAI</source>
          . Springer-Verlag (
          <year>2004</year>
          )
          <fpage>174</fpage>
          -
          <lpage>188</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Sutton</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barto</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Reinforcement Learning: An Introduction</article-title>
          . Cambridge: MIT Press (
          <year>1998</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>