<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Learning about Actions and Events in Shared NeMuS</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Milena Rodrigues Tenorio</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Edjard de Souza Mota</string-name>
          <email>edjardg@icomp.ufam.edu.br</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jacob M. Howe</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Artur S. d'Avila Garcez</string-name>
          <email>a.garcezg@city.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>City, University of London</institution>
          ,
          <addr-line>London, EC1V 0HB</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Universidade Federal do Amazonas, Instituto de Computaca~o, Campus Setor Norte Coroado - Manaus - AM - Brasil CEP: 69080-900</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Discussion on Inductive Learning about Dynamic Data Our scenario on the realm of Driving o ences considering a small portion of it in a usual tra c light. Consider four cars c1, c2, c3 and c4, and a tra c light tl1 on a street s1, as depicted in Figure 1.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        The categorization process of information from pure data or learned in
unsupervised arti cial neural networks is still manual, especially in the labeling phase.
Such a process is fundamental to knowledge representation [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], especially for
symbol-based systems like logic, natural language processing and textual
information retrieval. Unfortunately, applying categorization theory in large volumes
of data does not lead to good results mainly because there is no generic and
systematic way of categorizing such data processed by arti cial neural networks
and joining investigated conceptual structures.
      </p>
      <p>
        Connectionist approaches are capable of extracting information from
articial neural networks, but categorizing them as symbolic knowledge have been
little explored. The obstacle lies on the di culty to nd logical justi cation from
response patterns of these networks [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. This gets worse when considering
inductive learning from dynamic data which is very important to Cognitive Sciences
that considers categorization as a mental operation of classifying objects, actions
and events [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
      </p>
      <p>
        We shall address the discoveries of our on-going investigation on the problem
of inductively learning (IL) from dynamic data by applying a novel framework for
neural-symbolic representation and reasoning called share Neural Multi-Space
(NeMuS) used in the Amao system[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Instead of woking like traditional
approaches for ILP, e.g. [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], Amao uses a shared NeMuS of a give background
knowledge (BK) and uses inverse uni cation as the generalization mechanism
of a set of logically connected expressions from the Herbrand Base (HB) of BK
that de nes positive examples.
      </p>
      <p>
        The logical entities considered are based on dynamic nature of the data[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],
like a historical database about a tra c light. No external action is assumed to
in uence this scenario and the passage of time is based on actions on it.
car(c1). is at(c1,s1). is direction(c1,r).
car(c2). is at(c2,s1). is direction(c2,r).
car(c3). is at(c3,s1). is direction(c3,r).
car(c4). is at(c4,s1). is direction(c4,r).
street(s1). is at(tl1,s1). is direction(s1,r).
traffic light(tl1).
      </p>
      <p>There are four moments of interest.M1: All cars are moving; M2: c1 stopped
on street; M3: tl1 signals warning, so c2 has stopped; and M4: tl1 stops
blinking yellow and goes to stop sign (red), then c3 has stopped.</p>
      <p>M1 M2 M3 M4
~warning(tl1,w1).
~go(tl1,g1).
~move(c1,t3).
~move(c2,t3).
~move(c3,t3).
move(c4,t3)..
go(tl1,g0).
move(c1,t0). ~move(c1,t1). ~move(c1,t2).
move(c2,t0). move(c2,t1). ~move(c2,t2).
move(c3,t0). move(c3,t1). move(c3,t2).
move(c4,t0). move(c4,t1). move(c4,t2).
during(t0,t2,g0). during(t2,t2,w0).
during(t3,t3,g1). during(t3,t3,w1).</p>
      <p>Change through time of an entity (car or tra c light) is represented by a
change from positive to negative literal of move, warning and go. The goal is to
identify which cars have committed a tra c light or driving o ense. Tra c
regulations would point that c1 and c4 violated such laws. c1 is blocking (it stopped)
tra c on s1 while tl1 indicates to go, and c4 is moving when tl1 is indicating
to stop. For lack of space, we consider just the target block offence(C) with
positive example block offence(c1) and negative ~block offence(c2), and
the target driving offence(C) with positive example driving offence(c4)
and negative ~driving offence(c3). The following (unsual long) hypothesis
should be generated.
block_offence(C); car(C); traffic_light(TL); is_at(C,S); is_at(TL,S);
move(C,TA); go(TL,GA); ~move(C,TB); warning(TL,W1);
during(TA,TB,GA); during(TX,TY,W1).
driving_offence(C); car(C); traffic_light(TL); is_at(C,S); is_at(TL,S);
move(C,TA); go(TL,GA); move(C,TB); ~go(TL,GB);
during(TA,TX,GA); during(TY,TB,GB).</p>
      <p>Shared NeMuS codes allow us to know that (1) the car and tra c light
are on the same street, and (2) the car has the same direction of the street.
Predicate code 2 can be ignored inasmuch as it is unnecessary information,
because it is a rule that involves carriage movement and obedience to tra c light.
Amao gets the bindings relations (occurrences) the given objects as positive and
negative examples. As c1, c2, c3, and c4 are cars they belong to the same region
of predicate codes. is at() relating to s1, both have is direction() with r
(right), and have a single object di erent that also relates through is at ()
with s1, the tl1. The di erence between the positive and negative examples
lies in their action predicates, in which c1 performs an action before any change
occurs in t1. We, not in Amao a automatic mechanism, also noticed that the
predicate is direction () and r do not relate in any way to another object or
to action predicates. Thus, we can ignore this information in the construction
of a hypothesis. By inverse uni cation, Amao nds a linkage pattern between
is at(C,S) and is at(TL,S), and thus connecting the car and the tra c light.
3</p>
    </sec>
    <sec id="sec-2">
      <title>Concluding Remarks</title>
      <p>The example explored here is small, and yet we have a long rule. An example
with more information, such as velocity, position of the car and people on the
street,their relations we will have many ways to nd hypotheses. We aim to
overcome this challenge by using shared NeMuS weight to to group the predicates
that form an intermediate concept, an abstraction, so that we can add only the
predicates needed for the rules.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Cohen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lefebvre</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Handbook of categorization in cognitive science</article-title>
          .
          <source>Elsevier</source>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>d'Avila Garcez</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Broda</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gabbay</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <source>Neural-Symbolic Learning Systems: Foundations and Applications</source>
          , Perspectives in Neural Computing. Springer-Verlag (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Gardenfors</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Concept learning and non-monotonic reasoning</article-title>
          .
          <source>In: Handbook of Categorization</source>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Mota</surname>
          </string-name>
          , E.d.S.,
          <string-name>
            <surname>Howe</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garcez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          : In: Besold,
          <string-name>
            <given-names>T.</given-names>
            R.,
            <surname>d'Avila Garcez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Noble</surname>
          </string-name>
          , I. (eds.) To appear
          <source>NeSy 2017 Neural-Symbolic Learning and Reasoning (July)</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Muggleton</surname>
            ,
            <given-names>S.H.:</given-names>
          </string-name>
          <article-title>Inductive Logic Programming</article-title>
          .
          <source>New Generation Computing</source>
          <volume>8</volume>
          (
          <issue>4</issue>
          ),
          <volume>295</volume>
          {
          <fpage>318</fpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Sowa</surname>
            ,
            <given-names>J.F.</given-names>
          </string-name>
          , et al.:
          <article-title>Knowledge representation: logical, philosophical, and computational foundations</article-title>
          , vol.
          <volume>13</volume>
          . MIT Press (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>