<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Concept Learning in Engineering based on ⋆ Refinement Operator</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Informatics, Karlsruhe Institute of Technology 76131 Karlsruhe</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>Semantic interoperability has been acknowledged as a challenge for industrial engineering due to the heterogeneity of data models in the involved software tools. In this paper, we show how to learn declarative class definitions of engineering objects in the XML-based data format AutomationML (AML). Specifically, we transform AML document to the description logic OWL 2 DL and use the DL-Learner framework to learn the concepts of named classes. Moreover, we extend the ALC refinement operator in DL-Learner by exploiting the syntax specification of AML and show significant better learning performance.</p>
      </abstract>
      <kwd-group>
        <kwd>Concept Learning</kwd>
        <kwd>Description Logics</kwd>
        <kwd>AutomationML</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Engineering is referred to as the activities for designing, testing and
commissioning complex industrial plants [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The engineering life cycle requires efficient data
exchange between software tools, where semantic interoperability plays a central
role. A lot of standardization groups are working at the semantic unification in
various engineering subfields, but a ”Super Data Model” that meets the needs
of all tasks would not appear in the near future [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. To enable data exchange
between engineering tools, the international standard AML1 (IEC 62714) proposes
an XML-based approach [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]:
of interfaces e.g. SignalInterface. They are modeled in subsumption
hierarchies and can be extended to cover tool-specific terminologies. We call the
role and interface classes as the concrete conceptual model of AML.
– Finally, AML specifies how to use the abstract and the concrete conceptual
model to exchange data between engineering software tools.
      </p>
      <p>
        The motivation of AML is to neutralize tool-specific data using the
aforementioned conceptual models. Nevertheless, the standardized role and interface
classes can not satisfy individual modeling requirements, since they lack of
sufficient semantic expressiveness for describing tool-specific engineering objects. In
practice, the user has to extend these classes and leave the semantic
interpretation as a functionality of the data importer. This problem encourages the study
of concept learning from engineering data in AML [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], i.e. inducing descriptions
of named engineering classes in terms of AML class-, attribute- and interface
names.
      </p>
      <p>
        Semantic web technologies such as RDF(S) and OWL are popular tools to
achieve interoperability in the World Wide Web. Several studies from the
engineering domain have shown that transforming XML-based data to RDF(S)/OWL
ontologies enhances the semantic interoperability with automated reasoning [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ][
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
In this paper, we transform AML to the description logic OWL 2 DL and
derive descriptions of named engineering classes using the well-known framework
DL-Learner [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. DL-Learner is an open-source project for concept learning in
description logics. Among other important features, a downward refinement
operator ρ for ALC was proposed, which was extended to an operator for ALCQ
with the support of concrete roles [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Based on ρ, two algorithms OCEL [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]
and CELOE [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] are implemented to learn concepts in description logics. It is
worth noting that DL-Learner employs a partial closed-world reasoner for two
reasons: a) it is much faster than a standard OWL reasoner, and b) machine
learning tasks often desire closed world reasoning. In this paper, we study the
performance of DL-Learner and argue that for our particular task, the
refinement operator ρ is not quite efficient since it disregards the constraints exposed
in the underlying XML schema of AML. Therefore, we propose an extension to
ρ in its ALC part in section 3 and compare the results with the original one in
section 4.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Preliminaries</title>
      <p>Figure 1 shows the main components of AML. Modeling in AML usually begins
with the hierarchy of user-specific roles and interfaces. Subsumption relations can
be defined among these classes using the XML attribute RefBaseClassPath. The
next step is the modeling of system units which represent reusable engineering
objects, for example the robot model kr5 from the manufacturer KUKA. Each
system unit may consist of interfaces (called as external interfaces) and nested
internal structures (called as internal elements). The composition is illustrated by
the connections with a filled diamond endpoint in figure 1. The star symbol over</p>
      <p>Role
+ Name: String
+ RefBaseClassPath: String</p>
      <p>references
*</p>
      <p>SystemUnit
+ Name: String
hasInternalElement
hasAttribute
hasInterface
*</p>
      <p>Attribute
+ Name: String
*
hasAttribute</p>
      <p>InterfaceClass
+ Name: String
+ RefBaseClassPath: String</p>
      <p>references
*</p>
      <p>ExternalInterface
+ Name: String
one connection means that the cardinality of the composition is unlimited.
Optionally, the semantics of a system unit or an external interface can be specified
as a reference to an AML role or interface class respectively. While an internal
element and an external interface can reference only one single class, a system unit
can reference more than one to allow the modeling of multi-functional devices.
Finally, attributes can be added to describe properties of objects, e.g. kr5.weight.</p>
      <p>In order to learn concepts from AML, we firstly need a formal semantic
representation of the XML-based data. The Web Ontology Language (OWL) is
the W3C standard for knowledge representation on the web and its subset OWL
2 DL is semantically compatible with the SROIQ description logic. Besides
of its decidability, OWL 2 DL provides a rich vocabulary for complex class
expressions, making it a rational choice for the semantic lifting. In particular,
the support of nominals and concrete roles allows us to describe meaningful
engineering concepts. For example, robots which have at least 6 axis from the
manufacturer KUKA can be stated as:</p>
      <p>Robot ⊓ ∃hasManufacturer.[”KUKA”] ⊓ ∃hasNumAxis.[≥ 6]
(1)</p>
      <p>Table 1 shows the mapping strategy from AML to OWL 2 DL. Specifically,
AML role and interface classes are mapped to OWL classes, while system units
and external interfaces are mapped to OWL individuals. Intuitively, relations
between objects are mapped to object properties, and attributes are mapped to
data properties. In this paper, we restrict the scope of the lifted AML
ontology and focus on just two object properties: hasInternalElement (hasIE in short)
and hasExternalInterface (hasEI in short). Because internal elements and
external interfaces can be independent of any AML class, both hasIE and hasEI have
the range as OWL : Thing. The abstract conceptual model of AML is not
transformed since it does not carry useful semantics for engineering. However, we add
an annotation to each lifted AML entity to indicate its role in the XML schema.
For example, each lifted system unit has an annotation of SystemUnit. After the
transformation, we obtain a knowledge base K = (T , A) including a
terminological part T (T-Box) and an assertional part A (A-Box). The T-Box contains the
concept definitions of AML role and interface classes, and the A-Box contains</p>
      <p>AML
role class
interface class
system unit
external interface
relationship
attribute</p>
      <p>OWL 2 DL DL
class concept
class concept
individual object
individual object
object property abstract role
data property concrete role</p>
      <p>Example</p>
      <p>Robot
SignalInterface</p>
      <p>kr5
kr5 digitalIn1
hasIE, hasEI
hasWeight
the ground facts, i.e. system units and their internal structures. For example,
following assertions are generated for the system unit kr5:
hasManufacturer(kr5, ”KUKA”)
hasExternalInterface(kr5, kr5 digitalIn1)
hasInternalElement(kr5, kr5 arm)</p>
      <sec id="sec-2-1">
        <title>DigitalIOInterface(kr5 digitalIn1)</title>
      </sec>
      <sec id="sec-2-2">
        <title>Robot(kr5 arm)</title>
        <p>(2)
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Concept learning in AutomationML</title>
      <p>
        Concept Learning is a subfield of machine learning which aims to induce a
concept description for a set of positive and negative examples. In this paper, we
focus on concept learning in description logics, and follow the definition of a
learning problem as proposed in [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>Definition 1 (concept learning in description logics). Let Target be a
concept name and K be a knowledge base (not containing Target). Let E = E+ ∪ E−
be a set of examples, where E+ are the positives examples and E− are the
negative examples. The learning problem is to find a concept C ≡ Target with
K ∪ C |= E+ and K ∪ C 6|= E−.</p>
      <p>In the context of AML, the ultimate goal is to learn the description of a named
class from a set of AML system units, since they are models of engineering objects
that we are interested in. Figure 2 illustrates the learning procedure. While the
AML data is mapped to an OWL 2 DL ontology as described before, the user
is expected to select some AML system units as positive examples E+, while
leaving the rest as the negatives E−. Afterwards, a configuration file has to be
generated for the learning system.</p>
      <p>Concept Learning methods often employ refinement operators to reduce the
search space of concept hypotheses. The essential property of the refinement
operator ρ in DL-Learner is its completeness in ALC. That means, starting from
any concept C (including ⊤), ρ will reach the target concept with sufficient
time. Although the support of concrete roles makes ρ incomplete because of
AML</p>
      <p>select
map to</p>
      <p>OWL
pos pos pos
neg</p>
      <p>neg
Background Knowledge</p>
      <p>Config</p>
      <p>setting
DL-Learner
the infiniteness of real numbers, ρ is capable of finding proper concrete roles by
computing splits in the space of real numbers. However, the direct use of ρ would
be inefficient, because it does not take into account the syntactic constraints
defined in the underlying XML schema of AML. Specifically, figure 1 shows that
only external interfaces can reference interface classes and each external interface
can only reference one interface class. These constraints can be integrated into
the refinement operator to improve the performance of learning, especially for a
large T-Box. Therefore, we divide the set of named concepts NC into two subsets
Nar and Nai, where Nar is the set of all AML role classes and Nai is the set of
all AML interface classes. Then we define the sets Mop, Mie and Mei as follows:
Mop = {∃hasIE.⊤, ∃hasEI.⊤, ∀hasIE.⊤, ∀hasEI.⊤}
Mie = {A | A ∈ Nar, ∄A′ ∈ Nar : A ⊏ A }</p>
      <p>′
Mei = {A | A ∈ Nai, ∄A′ ∈ Nai : A ⊏ A }
′
(3)
(4)
(5)</p>
      <p>Mie is the set of top level AML role classes, and Mei is the set of top level
AML interface classes. Further, let Uie = {C1 ⊔ C2 ⊔ ... | Ci ∈ Mie ∪ Mop},
Uei = {C1 ⊔ C2 ⊔ ... | Ci ∈ Mei} and sh↓(C) be the set of direct sub classes of a
named concept C ∈ NC , we extend ρ in the following cases:
– ρ(C) = Uei, if C = ⊤ and C is a filler of hasEI
– ρ(C) = Uie, if C = ⊤ and C is not a filler of hasEI
– ρ(C) = sh↓(C), if C ∈ NC is a filler of hasEI
– ρ(C) = sh↓(C) ∪ {C ⊓ D|D ∈ ρ(⊤)}, if C ∈ NC is not a filler of hasEI</p>
      <p>
        In the other cases, we keep ρ as it was in DL-Learner and omit the details
of it in this paper for brevity. We call the new refinement operator ρaml and
implemented it based on ρ in the DL-Learner framework. Notice that negated
atomic concepts such as ¬A are ignored in both Mie and Mei, since negations are
not preferred in engineering and are not used in practice. Moreover, we do not
refine the filler of hasEI with concept intersections, because one external interface
can reference only one interface class and does not have nested structures. As a
result, ρaml would generate far less refinements than ρ. For example, a refinement
chain ⊤ ∃hasEI.⊤ ∃hasEI.C1 ∃hasEI.(C1 ⊓ C2) could be produced by ρ
but not by ρaml, since (C1 ⊓ C2) is not a proper refinement of the filler of hasEI.
In this section, we compare learning results using the refinement operator ρ
from DL-Learner and the extended one ρaml as described above. Specifically, we
measure the time required until the first 100% accurate solution is found. The
raw AML document comes from the research project ReApp which was
originally used for modeling industrial robot systems [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The lifted AML ontology
comprises of 222 classes, 497 individuals and 73 data properties. To simulate the
heterogeneity in engineering projects, we perform two different benchmarks. The
first one has an additional 50 AML role and 25 AML interface classes, while the
second one has twice as much. We choose the algorithm CELOE, since its
heuristic is configured to produce shorter concepts than OCEL. Generally speaking,
CELOE sets a stronger penalty to long refinements and is less rewarded by the
immediate accuracy gain. In each benchmark, we run 25 experiments of different
target concepts. Axiom 6 show one example of the ground truth.
      </p>
      <p>RobotWithServoMotors ≡ ∃hasIE.(ArticulatedRobot ⊓ ∃hasIE.ServoMotor) (6)
Table 2 summarizes the results of five representative experiments of varying
complexity, while the rest ones share similar characteristics and are omitted for
brevity. The column Concepts is the number of tested concept hypotheses. The
column Overall is the overall time needed to find the first correct solution, and
the column Reasoning is the time spent for reasoning, both timers are in
milliseconds. All measurements in the table are taken from ρaml, while the percentages
in parentheses represent the ratio in the form of ρaml/ρ. Unknown values of the
ratio means that no solution was found within 10 minutes with ρ. The results
show that ρaml is significant faster than ρ (the ratios are much smaller than
100%), since ρaml generates much less concept hypotheses for testing. However,
for some cases no solution was found within 10 minutes with either ρ or ρaml,
so learning in AML still remains a challenging task2.
5</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        In this paper, we studied concept learning from engineering data stored in the
XML-based data format AML. We showed how to use the DL-Learner framework
2 By reducing the expansion penalty of CELOE, we were able to find a solution with
the extended refinement operator ρaml for some of these hard cases.
to learn engineering concepts in description logic, by transforming an AML
document to an OWL 2 DL ontology. We proposed an extension of the ALC downward
refinement operator ρ in DL-Learner to exploit the syntactic constraints defined
in the XML schema of AML. Experimental results show that the extended
operator ρaml has a significant performance improvement in all test cases. However,
learning is still very challenging in some cases and could be worse if the size
of the T-Box grows further. In future work, we want to investigate whether we
can achieve better learning results using a semantic language other than OWL
2 DL, for example the hybrid system AL-log that merges ALC and DATALOG.
In particular, an ideal refinement operator for AL-log was proposed in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. For
learning in OWL 2 DL, we want to study if a heuristic can intelligently adapt
itself to avoid the laborious fine tuning of learning parameters.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Abele</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Legat</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grimm</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Mu¨ller, A.W.:
          <article-title>Ontology-based validation of plant models</article-title>
          .
          <source>In: 2013 11th IEEE International Conference on Industrial Informatics (INDIN)</source>
          . pp.
          <fpage>236</fpage>
          -
          <lpage>241</lpage>
          (
          <year>July 2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Bigvand</surname>
            ,
            <given-names>P.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drath</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Scholz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , Schu¨ller, A.:
          <article-title>Agile standardization by means of PCE requests</article-title>
          .
          <source>In: 2015 IEEE 20th Conference on Emerging Technologies Factory Automation (ETFA)</source>
          . pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          (
          <year>Sept 2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bigvand</surname>
            ,
            <given-names>P.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fay</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Drath</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carrion</surname>
            ,
            <given-names>P.R.</given-names>
          </string-name>
          :
          <article-title>Concept and development of a semantic based data hub between process design and automation system engineering tools</article-title>
          .
          <source>In: 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA)</source>
          . pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          (
          <year>Sept 2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. Bu¨hmann, L.,
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Westphal</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <string-name>
            <surname>DL-Learner</surname>
          </string-name>
          :
          <article-title>A framework for inductive learning on the semantic web</article-title>
          .
          <source>Web Semant</source>
          . 39(C),
          <volume>15</volume>
          -
          <fpage>24</fpage>
          (
          <year>Aug 2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Drath</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Lu¨der,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Peschke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Hundt</surname>
          </string-name>
          , L.:
          <article-title>AutomationML - the glue for seamless automation engineering</article-title>
          .
          <source>In: 2008 IEEE International Conference on Emerging Technologies and Factory Automation</source>
          . pp.
          <fpage>616</fpage>
          -
          <lpage>623</lpage>
          (
          <year>Sept 2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Hua</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hein</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Concept learning in AutomationML with formal semantics and inductive logic programming (accepted)</article-title>
          .
          <source>In: 14th IEEE International Conference on Automation Science and Engineering (Aug</source>
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Hua</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zander</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bordignon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hein</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>From AutomationML to ROS: A model-driven approach for software engineering of industrial robotics using ontological reasoning</article-title>
          .
          <source>In: 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA)</source>
          . pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          (
          <year>Sept 2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Kovalenko</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wimmer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sabou</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , Lu¨der,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Ekaputra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Biffl</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          :
          <article-title>Modeling AutomationML: semantic web technologies vs. model-driven engineering</article-title>
          .
          <source>In: Emerging Technologies Factory Automation (ETFA)</source>
          ,
          <source>2015 IEEE 20th Conference on</source>
          . pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          (
          <year>Sept 2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Bu¨hmann, L.,
          <string-name>
            <surname>Tramp</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Class expression learning for ontology engineering</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          <volume>9</volume>
          (
          <issue>1</issue>
          ),
          <fpage>71</fpage>
          -
          <lpage>81</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hitzler</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Concept learning in description logics using refinement operators</article-title>
          .
          <source>Machine Learning</source>
          <volume>78</volume>
          (
          <issue>1</issue>
          ),
          <volume>203</volume>
          (Sep
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Lisi</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malerba</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Ideal refinement of descriptions in AL-log</article-title>
          . In: Horva´th,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Yamamoto</surname>
          </string-name>
          ,
          <string-name>
            <surname>A</surname>
          </string-name>
          . (eds.)
          <article-title>Inductive Logic Programming</article-title>
          . pp.
          <fpage>215</fpage>
          -
          <lpage>232</lpage>
          . Springer Berlin Heidelberg, Berlin, Heidelberg (
          <year>2003</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>