<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>OWL Instance Data Evaluation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Li Ding</string-name>
          <email>dingl@cs.rpi.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jiao Tao</string-name>
          <email>taoj2@cs.rpi.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Deborah L. McGuinness</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Tetherless World Constellation, Computer Science Department Rensselaer Polytechnic Institute 110</institution>
          <addr-line>8th st., Troy, NY 12180</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>As more applications are depending on semantic web data from diverse sources, semantic web data evaluation is becoming more critical. While language validators and general reasoners can help, these typically focus on syntax and logical consistency. Many applications need additional support for finding possible issues (as well as provable mistakes). We are investigating methods and environments that provide computational support for identifying possible problems with instance data. We report on a line of work focusing on evaluation of provable and possible problems with OWL instance data and provide some discussion motivated by our first application setting validating large amounts of diverse explanation data.</p>
      </abstract>
      <kwd-group>
        <kwd>Semantic Web</kwd>
        <kwd>OWL instance data evaluation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Before consuming semantic web data, many applications and users deploy automated
tools to find problems early. Typically users will deploy a syntax checker, such as the
W3C RDF Validator. They may also deploy tools such as Pellet to check semantic
consistency. These tools typically provide techniques aimed at finding provable
(rather than possible) issues. We present two examples using the wine ontology1 that
motivate instance data evaluation going beyond what conventional tools provide.
1. When creating an instance W1 of wine:Zinfandel, a user may forget to provide
information about the maker of the wine. Before using W1, a warning may be
beneficial concerning the missing value since the wine ontology asserts that each
wine has exactly one maker. OWL reasoners will not produce an error message
about this point because they use the open world assumption, and believe that
maker information will be provided later.
2. When creating an instance W2 of wine:Zinfandel, a user may mistakenly assert
that the maker of W2 is wine:Red, whose type is wine:WineColor. A warning
message may be beneficial because the wine ontology states that the range of
wine:hasMaker is wine:Winery. OWL reasoners will infer that wine:Red is an
instance of wine:Winery, and they will not generate an error message unless they
1 The wine ontology (http://www.w3.org/TR/owl-guide/wine) is provided in the OWL guide.
know wine:Red can not be an instance of wine:Winery e.g., because
wine:WineColor is owl:disjointWith wine:Winery.</p>
      <p>
        Previous work related to semantic web data evaluation mainly focuses on general
ontology evaluation [
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4">1-4</xref>
        ] and OWL DL ontology debugging [
        <xref ref-type="bibr" rid="ref10 ref5 ref6 ref7 ref8 ref9">5-10</xref>
        ]. None of these
efforts directly focused on OWL instance data and the resulting tools do not satisfy
our motivating examples. Therefore, more comprehensive OWL instance data
evaluation method and environment work is needed.
      </p>
      <p>Our work focuses on web settings where applications ingest large amounts of
OWL instance data. We are developing an extensible OWL instance data evaluation
environment that inspects instance data for provable errors as well as possible issues,
such as compatibility with the term descriptions in the corresponding ontologies or
conceptual modeling style guidelines. Our initial contributions include a list of issues
and system designs for OWL instance data evaluation, and preliminary results
utilizing SPARQL in our implementation.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Issues in OWL Instance Data Evaluation</title>
      <p>We will describe the data to be evaluated and the associated evaluation services.</p>
      <p>Scope of data. Semantic Web data represented in OWL can be viewed as an
RDF graph, i.e. a set of RDF triples; therefore, our environment basically checks a set
of RDF triples describing individuals for issues that need further study. We use an
RDF document (i.e. a document serializing some RDF triples) to provide an
operational boundary for RDF triples to be evaluated by our environment. We can
refine the selection of RDF triples by grouping RDF triples2 into (i) ontology (triples
describing known classes/properties), (ii) instance (triples describing known
individuals) and (iii) triples which do not belong to ontology or instance data.</p>
      <p>Evaluation service process. Our extensible workflow for OWL instance data
evaluation consists of the following steps:
1. Load an RDF document.
2. Parse OWL instance data from the RDF document using a RDF syntax
validation service such as the Jena RDF parser.
3. Load the corresponding ontologies3 used by the OWL instance data.
4. Inspect the OWL instance data for issues such as consistency and
compatibility issues.</p>
      <p>While steps 1-3 can be implemented using existing tools, step 4 involves a wide
spectrum of evaluation services and should be customizable to meet different
application requirements. Currently, we focus on issues related to compatibility e.g.
whether the type of an individual is compatible with the expected type suggested by
the corresponding ontologies, and we assume that the corresponding ontologies are
available and free of semantic inconsistency.
2 Triples can be grouped by their subject RDF resources, which can be classified as class,
property, individual, and untyped according to OWL semantics. Triples may appear in
multiple groupings if working with OWL-Full data.
3 We focus on online OWL ontologies which are shared and accessed on the Web.</p>
      <p>Issues related to an individual’s type description:
• Unexpected individual type: the known types of an individual do not meet the
restrictions specified by domain, range, and/or property value restrictions in
the corresponding ontology.
• Redundant class/property instantiation, e.g. an individual is typed as a class C
and typed as C’s super-classes in explicit (non-inferred) statements.
• Non-leaf class recognition for an individual. This is triggered when an
individual is recognized to be an instance of a class that has subclasses, but the
individual is not recognized to be an instance of any of the subclasses.
Issues related to property restrictions:
• Missing property values: more property values are needed to meet the
minimum property cardinality restrictions.
• Missing individual (in)equality information for confirming whether the
maximum property cardinality restrictions have been satisfied.</p>
      <p>To detect the above issues, we are investigating a SPARQL based approach. We
assume the existence of an OWL DL reasoner with a SPARQL query interface such
that we can run SPARQL queries on the triples inferred by the reasoner that has
access to instance data and the associated OWL ontologies. With this assumption,
first, we write several SPARQL queries to inspect each of the issues. Then each query
is run against the inferred RDF dataset generated by the assumed reasoner. We
encode the first example in the introduction in
http://tw.rpi.edu/2008/03/wineinstance.owl which has three instances of wine:Zinfandel (with W3 missing a value
for wine:hasColor), and use http://tw.rpi.edu/2008/03/wine.owl, which is a fragment of
the wine ontology. We show a SPARQL query (see below) for detecting the issue of
“missing property values”. The query does not return the wine W3 because the
definition of wine:Zinfandel in the wine ontology already asserted the value of
hasColor using an owl:hasValue restriction; and it only returns the wine W1 which
does not meet the expectation of the owl:cardinality restriction on the property
hasMaker (the restriction is inherited from wine:Wine).</p>
      <p>PREFIX rdf: &lt;http://www.w3.org/1999/02/22-rdf-syntax-ns#&gt;
PREFIX rdfs: &lt;http://www.w3.org/2000/01/rdf-schema#&gt;
PREFIX owl: &lt;http://www.w3.org/2002/07/owl#&gt;
SELECT ?w ?p ?g_i
FROM NAMED &lt;http://tw.rpi.edu/2008/03/wine-instance.owl&gt;
FROM NAMED &lt;http://tw.rpi.edu/2008/03/wine.owl&gt;
WHERE { GRAPH ?g_o { ?c rdfs:subClassOf ?r.</p>
      <p>?r rdf:type owl:Restriction .
?r owl:onProperty ?p .
?r owl:cardinality ?card .</p>
      <p>FILTER( ?card = 1 )
OPTIONAL { ?c rdfs:subClassOf ?r1.</p>
      <p>?r1 rdf:type owl:Restriction .
?r1 owl:onProperty ?p .</p>
      <p>?r1 owl:hasValue ?val . }</p>
      <p>FILTER( !BOUND(?r1) ) }
GRAPH ?g_i { ?w rdf:type ?c .</p>
      <p>OPTIONAL { ?w ?p ?o . }</p>
      <p>FILTER( !BOUND(?o) ) } }</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>
        Inspired by our past experiences on ontology evolution environments [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and our
current need to evaluate large amounts of disparate instance data, we are developing a
comprehensive web based OWL instance data evaluation environment. We will
include evaluation services concerning provable issues such as OWL DL semantic
consistency checking, as well as possible issues such as checking if an instance meets
the expected cardinality restrictions from the corresponding ontologies. Our tools for
checking possible issues will support users who need additional support in bridging
the open world reasoning paradigm of description logics with the closed world
reasoning paradigm of database integration. We are also designing APIs that let users
add their own tools to check for application- or environment-specific requirements
such as special naming conventions and style conventions. We are running our tests
over OWL instance data such as Proof Markup Language explanation metadata in our
Inference Web project [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. We also plan to test our implementation using more real
world datasets collected by tools such as Swoogle [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ].
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sure</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Gomez-Perez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Daelemans</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Reinberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Guarino</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N. F.</given-names>
            <surname>Noy</surname>
          </string-name>
          .
          <source>Why Evaluate Ontology Technologies? Because It Works! IEEE Intelligent Systems</source>
          ,
          <volume>19</volume>
          (
          <issue>4</issue>
          ):
          <fpage>74</fpage>
          -
          <lpage>81</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>A.</given-names>
            <surname>Gomez-Perez</surname>
          </string-name>
          .
          <source>Evaluation of Ontologies. Intl. Journal of Intelligent Systems</source>
          ,
          <volume>16</volume>
          (
          <issue>3</issue>
          ):
          <fpage>391</fpage>
          -
          <lpage>409</lpage>
          . (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>D. L. McGuinness</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Fikes</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Rice</surname>
            , and
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Wilder</surname>
          </string-name>
          .
          <article-title>An Environment for Merging and Testing Large Ontologies</article-title>
          .
          <source>In KR</source>
          , pp.
          <fpage>483</fpage>
          -
          <lpage>493</lpage>
          . (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>M.</given-names>
            <surname>Gruninger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. S.</given-names>
            <surname>Fox</surname>
          </string-name>
          .
          <article-title>Methodology for the Design and Evaluation of Ontologies</article-title>
          . In Workshop on Basic Ontological Issues in Knowledge Sharing. (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>B.</given-names>
            <surname>Parsia</surname>
          </string-name>
          , E. Sirin,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Kalyanpur. Debugging OWL</surname>
          </string-name>
          <article-title>Ontologies</article-title>
          . In WWW, pp.
          <fpage>633</fpage>
          -
          <lpage>640</lpage>
          . (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>P.</given-names>
            <surname>Plessers</surname>
          </string-name>
          and
          <string-name>
            <given-names>O. D.</given-names>
            <surname>Troyer</surname>
          </string-name>
          .
          <article-title>Resolving Inconsistencies in Evolving Ontologies</article-title>
          . In ESWC, pp.
          <fpage>200</fpage>
          -
          <lpage>214</lpage>
          . (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>H.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Rector</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Drummond</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Seidenberg</surname>
          </string-name>
          .
          <article-title>Debugging OWLDL Ontologies: A Heuristic Approach</article-title>
          . In ISWC, pp.
          <fpage>745</fpage>
          -
          <lpage>757</lpage>
          . (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>K.</given-names>
            <surname>Baclawski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C. J.</given-names>
            <surname>Matheus</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Kokar</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Letkowski</surname>
            and
            <given-names>P. A.</given-names>
          </string-name>
          <string-name>
            <surname>Kogut</surname>
          </string-name>
          .
          <article-title>Towards a Symptom Ontology for Semantic Web Applications</article-title>
          . In ISWC, pp.
          <fpage>650</fpage>
          -
          <lpage>667</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9. Ó.
          <string-name>
            <surname>Corcho</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>González-Cabero</surname>
          </string-name>
          , and
          <string-name>
            <surname>M. del Carmen</surname>
          </string-name>
          Suárez-Figueroa.
          <article-title>ODEVAL: A Tool for Evaluating RDF(S), DAML+OIL and OWL Concept Taxonomies</article-title>
          . In AIAI, pp.
          <fpage>369</fpage>
          -
          <lpage>382</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Volz</surname>
          </string-name>
          .
          <article-title>Patching Syntax in OWL Ontologies</article-title>
          . In ISWC, pp.
          <fpage>668</fpage>
          -
          <lpage>682</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>D. L. McGuinness</surname>
            and
            <given-names>P.</given-names>
          </string-name>
          <article-title>Pinheiro da Silva. Explaining Answers from the Semantic Web: The Inference Web Approach</article-title>
          .
          <source>Journal of Web Semantics</source>
          ,
          <volume>1</volume>
          (
          <issue>4</issue>
          ):
          <fpage>397</fpage>
          -
          <lpage>413</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12. L.
          <string-name>
            <surname>Ding</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Finin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Joshi</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Pan</surname>
            ,
            <given-names>R. Scott</given-names>
          </string-name>
          <string-name>
            <surname>Cost</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Peng</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Reddivari</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Doshi</surname>
            and
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Sachs</surname>
          </string-name>
          .
          <article-title>Swoogle: A Search and Metadata Engine for the Semantic Web</article-title>
          .
          <source>In CIKM</source>
          , pp.
          <fpage>652</fpage>
          -
          <lpage>659</lpage>
          . (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>