<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Describing Reasoning Results with RVO, the Reasoning Violations Ontology</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bojan Bozic</string-name>
          <email>bojan.bozic@scss.tcd.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rob Brennan</string-name>
          <email>rob.brennan@scss.tcd.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Kevin C. Feeney</string-name>
          <email>kevin.feeney@scss.tcd.ie</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Gavin Mendel-Gleason</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Knowledge and Data Engineering Group, Trinity College Dublin, College Green</institution>
          ,
          <addr-line>Dublin 2</addr-line>
          ,
          <country country="IE">Ireland</country>
        </aff>
      </contrib-group>
      <fpage>62</fpage>
      <lpage>69</lpage>
      <abstract>
        <p>This paper presents a new OWL RL ontology, the Reasoning Violations Ontology (RVO), which describes both ABox and TBox reasoning errors produced by DL reasoners. This is to facilitate the integration of reasoners into data engineering tool-chains. The ontology covers violations of OWL 2 direct semantics and syntax detected on both the schema and instance level over the full range of OWL 2 and RDFS language constructs. Thus it is useful for reporting results to other tools when a reasoner is applied to linked data, RDFS vocabularies or OWL ontologies, for example for quality evaluations such as consistency, completeness or integrity. RVO supports supervised or semi-supervised error localisation and repair by de ning properties that both identify the statement or triple where a violation is detected, and by providing context information on the violation which may help the repair process. In a case study we show how the ontology can be used by a reasoner and a supervised repair process to accelerate high quality ontology development and provide automated constraint checking feedback on instance data. RVO is also being used to enable integration of reasoning results into multi-vendor data quality tool chains within the ALIGNED H2020 project.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology Engineering</kwd>
        <kwd>Data Integrity</kwd>
        <kwd>Consistency Checking</kwd>
        <kwd>Reasoning</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        A common task performed with Semantic Web reasoners is the detection and
reporting of errors or inconsistencies found in an ontology. This task frequently
occurs within the ontology authoring, interlinking, classi cation, quality
analysis and evolution phases of the linked data lifecycle [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. However, to manage the
entire data lifecycle or even the full range of activities within a single lifecycle
stage, typically requires many tools to be integrated into a tool-chain. Current
research on standard mechanisms for linked data tool-chain integration is still
immature. However, the use of ontologies to support the interchange of data for
tool-chain integration has been explored [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The existing gap in related work, as
we show in Section 2 is the absence of a complete ontology for modelling
reasoning errors. This would enable the integration of standardised ontology violation
detection services into linked-data management tool-chains. Other relevant work
in the eld focuses on pitfalls, prevention of mistakes and general ontology
design and structural issues. The two goals that have driven this research are
rstly, to produce a service which will assist in high-quality ontology
development by identifying reasoning violations and producing semi-automated repair
recipes. Secondly, to produce a service which can detect constraint violations on
instance data according to a schema (ontology), and produce semi-automated
repair recipes. In order to support these services, we need a rich, highly structured,
general purpose way of expressing reasoning violations. This paper presents the
RVO (Reasoning Violations Ontology). It describes OWL and RDF(S) reasoning
errors, in two categories: those involving classes, properties and axioms (schema
/ TBox) and those involving instances (ABox). This ontology is used by a
custom reasoner implemented in SWI-Prolog, the Dacura Quality Service [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], to
report the errors that it detects to other linked data lifecycle tools. Our rst
client application is the Dacura Schema Manager [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], which can consume RVO
and presents the reasoner output with ltered, categorised, detailed error
information, as well as information about the source of the error. The principal
contributions of this paper are: a description of the published RVO ontology,
a discussion of the integration of RVO in our own data lifecycle web platform
Dacura and documentation of the violation identi cation process for ontology
developers. The rest of the paper is structured as follows: Section 2 is dedicated
to related work. Section 3 presents the RVO ontology and provides insights into
its design. Section 4 validates the ontology in a toolchain integration case.
Finally, Section 5 concludes the paper and provides an answer to the research
question as well as an outlook on future work.
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        To the best of our knowledge, there are no ontologies that have been developed
for the speci c purpose of describing reasoning violations. However, similar
problems have been addressed from di ering perspectives. One of the most relevant
contributions is OOPS! [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] which is a tool with a catalogue for validating
ontologies by spotting common pitfalls. The catalogue contains 41 pitfalls which the
tool checks for. The ontology can be inserted directly in a textbox or referenced
by URI. Although, OOPS! identi es many common pitfalls, it detects design
aws rather than logical errors and does not use an ontology for error reporting.
Other research [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] has identi ed the types of aws that can occur in the object
property box and proposed corresponding compatibility services. However, this
work is very speci c and focuses on properties and their compatibility. Our
approach addresses a far broader palette of violations, across the ABox and TBox,
incorporating class and property violations. In [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], a very similar approach to
OOPS! was proposed, covering logical and non-logical anti-patterns, but it is
quite limited as it covers only 4 logical and 3 non-logical anti-patterns as well
as 4 guidelines. The work presented in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] will be combined with our Reasoning
Violations Ontology in order to extend Linked Data Quality in an ALIGNED
project use case. We have also published di erences between SHACL and RVO
in the deliverable [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] The Shapes Constraint Language (SHACL) introduced in
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], is a language for describing and constraining the contents of RDF graphs.
As part of its ongoing development, through the W3Cs RDF Data Shapes
Working Group, it is de ning a standard error reporting format. Our ontology can be
considered as an extension of SHACLs error reporting, as it can express a
superset of the violations that can be expressed in SHACL, also while SHACL detects
bad triples which caused an error, RVO is able to detect a whole subgraph which
was involved in producing the violation. We plan to link RVO to SHACL errors
through reuse of their predicates once the format achieves standardisation and
stability. Another W3C vocabulary is EARL1 which can be used for validation
results. Although it has been de ned in the context of validating accessibility
tools, it contains several terms for describing validation results in RDF. There
are also some publications about preventing errors in ontology development,
such as [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. They are extremely useful for de ning best practices and fueling
the discussion about ontology engineering style and error prevention, but they
provide no insights into error reporting for existing ontologies. Closer to that
is a publication about debugging OWL ontologies [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. They have integrated a
number of simple debugging cues generated from the description logic reasoner,
Pellet2, in the hypertextual ontology development environment, Swoop3.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>The Reasoning Violations Ontology (RVO)</title>
      <p>
        The purpose of RVO is to enable a reasoner to describe reasoning errors
detected in an input ontology in order to facilitate the integration of reasoners
into semantic web toolchains. It is de ned as a simple OWL 2 ontology that
is amenable to RDFS-based interpretations or use as a linked data vocabulary
without any dependence on reasoning. In future, an RDFS version of the
ontology is planned, in order to support interpretation by RDFS reasoners. A
permanent identi er for the ontology has been registered with the W3C
permanent identi er community group. The full source of the ontology is published
online4 and meta-data have been added to facilitate LODE-based [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]
documentation generation5. This ontology is used to describe RDF and OWL reasoning
violation messages in the Dacura Quality Service [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. These are generated by
running an RDF/RDFS/OWL-DL reasoner over an RDF-based ontology model
and allowing the Dacura quality service to report any integrity violations
detected at schema or instance level. These violations report areas where the input
model is logically inconsistent or breaks RDFS/OWL semantics or axioms.
Violations may be reported as based on open world or closed world assumptions.
The open world is the default OWL semantics and can typically only detect
      </p>
      <sec id="sec-3-1">
        <title>1 https://www.w3.org/TR/EARL10-Schema/</title>
      </sec>
      <sec id="sec-3-2">
        <title>2 https://github.com/complexible/pellet</title>
      </sec>
      <sec id="sec-3-3">
        <title>3 https://github.com/ronwalf/swoop</title>
      </sec>
      <sec id="sec-3-4">
        <title>4 https://w3id.org/rvo</title>
      </sec>
      <sec id="sec-3-5">
        <title>5 http://www.essepuntato.it/lode/closure/reasoner/https://w3id.org/rvo</title>
        <p>a limited number of problems due to incomplete knowledge. The closed world
interpretation assumes that you have provided all relevant aspects of the model
and is able to detect a much wider range of violations, e.g. missing or misspelled
term de nitions. This is often useful during ontology development or in a system
that interprets OWL as a constraint language.
3.1</p>
        <sec id="sec-3-5-1">
          <title>The Ontology</title>
          <p>The ontology can be divided into two layers. The top layer consists of the base
classes and their properties and the bottom layer is a vocabulary which de nes
the hierarchical structure of violations identi ed so far (see 3.2).</p>
          <p>Figure 1 shows the top tier of the ontology which represents general metadata
about a Violation as well as related properties, elements and classes. Class
violations are used for reporting issues regarding the TBox and instance violations
ABox in general. Therefore, class violations are reported when e.g. property
domains are missing, subsumption errors are detected, or class and property cycles
are found. Instance violations show instances which are not elements of valid
classes, cardinalities which are incorrect, property constraints that are violated,
literals and objects which are confused, etc.
3.2</p>
        </sec>
        <sec id="sec-3-5-2">
          <title>Error Classes</title>
          <p>We have organised reasoning errors in violation classes and put them in a
hierarchical structure. The top level di erentiation of violations is instance or schema,
depending on whether the violation occurred in the ABox (instances) or TBox
(schema). Here is an overview of all errors currently documented:
{ Instance</p>
          <p>InstanceBlankNode</p>
          <p>NotAnElement: NotRestrictionElement, ObjectInvalidAtClass,
EdgeOrphanInstance, DataInvalidAtDatatype (NotBaseTypeElement)
InstanceProperty: NotPropertyDomain, InvalidEdge,
NotFunctionalProperty, LocalOrphanProperty, NotInverseFunctionalProperty
{ Schema</p>
          <p>ClassViolation: NotUniqueClassLabel, NotUniqueClassName,
NotDomainClass, ClassCycle, NoImmediateClass (NotSuperClassOfClass),
OrphanClass (NotIntersectionOfClass, NoSubclassOfClass, NotUnionOfClass)
PropertyViolation: PropertyCycle, NotUniquePropertyName,
SchemaBlankNode, PropertyTypeOverload, PropertyAnnotationOverload,
OrphanProperty (NotSubpropertyOfProperty), PropertyDomain (InvalidDomain,
DomainNotSubsumed, NoExplicitDomain), PropertyRange (InvalidRange,
RangeNotSubsumed, NotExplicitRange)
3.3</p>
        </sec>
        <sec id="sec-3-5-3">
          <title>Example of RVO in Use - Class Violation</title>
          <p>In our example a reasoning error is asserted rst in JSON as raw data and then
converted to RDF triples using RVO in order to be consumed in Dacura. The
example shows a ClassViolation which is a SchemaViolation and more speci cally
a ClassCycleViolation. Such speci c violation detection results make it possible
to provide exact suggestions to ontology developers or repair agents and trigger
ontology improvements.
1 { " rdf : type ": " ClassCycleViolation ",
2 " bestPractice ": { " type ": " xsd : boolean ",
3 " data ": " false "} ,
4 " message ": " Class UnitOfSocialOrganisation has a class cycle with path : [</p>
          <p>TemporalEntity , UnitOfSocialOrganisation ]" ,
" path ": [
" seshat : TemporalEntity ",
" dacura : UnitOfSocialOrganisation "
],
" class ": " seshat : UnitOfSocialOrganisation "</p>
          <p>The response RDF graph provides a much better way to interpret the results:
The instance is called example1 and is a ClassCycleViolation. bestpractice is
false, so it is an error rather than a warning. The message provides a summary of
the cause of the violation, but the important parts are the next two properties.
The path property marks all classes which were involved in the cycle and the class
property marks the class where the cycle has been detected. Another important
feature is that RVO provides us direct links to the Seshat ontology (an ontology
which models the Seshat Global History Databank6) and hence to the OWL
classes from the external ontology which were involved in the violation process.
4</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Validation through Integration into ALIGNED</title>
      <p>The Dacura Toolchain Case Study covers toolchaining and reporting to users.
At this point we want to have a closer look into supervised ontology repair and
publishing.</p>
      <sec id="sec-4-1">
        <title>6 https://evolution-institute.org/project/seshat/</title>
        <p>In the use case scenario in Figure 2, the Dacura Shema Service gets an
external ontology which is loaded by the Dacura Schema Manager and needs
to be validated into the knowledge base (step 1). The ontology is then send to
DQS and checked for errors by the DQS reasoner (step 2), whose rules comply
with the violation classes of RVO. The detected violations are sent back to the
client (step 3). The results are classi ed and assigned classes from RVO (step
4). Dacura then integrates the report in the UI and presents it to the user (step
5). Finally, the user can repair the ontology in an editor and republish it to the
Web (step 6).</p>
        <p>So how did RVO help in this speci c scenario? After the Data Quality Service
checked the external ontology for errors, it used the RVO structure to provide
information about a speci c violation by creating individuals. This provided
us with a classi cation of DQS' results. RVO has been used by the client for
classi cation of the errors and for providing relevant information about violations
to the user. An additional bene t would be to archive the history of errors in a
knowledge base and be able to query for certain occurrences of violations for an
ontology.</p>
        <p>Table1 shows the validation of ALIGNED ontologies7 which have all been
developed by using di erent approaches (Protege, RDF2RDF, human checks,
etc.). We have used the Data Quality Service and RVO to validate several project
ontologies and report the errors and warnings found in a rst run. Although,
this is only a case study and especially the validation and correction e orts</p>
      </sec>
      <sec id="sec-4-2">
        <title>7 http://aligned-project.eu/data-and-models/</title>
        <p>are estimated, the table signalises the potential for improvement of existing
ontologies.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion and Future Work</title>
      <p>In this paper we have shown that a dedicated reasoning error ontology
improves error reporting with structured data, and integration of the ontology in
the Dacura toolchain case study. The Reasoning Violations Ontology not only
bene ts the interpretation and further processing of reasoning errors in tools,
platforms, and Web UIs which present results of the reasoning process or
ontology validation, but can also be used as a common format to represent violations
found in ontologies during the whole software toolchain process. We have shown
an example of supervised ontology repair use case and explained the advantages
of our approach. Furthermore, we have given some examples for reasoning
violations and constructed RDF graphs to present the results. Our future work will
continue with the integration of the ontology in the ALIGNED toolchain and
linking of the ontology to SHACL constraints as well as using it together with
RDFUnit. Finally, we plan to evaluate the bene ts in a case study with ontology
engineers and investigate their work with the ontology and our tools in order to
improve the quality of their ontology or repair it.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgement</title>
      <p>This research has received funding from the European Unions Horizon 2020
research and innovation programme under grant agreement No 644055, the
ALIGNED project (www.aligned-project.eu) and from the ADAPT Centre for
Digital Content Technology, funded under the SFI Research Centres Programme
(Grant 13/RC/2106) and co-funded by the European Regional Development
Fund. References</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Soren Auer, Lorenz Buhmann, Christian Dirschl, Orri Erling, Michael Hausenblas, Robert Isele, Jens Lehmann, Michael Martin,
          <string-name>
            <surname>Pablo N Mendes</surname>
          </string-name>
          , Bert Van Nu elen, et al.
          <article-title>Managing the life-cycle of linked data with the lod2 stack</article-title>
          .
          <source>In The Semantic Web{ISWC</source>
          <year>2012</year>
          , pages
          <fpage>1</fpage>
          <lpage>{</lpage>
          16. Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>Rob</given-names>
            <surname>Brennan</surname>
          </string-name>
          , Bojan Bozic, Monika Solanki, Dimitris Kontokostas, Andreas Koller, and
          <string-name>
            <given-names>Christian</given-names>
            <surname>Dirsch</surname>
          </string-name>
          .
          <source>D2</source>
          .
          <article-title>7 meta-model phase 2</article-title>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Kevin</given-names>
            <surname>Feeney</surname>
          </string-name>
          , Gavin Mendel-Gleason, and
          <string-name>
            <given-names>Rob</given-names>
            <surname>Brennan</surname>
          </string-name>
          .
          <article-title>Linked data schemata: xing unsound foundations (submitted)</article-title>
          .
          <source>Semantic Web Journal - Special Issue on Quality Management of Semantic Web Assets</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>C</given-names>
            <surname>Maria</surname>
          </string-name>
          <article-title>Keet</article-title>
          .
          <article-title>Detecting and revising aws in owl object property expressions</article-title>
          .
          <source>In Knowledge Engineering and Knowledge Management</source>
          , pages
          <volume>252</volume>
          {
          <fpage>266</fpage>
          . Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5. Carsten Ke ler, Mathieu d'Aquin,
          <string-name>
            <given-names>and Stefan</given-names>
            <surname>Dietze</surname>
          </string-name>
          .
          <article-title>Linked data for science and education</article-title>
          .
          <source>Semantic Web</source>
          ,
          <volume>4</volume>
          (
          <issue>1</issue>
          ):1{
          <issue>2</issue>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Dimitris</given-names>
            <surname>Kontokostas</surname>
          </string-name>
          , Patrick Westphal, Soren Auer, Sebastian Hellmann, Jens Lehmann, Roland Cornelissen, and
          <string-name>
            <given-names>Amrapali</given-names>
            <surname>Zaveri</surname>
          </string-name>
          .
          <article-title>Test-driven evaluation of linked data quality</article-title>
          .
          <source>In Proceedings of the 23rd international conference on World Wide Web</source>
          , pages
          <volume>747</volume>
          {
          <fpage>758</fpage>
          . ACM,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Gavin</given-names>
            <surname>Mendel-Gleason</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Kevin</given-names>
            <surname>Feeney</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Rob</given-names>
            <surname>Brennan</surname>
          </string-name>
          .
          <article-title>Ontology consistency and instance checking for real world linked data</article-title>
          .
          <source>In Anisa Rula</source>
          , Amrapali Zaveri, Magnus Knuth, and Dimitris Kontokostas, editors,
          <source>LDQ@ESWC</source>
          , volume
          <volume>1376</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Bijan</given-names>
            <surname>Parsia</surname>
          </string-name>
          , Evren Sirin, and
          <string-name>
            <given-names>Aditya</given-names>
            <surname>Kalyanpur</surname>
          </string-name>
          .
          <article-title>Debugging owl ontologies</article-title>
          .
          <source>In Proceedings of the 14th international conference on World Wide Web</source>
          , pages
          <volume>633</volume>
          {
          <fpage>640</fpage>
          . ACM,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>Silvio</given-names>
            <surname>Peroni</surname>
          </string-name>
          , David Shotton,
          <string-name>
            <given-names>and Fabio</given-names>
            <surname>Vitali</surname>
          </string-name>
          .
          <article-title>Tools for the automatic generation of ontology documentation: A task-based evaluation</article-title>
          .
          <source>International Journal on Semantic Web and Information Systems (IJSWIS)</source>
          ,
          <volume>9</volume>
          (
          <issue>1</issue>
          ):
          <volume>21</volume>
          {
          <fpage>44</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Mar</surname>
          </string-name>
          <article-title>a Poveda-Villalon, Mari Carmen Suarez-Figueroa, and Asuncion GomezPerez</article-title>
          .
          <article-title>Validating ontologies with oops! In Knowledge Engineering and Knowledge Management</article-title>
          , pages
          <volume>267</volume>
          {
          <fpage>281</fpage>
          . Springer,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Alan</surname>
            <given-names>Rector</given-names>
          </string-name>
          , Nick Drummond, Matthew Horridge, Jeremy Rogers, Holger Knublauch, Robert Stevens,
          <string-name>
            <given-names>Hai</given-names>
            <surname>Wang</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Chris</given-names>
            <surname>Wroe</surname>
          </string-name>
          .
          <article-title>Owl pizzas: Practical experience of teaching owl-dl: Common errors &amp; common patterns</article-title>
          .
          <source>In Engineering Knowledge in the Age of the Semantic Web</source>
          , pages
          <volume>63</volume>
          {
          <fpage>81</fpage>
          . Springer,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Catherine</surname>
            <given-names>Roussey</given-names>
          </string-name>
          , Oscar Corcho, and
          <string-name>
            <surname>Luis Manuel</surname>
          </string-name>
          Vilches-Blazquez.
          <article-title>A catalogue of owl ontology antipatterns</article-title>
          .
          <source>In Proceedings of the fth international conference on Knowledge capture</source>
          , pages
          <volume>205</volume>
          {
          <fpage>206</fpage>
          . ACM,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>Arthur</given-names>
            <surname>Ryman</surname>
          </string-name>
          .
          <article-title>Z speci cation for the w3c editor's draft core shacl semantics</article-title>
          .
          <source>arXiv preprint arXiv:1511.00384</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>