<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A document-inspired way for tracking changes of RDF data</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Silvio Peroni</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>There are several distinct ways to represent data drift in the Linked Open Data world. In this paper we introduce an approach for tracking data changes that has been used in the context of the OpenCitations Project. Such approach has been inspired by existing works on change tracking mechanisms in documents created through word-processors such as Microsoft Word and OpenOfice Writer. RASH: https://w3id.org/oc/paper/occ-driftalod2016.html 3 http://opencitations.net/ 4 https://creativecommons.org/publicdomain/zero/1.0/legalcode</p>
      </abstract>
      <kwd-group>
        <kwd>OpenCitations</kwd>
        <kwd>OpenCitations Corpus</kwd>
        <kwd>PROV-O</kwd>
        <kwd>RDF changes</kwd>
        <kwd>change tracking</kwd>
        <kwd>document changes</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>Data change in time, and the reason for this change can be manyfold. On the one
hand, they can contain mistakes that are corrected once they are identified, even after
the publication date. On the other hand, information (or, better, representations
of certain actual situations, like the composition of the government of a country)
naturally evolves in time.</p>
      <p>
        RDF technologies (RDF, OWL, SPARQL, etc.) were not originally thought to
keep track of such changes natively. Thus, alternative approaches have been
proposed in the past so as to extend such formalisms with mechanisms for adding such
additional endeavour. The introduction of Named Graphs [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and the Provenance
Ontology (PROV-O) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] are among the most used and appropriate ways for
enabling the description of time-dependent (or, more generally, context-dependent)
data. However, there can still exist diferent ways of keeping track of such changes
in time.
      </p>
      <p>
        In this paper we introduce an approach for tracking changes in RDF data by
means of RDF provenance statements, which has been concretely used in the
context of the OpenCitations Project3 [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. The main aim of OpenCitations is the
creation of an open repository of scholarly citation data – the OpenCitations Corpus
(OCC) – made available under a Creative Commons public domain dedication4 to
provide in RDF accurate citation information (bibliographic references) harvested
from the scholarly literature. All the entities in the OCC have metadata describing
their provenance, so as to keep track of the curatorial activities related to each OCC
entity, the curatorial agents involved, their roles, and the sources used for retrieving
such data. By means of the extension to the Provenance Ontology (PROV-O) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
we propose for handling such provenance data (which is one of the contributions of
this work), we show how it is possible to reconstruct a particular status (or
snapshot) of an entity in the OCC at a specified time by using a mechanism inspired
by existing works on change tracking mechanisms in documents created through
word-processors such as Microsoft Word and OpenOfice Writer.
      </p>
      <p>The rest of the paper is organised as follows. In Section 2 we briefly introduce
some possible approaches to keep track of changes of RDF data. In Section 3 we
describe our approach for addressing such issue, while in Section 4 we discuss its
application in the context of the OCC. Finally, in Section 5 we conclude the paper
sketching out some future works.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Approaches to changes</title>
      <p>
        In the past, several works in the Semantic Web domain have concerned theoretical
and practical aspects of change tracking in ontologies and RDF data [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
However, the main focus of this paper is not about expanding the theoretical notion
of delta (i.e. the function that defines the changes) nor about discussing algorithms
that are able to identify changes between two versions of the same object (e.g. an
ontology) a posteriori. Rather, we are interested in mechanisms (based on RDF)
to keep track explicitly of the changes when they happen, so as to reconstruct the
whole history of an entity at a given time.
      </p>
      <p>
        Two approaches can be used for representing how a particular dataset has evolved
in time. On the one hand, we have statement-centric approaches, that basically
provide mechanisms to record how the set of statements in a dataset has evolved
by means of simple operations such as addition and deletion. On the other hand,
we have resource-centric approaches, that mainly allow one to say when an instance
of a time-dependent class or property (traditionally called anti-rigid concept [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ])
changes its status somehow.
      </p>
      <p>There are at least two possible approaches belonging to the first of the
aforementioned categories: physical snapshots and massive statement reification .</p>
      <p>
        A physical snapshot of a given LOD dataset is a particular record of all the
statements in such dataset at a given time. Using this technique, the tracking of all
the changes of the dataset is stored every time one thinks is appropriate, e.g. every
time a statement has been added/modified, after a certain amount of modification
to the dataset, after a particular time interval (every week, every month, etc.), and
so on. This is a quite common strategy for several LOD datasets available online
(such as DBPedia [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], which makes available versioned datasets as described at
http://wiki.dbpedia.org/datasets), it is quite easy to implement, but one would
need extraordinary amounts of space and time for keeping track of how a dataset
has changed, since every snapshot would record the entire dataset at a certain date.
      </p>
      <p>
        The massive statement reification mechanism requires the creation of additional
identifiers (one for each statement), and all of them are, in some way, marked when
they have been created/removed and by whom. This kind of approach can be coupled
easily with existing models, such as PROV-O [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], so as to keep track of how a
statement has been modified in time – similarly to what Wikidata 5 [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] implements.
In this case, the size of the dataset continuously increases – since deleted statements
are not really removed from the dataset, rather they are marked as deleted. However,
such mechanism also allows one to track changes and to index them when they
      </p>
      <sec id="sec-2-1">
        <title>5 https://www.wikidata.org/</title>
        <p>actually happen. This is a quite huge advantage, since it would allow one to restore
any possible status of the dataset by discarding all the modifications happened after
a certain date.</p>
        <p>Among the resource-centric mechanisms, it is worth mentioning the
provenancecentric and the by-design approaches, that allow one to record changes of a certain
resource, e.g. a particular class or an individual, by means of re-using existing models
and without explicitly referring to the set of statements they are involved in.</p>
        <p>
          An ontology that can be used for addressing the former category is PROV-DC [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ],
which enables expressing how entities change in time by means of additional classes
and properties added to PROV-O, which now allows the specification of activities
such as prov:Create, prov:Modify, etc. While this is a valuable and simple approach,
it is not easy to understand in a formal way which particular aspect of an entity has
actually changed.
        </p>
        <p>
          The alternative approaches, i.e. those compliant with the by-design mechanism,
oblige the dataset creator to include, from the very beginning, a finest
conceptualisation of the (anti-rigid) entities that can change in time in the actual ontology she
is using for representing the data. A good option here is to use particular ontology
design patterns, such as the time-indexed situation pattern6 or the 4D Fluent OWL
ontology [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. However, if something that now can be modified was not considered
as such at the very beginning, it would be possible that part of the ontology used
for representing the data (and consequently the data themselves) could be modified
accordingly – wasting time and, potentially, changing the current organisation of
the data, thus limiting their reusability in the long term.
        </p>
        <p>Both the aforementioned resource-centric mechanisms would allow not to delete
permanently any information, rather they would oblige to include the entire history
of each entity in the dataset, since they use particular ontological constructs to tell
the user when an entity has been created/invalidated, by whom, and so on.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>A document-inspired approach to data drift</title>
      <p>
        The approach we propose reuses techniques proper to both statement-centric and
resource-centric approaches, taking inspiration from a well-known structure for
keeping track of changes in word-processor documents, in particular OpenOfice Writer
(OOW herein). When an author activates the change tracking plugin in OOW, every
insertion and deletion into the document are tracked by using two diferent
mechanisms proper to overlapping markup theories, called milestone (for insertions) and
stand-of markup (for deletions) [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Milestones allows one to add the new content
directly within the existing text, marking it in some way that can be recognisable.
Contrarily, stand-of markup removes explicitly a piece of text from the actual
content of the document, and places it in an auxiliary space for easy retrieving and, if
needed, restoration.
      </p>
      <p>
        Following the same principles, we developed a mechanism that allows us to either
add or remove new statements directly to the current set of data related to an entity
(i.e. the RDF triples that have such entity as subject, readapting some of the aspects
of the approach introduced in [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]), while preserving provenance information of such
addition/deletion actions in an appropriate contextual space, i.e. the provenance
graph associated to such entity (as also suggested in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]). For doing that we leverage
the PROV-O [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] ontology, and extend it by adding an additional data property called
hasUpdateQuery, which allows us to record insertions and deletions as SPARQL
6 http://ontologydesignpatterns.org/wiki/Submissions:TimeIndexedSituation
      </p>
      <p>INSERT and SPARQL DELETE queries – while the use of SPARQL variables is
prohibited in the update queries.</p>
      <p>The main idea of our approach is that each entity in a dataset (i.e. an instance e of
the class prov:Entity) is represented by one or more snapshots (other instances e1, e2,
e3, ... of prov:Entity, each intended as specialisation of e via prov:specializationOf).
Each snapshot records the composition of the entity e (i.e. the set of statements using
e as subject) at a fixed point in time. In addition, each snapshot is linked to the
others according to their temporal creation/invalidation by means of the property
prov:wasDerivedFrom.</p>
      <p>Please let us introduce a working example for discussing the approach proposed.
For instance, let us consider the entity sp as composed by the following two
statements:
:sp a foaf:Person ;
foaf:name "Silvio Peroni" .</p>
      <p>The addition of these statements also generates, at least, the following
provenance statements, so as to set sp as a provenance entity, where its statements are
implicitly encoded in a specific snapshot:
:sp a prov:Entity .
:sp-snapshot -1 a prov:Entity ;</p>
      <p>prov:specializationOf :sp .
:sp a foaf:Person ;
foaf:givenName "Silvio" ;
foaf:familyName "Peroni" .</p>
      <p>Then suppose the curator of such data will decide to split the full name of sp using
two distinct properties, i.e. foaf:givenName and foaf:familyName, so as to remove
the more generic foaf:name:</p>
      <p>In this case, a new snapshot of the entity will be generated, which specifies which
statements have been added/deleted (by means of the property new:hasUpdateQuery)
starting from the previous snapshot linked through the property prov:wasDerivedFrom,
as follows:
:sp-snapshot -2 a prov:Entity ;
prov:specializationOf :sp ;
prov:wasDerivedFrom :sp-snapshot -1 ;
new:hasUpdateQuery "INSERT DATA { :sp foaf:givenName 'Silvio ' ; foaf:familyName '</p>
      <p>Peroni ' } ; DELETE DATA { :sp foaf:name 'Silvio Peroni ' }" .</p>
      <p>Using such snapshot-oriented structure, which clearly indicates how a previous
snapshot of an entity has been modified to reach the set of statements currently
available, makes easier to:
– retrieve the current statements of the entity, since they are those currently
available in the dataset;
– restore the entity to a certain snapshot si by applying the inverse operations (i.e.
deletions instead of insertions and vice versa) of all the update queries from the
most recent snapshot sn to si+1.</p>
      <p>For instance, to get back to the status recorded by the first snapshot of the
aforementioned example, we can run all the inverse operations of the update query
specified in the second snapshot, i.e.:
INSERT DATA { :sp foaf:name 'Silvio Peroni ' } ;
DELETE DATA { :sp foaf:givenName 'Silvio ' ; foaf:familyName 'Peroni ' }</p>
    </sec>
    <sec id="sec-4">
      <title>A real application: the OpenCitations Corpus</title>
      <p>
        The OCC has been accompanied by a formal metadata model [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] which is strictly
followed by all the data in the corpus. The metadata model is explicitly aligned with
the SPAR Ontologies [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] for expressing the data and to other standard
vocabularies, e.g. PROV-O [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] and PROV-DC [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], for expressing contextual information of
entities, such as provenance information. All the ontological entities introduced by
the metadata model are conveniently grouped together in the OpenCitations
Ontology (OCO)7, which also implements the oco:hasUpdateQuery for keeping track of
changes as described in Section 3,8. The entities included in the corpus can have
one of the following types:
– bibliographic resource (br), class fabio:Expression – a resource that either
cites or is cited by other bibliographic resources (e.g. journal articles), or that
contains such citing/cited resources (e.g. a journal);
– resource embodiment (re), class fabio:Manifestation – details of the
physical or digital form in which the bibliographic resource is made available by its
publisher;
– bibliographic entry (be), class biro:BibliographicReference – the literal
textual bibliographic entry occurring in the reference lists within the
bibliographic resource, that references another bibliographic resource;
– responsible agent (ra), class foaf:Agent – an agent having certain roles with
respect to the bibliographic resource;
– agent role (ar), class pro:RoleInTime – a role held by an agent with respect
to the bibliographic resource (e.g. author, editor, publisher);
– identifiers (id) (class datacite:Identifier) – an external identifier (e.g. DOI,
ORCID, PubMedID) associated with the bibliographic entity.
      </p>
      <p>
        Each OCC entity is identified by a URL (e.g. https://w3id.org/oc/corpus/
br/525205) that includes a two-letter short name for the class of such entity (e.g.
“br” for bibliographic resources) and the number (e.g. “525205”) that uniquely
identifies it among the resources of the same type. Independently from the particular
type assigned to entities, they have associated provenance information such as those
introduced in Section 3. In particular, we record four diferent kinds of provenance
entities, as indicated in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]:
– snapshot of entity metadata (short: se) – a particular snapshot recording the
metadata associated with an individual entity at a particular time;.
– curatorial activity (short: ca) – a curatorial activity relating to that entity, where
possible activities are:
1. creation, i.e. the activity of creating a new entity and of associating new
metadata with it;
2. modification, i.e. the activity of modifying (adding/removing) the metadata
associated with an existing entity, or even of deprecating the entire entity;
3. merging, i.e. the activity of unifying the metadata relating to two diferent
OCC bibliographic entity descriptions, if they actually represent the same
thing. This can result in the deprecation of one of the corpus entities in
favour of the other one.
      </p>
      <sec id="sec-4-1">
        <title>7 http://w3id.org/oc/ontology</title>
        <p>8 We have not specify any formal domain and range for this property so as to foster its reuse
in diferent contexts. However, in the OpenCitations Corpus, it has been used implicitly
on prov:Entity individuals, each referring to a particular snapshot of a certain OCC
bibliographic entity.
– provenance agent (short: pa) – the agent, such as a person, organisation or
process, that creates or modifies entity metadata, or that is used as source
provider of those metadata (e.g. Crossref);
– curatorial role (short: cr) – a particular role held by a provenance agent with
respect to a curatorial activity (e.g. OCC curator, metadata source).</p>
        <p>All this information is stored in the provenance graph related to the particular
OCC entity in consideration. The URL of such provenance graph is the URL of the
entity in consideration plus “/prov/”. The URL of all the aforementioned provenance
entities (e.g. https://w3id.org/oc/corpus/br/525205/prov/se/1) is built using
the provenance graph as base and adding two-letter short name for the class of
such provenance entity (e.g. “se” for snapshot of entity metadata) plus “/” plus
the number (e.g. “1”) that uniquely identifies it among the resources of the same
type in the context of that particular provenance graph. An exception to that URL
template is provided for all the provenance agents that are shared among the whole
corpus and, thus, that have https://w3id.org/oc/corpus/prov/pa/ as base URL
(e.g. https://w3id.org/oc/corpus/prov/pa/1).</p>
        <p>As an example, let us discuss the provenance statements added during the
creation and modification of https://w3id.org/oc/corpus/br/525205 – that are all
available online. After the creation, the following statements are added to the corpus:</p>
        <p>Basically, the first snapshot of the resource br/525205 has been created on
August 8, 2016, at 22:25:48 (property prov:generatedAtTime), starting from the data
contained in the source document http://api.crossref.org/works/10.2196/mhealth.
5331 (property prov:hadPrimarySource). The activity that generated the data of
br/525205 (property prov:wasGeneratedBy) was a creation (class prov:Create) that
involved (property prov:qualifiedAssociation ) two agents (referred by the property
prov:agent), i.e. SPACIN CrossrefProcessor (that is one of the automatic scripts
of OpenCitations responsible for the creation of RDF data) and Crossref, as OCC
curator and source metadata provider respectively.</p>
        <p>Then, few days after its creation, the resource br/525205 has been extended
with additional data concerning its citation links to other bibliographic resources,
as well as the completion of the full textual references it includes. The following
provenance statements have been, thus, generated:
# The old snapshot has been invalidated...
&lt;https://w3id.org/oc/corpus/br/525205/prov/se/1&gt;
prov:invalidatedAtTime "2016-08-29T22:42:06"^^xsd:dateTime ;
prov:wasInvalidatedBy &lt;https://w3id.org/oc/corpus/br/525205/prov/ca/2&gt; .</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>5 Conclusions</title>
      <p>In this paper we have introduced an approach for keeping track of changes in RDF
data and, consequently, in LOD datasets. The method proposed is actually derived
from existing techniques applied to the Document Engineering domain for addressing
similar issues. We have also described the use of this approach within the
OpenCitations Project as the main mechanism for providing a complete history of how the
entities in the OpenCitations Corpus have evolved in time. In the future, we plan to
develop automatic tools that allow us to restore a particular snapshot of an entity
by looking at its provenance information only, so as to facilitate the restoration of
entities at a particular time.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Connolly</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Delta: An Ontology for the Distribution of Differences Between RDF Graphs</article-title>
          . https://www.w3.org/DesignIssues/Diff
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Carroll</surname>
            ,
            <given-names>J. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hayes</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Stickler</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Named graphs</article-title>
          .
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          ,
          <volume>3</volume>
          (
          <issue>4</issue>
          ):
          <fpage>247</fpage>
          -
          <lpage>267</lpage>
          . http://dx.doi. org/10.1016/j.websem.
          <year>2005</year>
          .
          <volume>09</volume>
          .001
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Ding</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peng</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>da</surname>
            <given-names>Silva</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>P. P.</given-names>
            ,
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <surname>D. L.</surname>
          </string-name>
          (
          <year>2005</year>
          ).
          <article-title>Tracking RDF Graph Provenance using RDF Molecules</article-title>
          .
          <source>Technical report</source>
          . http://ebiquity.umbc.edu/get/ a/publication/178.pdf
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Garijo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eckert</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          (
          <year>2013</year>
          ). Dublin Core to PROV Mapping. W3C Working Group Note, 30
          <string-name>
            <surname>April</surname>
          </string-name>
          <year>2013</year>
          . https://www.w3.org/TR/prov-dc/
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Guarino</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Welty</surname>
            ,
            <given-names>C. A.</given-names>
          </string-name>
          (
          <year>2009</year>
          ).
          <article-title>An Overview of OntoClean</article-title>
          . In Handbook on Ontologies:
          <fpage>201</fpage>
          -
          <lpage>220</lpage>
          . Berlin, Germany: Springer.
          <source>ISBN: 978-3-540-70999-2</source>
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Lebo</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sahoo</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>PROV-O: The PROV Ontology</article-title>
          .
          <source>W3C Recommendation</source>
          , 30 April 2013. World Wide Web Consortium. http://www.w3.org/ TR/prov-o/
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Isele</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jakob</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jentzsch</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kontokostas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mendes</surname>
            ,
            <given-names>P. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hellmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Morsey</surname>
            , M., van Kleef,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia</article-title>
          .
          <source>Semantic Web</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ):
          <fpage>167</fpage>
          -
          <lpage>195</lpage>
          . http://dx.doi.org/10.3233/SW-140134
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kunnatur</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>M. C. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musen</surname>
            ,
            <given-names>M. A.</given-names>
          </string-name>
          (
          <year>2004</year>
          ).
          <article-title>Tracking Changes During Ontology Evolution</article-title>
          .
          <source>In Proceedings of ISWC</source>
          <year>2004</year>
          :
          <fpage>259</fpage>
          -
          <lpage>273</lpage>
          . http://dx.doi. org/10.1007/978-3-
          <fpage>540</fpage>
          -30475-3_
          <fpage>19</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>The Semantic Publishing and Referencing Ontologies</article-title>
          . In Semantic Web Technologies and Legal Scholarly Publishing:
          <fpage>121</fpage>
          -
          <lpage>193</lpage>
          . http://dx.doi.org/10. 1007/978-3-
          <fpage>319</fpage>
          -04777-
          <issue>5</issue>
          _
          <fpage>5</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dutton</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gray</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shotton</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Setting our bibliographic references free: towards open citation data</article-title>
          .
          <source>Journal of Documentation</source>
          ,
          <volume>71</volume>
          (
          <issue>2</issue>
          ):
          <fpage>253</fpage>
          -
          <lpage>277</lpage>
          . http://dx.doi.org/10.1108/JD-12-2013-0166
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poggi</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vitali</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Overlapproaches in documents: a definitive classification (in OWL, 2!)</article-title>
          .
          <source>In Proceedings of Balisage</source>
          <year>2014</year>
          . http://dx.doi.org/10. 4242/BalisageVol13.Peroni01
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shotton</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Metadata for the OpenCitations Corpus</article-title>
          . Figshare. https://dx.doi.org/10.6084/m9.figshare.3443876
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Peroni</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shotton</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vitali</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          (
          <year>2016</year>
          ).
          <article-title>Freedom for bibliographic references: OpenCitations arise</article-title>
          . To appear
          <source>in Proceedings of 2016 International Workshop on Linked Data for Information Extraction (LD4IE</source>
          <year>2016</year>
          ). https://w3id.org/oc/paper/occlisc2016.html
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Vrandecic</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krötzsch</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Wikidata: a free collaborative knowledge base</article-title>
          .
          <source>Communication of the ACM</source>
          ,
          <volume>57</volume>
          (
          <issue>10</issue>
          ):
          <fpage>78</fpage>
          -
          <lpage>85</lpage>
          . http://dx.doi.org/10.1145/2629489
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Völkel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Groza</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>SemVersion: RDF-based ontology versioning system</article-title>
          .
          <source>In Proceedings of the IADIS WWW/Internet</source>
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Welty</surname>
            ,
            <given-names>C. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fikes</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>A Reusable Ontology for Fluents in OWL</article-title>
          .
          <source>In Proceedings of FOIS</source>
          <year>2006</year>
          :
          <fpage>226</fpage>
          -
          <lpage>236</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Zeginis</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tzitzikas</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christophides</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          (
          <year>2007</year>
          ).
          <article-title>On the Foundations of Computing Deltas Between RDF Models</article-title>
          .
          <source>In Proceedings of ISWC/ASWC</source>
          <year>2007</year>
          :
          <fpage>637</fpage>
          -
          <lpage>651</lpage>
          . http: //dx.doi.org/10.1007/978-3-
          <fpage>540</fpage>
          -76298-0_
          <fpage>46</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>