<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Pundit: Creating, Exploring and Consuming Semantic Annotations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Marco Grassi</string-name>
          <email>am.grassi@univpm.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christian Morbidoni</string-name>
          <email>bchristian.morbidoni@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michele Nucci</string-name>
          <email>cm.nucci@univpm.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Simone Fonda</string-name>
          <email>dfonda@netseven.it</email>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Francesca Di Donato</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Semedia Group, Universita Politecnica delle Marche</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2013</year>
      </pub-date>
      <fpage>65</fpage>
      <lpage>72</lpage>
      <abstract>
        <p>This paper presents Pundit, a novel semantic web annotation tool, and demonstrates its use in producing structured data out of users annotations. Pundit allows communities of scholars to produce machinereadable annotations that can be made public and thus consumable as web data via SPARQL and ad-hoc REST APIs. Pundit is highly congurable and can deployed in custom instances to include well-de ned and agreed annotation vocabularies. Such instances can be distributed as bookmaklets to community users so they can create uniformly structured data in a certain application scenario. Basing on the provided APIs, some demonstrative applications have been developed, exploring di erent use scenarios, ranging from philosophy to journalism and cultural heritage. The main aim of this paper is to demonstrate how such uniformly structured annotations can be quickly re-used on the web to make information discoverable or to visualize it in interesting ways.</p>
      </abstract>
      <kwd-group>
        <kwd>Digital libraries</kwd>
        <kwd>Semantic Web</kwd>
        <kwd>Ontology</kwd>
        <kwd>Data Model</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>3 Scuola Normale Superiore, Italy</title>
      <p>
        efrancesca.didonato@sns.it - http://www.sns.it/
Annotation is a primary activity for scholars and professionals. It consists in
enriching a content with some new information, which possibly helps in
understanding or searching the content itself. While until few decades ago annotations
were sketched by hand on the side of a book, today web technologies have the
potential to make them in nitely replicable, remotely accessible and easy to
share. Web annotations systems and bookmarking/clipping tools are popular
nowadays both among generic users (e.g. social tagging) and among scholarly
communities (e.g. Zotero4, Mendeley5 users). However, existing annotation
systems are generally limited to textual comments, tags or prede ned metadata
templates (e.g. bibliographic records). Furthermore, annotations are often
isolated into closed systems and very rarely are connected to the Web of Data.
The simple idea behind our work is that of making of annotations a vehicle to
create new semantic web data, actually adding links and, ultimately, knowledge
to the so called Global Data Space [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Once annotations become available in a
standard and highly expressive form, a variety of applications can be built to
visualize the resulting knowledge in speci c domains. Pundit is a novel
annotation system that aims at implementing this vision, by enabling annotators (e.g.
scholars) to use semantically speci ed relations and link to web of data entities,
producing in fact accessible RDF graphs out of their work. Such RDF graphs
are collections of annotations that we call \notebooks". Notebooks can be
consumed via REST APIs or standard SPARQL endpoints. In this paper we rst
overview Pundit at a high level, then we focus on the issue of e ectively re-using
the annotations produced in Pundit to drive demonstrative use cases and
address end-user needs such as sharing, exploring and visualizing annotations. Two
main directions are currently being targeted. In Ask6, we attempt at creating
a portal to manage annotations, share them and explore public notebooks. We
then explore, by means of some demonstrative developments, the possibility of
basing on the Pundit \framework" to build vertical, specialized applications. In
the latter case, the basic pattern we follow is that of con guring and
deploying custom instances of Pundit, which can be distributed among users. Such
instances generate annotations that conform to pre-de ned data schemas and
can be quickly fed into existing open-source tools to produce more interesting
visualizations. Nevertheless they maintain the generality and exibility of RDF,
thus being compatible with Ask or other \general purpose" usages of data.
2
      </p>
      <sec id="sec-1-1">
        <title>Related Works</title>
        <p>
          An exhaustive state of the art in semantic annotation goes beyond the purpose
of this paper and can be found in the literature [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] and this section focus only
on tools related to our work. The semantic tagging paradigm, which exploits
publicly available Linked Data sources to retrieve unambiguous tags, has been
implemented in Faviki7 and Europeana Connect Media Annotation Prototype
(ECMAP)[
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. Other tools such as One click annotation [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ], CWRC-Writer [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]
and LORE (Literature Object Reuse and Exchange) [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] also allow the use of
restricted vocabularies or ontologies in the annotations. Some annotations tools,
as LORE and CWRC-Writer enable also the editing of more expressive
annotations in the form of subject-predicate-object statements. Although not based on
Semantic technologies and not supporting semantic annotations, Open
Knowledge Foundation (OKFN) Annotator8 has been conceived as a JavaScript library
that can be added to any Web page, both adding it into HTML and injecting it
using a bookmarklet, to make it annotatable, similarly to Pundit.
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>6 http://ask.as.thepund.it</title>
    </sec>
    <sec id="sec-3">
      <title>7 http://www.faviki.com</title>
    </sec>
    <sec id="sec-4">
      <title>8 http://okfnlabs.org/annotator/</title>
      <p>Annotations in Pundit are essentially triples that connects di erent kinds of
items together. A triple has the form [ subject - predicate - object ], where the
subject and object can be segments of text and images (e.g. [text - describes
image]&gt;) or entities from the web of data (e.g. [text - has author - Dante(from
Freebase.com)] or [image - depicts - Florence(from DBPedia.org)]). The most
expressive annotation interface provided by the Pundit client is the "triple
composer". It allows users to drag and drop items into triples, or select them from
the web page (e.g. by selecting a text or an image), as well as searching into
available vocabularies and data sources. However, other annotation wizards
support speci c kind of annotations, as putting two segments of text in relation, or
attaching tags and comments to a text segment. Image annotation of a segments
of images is supported by a dedicated module as shown in 1. The Pundit client
is a JavaScript application that can be deployed as a library, to then be easily
included in existing web sites to make the content \annotable"9, as well as
delivered as a bookmarklet. A bookmarklet is a simple link (bookmark) that, once
added to a web browser allows loading Pundit on every web page and annotating
its content.</p>
      <p>
        In Pundit, an annotation contains information at a twofold level. The rst
one is the \annotation metadata" and deals with the act of annotating, including
information on the author, the time of creation and the involved web resources.
Pundit bases on the Open Annotation data model (OA)10 [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] for representing
this dimension. The second, the \annotation graph", is an RDF graph resulting
from metadata and relations among web resources that a user has created by
annotating. In other words, it captures the semantics of the annotation
representing the user's contribution in terms of \domain knowledge". For example, an
annotation graph could contain Wikipedia pages corresponding to Italian writers
and relevant text segments from their works on wikisource.org or other open web
archives, perhaps linking each text to a number of other texts from relevant
contemporary writers. We call \items" the nodes of such a graph, which represent
      </p>
    </sec>
    <sec id="sec-5">
      <title>9 this has been done in wittgensteinsource.org 10 Open Annotation core speci cation: http://www.openannotation.org/spec/core/</title>
      <p>the annotated web resources, being them web pages segments or other kind of
entities (places, persons, etc.) While no restrictions are applied and no
assumptions are made by Pundit regarding the ontologies used in annotation graphs, a
certain knowledge of the structure of the single annotations into a notebook has
to be owned by a developer to implement a meaningful visualization based on
such \free shaped" data.</p>
      <p>So far, one of the most successful approaches to foster the reuse of data on
the web is to create a consensus around vocabularies and ontologies within a
certain community. In Pundit we try to follow this pattern by make it possible
to deploy customized annotation clients, in the form of JavaScript libraries or
bookmarklets, which can be distributed to users by \community leaders". A
custom client possibly includes a precise set of a well-de ned set of \relations" to be
used in annotations to create typed links among items or taxonomies where
relevant web entities are collected and ready to be annotated. Both taxonomies and
relations are represented in JSON and can be easily extracted from existing
vocabularies (e.g. SKOS) or ontologies, as we did in the Wittgenstein's brown book
pilot11. Aggregating items in collection, for sharing and publishing, is a common
pattern in social clipping and bookmarking tools. In Pundit, annotations are
collected in notebooks that users can optionally make publicly accessible. When
a notebook is public, the annotations contained in it are not only shown in the
Pundit client (e.g. when a user loads the Pundit bookmarklet on one of the
annotated web pages) but, more interestingly, a notebook can be consumed by
means of open REST APIs and accessed by a variety of web applications. Each
notebook provides a SPARQL endpoint to query its content. In other words,
a notebook is an independent RDF graph created by a given user in time and
connecting a variety of web resources.
4</p>
      <sec id="sec-5-1">
        <title>Consuming annotations</title>
        <p>Regarding how to use annotations, and the semantic data they enclose, to drive
end-user applications, there are mainly two \dimensions" that can be explored:
{ Annotation centric approach. This is commonly used in clipping systems
where each clip is the result of a single annotation and is shown as a \box"
containing some information (e.g. pictures, links, tags) about the annotated
items. We mainly based on this approach in designing Ask, a prototype web
application to search over public notebooks and manage personal ones.
{ Item centric approach. As annotations graphs in a notebook can be in fact
consumed as a unique and bigger RDF graph, a possible way of looking at
the data is that of focusing the visualization on the annotated items and
their relations with other items. This approach clearly bene ts from an
apriori knowledge on ontologies and custom vocabularies used in annotations,
as it needs to take into account the nature of the information and deals with
the \meaning" of annotations.
11 DM2E blog, Wittgenstein Brown Book experiment,
http://dm2e.eu/dm2e-to-startwork-on-wittgensteins-brown-book/</p>
        <p>Ask12 is a web application where public notebooks stored in Pundit can be
searched and explored. At the time of writing a new version of the tool is being
released. Personal notebooks are accessible to their owner and can be made
public or kept private. By default, Ask provides a general purpose visualization
of notebooks where single annotations are shown as \metadata boxes". However,
alternative visualizations (such as the one described in the following sections)
can be easily plugged by providing a compliant REST API. Ask is currently
subject to intense development, and one of the most interesting recent features
is the prototypal faceted browser available in alpha version13.
4.1</p>
        <sec id="sec-5-1-1">
          <title>Edgemaps Visualization: A Demonstrative Use Case.</title>
          <p>
            Edgemaps [
            <xref ref-type="bibr" rid="ref10">10</xref>
            ] is an open-source web tool that drives an interesting
visualization demonstration in the eld of philosophy14. The graph is generated by
Freebase.com data, which includes \in uences" slot in the description of authors.
While for a \generic" user such a visualization is enough, we cant probably say
the same for scholars that consider such relations as a matter of study and might
probably ask: \Why exactly do you say that Marx in uences Gramsci?", \What
is the evidence of that in the actual primary sources?", \Who said that?".
Structured annotations in conjunction with online open content as the one provided
by Wikisource15 make it relatively easy to bring the philosophers demo a little
further: generating the graph from scholars annotations made on primary sources
(thus including the evidence of the connections), rather than from centralized
data. We did so proving an opportunely tuned instance of Pundit and extending,
with little programming e ort, the Edgempas code. The demonstration is
documented on the web site16. The Pundit instance uses relations picked picked from
12 http://ask.as.thepund.it
13 http://demo.ask.thepund.it
14 http://mariandoerk.de/edgemaps/
15 http://wikisource.org
16 http://www.thepund.it/visualization-demos/philosophers-demo-howto/
the CiTO ontology17 and includes predicates like \cites" and \quotes", as well
as other more speci c ones like \discusses", \cites as sources", \agrees with",
etc. Each time two philosophers are connected by an \in uenced by" relation,
the corresponding annotations are shown so that the scholar can immediately
get an evidence of \why the relation is there". It is also possible to load multiple
notebooks from di erent scholars, thus in fact enabling a collaborative scenario,
where annotation authorship is always tracked back and each user can decide
what notebook to see or trust.
4.2
          </p>
        </sec>
        <sec id="sec-5-1-2">
          <title>Data Journalism</title>
          <p>The same pattern can be applied to several contexts and to address very diverse
use cases, as economics or journalism. The data journalism demonstrative
application shows the use of annotations, in this case quotations from politicians and
public persons taken from online news papers, to produce dynamic graphics. A
Pundit bookmarklet has been deployed containing a small set of relations (or
properties) to tag, describe and date in time politicians' declarations. The
associated visual tool has been developed in JavaScript and provided as a web API,
which gets a notebook (id) as argument and builds a timeline where annotated
declarations are shown along with the trend of a nancial indicator. The idea is
that of creating a tool for journalists to demonstrate and reveal possible existing
connections among what important persons says and how the market behaves.
(Fig. 4). A live demo can be found online18.
4.3</p>
        </sec>
        <sec id="sec-5-1-3">
          <title>Tracking Annotated Resources Over Time</title>
          <p>Timeline visualization has become a common practice for showing data
containing time-related information and several tools already exist that allows creating
such type of visualization. Instead of developing another one, Pundit reuses
TimelineJS19. This is an example of the advantages of decoupling annotation
17 CiTO Ontology: http://purl.org/spar/cito/
18 Journalism demo, http://ask.thepund.it/?#/timeline/31951d93/20120927
19 TimelineJS: www.timeline.verite.co
creation and consumption. A pundit API has been created that allows to
extract time-related information from a notebook given its id and to convert them
in a TimelineJS compliant JSON to feed the timeline, as shown in Fig. 5.
Annotations in the notebook simply need to have date information, i.e. they have
to contain triples having as subject a text fragment or an image, as predicate
\dates to" (for a date) or \start date" and \end date" (for a period in time) and
as object a date.</p>
          <p>
            A similar approach has been used in another experiment conducted in the
context of the Burckhardtsource.org platform that aims at mapping and
producing a critical edition of the extensive correspondence of 400 European
intellectuals with Jacob Burckhardt over a period of more than half a century from
1842 to 1897. 20 [
            <xref ref-type="bibr" rid="ref11">11</xref>
            ]. In this case study, the resources of interest were of three
types: Persons, Places and Works of art. Freebase has been used data source for
such resources as it contained already several of them. In line with the
principle of contributing to the Web of Data, rather than only consuming it, missing
resources have been added to Freebase. As a result, at the time of writing this
paper, scholars have added several hundreds of new entries to Freebase.org,
providing basic metadata and descriptions. Pundit has been con gured to use a
simple set of properties, to cover the di erent relations that can occur among
resources. These relations allow explicitly relating dates, places and persons with
text in the letters. The Timeliner open-source tool21 has been used to show
dynamic visualizations built from the corpus of annotations that scholars created
so far, mainly about places and persons, see Fig. 6. The visualization shows
the letters in a timeline, based on their sending date. It also graphs all of the
mentioned places and persons on a map, where person location is determined by
their birthplace and their movements can be tracked over time.
5
          </p>
        </sec>
      </sec>
      <sec id="sec-5-2">
        <title>Conclusions</title>
        <p>In this paper we presented preliminary results in leveraging on structured
semantic annotations to create interactions and visualization of collaboratively
20 www.burckhardtsource.org
21 http://timeliner.okfnlabs.org/
created data. In our examples we used Pundit: a customizable and exible
semantic web annotation tool. In deploying the tool for di erent use scenarios,
we highlighted a simple pattern consisting of developing custom vocabularies,
perhaps aggregating existing data, distributing a simple tool to annotate web
resources of interest and, nally building on third party applications to consume
the generated information and address speci c data visualization needs.
6</p>
      </sec>
      <sec id="sec-5-3">
        <title>Acknowledgments</title>
        <p>The research activity underlaying this work is being partially funded by the
European Union's Seventh Framework Programme managed by REA-Research
Executive Agency22 ([FP7/2007-2013][FP7/2007-2011]) under grant agreement
n. 262301, and by the GramsciSource project of the MIUR, FIRB 2012, p.
RBFR12MZ8R 003. Pundit was originally developed in the Semlib project23.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>C.</given-names>
            <surname>Bizer</surname>
          </string-name>
          , T. Heath, \
          <article-title>Linked Data: Evolving the Web into a Global Data Space"</article-title>
          , http://linkeddatabook.com/editions/1.0/
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>C.</given-names>
            <surname>Morbidoni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Grassi</surname>
          </string-name>
          , M. Nucci,\
          <article-title>Introducing SemLib Project: Semantic Web Tools for Digital Libraries"</article-title>
          .
          <source>International Workshop on Semantic Digital Archives 15th International Conference on Theory and Practice of Digital Libraries (TPDL)</source>
          .
          <volume>29</volume>
          .09.2011 in Berlin.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Andrews</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zaihrayeu</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pane</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <article-title>"A classi cation of semantic annotation systems</article-title>
          .
          <source>Semantic Web Journal"</source>
          . Online Available: http://www.semantic-Webjournal.
          <article-title>net/content/classi cation-semantic-annotation-systems</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>B.</given-names>
            <surname>Haslhofer</surname>
          </string-name>
          , E. Momeni,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gay</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Simon</surname>
          </string-name>
          , \
          <article-title>Augmenting Europeana Content with Linked Data Resources'</article-title>
          ,
          <source>in 6th International Conference on Semantic Systems (I-Semantics)</source>
          ,
          <year>September 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>M. L. Ralf</surname>
            <given-names>Heese</given-names>
          </string-name>
          , \
          <source>One Click Annotation' in 6th Workshop on Scripting and Development for the Semantic Web</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>G.</given-names>
            <surname>Rockwell</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Brown</surname>
          </string-name>
          , J. Chartrand, S. Hesemeier, \
          <article-title>CWRC-Writer: An In-Browser XML Editor'</article-title>
          - Digital Humanities 2012 Conference Abstracts. University of Hamburg,
          <source>Germany. July 1622</source>
          ,
          <year>2012</year>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>A.</given-names>
            <surname>Gerber</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Hunter</surname>
          </string-name>
          , \Authoring,
          <article-title>Editing and Visualizing Compound Objects for Literary Scholarship'</article-title>
          ,
          <source>Journal of Digital Information</source>
          , vol.
          <volume>11</volume>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8. \Open Annotation:
          <source>Alpha3 Data Model Guide' 15</source>
          October 2010 Eds. R. Sanderson and H. Van de Sompel. http://www.openannotation.org/spec/alpha3/
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>M.</given-names>
            <surname>Grassi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Morbidoni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nucci</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Fonda</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Ledda</surname>
          </string-name>
          .
          <article-title>"Pundit: Semantically Structured Annotations for Web Contents and Digital Libraries"</article-title>
          .
          <source>Proceedings of the Second International Workshop on Semantic Digital Archives (SDA</source>
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10. M. Dork, S. Carpendale, C. Williamson, \
          <article-title>EdgeMaps: Visualizing Explicit and Implicit Relations"</article-title>
          .
          <source>Proceedings of VDA 2011: Conference on Visualization and Data Analysis</source>
          , IS&amp;T/SPIE. 2011
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <given-names>F.</given-names>
            <surname>Di</surname>
          </string-name>
          <article-title>Donato. \Working on scholarly contents: A semantic vision"</article-title>
          .
          <source>In Proceedings of Open Platforms for Digital Humanities</source>
          ,
          <fpage>17</fpage>
          -
          <lpage>18</lpage>
          January
          <year>2013</year>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>22 http://ec.europa.eu/research/rea, DM2E Project: http://dm2e.eu/</mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>23 http://www.semlibproject.eu/, SemLib EU project</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>