<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>conTEXT { A Mashup platform for Lightweight Text Analytics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ali Khalili</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Soren Auer</string-name>
          <email>auer@cs.uni-bonn.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Axel-Cyrille Ngonga Ngomo</string-name>
          <email>ngongag@informatik.uni-leipzig.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>AKSW, Institute of Computer Science, University of Leipzig</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Institute of Computer Science, University of Bonn and Fraunhofer IAIS</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Social media technologies such as Weblogs, Microblogging, Wikis and Social Networks have become one of the most important parts of our daily life as they enable us to communicate and share stories with a lot of people. The more the amount of published information grows, the more important are solutions for accessing, analyzing, summarizing and visualizing information. While substantial progress has been made in the last years in each of these areas individually, we argue, that only the intelligent combination of approaches will make this progress truly useful and leverage further synergies between techniques. conTEXT aims to provide a user-friendly and lightweight Mashup platform enabling endusers to use sophisticated NLP techniques for analyzing and visualizing their content. it provides a exible text analytics architecture of participation by innovative combination of di erent pieces of services for content collection and analysis. Named Entity Recognition (e.g. DBpedia Spotlight, FOX), Relation Extraction (e.g. BOA), Sentiment Analysis (e.g. Vivekn), Social Media (e.g. Twitter, Fcebook, Google+, LinkedIn), and Visualization (e.g. Exhibit, D3js) are some of the example services and APIs currently utilized in conTEXT.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Currently, there seems to be an imbalance on the Web. Hundreds of millions of
users continuously share stories about their life on social networking platforms
such as Facebook, Twitter and Google Plus. However, the conclusions which can
be drawn from analysing the shared content are rarely shared back with the
users of these platforms. The social networking platforms on the other hand
exploit the results of analysing user-generated content for targeted placement
of advertisements, promotions, customer studies etc. One basic principle of data
privacy is, that every person should be able to know what personal information is
stored about herself in a database (cf. OECD privacy principles1). We argue, that
this principle does not su ce anymore and that there is an analytical information
imbalance. People should be able to nd out what patterns can be discovered
and what conclusions can be drawn from the information they share.</p>
    </sec>
    <sec id="sec-2">
      <title>1 http://oecdprivacy.org/#participation</title>
      <p>We showcase conTEXT { a text analytics Mashup, which helps to mitigate
the analytical information imbalance by allowing end-users to use sophisticated
NLP techniques for analysing and visualizing their content, be it a weblog,
Twitter feed, website or article collection. The architecture of conTEXT comprises
di erent services for content access, content analysis (currently mainly Named
Entity Recognition, Relation Extraction and Sentiment Analysis ) and
visualization. Di erent exchangeable components can be plugged into this architecture.
Users are empowered to provide manual corrections and feedback on the
automatic text processing results, which directly increase the semantic annotation
quality and are used as input for attaining further automatic improvements. An
online demo of the conTEXT is available at http://context.aksw.org.</p>
      <p>conTEXT empowers users to answer a number of questions, which were
previously impossible or very tedious to answer. Examples include:
{ Finding all articles or posts related to a speci c person, location or
organization.
{ Identifying the most frequently mentioned terms, concepts, people, locations
or organizations in a corpus.
{ Showing the temporal relations between people or events mentioned in the
corpus.
{ Discovering typical relationships between entities.
{ Identifying trending concepts or entities over time.
{ Find posts where certain entities or concepts co-occur.</p>
      <p>conTEXT lowers the barrier to text analytics by providing the following key
features:
{ No installation and con guration required.
{ Access content from a variety of sources.
{ Instantly show the results of text analysis to users in a variety of
visualizations.
{ Allow re nement of automatic annotations and take feedback into account.
{ Provide a generic architecture where di erent services and APIs for content
acquisition, natural language processing and visualization can be plugged
together.</p>
      <p>
        It is worth mentioning that we have published the idea and technical details
of conTEXT plus a comprehensive evaluation of the platform at [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
2
conTEXT
      </p>
      <sec id="sec-2-1">
        <title>Mashup Architecture and Work ow</title>
        <p>RSS, Atom, RDF Feeds
REST APIs
SPARQL Endpoints
Web Crawlers</p>
        <sec id="sec-2-1-1">
          <title>Collecting</title>
        </sec>
        <sec id="sec-2-1-2">
          <title>Processing</title>
        </sec>
        <sec id="sec-2-1-3">
          <title>Enriching</title>
          <p>feedback</p>
        </sec>
        <sec id="sec-2-1-4">
          <title>Mixing</title>
          <p>BOA
RDFaCE</p>
        </sec>
        <sec id="sec-2-1-5">
          <title>Annotation Refinement</title>
          <p>Exhibit
D3.js</p>
        </sec>
        <sec id="sec-2-1-6">
          <title>Exploring &amp; Visualizing</title>
          <p>
            The assembled text corpus is then processed by NLP services. While
conTEXT can integrate virtually any NLP services, it currently implements
interfaces for DBpedia Spotlight [
            <xref ref-type="bibr" rid="ref4">4</xref>
            ] and the Federated knOwledge eXtraction
Framework (FOX) [
            <xref ref-type="bibr" rid="ref6">6</xref>
            ] for discovering and annotating named entities in the text.
DBpedia Spotlight annotates mentions of DBpedia resources in text thereby links
unstructured information sources to the Linked Open Data cloud through
DBpedia. FOX is a knowledge extraction framework that utilizes a variety of di erent
NLP algorithms to extract RDF triples of high accuracy from text. Unlike
DBpedia Spotlight, which supports all the DBpedia resource types, FOX is limited to
Person, Location and Organization types. On the other hand, since FOX uses
ensemble learning to merge di erent NLP algorithms, leads to a higher precision
and recall (see [
            <xref ref-type="bibr" rid="ref6">6</xref>
            ] for details).
          </p>
          <p>
            The processed corpus is then further enriched by three mechanisms:
{ DBpedia URIs of the found entities are de-referenced in order to add more
speci c information to the discovered named entities (e.g. longitude and
latitudes for locations, birth and death dates for people etc.).
{ Entity co-occurrences are matched with pre-de ned natural-language
patterns for DBpedia predicates provided by BOA (BOotstrapping linked datA)2
in order to extract possible relationships between the entities.
{ The sentiment of articles is analyzed by the help of Vivekn[
            <xref ref-type="bibr" rid="ref5">5</xref>
            ] which is an
open source sentiment analysis service.
          </p>
          <p>The processed data can also be joined with other existing corpora in a text
analytics mashup. Such a mashup of di erent annotated corpora combines
information from more than one corpus in order to provide users an integrated
view. Analytics mashups help to provide more context for the text corpus under
analysis and also enable users to mix diverse text corpora for performing a
com</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>2 http://boa.aksw.org</title>
      <p>
        parative analysis. For example, a user's Wordpress blog corpus can be integrated
with corpora obtained from her Twitter and Facebook accounts. The creation
of analytics mashups requires dealing with the heterogeneity of di erent corpora
as well as the heterogeneity of di erent NLP services utilized for annotation.
conTEXT employs NIF (NLP Interchange Format)3[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] to deal with this
heterogeneity. The use of NIF allows us to quickly integrate additional NLP services
into conTEXT.
      </p>
      <p>The processed, enriched and possibly mixed results are presented to users
using di erent views for exploration and visualization of the data. Exhibit 4
(structured data publishing) and D3.js5 (data-driven documents) are employed for
realizing a dynamic exploration and visualization experience. Additionally,
conTEXT provides an authoring user interface based on the RDFa Content Editor
(RDFaCE)6 to enable users to revise the annotated results. User-re ned
annotations are sent back to the NLP services as feedback for the purpose of learning
in the system.
3 http://persistence.uni-leipzig.org/nlp2rdf/</p>
    </sec>
    <sec id="sec-4">
      <title>4 http://simile-widgets.org/exhibit3/</title>
    </sec>
    <sec id="sec-5">
      <title>5 http://d3js.org/</title>
    </sec>
    <sec id="sec-6">
      <title>6 http://rdface.aksw.org</title>
      <p>Exploration and visualization interfaces
The dynamic exploration of content indexed by the annotated entities facilitates
faster and easier comprehension of the content and provide new insights.
conTEXT creates a novel entity-based search and browsing interface for end-users
to review and explore their content. On the other hand, conTEXT provides
di erent visualization interfaces which present, transform, and convert
semantically enriched data into a visual representation, so that, users can explore and
query the data e ciently. Visualization UIs are supported by noise-removal
algorithms which will tune the results for better representation and will highlight the
picks and trends in the visualizations. For example, we use a frequency threshold
when displaying single resources in interfaces. In addition, a threshold based on
the Dice similarity is used in interfaces which display co-occurrences. By these
means, we ensure that the information overload is reduced and that information
shown to the user is the most relevant. Note that the user can chose to deactivate
or alter any of these thresholds.</p>
      <p>conTEXT allows to plugin a variety of di erent exploration and visualization
modules, which operate on the conTEXT data model capturing the annotated
corpora. By default, conTEXT provides the following views for exploring and
visualizing the annotated corpora (cf. Figure 2):
{ Faceted browsing allows users to quickly and e ciently explore the corpus
along multiple dimensions (i.e. articles, entity types, temporal data) using
the DBpedia ontology. The faceted view enables users to drill a large set of
articles down to a set adhering to certain constraints.
{ Matrix view shows the entity co-occurrence matrix. Each cell in the matrix
re ects the entity co-occurrence by entity types (color of the cell) and by the
frequency of co-occurrence (color intensity).
{ Sentiment view shows the overall sentiment of the corpus as well as the
sentiment of the individual articles in the corpus.
{ Image view shows a picture collage created from the entities Wikipedia
images. This is an alternative for tag cloud which re ects the frequent entities
in the corpora by using di erent image sizes.
{ Tag cloud shows entities found in the corpus in di erent sizes depending on
their prevalence. The tag cloud helps to quickly identify the most prominent
entities in the corpora.
{ Chordal graph view shows the relationships among the di erent entities in
a corpus. The relationships are extracted based on the co-occurrence of the
entities and their matching to a set of prede ned natural language patterns.
{ Places map shows the locations and the corresponding articles in the corpus.</p>
      <p>This view allows users to quickly identify the spatial distribution of locations
refereed to in the corpus.
{ People timeline shows the temporal relations between people mentioned in
the corpus. For that purpose, references to people found in the corpus are
enriched with birth and death days found in DBpedia.
{ Trend view shows the occurrence frequency of entities in the corpus over the
times. The trend view requires a corpus with articles having a timestamp</p>
      <p>(such as blogposts or tweets).
2.2</p>
      <p>
        Annotation re nement interfaces
A lightweight text analytics as implemented by conTEXT provides direct
incentives to users to adopt and revise semantic text annotations. Users will obtain
more precise results as they re ne annotations. On the other hand, NLP services
can bene t from these manually-revised annotations to learn the right
annotations. conTEXT employs the RDFa Content Editor RDFaCE within the faceted
browsing view and thus enables users to edit existing annotations while
browsing the data. The WYSIWYM (What-You-See-Is-What-You-Mean) interface [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]
provided by RDFaCE enables integrated visualization and authoring of
unstructured and semantic content (i.e. annotations encoded in RDFa). The manual
annotations are collected and sent as feedback to the corresponding NLP service.
In collaboration with DBpedia Spotlight and FOX team, we created feedback
APIs for these services. The user feedback serves two purposes: On one hand,
it directly increases the quality of the semantic annotation. On the other hand,
it can serve as input for active learning techniques, which can further boost
precision and recall of the semantic annotation.
2.3
      </p>
      <p>Linked Data interface for search engine optimization (SEO)
The Schema.org initiative provides a collection of shared schemas that Web
authors can use to markup their content in order to enable enhanced search
and browsing features o ered by major search engines. RDFa, Microdata and
JSON-LD are currently approved formats to markup web documents based on
Schema.org. There are already tools like Google Structured Data Markup Helper 7
which help users to generate and embed such markup into their web content.
A direct feature of the Linked Data based text analytics with conTEXT is the
provisioning of a SEO interface. conTEXT encodes the results of the content
annotation (automatic and revisions by the user) in the JSON-LD 8 format which
can be directly exposed to schema.org aware search engines. This component
employs the current mapping from the DBpedia ontology to the Schema.org
vocabularies9. Thus the conTEXT SEO interface enables end-users to bene t from
better exposure in search engines (e.g. through Google's Rich Text Snippets )
with very little e ort.
2.4</p>
      <p>Real-time semantic analysis
In addition to its normal functionality, conTEXT also supports real-time
content analysis for streaming data like Twitter streams. A demo of the real-time
semantic analysis for Twitter is available at http://context.aksw.org/resa.</p>
    </sec>
    <sec id="sec-7">
      <title>7 https://www.google.com/webmasters/markup-helper/</title>
      <p>8 JSON for Linked Data http://json-ld.org/</p>
    </sec>
    <sec id="sec-8">
      <title>9 http://schema.rdfs.org/mappings.html</title>
      <p>This way, users can see the live progress of di erent analytics views on
incoming data and therby can quickly follow the trends which are currently on the
social media. Real-time analytics is also useful for the companies and businesses
to gain competitive advantage and to improve their customer relationships by
monitoring users feedback on social media websites.
conTEXT is a Web application implemented in PHP and JavaScript using a
relational database backend (MySQL). The application makes extensive use of the
model-view-controller (MVC) architecture pattern and relies heavily on JSON
format as input for the dynamic client-side visualization and exploration
functionality.</p>
      <p>Figure 4 shows the conTEXT data model, which comprises Corpus, Article,
Entity and Entity Type tables to represent and persist the data for text
analytics. A corpus is composed of a set of articles or a set of other corpora (in
case of a mixed corpus). Each article includes a set of entities represented by
URIs and an annotation score. The Entity type table stores the type(s) for
each entity. As described in Section 2, conTEXT employs NIF for
interoperability between di erent NLP services as well as di erent corpora. Code 1.1 shows
a sample NIF annotation stored for an article. In order to create the required
input data structures for di erent visualization views supported by D3.js and</p>
      <p>Exhibit, we implemented a data transformer component. This component
processes, merges and converts the stored NIF formats into the appropriate input
formats for visualization layouts (e.g. D3 Matrix layout or Exhibit Map layout).
After the transformation, the converted visualization input representations are
cached on the server-side as JSON les to increase the performance of the system
in subsequent runs.</p>
      <p>One of the main design goals during the development of conTEXT was
modularity and extensibility. Consequently, we realized several points of extensibility
for implementation. For example, additional visual analysis views can be easily
added. Additional NLP APIs and data collectors can be registered. The faceted
browser based on Exhibit can be extended in order to synchronize it with other
graphical views implemented by D3.js and to improve the scalability of the
system. Support for localization and internationalization can be added into the user
interface as well as to the data processing components.</p>
      <p>Code 1.1. Generated semantic annotations represented in NIF/JSON.
"@context": {
"nif":</p>
      <p>"http://persistence.uni-leipzig.org/nlp2rdf/ontologies/nif-core",
In order to evaluate the usefulness and usability of conTEXT, we performed
a user study with 25 subjects (20 PhD students having di erent backgrounds
from computer software to life sciences, 2 MSc students and 3 BSc students with
good command of English) on a set of 10 questions pertaining to knowledge
discovery in corpora of unstructured data. To provide quantitative insights in
the usefulness of conTEXT, we carried out a task-driven usefulness study where
we measured the improvement in e ciency and e ectiveness that results from
using conTEXT. The evaluation platform provided users with a short tutorial
on how to perform the tasks using conTEXT and how to add their responses for
the questions. A look at the e ectiveness results (Figure 5) suggests that those
users who tried to carry out these task without conTEXT failed as they achieve
an average Jaccard score of 0.17 on this particular task while users relying on
conTEXT achieve 0.65. Moreover, as shown in Figure 6, in all cases, the users
are more time-e cient when using conTEXT than without the tool.</p>
      <p>To assess the usability of conTEXT, we used the standardized, ten-item
Likert scale-based System Usability Scale (SUS) questionnaire and asked each
person who partook in our usefulness evaluation to partake in the usability
evaluation. The results of our study (cf. Figure 7) showed a mean usability score
of 82 indicating a high level of usability according to the SUS score.
3</p>
      <sec id="sec-8-1">
        <title>Conclusion and Future Work</title>
        <p>With conTEXT, we showcased an innovative text analytics Mashup platform for
end-users, which integrates a number of previously disconnected technologies. In
this way, conTEXT is making NLP technologies more accessible, so they can be
easily and bene cially used by arbitrary end-users. conTEXT provides instant
bene ts for annotation and empowers users to gain novel insights and complete
tasks, which previously required substantial development.</p>
        <p>In future, we plan to investigate, how user feedback can be used across
different corpora. We consider the harnessing of user feedback by NLP services
an area with great potential to attain further boosts in annotation quality. We
plan to integrate revisioning functionality, where users can manipulate complete
sets of semantic annotations instead of just individual ones. In that regard, we
envision that conTEXT can assume a similar position for text corpora as have
data cleansing tools such as OpenRe ne for structure data.</p>
      </sec>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Hellmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lehmann</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , Brummer, M.:
          <article-title>Integrating nlp using linked data</article-title>
          .
          <source>In: 12th International Semantic Web Conference</source>
          ,
          <volume>21</volume>
          -25
          <source>October</source>
          <year>2013</year>
          , Sydney, Australia (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Khalili</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Wysiwym authoring of structured content based on schema.org</article-title>
          .
          <source>In: WISE 2013</source>
          . pp.
          <volume>425</volume>
          {
          <fpage>438</fpage>
          . Springer Berlin Heidelberg (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Khalili</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Auer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ngomo</surname>
            ,
            <given-names>A.C.N.</given-names>
          </string-name>
          <article-title>: context { lightweight text analytics using linked data</article-title>
          .
          <source>In: 11th Extended Semantic Web Conference (ESWC2014)</source>
          (
          <year>2014</year>
          ), http://svn.aksw.org/papers/2014/ESWC_conTEXT/public.pdf
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Mendes</surname>
            ,
            <given-names>P.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jakob</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Garc</surname>
            a-Silva,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Dbpedia spotlight: shedding light on the web of documents</article-title>
          .
          <source>In: Proceedings of the 7th International Conference on Semantic Systems</source>
          . pp.
          <volume>1</volume>
          {
          <issue>8</issue>
          . I-Semantics '
          <fpage>11</fpage>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          , New York, USA (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Narayanan</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Arora</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bhatia</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Fast and accurate sentiment classi cation using an enhanced naive bayes model</article-title>
          .
          <source>CoRR abs/1305</source>
          .6143 (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ngomo</surname>
            ,
            <given-names>A.C.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heino</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lyko</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Speck</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , Kaltenbock, M.:
          <article-title>Scms - semantifying content management systems</article-title>
          .
          <source>In: ISWC</source>
          . pp.
          <volume>189</volume>
          {
          <issue>204</issue>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>