<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Sorry, I only speak natural language: a pattern-based, data-driven and guided approach to mapping natural language queries to SPARQL</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mariano Rico</string-name>
          <email>mariano.rico@upm.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christina Unger</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Philipp Cimiano</string-name>
          <email>cimianog@cit-ec.uni-bielefeld.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Ontology Engineering Group (OEG) Universidad Politecnica de Madrid</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Semantic Computing Group Bielefeld University</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2015</year>
      </pub-date>
      <abstract>
        <p>We present a new interface based on natural language to support users in specifying their queries with respect to RDF datasets. The approach relies on a number of prede ned patterns that uniquely determine a type of SPARQL query. The approach is incremental and assisted in that it guides a user step by step in specifying a query by incrementally parsing the input and providing suggestions for completion at every stage. The methodology to specify the patterns is informed by empirical distributions of SPARQL query types as found in standard query logs. So far, we have implemented the approach using two patterns only as proof-of-concept. The coverage of the pattern library will be extended in the future. We will also provide an evaluation of the approach on the well-known QALD dataset.</p>
      </abstract>
      <kwd-group>
        <kwd>SPARQL queries</kwd>
        <kwd>natural language</kwd>
        <kwd>pattern based</kwd>
        <kwd>data driven</kwd>
        <kwd>guided systems</kwd>
        <kwd>lemon model</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>SPARQL is the query language for the Web of data, but it su ers from a high
adoption barrier by end users. Mastering the SPARQL syntax is a problem for
users lacking IT skills. But even knowing the SPARQL syntax, a more severe
problem remains: the need to know the underlying vocabulary of the queried
dataset. Thus, querying RDF data remains a barrier not only for lay people but
also for technically skilled users. There are di erent approaches to alleviate this
barrier and to support users in the task of querying RDF data.</p>
      <p>
        One approach consists in guiding users in writing SPARQL queries by some
interface, e.g. SindiceTech's Qakis [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] or SparQLed [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], in which you see the
? Supported by LIDER (EU FP7 proj. 610782) and projects JCI-2012-12719,
TIN201346238-C4-2-R (4V), UNPM13-4E-1814 (INFRA)
SPARQL query but you are assisted to avoid syntactic errors. Such approaches
remove the rst problem mentioned above.
      </p>
      <p>
        Another type of approach uses visual metaphors to support writing queries,
abstracting from the SPARQL syntax, e.g. Rhizomer [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], GoRelations [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ],
RelFinder [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] or SPEX [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The third type of approach relies on natural, or
controlled natural language as query interface. A user writes a query in natural
language and the interface systems needs to map this natural language query
into SPARQL, thus completely hiding the SPARQL query language from the
user. Examples of the latter category are PowerAqua [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and others.
      </p>
      <p>
        The systems in the third category are typically not incremental in the sense
that they require a user to enter a full query before it is processed. Thus, the
user has no guidance on how to write the query. Exceptions are systems such
as Attempto-OWL [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] or GINO [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], which rely on controlled natural language.
Such approaches de ne a controlled language in a top-down fashion, without
empirically looking at the types of queries users actually make.
      </p>
      <p>
        We present a novel approach to guided natural language querying that is
incremental in the sense that it interprets the question while the user is typing
it and can thus provide guidance by proposing possible completions of the query
to the user. The approach relies on a number of patterns that have been de ned
to cover the most frequent types of SPARQL queries. So far, only two patterns
have been implemented to provide a proof-of-concept, but the long-term goal
is to continue adding natural language patterns iteratively to cover the most
frequent types of SPARQL queries sent by users to SPARQL endpoints. In fact,
it has been shown that the the SPARQL queries made to SPARQL endpoints
follow a power-law distribution [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] (at least for the DBpedia and the Spanish
DBpedia).
      </p>
      <p>Figure 1 shows the number of queries for each type (left y-axis) and the
percentage of the total number of queries (right y-axis). One can see that the
rst query type (the most used) was used by 1.2 million queries, corresponding to
42% of the total number of queries. The top-20 queries cover 95% of all queries.
This gure was built using 3 months of DBpedia logs (USEWOD 2014 dataset).
A speci c question of a user might be:</p>
      <p>\Give me movies by Tarantino"
The corresponding natural language pattern would be the following:</p>
      <p>Give me Noun Preposition Instance
The corresponding SPARQL query type would be the following:</p>
      <p>SELECT ?s WHERE f?s prop instance g
And the actual SPARQL query would look as follows:</p>
      <p>SELECT ?s WHERE f?s dbpedia:director dbpedia:Tarantinog
Our long-term goal is to have an approach that covers 90% of all queries. By
guiding the user, one ensures that only such queries are typed in that can actually
1,400,000
 tep1,200,000
y
y
r
e
 tqu1,000,000
a
h
 t
ro 800,000
 f
s
e
i
r
eu 600,000
q
  f
o
r
eb 400,000
m
u
N
200,000
0
2
4
6</p>
      <p>8 10 12 14
Query type (ordered by frequency)
16
18
20
be processed by the system, thus reducing errors and increasing robustness of
the system. With this method we can cover quickly the most frequent query
types, but covering the long tail would require implementing hundreds of query
types. Our system is intended to allow an incremental way of adding new query
types.</p>
      <p>
        An important challenge is to have a system with high lexical coverage that
covers as many alternative ways of referring to one given property, class or
individual as possible. We rely on ontology lexica as modeled by the lemon model [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]
to make such lexicalizations explicit. We exploit existing lexicalizations of
DBpedia which relate vocabulary elements in DBpedia to the lexical entries that
verbalize these via the lemon model [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. In this way, for instance, we can look
up in the lexicon that dbpedia:starring can be verbalized by ``movie with''
and that the property dbpedia:producer is verbalized by ``movie by'', etc.
The lexicalization relation is clearly not 1:1, as one vocabulary element can be
verbalized by di erent lexical entries, and one lexical entry can be ambiguous
and potentially refer to di erent vocabulary elements. A possible methodology
here would be to prioritize the creation of lexical entries in a way that is informed
by frequency of use of types (classes) and properties in the given dataset.
      </p>
      <p>
        A further challenge is to have a real-time response so that query completion
is immediate from the users' point of view. This can be achieved by appropriate
inverted indexes that return for a class which properties are associated to this
class, which instances stand in the subject or object of a particular property, etc.
We rely on an index [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]3 that provides a quick response to intensive SPARQL
queries like select ?type where f?s dbpedia:starring ?v . ?s a ?typeg
(type of the subject in triples with property dbpedia:starring). Table 1 shows
the result of the previous query, but ordered by usage (triples with subjects of
that type). With this information we provide to the user a list of options starting
with work, followed by film and television show, etc.
3 See http://loupe.linkeddata.es/loupe/
SELECT ?s WHERE f?s a dbpedia:Film .
      </p>
      <p>?s dbpedia:starred dbpedia:John_Travoltag
or Which Noun Verb Preposition Instance?
e.g. Which river passes through London?, mapping to the SPARQL query
SELECT ?s WHERE f?s a dbpedia:River .</p>
      <p>?s dbpedia:crosses dbpedia:Londong</p>
      <p>Overall, NL patterns thus represent slotted and typed patterns into which
elements can be inserted to be completed. Once all elements have been inserted
into an NL pattern, the SPARQL query is determined.</p>
      <p>Figure 2 shows two NL patterns. Each NL pattern represents a sequence of
so called Parseable Elements. Each element parses or recognizes one part of the
input. A question is parsed by applying all NL patterns available and
determining which ones match or recognize the input. This is determined iteratively
by checking for each parseable element whether it recognizes or matches the
corresponding part of the question. In general, multiple patterns will match a
question at any time. We distinguish the following types of parseable elements:
B</p>
      <p>D
NLP
NLP
1
2</p>
    </sec>
    <sec id="sec-2">
      <title>TextElem</title>
    </sec>
    <sec id="sec-3">
      <title>TextElem</title>
    </sec>
    <sec id="sec-4">
      <title>TextElem</title>
    </sec>
    <sec id="sec-5">
      <title>PNElem</title>
    </sec>
    <sec id="sec-6">
      <title>InstElem</title>
    </sec>
    <sec id="sec-7">
      <title>TextElem</title>
    </sec>
    <sec id="sec-8">
      <title>CNElem</title>
    </sec>
    <sec id="sec-9">
      <title>VElem</title>
    </sec>
    <sec id="sec-10">
      <title>InstElem A C</title>
      <p>Fig. 2. Use case for two NL query patterns NLP1 and NLP2
{ TextElements: These elements are responsible for recognizing constant
ller elements (e.g. `what', `who', etc.)
{ PropertyNounElements: These elements are responsible for recognizing
a noun that denotes a property (e.g. `capital' )
{ ClassNounElements: These elements are responsible for recognizing a
noun that denotes a class (e.g. `river' )
{ VerbElements: These elements are responsible for parsing a verb that
denotes a property (e.g. `passes' )
{ InstanceElements: These elements are responsible for parsing an instance
(e.g. `London', `John Travolta' ), etc.</p>
      <p>For each pattern, the system checks whether it accepts the input query. It
iterates through the sequence of parseable elements that constitute an NL pattern
and veri es for each parseable element whether it recognizes the corresponding
part of the sentence. A simple lookahead method is used to compute possible
completions of the question by showing the user the inputs that the following
parseable element will accept. Choices made by the user are propagated to future
elements of the sequence as needed and modeled by corresponding dependencies
between the parseable elements in the sequence. In the example depicted in
Figure 2), the user has typed in what, which matches both patterns. Then, the
system proposes completions for both patterns. The user can delete any number
of previous selections to return to a previous point and the system continues the
process from that point.
3</p>
      <p>Architecture of the system
The architecture of the system is depicted in Figure 3. The main components of
the architecture are the following ones:</p>
      <p>DBpedia
endpoint</p>
      <sec id="sec-10-1">
        <title>DBpedia index</title>
      </sec>
      <sec id="sec-10-2">
        <title>DBpedia lexicalization</title>
        <p>Web Server</p>
      </sec>
    </sec>
    <sec id="sec-11">
      <title>Internet</title>
      <p>interQA</p>
    </sec>
    <sec id="sec-12">
      <title>Internet end user (multilingual)</title>
      <p>Fig. 3. Key components in the interQA system for the DBpedia use case.
1. SPARQL endpoint: As any user interface, a quick response is a
fundamental issue. In order to avoid an excessive number of requests to the endpoint,
we create an index with the results of a speci c set of extractive queries.
Therefore, we need a privileged access to the endpoint. In our experiments
we have used the Spanish DBpedia. Other endpoints could run the indexer
in low-demand periods (by night) or with small pagination (the smaller the
pagination size, the longer time to create the index).
2. SPARQL endpoint index: This index is available online as a REST
service. For the case of the Spanish DBpedia see (http://loupe.linkeddata.
es/loupe).
3. Question Interpretation component: the component4 that
incrementally interprets the user's input by matching it to the patterns and returns
possible completions. It is described in the next section.
4. Frontend: A web server running a web application to interact with the user.
5. Lexicon: a lexicon that contains information about how the vocabulary
elements of the dataset are lexicalized in natural language. The system
currently uses the lexicon for DBpedia in three languages (Spanish, English,
German).
4</p>
      <p>Question Interpretation component
We have presented a preliminary system that interprets natural language
questions with respect to SPARQL and has three key features: i) it is pattern-based
in the sense that it exploits a number of patterns that cover the most frequent
types of SPARQL queries, ii) it is data-driven in the sense that it is grounded
in an analysis of frequent query types and in that it uses indices to anticipate
possible completions of a query in real time, and iii) it is guided in the sense
that it computes potential completions and displays these to the user. In this
4 See http://github.com/ag-sc/InterQA
g &gt;
itrn i)ng *</p>
      <p>r&gt;
S t</p>
      <p>Sg 1
n
i
&lt;
tr
t isS
n L&lt;
e t</p>
      <p>s
em )g i(L
llEe itrn aed
b (S h
a e a
rsa rsa ko
P p lo 1
*
an id g &gt;</p>
      <p>n g
le vo itr in
o S tr
o S
b
&lt;
t
s
i
L
g
n
i
r
t
S
)
&gt; 1
) &lt;
t g t
n in ) is
e tr ) g (L
litrEengm (tscaeSh i(trSndgd i(trrsaeSn kaaehod
S m a p lo
»
e
t
a
e
r
c
1 «
g &gt;
in g
r )n 1
t i</p>
      <p>r&gt;
S t
g
S
n
i
&lt;
tr
t isS
n L&lt;
e ts
lem )ng i(Ld 1
tscEaenn i(trrsaeS kaaeho 1
I p lo
»
e
t
a
e
r
c
«g &gt;
itrn i)ng</p>
      <p>r&gt;
S t
g
S
n
i
&lt;
tr
isS
L
&lt;
t
s
) i
g (L
1 un in d
o tr ae
N (S h
s e a
s s k
la ra o</p>
      <p>C p lo
1
n &gt; g
lae ing itrn
oo tr S
b S
&lt;
t
s
i
L
) *
(
y
r
e
) u
g Q
n L
n i
r tr () Q 1
ttae (seS txe PRA
P s N S
A r t t</p>
      <p>a e e
Q p g g
»
e
t
a
e
r
c
«
d g &gt; &gt; &gt; &gt; id id
ivo itrn ing try ing ing vo vo</p>
      <p>S tr En tr tr</p>
      <p>S l S S
t&lt; ica t&lt; t&lt;
is x is is
L e L L</p>
      <p>L
&lt;
t
s
i
L
»
e
t
a
e
r
c
«
»
e
t
a
e
r
c
«
1
1
)
y
r
t
n
E
l
a
c
i
xe ) )t )t
L g n n
, in e e
1 ng ) tr m m
trryeunoopN lii(ttrrrsaaeeSSPnbddg i()trrsaeSng ii(ttrsLkaaeShnoodg&lt;&gt; ,lii(tttrrxcLyEaeeSSnng iI()tttrsscaeeSnnng i()ttrrseeePop lII(tttsssccEaaeeeennnn iiil(tttrrsEeeeSPnnoopg trc«eae»
P a p l g g g s s
»
e
t
a
e
r
c
«
n &gt; g
a g in
1 le in tr
oo tr S
b S
1 t&lt;
s
i
L
)
(
y
r
e
2 ) u
rn g Q
ttae itrSn )(t LRQ
ryP (se xe PA
e s N S
u ra te te
Q p g g
d
i
o
v
)
n
1 r
e
t
t
r a
e P
g A
a Q
n (
a rn
M te
n t
r a
te P
t y
a r
P e
y u
1 re Q
u d</p>
      <p>d
Q a
»
e
t
a
e
r
c
«</p>
      <p>d
t i
se vo
T
r
e
g )
a (
n g
a n</p>
      <p>i
M h
n t
r e
e
tt m
a o
P tS
ry se
e t
u</p>
      <p>Q
&gt; n &gt; g
ing lae ing itrn
trS&lt; oob trS S te»</p>
      <p>&lt; a
its its re
L L c</p>
      <p>«
)
g
n
i
r
t
S
,
g
n
i
r
t
S
(
m
r
o
F
s
u
l
P
l
a
c
i
n
o
n
a
)
(
1 r1n rsFoC )g ryeuQ
ttryaeeP Itscaenn i(trsseSn )(txeN LSPRAQ
u te ra te te
1 Q g p g g
way, one ensures that only such queries are entered into the system that are also
valid and can be processed and interpreted by the system, thus reducing errors
and increasing robustness. Future work includes increasing the coverage of the
system with more patterns, improving the indexes and covering languages other
than English. An evaluation of the approach remains to be done.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>E.</given-names>
            <surname>Cabrio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Cojan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. P.</given-names>
            <surname>Aprosio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Magnini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lavelli</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Gandon</surname>
          </string-name>
          , \
          <article-title>QAKiS: an Open Domain QA System based on Relational Patterns,"</article-title>
          <source>in Proc. of 11th International Semantic Web Conference. Poster &amp; Demostrations Track</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>S.</given-names>
            <surname>Campinas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. E.</given-names>
            <surname>Perry</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ceccarelli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Delbru</surname>
          </string-name>
          , and G. Tummarello, \
          <article-title>Introducing RDF Graph Summary with Application to Assisted SPARQL Formulation,"</article-title>
          <source>in Proc. of 23rd International Workshop on Database and Expert Systems Applications (DEXA)</source>
          , pp.
          <volume>261</volume>
          {
          <issue>266</issue>
          , IEEE,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>R.</given-names>
            <surname>Garc</surname>
          </string-name>
          <string-name>
            <given-names>a</given-names>
            ,
            <surname>J. M. Gimeno</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Perdrix</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Gil</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Oliva</surname>
          </string-name>
          , \
          <article-title>The Rhizomer Semantic Content Management System,"</article-title>
          <source>in Proc. of First World Summit on the Knowledge Society. Emerging Technologies and Information Systems for the Knowledge Society. LNCS 5288</source>
          , pp.
          <volume>385</volume>
          {
          <issue>394</issue>
          , Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. L. Han,
          <string-name>
            <surname>T</surname>
          </string-name>
          . Finin,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Joshi</surname>
          </string-name>
          , \
          <article-title>GoRelations: An Intuitive Query System for DBpedia,"</article-title>
          <source>in Proc. of Joint International Semantic Technology Conference (JIST)</source>
          .
          <source>LNCS 7185</source>
          , pp.
          <volume>334</volume>
          {
          <issue>341</issue>
          , Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>S.</given-names>
            <surname>Lohmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Heim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Stegemann</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Ziegler</surname>
          </string-name>
          , \
          <article-title>The RelFinder User Interface: Interactive Exploration of Relationships between Objects of Interest,"</article-title>
          <source>in Proc. of 15th International Conference on Intelligent User Interfaces</source>
          , pp.
          <volume>421</volume>
          {
          <issue>422</issue>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>S.</given-names>
            <surname>Scheider</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Degbelo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Lemmens</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. van Elzakker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Zimmerhof</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Kostic</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Jones</surname>
          </string-name>
          , and G. Banhatti, \
          <article-title>Exploratory querying of SPARQL endpoints in space and time," Semantic Web Journal</article-title>
          (to appear),
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>V.</given-names>
            <surname>Lopez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Fernandez</surname>
          </string-name>
          , E. Motta, and
          <string-name>
            <given-names>N.</given-names>
            <surname>Stieler</surname>
          </string-name>
          , \
          <article-title>PowerAqua: Supporting users in querying and exploring the Semantic Web,"</article-title>
          <source>Semantic Web Journal</source>
          , vol.
          <volume>3</volume>
          , no.
          <issue>3</issue>
          , pp.
          <volume>249</volume>
          {
          <issue>265</issue>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>N. E.</given-names>
            <surname>Fuchs</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Kaljurand</surname>
          </string-name>
          , and T. Kuhn, \
          <article-title>Attempto Controlled English for Knowledge Representation,"</article-title>
          <source>in Proc. of 4th International Summer School. Reasoning Web. LNCS 5524</source>
          , pp.
          <volume>104</volume>
          {
          <issue>124</issue>
          , Springer,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>A.</given-names>
            <surname>Bernstein</surname>
          </string-name>
          and E. Kaufmann, \GINO{
          <string-name>
            <given-names>A Guided</given-names>
            <surname>Input Natural Language Ontology Editor</surname>
          </string-name>
          ,
          <article-title>"</article-title>
          <source>in Proc. of 5th International Semantic Web Conference (ISWC)</source>
          .
          <source>LNCS 4273</source>
          , pp.
          <volume>144</volume>
          {
          <issue>157</issue>
          , Springer,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>M.</given-names>
            <surname>Rico</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Gomez-Perez</surname>
          </string-name>
          , \
          <article-title>The Pareto principle also rules SPARQL queries,"</article-title>
          <source>Journal of Web Semantics (in preparation)</source>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>J. McCrae</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Spohr</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Cimiano</surname>
          </string-name>
          , \
          <article-title>Linking Lexical Resources and Ontologies on the Semantic Web with Lemon,"</article-title>
          <source>in Proc. of 8th Extended Semantic Web Conference (ESWC). Part 1. The Semantic Web: Research and Applications. LNCS 6643</source>
          , pp.
          <volume>245</volume>
          {
          <issue>259</issue>
          , Springer,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>C. Unger</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>McCrae</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Walter</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Winter</surname>
            , and
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Cimiano</surname>
          </string-name>
          , \
          <article-title>A lemon lexicon for DBpedia,"</article-title>
          <source>in Proc. of 1st International Workshop on NLP and DBpedia</source>
          , co
          <article-title>-located with the 12th International Semantic Web Conference (ISWC)</article-title>
          .
          <source>CEUR</source>
          Vol-
          <volume>1064</volume>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>N.</given-names>
            <surname>Mihindukulasooriya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Rico</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Garcia-Castro</surname>
          </string-name>
          , \
          <article-title>An Analysis of Quality Issues of the Properties Available in the Spanish DBpedia," in Proc. of Conference of the Spanish Association for Arti cial Intelligence (CAEPIA), LNCS</article-title>
          (to appear), Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>