<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Knowledge Translation: Computing the query potential of bio-ontologies</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Wee Tiong Ang</string-name>
          <email>wtang@i2r.a-star.edu.sg</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rajaraman Kanagasabai</string-name>
          <email>kanagasa@i2r.a-star.edu.sg</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Christopher J. O. Baker</string-name>
          <email>bakerc@unb.ca</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Data Mining Department, Inst. for Infocomm Research, 1 Fusionopolis Way Singapore</institution>
          ,
          <addr-line>138632</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Department of Computer Science and Applied Statistics, University of New Brunswick</institution>
          ,
          <addr-line>Saint John</addr-line>
          ,
          <country country="CA">Canada</country>
          ,
          <addr-line>E2L 4L5</addr-line>
        </aff>
      </contrib-group>
      <abstract>
        <p>Online ontologies have become a topic of discussion in a number of meta-data and content management communities including biology. For a number of technical and social reasons, domain experts are unable to get close enough to understand the conceptualization of an ontology they may wish to reuse or access as a query model. Consequentially they face initial conceptual challenges in how they can contribute to the ontology development process and what actual benefit they can derive from their contributions in the short and medium term. To ameliorate this need we report on the KnowleFinder system that summarizes queries that can be built from ontology as a query model and translates these into natural language statements for interpretation by the domain expert. Each natural language statement can then be submitted as an A-box reasoning query and its subsequent answer is retrieved. We illustrate the system with a subset of bioontologies.</p>
      </abstract>
      <kwd-group>
        <kwd>Ontology</kwd>
        <kwd>Graph Mining</kwd>
        <kwd>Summarization</kwd>
        <kwd>Natural Language Generation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>
        The proliferation and storage of ontologies has become a topic of discussion in a number
of meta-data and content management communities [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ] and bio-ontologies are
prominent in their contribution to this trend. Evidence of this can be seen from the
establishment of OBO [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] and BioPortal [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] which are repositories designed to serve the
bio-ontology professionals. In reality, communities of practice such as ontology
engineers and system engineers across all domains are concerned about reusability and
quality of ontologies. Reuse is limited by a number of factors that include access, quality
of ontologies, appropriate criteria for evaluating ontologies. To date, a number of
ontology repositories facilitate coordinated access to metrics about ontologies focusing
on algorithms for searching, ranking and classifying ontologies, OntoSelect [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ],
OntoKhoj [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] Swoogle [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], AKTiveRank [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] Watson [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. These resources make it easier
for knowledge engineers to access the ontologies and Semantic Web resources relevant
to their needs and were designed to enable consumers of ontology to make assessments
on their re-useabilty. However, there still remain barriers to the adoption of ontologies by
the wider community of domain experts. This is partly to do with the technical tool set
required to view, navigate and query ontologies remains non trivial. More recently
graphical query tools have become available [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref13">10, 11, 12, 13</xref>
        ]. Moreover this is
compounded by the fact that domain experts rarely take time to learn to use new tools or
query language and have to work through a third party and that many of the tools that
exist are not robust or scalable. In addition, they can have different visualization
paradigms [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] and the psychological / human computer interaction challenges are only
beginning to be addressed. [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. For these reasons, the domain experts are unable to get
close enough to understand the domain conceptualization of a given ontology or access
its query model. Consequentially, they can also face initial conceptual challenges in how
they can contribute to the ontology development process and what actual benefit they can
derive from their contributions in the short and medium term [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. Together these
challenges can be summarized with the term Ontology Comprehension. While not all
these challenges can be addressed by one solution, we define a precise need for which we
have designed a prototype implementation. In summary, we provide the domain experts
with an overview of the query capacity of existing ontologies. We report on the system
that summarizes queries that can be built using the ontology as a query model and
translates these into natural language statements for interpretation by users.
1.1
      </p>
      <sec id="sec-1-1">
        <title>Ontology Interrogation</title>
        <p>
          Ontological formalisms and their corresponding query languages each have different
expressive power and have difference capacities to support queries as well as logical
inference over the conceptualizations [
          <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
          ]. The most elementary ontology
interrogation can provide details of instances that belong to a particular class or the class
to which a given instance belongs. Binary role queries generate instances that are related
by named relations in ontology. Such basics constructs can be combined to form more
complex instance level queries and operators such as, unions, intersects, negations, can
be applied. More complex ontology interrogations involve reasoning over the T-box in
the conceptualization, namely, formal concepts hierarchies, axioms, and formal
definitions on concepts and associated constraints. Further details can be found in [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]
and in recent summary [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] which details nine types of scenario and requirements for
reasoning over OWL-formalised bio-ontologies. We focus our work on the generation of
intelligible statements in natural language derived from concept realization and transitive
relations mined from OWL ontologies. We consider multiple features of the
conceptualizations, namely concepts, relations (object properties), instances in the
ontologies. Using these constructs we can rewrite simple triples as questions. For
example instance-concept relations can be written as ‘Find instances of Gene’ and the
corresponding A-box query (nRQL) can be issued to the ontology or knowledgebase.
Real world questions that scientists often ask are often built from instance level input,
akin to keyword search. We focus also in capturing non conceptual information and
generating a corresponding conceptual query. For example, users inputting the keyword
‘p53’ (using the fuzzy matching option) can query for parent classes which asserts the
question what is p53 ? In addition to translations of concept and instance level ‘parent
look-up’ we focus on translations where users can discover concepts and instances
related to the selected concept / instance query term. We generate queries comprising of
membership relations and is-a relations between concepts and instances, spanning
multiple relationship types. We also support the generation of natural language queries
where no instances are present since our goal is to translate the query potential of
ontologies it is the translation of syntactic knowledge to natural language that serves to
edify the domain expert.
2
        </p>
      </sec>
    </sec>
    <sec id="sec-2">
      <title>KnowleFinder</title>
      <p>In order to summarize the query potential from ontology in simple terms, we assembled
KnowleFinder, (Figure 1), a multi-tier system (web, application and data) comprising of
a customized transitive query algorithm coupled with a natural language generation
algorithm. The transitive query algorithm, named ARQ, is tailored to return all query
paths across multiple object properties found in an ontology using a single-input query
term as a source. The results of these transitive query paths are translated into natural
language statements generated using the domain knowledge expressed in the ontology
entities (NLG). These natural language statements represent valid queries that can be
made to the ontology. In cases where the syntactic queries can return instances from an
OWL-DL knowledgebase, these results are made available to users through a
hyperlinked URL. Here we detail the components of the architecture and the online
implementation. A full evaluation of this novel translation task is held back for a
subsequent manuscript.</p>
      <p>OWL Ontology Repository
ARQ</p>
      <sec id="sec-2-1">
        <title>Entity Extractor</title>
        <p>ARQ
Path
XML</p>
      </sec>
      <sec id="sec-2-2">
        <title>Path Finding</title>
        <p>ARQ
Path XML</p>
      </sec>
      <sec id="sec-2-3">
        <title>User Selection / Query Formulator</title>
      </sec>
      <sec id="sec-2-4">
        <title>A-box Reasoning</title>
        <p>NLG</p>
        <p>Surface</p>
        <p>Realization
NL Query
Content
Determination and
Query Generation
Discourse
Planning</p>
      </sec>
      <sec id="sec-2-5">
        <title>Query Result</title>
        <sec id="sec-2-5-1">
          <title>2.1 Transitive ARQ Algorithm</title>
          <p>The algorithm for mining all object properties in the ontology to discover transitive
relations between two entities is presented in Figure 2. Given two concepts Csource and
Ctarget , the algorithm seeks to trace a pathway between them using the following idea.
First, the algorithm lists all triples in which the domain matches Csource. Thereafter, every
listed concept is in turn treated as the source concept and the related object property
instances explored. This process is repeated recursively until Ctarget is reached or if no
object property instances are found. All resulting transitive paths are output in the
ascending order of path length. The algorithm considers the properties inherited from
parent concepts and adds ancestor concepts of the source terms into a search list from
which all possible object properties, linking each of the concepts in the search list to
other concepts in the ontology, are recursively added into a path list. We further extended
the algorithm to include searching for relationships between two instances of concepts,
between instances of a concept to another concept and between a concept's relationship
to an instance of another concept. Another extension is the ability to find relationships
that connect two similar OWL concepts. This is particularly useful in finding linkages
such as people-to-people relations or , protein-protein interactions.</p>
          <p>1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.</p>
          <p>Retrieve all ancestors, CListsource, of source concept, Csource
Retrieve all concepts, CListtarget of the ontology as targets.</p>
          <p>For each concept Ctarget, in CListtarget, do
While CListsource is not empty, do
For each concept Csource, in CListsource, do
Retrieve all concepts CListrange where Csource is a domain in an object property, O
For each concept Crange, in CListrange, do
If Crange == Ctarget then
For each triple link Triplelinked, in TListlinked, do
Add Triplelinked as ARQvalid into ARQListvalid
Endfor
Add Csource Æ O Æ Crange as ARQvalid into ARQListvalid
Remove Csource from CListsource</p>
          <p>Add Csource into CListvisited
Else</p>
          <p>Add Csource Æ O Æ Crange as Triplelinked into TListlinked
If Crange not in CListvisited then
Add Crange into CListsource</p>
          <p>Endif, Endif, Endfor, Endfor, Endwhile, Endfor</p>
          <p>Generic ARQ algorithm for mining transitive relations</p>
          <p>The limitation of the algorithm with respect to human factors and usability is the
need for users to have prior knowledge of the names of the source and target entities that
exist in the OWL ontology. To remove the necessity of users having such prior
knowledge we have revised the algorithm to receive a single input term (a concept or
instance), provided from a 'Google-like' text field with auto-complete features, and
search for transitive paths to all concepts in the ontology up to a limit of 3 triples away
from the input term. All paths returned by the algorithm are conceptually correct and will
generate individuals if the concepts are instantiated. The limit of 3 triples is sufficiently
expressive for general queries that users might pose in natural language and the compute
time required for to compute the transitive paths is manageable.</p>
        </sec>
        <sec id="sec-2-5-2">
          <title>2.2 Natural Language Query Generation (NLQG)</title>
          <p>
            Natural language generation (NLG) is the process of deliberately constructing a natural
language text in order to meet specified communicative goals [
            <xref ref-type="bibr" rid="ref20">20</xref>
            ]. In our context we
define NLG as the task of translating non-linguistic representation of information into a
human understandable natural language text. In this paper, the non-linguistic information
to be translated is the path produced by the transitive-ARQ algorithm. The NLG
subsystem takes this path and generates a natural language query for consumption by
domain experts. A technical description of the NLG subsystem is as follows:
          </p>
          <p>The input to the NLG subsystem is generated by the ARQ algorithm and is represented
as triples, which consist of 3 components: ARG1, PREDICATE and ARG2, where
ARG1 and ARG2 can be concepts or instances and PREDICATE is an Object property.
See Figure 3 for an illustration. To translate the triple into natural language, we primarily
use a template-based NLG methodology. In this approach, the domain-specific
knowledge and language-specific knowledge required for NLG are encoded as rule
templates. Given a triple, a rule matching engine is invoked to find the best matching rule
and the resulting rule is applied on the input triple to extract entities. The entities are
used to fill a template from which the natural language text is generated.
1.
2.</p>
          <p>Path Representation
simtech -&gt; has_employees -&gt; Person -&gt; is_related_to_academic_institution -&gt; Academy
Triples Representation
&lt;query&gt;&lt;triple&gt;
&lt;arg1 type="INSTANCE"&gt;simtech&lt;/arg1&gt;
&lt;predicate type="OBJECTPROPERTY"&gt;has_employees&lt;/predicate&gt;
&lt;arg2 type="CONCEPT"&gt;Person&lt;/arg2&gt;
&lt;/triple&gt;
&lt;triple&gt;
&lt;arg1 type="CONCEPT"&gt;Person&lt;/arg1&gt;
&lt;predicate type="OBJECTPROPERTY"&gt;is_related_to_academic_institution&lt;/predicate&gt;
&lt;arg2 type="CONCEPT"&gt;Academy&lt;/arg2&gt;
&lt;/triple&gt;&lt;/query&gt;
Content Determination and Query Generation Content determination recognizes the
domain entities in the triples and extracts them for use as content terms. Upper level
entities such as concepts, object properties are identified and extracted directly via a rule
template. However, extracting the lower level entities, e.g. the verb and noun in an object
property, is not straight forward. We employ an in-house Text Mining toolkit
[http://research.i2r.a-star.edu.sg/kanagasa/BioText/] to perform part of speech tagging
and term extraction. This is done as a preprocessing of the ARQ triples and the results
are passed to a rule matching engine. The rule matching engine applies the best matching
rule and retrieves a corresponding template to generate the natural language query.</p>
        </sec>
        <sec id="sec-2-5-3">
          <title>Discourse Planning and Query Aggregation: When two or more text components are</title>
          <p>generated in the previous step they are aggregated to generate a compact query. We
employ a set of aggregation patterns that are applied recursively to combine two or more
queries sharing the same entity as a conjunction, Figure 4. as well as a generalized
aggregation pattern that employs property hierarchy for combination.
Surface Realization: In this step, we check the query statement after sentence
aggregation for grammar and generate a human understandable query. We employ an
open source grammar checker, called LanguageTool (http://www.languagetool.org/),
which is part of the OpenOffice suite. We added several rules to enrich the grammar
verification checker.</p>
          <p>Rule Generation: To construct the rule-base used for encoding the domain-specific
knowledge and language-specific knowledge, we developed a rule learning algorithm that
takes user-provided example tuples of the form (triples generated by the ARQ algorithm,
and equivalent natural language statements) and outputs possible rules in an automated
fashion. After training, we let the rule learner generate rules and ranked them in
descending order of precision, where rules with equivalent rank were resolved using
recall. A threshold of 90% precision was used to discard inaccurate rules. All
nonduplicate rules from the rest formed the final rule-base.</p>
        </sec>
        <sec id="sec-2-5-4">
          <title>Without query aggregation</title>
          <p>Which enzyme has been reported to be found in fungi?
Which fungi act on substrate?</p>
        </sec>
        <sec id="sec-2-5-5">
          <title>With query aggregation</title>
          <p>Which enzyme has been reported to be found in fungi that acts on substrate?
Fig. 4. Illustration of Query Aggregation
2.2</p>
        </sec>
        <sec id="sec-2-5-6">
          <title>Query Formulation for DL A-box Reasoning</title>
          <p>In order to answer the questions written in natural language, the ARQ link that is used for
NLQG is automatically translated into an the syntax of an ontology A-box query
language by a query formulator before submission to a reasoning server. An ontology
query is expressed in the form of a directed graph in terms of concepts and role
assertions. This directed graph is modeled into a set of triples where a triple consists of a
predicate (role) and, its subsequent domain and range. Complex queries are formulated
based on multiple triples found in a graph and their connection is based on how each set
of domain and range in different predicates has similar properties. A valid DL query in
KnowleFinder must have at least one triple and an optional set of domain and range in a
role assertion query. The second component of the query formulation for reasoning,
namely, the specification of how multiple triples can be incrementally joined, allows user
to formulate more complex queries which involves multiple conjunction of predicates,
unknowns (variables) and constraints. An unknown or variable, employed in reasoning
over the ontology, is a concept container that allows all instances related to a particular
concept to be retrieved. Variables are used by default in a typical object property query.
For instance, in the example shown in Figure 5, in the nRQL query there are three
variables, ?X1, ?Y1 and ?Y2, related to the object properties,
Has_been_reported_to_be_found_in and Acts_on_substrate. In this case, KnowleFinder
retrieves all combinations of concepts Enzyme, Fungi and Substrate from the FungalWeb
ontology. A constraint in KnowleFinder (searching an instance), on the other hand, is
similar to using a WHERE clause in a SQL SELECT statement to conditionally select
data from a relational table. For instance, in the object property query shown in Figure 6,
the Enzyme variable, ?X1, is replaced with an individual, Laccase. This constrains the
retrieval of all the instances of Fungi to those in which Laccase has been found and that
act on the instances of Substrate.</p>
          <p>Definition 1 (Triple) A KnowleFinder graph triple, T is a set of elements: T = (Dm, P,Rn | m, n ≥ 1)
where: P is the predicate (object property), D is the concept of the object property as its domain
and R is the concept of the object property as its range, such that D → R by relationship, P.
Definition 2 (Query Graph) A KnowleFinder directed graph, G is a set of triples:
G = {(T)+} such that a valid query graph must have at least one triple.</p>
          <p>Definition 3 (Triples Connection) Given T = {(D1, P1, R1)} and T’domain = {(D1, P2, R2)}, there
exists a connection between T and T’domain due to the similarity property of their domain, D1 where
D1 = Dv or D1 = Dc.Similarly, given T’range = {(D2, P2, R1)}, there exists a connection between T
and T’range due to the similarity property of their range, R1 where R1 = Rv or R1 = Rc.
In defining the notion of connecting triples, we use the following notations:
• Dv is a domain variable (unknown). • Rv is a range variable (unknown).
• Dc is a domain constraint (individual). • Rc is a range constraint (individual).
Given a graph Q, a pair of triples that is connected to one another is a function mapping
the domain or range of the first triple to the domain or range of the second triple.</p>
          <p>The final component of the query formulation is the translation of graph triples into
nRQL query atoms, facilitating transfer of information from KnowleFinder to a reasoning
engine. nRQL is an A-box query language for Description Logic, ALCQHIR+(D−).
2.</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Applying KnowleFinder to Bio-Ontologies</title>
      <p>
        KnowleFinder http://datam1.i2r.a-star.edu.sg/user/knowlefinder/index.jsp has been
deployed as an online search portal for the domain experts to identify ontologies which
support queries relevant to their needs. Currently it serves up queries to a subset of
bioontologies in the domains of Lipidomics [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], FungalWeb [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] and the gene regulation
ontology available from OBO [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The working examples we present in this paper,
Figure 5 and 6 are from queries to the FungalWeb Ontology, a knowledgebase designed
to represent fungal enzymes with industrial applications.
3.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>
        We motivate the need for a knowledge translation capability, often requested by
biologists and other domain experts involved in the knowledge elicitation and ontology
creation process. While this task may appear elementary in its goals, it requires non
trivial technical solution and serves a crucial role saving significant amounts of time for
domain experts with entry level computational skills. Moreover, knowledge translation
tasks are increasingly recognized to be important in health and life sciences [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] and here
in particular, we address the access barriers to knowledge reuse. Since bio-ontologies are
the richest subset of online ontologies, with dedicated community support, we applied
our translation tool to this subset of knowledge resources to further facilitate adoption of
ontologies to a broader audience. We achieve this by simplifying the conceptualizations
to a series of natural language queries and illustrate our approach with examples.
Acknowledgments. Thanks are also due to Mathieu d’Aquin, Arash Shaban-Nejad, and
Patrick Lambirx, and Jacob Koehler for valuable discussions on this topic.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Warren</surname>
            <given-names>RH</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haarslev</surname>
            <given-names>V</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Butler</surname>
            <given-names>G.</given-names>
          </string-name>
          <article-title>The Ecology of Ontologies in the Public Domain</article-title>
          ,
          <source>The Monist: Biomedical Ontologies</source>
          , Vol.
          <volume>90</volume>
          , No. 4,
          <year>October 2007</year>
          ,
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <source>Ontology Summit</source>
          <year>2008</year>
          , http://ontolog.cim3.net/cgi-bin/wiki.pl?OntologySummit2008
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Smith</surname>
            <given-names>B</given-names>
          </string-name>
          ,
          <article-title>etal</article-title>
          .
          <source>Nature Biotechnology</source>
          <volume>25</volume>
          ,
          <fpage>1251</fpage>
          -
          <lpage>1255</lpage>
          (
          <year>2007</year>
          ).
          <article-title>The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>4. BioPortal,http://www.bioontology.org/ncbo/faces/index.xhtml</mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Buitelaar</surname>
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eigner</surname>
            <given-names>T.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Declerck</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <article-title>OntoSelect: A Dynamic Ontology Library with Support for Ontology Selection</article-title>
          .
          <source>In Proceedins of the Demo Session at the International Semantic Web Conference</source>
          . Hiroshima,
          <year>Japan 2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Patel</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Supekar</surname>
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            <given-names>Y.</given-names>
          </string-name>
          , and
          <string-name>
            <surname>Park E.K. OntoKhoj: A Semantic Web</surname>
          </string-name>
          <article-title>Portal for Ontology Searching, Ranking and Classification</article-title>
          .
          <source>In Proceedings of the Workshop on Web Information and Data Management</source>
          ,
          <string-name>
            <surname>ACM</surname>
          </string-name>
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Ding</surname>
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pan</surname>
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finin</surname>
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Joshi</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peng</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>and Kolari P.</surname>
          </string-name>
          (
          <year>2005</year>
          )
          <article-title>Finding and Ranking Knowledge on the Semantic Web</article-title>
          .
          <source>In: Proceedings of the 4th International Semantic Web Conference Date: November</source>
          <volume>07</volume>
          ,
          <year>2005</year>
          , LNCS 3729, p.
          <fpage>156</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Alani</surname>
            <given-names>H</given-names>
          </string-name>
          and
          <string-name>
            <surname>Brewster C. EON2006</surname>
          </string-name>
          ,
          <article-title>Evaluation of Ontologies for the Web 4th International</article-title>
          EON Workshop May 22nd,
          <year>2006</year>
          Edinburgh, United Kingdom
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Watson</surname>
          </string-name>
          , Semantic Web Gateway http://watson.kmi.open.ac.uk/Overview.html
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Krivov</surname>
            <given-names>S</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Williams</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Villa</surname>
            <given-names>F</given-names>
          </string-name>
          :
          <article-title>GrOWL: A tool for visualization and editing of OWL ontologies</article-title>
          .
          <source>J. Web Sem</source>
          .
          <volume>5</volume>
          (
          <issue>2</issue>
          ):
          <fpage>54</fpage>
          -
          <lpage>57</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Su</surname>
            <given-names>X</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Butler</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haarslev</surname>
            <given-names>V</given-names>
          </string-name>
          , (
          <year>2006</year>
          )
          <article-title>Ontoligent interactive query tool</article-title>
          , Edited by Koné, M.T.,and
          <string-name>
            <surname>Lemire</surname>
          </string-name>
          , D. Canadian Semantic Web Series, Springer,
          <source>Semantic Web and Beyond</source>
          , Vol.
          <volume>2</volume>
          , Springer-Verlag Inc, New York.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Fadhil</surname>
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Haarslev</surname>
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Ontovql</surname>
          </string-name>
          :
          <article-title>A graphical query language for owl ontologies</article-title>
          .
          <source>In Proceedings of the 2007 International Workshop on Description Logics (DL-2007)</source>
          , BrixenBressanone, near Bozen-Bolzano, Italy, pages
          <fpage>267</fpage>
          -
          <lpage>274</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          ,
          <article-title>etal.Towards ontology-driven navigation of the lipid bibliosphere</article-title>
          .
          <source>BMC Bioinform</source>
          <year>2008</year>
          ;
          <volume>9</volume>
          (
          <issue>784</issue>
          <year>Suppl</year>
          . 1):
          <fpage>S5</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Wang</surname>
            <given-names>X</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almeida</surname>
            <given-names>J</given-names>
          </string-name>
          .
          <article-title>Techniques Ontology Visualization</article-title>
          . In: Semantic Web:
          <article-title>Revolutionizing Knowledge Discovery Life Sciences</article-title>
          ,
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cheung</surname>
            <given-names>KH</given-names>
          </string-name>
          , Eds.
          <fpage>185</fpage>
          -
          <lpage>203</lpage>
          ,
          <year>2007</year>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Falconer</surname>
            <given-names>SM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Storey</surname>
            <given-names>MAD</given-names>
          </string-name>
          :
          <article-title>A Cognitive Support Framework for Ontology Mapping</article-title>
          .
          <source>ISWC/ASWC</source>
          <year>2007</year>
          :
          <fpage>114</fpage>
          -
          <lpage>127</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Garcia Castro</surname>
          </string-name>
          <article-title>A etal</article-title>
          .
          <article-title>Use of concept maps during knowledge elicitation in ontology development processes: nutrigenomics</article-title>
          .
          <source>BMC Bioinformatics</source>
          <year>2006</year>
          , 7:
          <fpage>267</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Haasep</surname>
          </string-name>
          ,
          <string-name>
            <surname>Broekstra</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Eberhart</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Volz</surname>
            <given-names>R.</given-names>
          </string-name>
          <article-title>A comparison of RDF query languages</article-title>
          ,
          <source>In Proc. Third International Semantic Web Conference</source>
          , Hiroshima, Japan,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Wolstencroft</surname>
            <given-names>K</given-names>
          </string-name>
          ,
          <article-title>etal. Applying OWL reasoning to genomic data</article-title>
          .
          <source>In Semantic Web: Revolution. Knowledge Discovery Life Sciences Baker</source>
          ,
          <string-name>
            <surname>CJO</surname>
          </string-name>
          , Cheung, KH (Eds.) 2007 pp
          <fpage>225</fpage>
          -
          <lpage>248</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Keet</surname>
            <given-names>CM</given-names>
          </string-name>
          ,
          <article-title>etal. A survey of requirements for automated reasoning services for bio-ontologies in OWL</article-title>
          ,
          <source>in:3rd Int'l.Workshop OWL Experiences &amp; Directions</source>
          . 2007
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Reiter</surname>
            <given-names>E</given-names>
          </string-name>
          &amp;
          <string-name>
            <surname>Dale</surname>
            <given-names>R</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Building Natural Language Generation Systems</surname>
          </string-name>
          , Camb Uni Press,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          ,
          <article-title>etal, Semantic web infrastructure for fungal enzyme biotechnologists</article-title>
          ,
          <source>Jnl. Web Sem., 4</source>
          ,
          <issue>3</issue>
          ,
          <year>2006</year>
          ,
          <fpage>168</fpage>
          -
          <lpage>180</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <article-title>The Knowledge Translation Portfolio at the Canadian Institute for Health Research http</article-title>
          ://www.cihr-irsc.gc.ca/e/29418.html]
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>