<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Christopher J. O. Baker</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Dept. CSAS, University of New Brunswick</institution>
          ,
          <addr-line>Saint John, New Brunswick, E2L 4L5</addr-line>
          ,
          <country country="CA">Canada</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Harvard Medical School 25</institution>
          <addr-line>Shattuck Street, Boston, MA 02115</addr-line>
          <country country="US">USA</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Yale Center for Medical Informatics</institution>
          ,
          <addr-line>300 Cedar Street, New Haven, CT 06510</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>iCyrus: A Semantic Framework for Biomedical Image Discovery Ahmad C. Bukhari</institution>
        </aff>
      </contrib-group>
      <abstract>
        <p>Images have an irrefutably central role in scientific discovery and discourse. However, the issues associated with knowledge management and utility operations unique to image data are only recently gaining recognition. In our previous work, we have developed Yale Image finder (YIF), which is a novel Biomedical image search engine that indexes around two million biomedical image data, along with associated metadata. While YIF is considered to be a veritable source of easily accessible biomedical images, there are still a number of usability and interoperability challenges that have yet to be addressed. To overcome these issues and to accelerate the adoption of the YIF for next generation biomedical applications, we have developed a publically accessible semantic API for biomedical images with multiple modalities. The core API called iCyrus is powered by a dedicated semantic architecture that exposes the YIF content as linked data, permitting integration with related information resources and consumption by linked data-aware data services. To facilitate the adhoc integration of image data with other online data resources, we also built semantic web services for iCyrus, such that it is compatible with the SADI semantic web service framework. The utility of the combined infrastructure is illustrated with a number of compelling use cases and further extended through the incorporation of Domeo, a well known tool for open annotation. Domeo facilitates enhanced search over the images using annotations provided through crowdsourcing. The iCyrus triplestore currently holds more than thirty-five million triples and can be accessed and operated through syntactic or semantic query interfaces. Core features of the iCyrus API, namely: data reusability, system interoperability, semantic image search, automatic update and dedicated semantic infrastructure make iCyrus a state of the art resource for image data discovery and retrieval. Demo Page: http://cbakerlab.unbsj.ca:8080/icyrus/</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Background</title>
      <p>
        Making biomedical image content explicit is essential with regards to making medical
decisions such as diagnosis, treatment, follow-up, data management and the
secondary use for biomedical research and assessment of care delivery. In the Life Sciences,
spreadsheets, databases and XML files continue to be the conventional formats used
to store experimental data, e.g. Biota [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], DrugBank [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] and Open Microscopy
Environment (OME) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Some projects go further and make their XML data accessible
via knowledge-based grid services, e.g. high-throughput biological imaging data [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ],
PLAZi [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. However, the fact that data exists only in these legacy formats frequently
impedes data integration and significantly impedes scientific discovery. More
recently, small communities of researchers have adopted semantic technologies to support
data integration and manipulation. In the Semantic web [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] paradigm, there exists a
common framework comprising of standards and technologies that enables data to be
shared and reused across applications. Specifically, semantic web uses an explicit data
model to describe data in an unambiguous way such that independently generated
data sets can be easily integrated under the same data model. The current proliferation
of semantic web methodologies results from the use of cutting-edge standards such as
the resource description framework (RDF) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and SPARQL [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] (a query language for
RDF graphs), which are supported by several applications, due to their robustness and
efficiency.
      </p>
      <p>
        In recent years, Linked Data has emerged as the most adopted semantic web
framework supporting data interoperability and reusability. Due to linked data
benefits, several life science and census datasets have been transformed into linked data.
Examples include LODD (linked open drug data) [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], Canadian health census to
linked data [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], Bio2RDF [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], BioNLP-SADI [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and the EMBL-EBI RDF
services [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. Moreover, several open-access non-semantic biomedical image
repositories are available on the Internet such as the National Biomedical Imaging Archive
(NBIA1), NIH Images2 and Yale Image Finder (YIF) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] but none of these provide
their content in a semantically accessible way. YIF is one of the most widely accessed
biomedical image search engines, which retrieves biomedical images and associated
papers based on queries made over the text within the image and its caption, and
within the associated paper’s abstract, title, and full text. YIF searches within the image
using a sophisticated image segmentation method; followed by OCR with additional
filtering of text for both high precision and high recall outputs [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Unlike the
syntactic core of YIF, a recent work utilizes the semantic enrichment technique called SEBI
to discover biological similar images [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. The rest of the paper has been arranged as
follows: Section “2” explains the system architecture and implementation procedure.
Sections “2.4”, “3" and “4” outline a series of case studies that leverage the API along
with examples. Section “5”, the concluding remarks section, highlights the
importance of current work in comparison with available techniques and measures how
our design and implementation extend the state of the art with respect to current
Biomedical applications research for access to images.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. System Architecture and Implementation</title>
      <p>
        We have designed an API based on a semantic framework that exposes YIF content
as linked data for integration with various other information resources and for
consumption by linked data-aware data services. Figure 1 displays the iCyrus API
Process Diagram. Specifically, YIF data is processed through the novel iCyrus algorithm
1 National Biomedical Imaging Archive. http://ncia.nci.nih.gov/
2 NIH Image Bank - National Institutes of Health. http://imagebank.nih.gov/
that transforms the data according to linked open data recommendations. The data is
maintained in a triple store and is made accessible through a SPARQL endpoint and
linked data explorer. To further integrate YIF with other data resources and
frameworks, we developed Semantic Automatic Discovery and Integration (SADI) [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]
web services through which the data can be accessed. This service layer also
facilitates the coupling of iCyrus with Domeo, a well-known tool for open annotation, such
that it provides crowd-sourced annotations as additional parameters to search
algorithms that promote context-based searching. We have divided the system architecture
into four phases based upon their functionalities. In the next sections, we explain the
internal working of each phase.
      </p>
      <sec id="sec-2-1">
        <title>2.1 Stage 1: Acquisitions and Manipulation Phase</title>
        <p>
          In the first stage, prior to the LODification process, we acquired the image datasets
from the Yale Image Finder repository to build a knowledgebase for our API [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
Specifically, we accessed the Lucene index and transformed the data (including the
metadata fields) into CSV files. After acquiring the data, it was prescreened to remove
irrelevant information and to clean the CSV files. Using the Google Refine tool [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ],
data was migrated into a MySQL database for parallel storage alongside our triple
store and for subsequent performance comparisons.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 Stage 2: LODification and Storage Phase</title>
        <p>
          The foremost task in semantic data publication is defining appropriate semantic
vocabularies. Reusability is considered a noble practice in semantic web application
development and it is generally accepted that well-known semantic vocabularies [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]
should be reused to enhance data interoperability and to promote robust integration
among datasets. To identify appropriate semantic mappings between available
ontologies and the YIF metadata, we created a Java program that suggests possible
mappings.
        </p>
        <sec id="sec-2-2-1">
          <title>Fig.1 The iCyrus API Process Diagram.</title>
          <p>
            The program extracts the tables and column names from our CSV files, storing them
as variables and invokes a WordNet service [
            <xref ref-type="bibr" rid="ref20">20</xref>
            ] that lexically compares each variable
with the ontology entities to find possible matches. The overall goal was to provide
candidate matches for subsequent curation albeit a comprehensive benchmarking of
the algorithm’s performance was not made. A cursory evaluation of the derived
mappings showed there were three types of results; (i) mappings that fully met our
requirements, which suggested predicates such as hasPubMedID and hasPMCID in the
FRBR-aligned Bibliographic Ontology (fbio); (ii) mappings that were insufficiently
defined, like the imageFeature property that exists in DICOM Ontology3; and (iii)
mappings with hosted resources that did not appear trustworthy. To manage the new
vocabularies that fulfill the requirements of iCyrus and SEBI [
            <xref ref-type="bibr" rid="ref16">16</xref>
            ], we have developed
the BIM (Biomedical Image) ontology [
            <xref ref-type="bibr" rid="ref21">21</xref>
            ] and set up an ontology-publishing server
called UNBvps4 that helps to define new vocabularies and to publish the existing
ontologies in an interactive way. The BIM ontology is separated in three parts; (i)
image vocabularies - which hold vocabularies for the annotation of an image and/or
region of interests (ROI) inside an image, as well as vocabularies to represent the pre
and post processing states of an image, (ii) text entities - covers annotations from the
text that are associated with an image (e.g. image captions) and provides semantic
representation for NLP algorithm outputs, (iii) a provenance model - that contributes
towards the maintenance of annotation versioning.
          </p>
          <p>
            Semantic mapping, the process of mapping between structured data and
semantic vocabularies, and triplification are the core internal processes of iCyrus. While
there are several automatic mapping generation tools (Virtuoso RDF view [
            <xref ref-type="bibr" rid="ref22">22</xref>
            ],
D2RQ mapping [
            <xref ref-type="bibr" rid="ref23">23</xref>
            ], Triplify [
            <xref ref-type="bibr" rid="ref24">24</xref>
            ]) which serve as useful mapping engines for the
initial stages of a project, they fail to fully accommodate the complex domain
semantics required by most real-time applications, including ours. Almost all relational
database to RDF conversion frameworks follow the same principles, namely the
mapping of table names to class names, the translation of column names into predicates
and the contents of databases are populated as instances of class categories. We
developed a customizable domain-dependent schema mapper for the curation of initial
mappings based on our MySQL stored data. After refining our mappings to make
them more flexible and fully compatible with our domain, a D2RQ server with a Jena
Model API [
            <xref ref-type="bibr" rid="ref25">25</xref>
            ], which holds the ModelD2RQ class, was used to invoke the external
semantic mapping file. With the help of the Jena Model API, items of interest were
extracted and linked with URIs, then converted to RDF by a dumpGenerator method.
Although available triplification frameworks permit the display of non-RDF data in
triple format, their query access times are quite slow, which can affect the
performance of applications built on them. A viable solution is to store the data in a
triplestore to improve access times. We selected Sesame because of its free availability and
the presence of an API that allowed us to access the triple store programmatically and
create a customized Java Code that transferred the RDF dump into a triple store.
          </p>
        </sec>
        <sec id="sec-2-2-2">
          <title>3 http://bioportal.bioontology.org/ontologies/SEDI 4 http://cbakerlab.unbsj.ca/unbvps/</title>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>2.3 Stage 3: RDF Exposing and Integration Phase</title>
      <p>
        To expose the linked open image data, we configured a Sesame triple store and
deployed SNORQL, an AJAX front-end for exploring RDF SPARQL endpoints [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
SNORQL permits users to view and export data in XML, XHTML and JSON - a
javascript object notation which is a popular format among web developers. When
querying a virtual RDF graph, SNORQL [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] translates the SPARQL query back into
SQL and fetches the results from the database. While data extraction through a triple
store is quite fast and trouble free, data extraction from a virtual RDF graph,
particularly for string comparisons, is slower and sometimes results in errors due to system
specifications. To facilitate end user navigation for technical users through iCyrus
linked data, we deployed Pubby [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ], a Linked Data interface for local and remote
SPARQL protocol servers. Pubby allows for triple store access through SPARQL
queries and yields dereferenceable URIs by rewriting the URIs found in the
SPARQL-exposed dataset into the Pubby server's namespace, which interlinks related
information from external data sources.
      </p>
      <p>
        The SNORQL endpoint allows external systems to access the YIF content.
For example, text-based information retrieval systems may need to integrate image
data for improving document ranking and for identifying related publications. To this
end, such a system would use the endpoint to retrieve keywords found within images
and image captions, and would combine these keywords with text from the body of
the associated document. The resulting hybrid word vector can then be used to match
user queries with available documents. Additionally, finding related publications can
be improved by integrating relationships that exist between images of different
publications. This information is currently available through the YIF web site: Given a
particular image, YIF calculates the top related images by comparing the text content
of that image to other images across the database [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. This list of related images is
accessible through the SNORQL endpoint, and may be used to identify related
publications based on both text and image information.
      </p>
    </sec>
    <sec id="sec-4">
      <title>2.4 Stage 4: iCyrus and SADI web services</title>
      <p>
        To demonstrate iCyrus’ usability as a semantic image API in general and a valuable
resource for biomedical knowledge exploration in particular, we developed thirty web
services using the SADI framework to advertise their availability. Primarily, the
SADI framework is designed to achieve semantic interoperability between different
web services as outlined in section 2. SADI integration allows for interesting
possibilities for extending the YIF functionality using other biomedical data resources.
Currently, text queries submitted to YIF via the web site are stemmed before image
retrieval; however, no query expansion is performed, which may result in missed
images where image captions contain synonymous terms to the user query. For example,
queries including gene names retrieve images matching the query text, but not images
that contain an alternative name for that gene. Combining the iCyrus SADI service,
getGeneAlterNames, with an existing SADI service, getImagesFromText, elegantly
adds query expansion to the workflow, thus retrieving a more complete set of images.
This could support a potential query: Display a gene, its alternate names, and
chromosomal location. The getGeneAlterNames SADI web service takes a gene ID as
input and searches through HUGO Gene Nomenclature Committee (HGNC) terms to
retrieve all synonyms or alternate names of the gene along with associated general
information like chromosomal location and HGNC ID. In order to execute a SADI
service, the inputs and outputs have to be defined in an RDF graph before the SADI
service generator method can be called [
        <xref ref-type="bibr" rid="ref12 ref17">12, 17</xref>
        ]. To build the getGeneAlterNames
service, we defined and published the input and output classes in our iCyrus SADI
service ontology5. To get the consolidated output view, we kept the input type in all of
the iCyrus services in the xsd:string format. Fig. 2 shows an RDF input graph for the
getGeneAlterNames service. Here,
semanticImageApiSadiServices:getGeneAlterNames_Input is the input class, which takes a string parameter as
input. The service algorithm accesses the HGNC database as a backend and looks for
HGNC IDs; then, it links the acquired information with the service output class to
improve resource interoperability and reusability. This service can work
independently or in combination with other SADI services to get a consolidated RDF output. In
the next section, we will show how we utilized this service to accomplish a task.
Fig 2. A graphical view of the getGeneAlterNames SADI service
      </p>
    </sec>
    <sec id="sec-5">
      <title>3. iCyrus with Federated Query Client</title>
      <p>
        We configured iCyrus’ SADI services registry with the SHARE federated query [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]
engine to illustrate SHARE’s automatic information discovery feature. As an
example, we ran the following query: Display images of the ‘IDS gene’ from all documents
along with their captions and extend the search with alternate gene names. The
SPARQL query syntax can be viewed in Fig. 3. After being invoked, the SHARE
client studies the query by reading the input file from the ‘FROM’ clause, then fetches
all the defined predicates in it, which in our query are hasFigureID,
hasFigureCaption, hasFullText, hasGene, and hasAlternameGene. Subsequently, it invokes a
method that seeks relevant web services by crawling through the service registry, looking
5 http://cbakerlab.unbsj.ca:8080/ontologies/semanticImageApiSadiServices.owl
for a match on the predicates. Once matches are found, it populates the virtual
knowledge base by running all the discovered services. In our example, SHARE
discovered getGeneAlterNames and getImagesFromText as related services. To process
the defined query, SHARE first looked for the IDS gene through its virtual knowledge
base and stored the matches in a separate results file; it then found an alternate name
for IDS, iduronate 2-sulfatase (Hunter Syndrome), and crawled through the virtual
knowledge base once again to add/append to the results file. Upon query completion,
the results are displayed to the user through a web interface. Fig. 3 depicts the figure
ID and caption for only two figures, a limit specified during query composition.
      </p>
      <p>Fig 3. SHARE screenshot demonstrating iCyrus SADI queries</p>
    </sec>
    <sec id="sec-6">
      <title>4. iCyrus Plugin for DOMEO</title>
      <p>
        Domeo [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] is an extensible web application enabling users to visually and efficiently
create and share ontology-based standoff annotation on HTML or XML document
targets. The tool supports manual and semi-automated annotation with complete
provenance records, as well as personal or community annotation with access
authorization and control. Domeo can be easily extended through the development of
software plugins, prompting us to facilitate the creation of annotation mashups using
image metadata accessible from the iCyrus. We developed a server-side software
plugin that, given a PubMed Central document, can query the iCyrus SPARQL
endpoint for all the metadata related to the figures in the document. The metadata are
then translated into a JSON format that is easily consumed by the Domeo client. By
leveraging the iCyrus plugin, Domeo offers an enhanced PubMed Central extraction
and annotation pipeline. In the DOMEO client available image metadata are displayed
under each figure in the image summary panel. This includes relevant annotations
from an image caption, the title, the PMID and the publication year of each image.
Hyperlinks allow users to browse an extended version of the metadata in the original
webpage of Yale Image Finder and in the exploratory pages of the iCyrus project. The
integration with Domeo also allows for the gathering of user feedback, including
corrections and additions pertaining to YIF metadata6.
      </p>
    </sec>
    <sec id="sec-7">
      <title>5. Concluding Remarks</title>
      <p>Yale Image Finder and other portals such as NIH Images, Hardin MD, NCI Visual
Online, and PHIL (Public Health Image Library), which are not semantically enabled,
permit the search for images based on specific biological queries like AIDS, cancer,
or other keywords. In this paper, we report on extending the functionality provided by
Yale Image Finder using a combination of technologies for semantic publishing of
scientific data. The core iCyrus implementation extends the YIF system and makes it
interoperable with other existing semantic or syntactic frameworks by making data
easily reusable, by providing feature search inside images, and by running automatic
updates. From an end user perspective, iCyrus aids both technical and non-technical
users from a range of biomedical domains in building mashups involving image data.
Technical users can access the API programmatically and can use the resource for
precise knowledge extraction or to build new mashups integrating iCyrus with other
life science resources. Employing the image browser component of iCyrus, a
nontechnical user can navigate through the linked image data and can acquire the desired
information graphically. The benefits of iCyrus include enhanced maintainability.
Update to YIF in its original configuration requires modification of the Lucene index
at the backend, which is considered to be error prone and labor-intensive. Moreover,
index managed data is rather limited in scope, discouraging its integration with
external resources where common data descriptions exist. In contrast, iCyrus stores its data
in a state of the art format, RDF, which overcomes the interoperability issues
associated with YIF. The underlying iCyrus technology strictly adheres principles to the
semantic web a principle that makes its extension easy and automatic. Similarly, its
compatibility with the LOD cloud opens up new avenues for ad-hoc integration of
image data to solve outstanding challenges whereas YIF and similar systems restrict a
user with read only access.</p>
      <p>
        Our combined approach, deploying iCyrus with SADI, SHARE, and
Domeo, makes the framework a universal solution in the bio image informatics
domain where tools with diverse functionalities can be accessed as a single application,
making it possible to query across multiple data sets and algorithms concurrently as
well as to harvest new annotations through crowdsourcing for later reuse in image
discovery. Like YIF, iCyrus is still a research prototype and the illustrations of its
services presented here have confirmed some of the limitations of semantic systems
identified and discussed elsewhere [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. The key limitation is a usability challenge,
namely that of query composition where the construction of SPARQL queries using
the SNORQL or SHARE clients is more complex than a keyword search in YIF.
While recent work has significantly eased the burden of creating SPARQL queries for
6 *Graphical view of iCyrus, Demeo integration. http://tinyurl.com/icyrusdomeoplugin
ontologies that use alphanumeric identifiers, by using more human-friendly labels
during query formulation, more work is necessary to abstract this powerful albeit
technical interface so that it becomes more users friendly to life scientists. Some
efforts toward this goal, from natural language to SPARQL, are ongoing [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ]. RDF
graph browsing and faceted browsing also offer an affable substitute to SPARQL
query composition and allow the user to dynamically migrate from one entity to
another via incoming or outgoing properties. We have further introduced the use of
SADI services and the query client SHARE into the iCyrus framework to facilitate
access to data in the API and distributed services. Akin to other semantically powered
federated query engines like DARQ [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ] and ANAPSID [
        <xref ref-type="bibr" rid="ref33">33,</xref>
        ] introduced to facilitate
transparent query to distributed linked data resources, SHARE’s role in the iCyrus
infrastructure is to coordinate the orchestration of SADI services designed specifically
to integrate desired image related data on the fly [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. SHARE suffers from a
relatively slow query execution compared with other known clients for SADI [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]. In
addition, at the time of writing, the only the available browser-based query interface
compatible with the SHARE client is Sentient Knowledge explorer [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ]. Use of other
clients such as HYDRA and its graphical query composition interface [
        <xref ref-type="bibr" rid="ref34 ref36">34, 36</xref>
        ] may in
future result in enhanced performance and further realize the existing investment we
have made in building SADI services for image data.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. Biota:
          <article-title>The Biodiversity Database Manager</article-title>
          . http://viceroy.eeb.uconn.edu/Biota.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Wishart</surname>
          </string-name>
          , D.S et al.
          <article-title>"DrugBank: a comprehensive resource for in silico drug discovery and exploration</article-title>
          .
          <source>" Nucleic acids research 34.suppl 1</source>
          (
          <year>2006</year>
          ):
          <fpage>D668</fpage>
          -
          <lpage>D672</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Goldberg</surname>
            <given-names>IG</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allan</surname>
            <given-names>C</given-names>
          </string-name>
          , B,
          <string-name>
            <surname>Creager</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Falconi</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hochheiser</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnston</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mellen</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sorger</surname>
            <given-names>PK</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Swedlow</surname>
            <given-names>JR</given-names>
          </string-name>
          .
          <article-title>The Open Microscopy Environment (OME) Data Model and XML File: Open Tools for Informatics and Quantitative Analysis in Biological Imaging</article-title>
          .
          <source>Genome Biol</source>
          .
          <year>2005</year>
          ;
          <volume>14</volume>
          :
          <fpage>R47</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Ahmed</surname>
            <given-names>WM</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lenz</surname>
            <given-names>D</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jia</surname>
            <given-names>L</given-names>
          </string-name>
          , Robinson,
          <string-name>
            <surname>JP</surname>
          </string-name>
          , Ghafoor,
          <string-name>
            <surname>A.</surname>
          </string-name>
          <article-title>XML-Based Data Model and Architecture for a Knowledge-Based Grid-Enabled Problem-Solving Environment for High-Throughput Biological Imaging</article-title>
          . Information Technology in Biomedicine, IEEE Transactions on.
          <year>2008</year>
          ;
          <volume>14</volume>
          (
          <issue>2</issue>
          ):
          <fpage>226</fpage>
          -
          <lpage>240</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>5. Plazi: Access to Taxonomic Literature. http://plazi.org/</mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Nigel</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hall</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berners-Lee</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <article-title>"The semantic web revisited</article-title>
          .
          <source>" Intelligent Systems, IEEE 21.3</source>
          (
          <year>2006</year>
          ):
          <fpage>96</fpage>
          -
          <lpage>101</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Resource</given-names>
            <surname>Description Framework</surname>
          </string-name>
          .
          <article-title>"Model and Syntax Specification." W3C Recommendation 22</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Prud'Hommeaux</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seaborne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <article-title>"SPARQL query language for RDF." W3C recommendation 15 (</article-title>
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Samwald</surname>
          </string-name>
          , M et al.
          <article-title>"Linked open drug data for pharmaceutical research and development</article-title>
          .
          <source>" Journal of cheminformatics 3</source>
          .1 (
          <year>2011</year>
          ):
          <fpage>19</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Bukhari</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baker</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>The Canadian health census as Linked Open Data: towards policy making in public health</article-title>
          .
          <source>In 9th International Conference on Data Integration in the Life Sciences; July 11-12</source>
          ,
          <year>2013</year>
          ;
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Belleau</surname>
          </string-name>
          , François et al.
          <article-title>"Bio2RDF: towards a mashup to build bioinformatics knowledge systems</article-title>
          .
          <source>" Journal of biomedical informatics 41.5</source>
          (
          <year>2008</year>
          ):
          <fpage>706</fpage>
          -
          <lpage>716</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Bukhari</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baker</surname>
            ,
            <given-names>C. J.</given-names>
          </string-name>
          (
          <year>2013</year>
          , January).
          <article-title>Towards Interoperable BioNLP Semantic Web Services Using the SADI Framework</article-title>
          .
          <article-title>In Data Integration in the Life Sciences</article-title>
          (pp.
          <fpage>69</fpage>
          -
          <lpage>80</lpage>
          ). Springer Berlin Heidelberg.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Faulconbridge</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.
          <article-title>"Updates to BioSamples database at European Bioinformatics Institute."</article-title>
          <source>Nucleic acids research</source>
          (
          <year>2013</year>
          ):
          <fpage>gkt1081</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Songhua</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCusker</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krauthammer</surname>
          </string-name>
          . M.,
          <article-title>"Yale Image Finder (YIF): a new search engine for retrieving biomedical images</article-title>
          .
          <source>" Bioinformatics</source>
          <volume>24</volume>
          .17 (
          <year>2008</year>
          ):
          <fpage>1968</fpage>
          -
          <lpage>1970</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kuhn</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krauthammer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <article-title>Image Mining from Gel Diagrams in Biomedical Publications</article-title>
          .
          <source>(SMBM)</source>
          .
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bukhari</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krauthammer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Baker</surname>
            ,
            <given-names>C. J. SEBI</given-names>
          </string-name>
          :
          <article-title>An Architecture for Biomedical Image Discovery, Interoperability and Reusability based on Semantic Enrichment</article-title>
          .
          <volume>SWA4LS</volume>
          <fpage>2014</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vandervalk</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The Semantic Automated Discovery and Integration, Web service Design-Pattern, API and Reference Implementation</article-title>
          .
          <source>Journal of Biomedical Semantics</source>
          <volume>2</volume>
          (
          <issue>1</issue>
          ),
          <fpage>5</fpage>
          -
          <lpage>23</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Verlic</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>LODGrefine-LOD-enabled Google Refine in Action. In I-SEMANTICS (Posters</article-title>
          &amp; Demos) (pp.
          <fpage>31</fpage>
          -
          <lpage>37</lpage>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Sauermann</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Völkel</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2011</year>
          ).
          <article-title>Cool URIs for the semantic web</article-title>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Miller</surname>
            ,
            <given-names>George A</given-names>
          </string-name>
          .
          <article-title>"WordNet: a lexical database for English."</article-title>
          <source>Communications of the ACM 38.11</source>
          (
          <year>1995</year>
          ):
          <fpage>39</fpage>
          -
          <lpage>41</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Bukhari</surname>
            ,
            <given-names>A. C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nagy</surname>
            ,
            <given-names>M. L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Krauthammer</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Ciccarese. P.</given-names>
            , &amp;
            <surname>Baker</surname>
          </string-name>
          ,
          <string-name>
            <surname>C. J. BIM</surname>
          </string-name>
          :
          <article-title>An open ontology for the annotation of biomedical images</article-title>
          .
          <source>ICBO 2015</source>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Erling</surname>
            , Orri, and
            <given-names>Ivan</given-names>
          </string-name>
          <string-name>
            <surname>Mikhailov</surname>
          </string-name>
          .
          <article-title>"Virtuoso: Rdf support in a native rdbms." Semantic Web Information Management (</article-title>
          <year>2010</year>
          ):
          <fpage>501</fpage>
          -
          <lpage>519</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seaborne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <article-title>"D2RQ-treating non-RDF databases as virtual RDF graphs." (ISWC2004) 7 Nov</article-title>
          .
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Sören</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al.
          <article-title>"Triplify: light-weight linked data publication from relational databases</article-title>
          .
          <source>" Proceedings of the 18th international conference on World wide web 20 Apr</source>
          .
          <year>2009</year>
          :
          <fpage>621</fpage>
          -
          <lpage>630</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Brian</surname>
          </string-name>
          . M.,
          <article-title>"Jena: A semantic web toolkit</article-title>
          .
          <source>" Internet Computing, IEEE 6.6</source>
          (
          <year>2002</year>
          ):
          <fpage>55</fpage>
          -
          <lpage>59</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Bizer</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Seaborne</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>D2rq - treating non-rdf databases as virtual rdf graphs</article-title>
          .
          <source>In: World Wide Web Internet and Web Information Systems</source>
          , p.
          <volume>26</volume>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Cyganiak</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bizer</surname>
          </string-name>
          . C.,
          <article-title>"Pubby-A Linked Data Frontend for SPARQL Endpoints."</article-title>
          <source>May</source>
          <volume>28</volume>
          (
          <year>2008</year>
          ):
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McCarthy</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vandervalk</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Withers</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kawas</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Samadian</surname>
            ,
            <given-names>S.: SADI</given-names>
          </string-name>
          ,
          <string-name>
            <surname>SHARE</surname>
          </string-name>
          , and
          <article-title>the in silico scientific method</article-title>
          .
          <source>BMC Bioinformatics</source>
          <volume>11</volume>
          (
          <issue>12</issue>
          ),
          <source>S7</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Ciccarese</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ocana</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <article-title>"Open semantic annotation of scientific publications using DOMEO."</article-title>
          <source>Journal of biomedical semantics 3.Suppl</source>
          <volume>1</volume>
          (
          <year>2012</year>
          ):
          <fpage>S1</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Riazanov</surname>
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laurila</surname>
            <given-names>JB</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baker</surname>
            <given-names>CJO</given-names>
          </string-name>
          :
          <article-title>Deploying mutation impact text-mining software with the SADI Semantic Web Services framework</article-title>
          .
          <source>BMC Bioinformatics</source>
          ,
          <source>Proceedings ECCB 2010 Workshop</source>
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>McCarthy</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vandervalk</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M. SPARQL Assist</given-names>
          </string-name>
          <string-name>
            <surname>Language-Neutral Query</surname>
          </string-name>
          Composer. [http://arxiv.org/abs/1012.1666]
          <article-title>Semantic Web Applications and Tools for Life</article-title>
          <source>Sciences; December</source>
          <year>10th</year>
          ,
          <year>2010</year>
          ; Berlin,
          <year>Germany 2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Bastian</surname>
            ,
            <given-names>Q</given-names>
          </string-name>
          , Ulf Leser.
          <article-title>"Querying distributed RDF data sources with SPARQL." The Semantic Web: Research and Applications (</article-title>
          <year>2008</year>
          ):
          <fpage>524</fpage>
          -
          <lpage>538</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Acosta</surname>
          </string-name>
          , Maribel et al.
          <article-title>"ANAPSID: an adaptive query processing engine for SPARQL endpoints." The Semantic Web-ISWC</article-title>
          <year>2011</year>
          (
          <year>2011</year>
          ):
          <fpage>18</fpage>
          -
          <lpage>34</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Riazanov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shaban-Nejad</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rose</surname>
            ,
            <given-names>G. W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Forster</surname>
            ,
            <given-names>A. J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckeridge</surname>
            ,
            <given-names>D. L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Baker</surname>
            ,
            <given-names>C. J. “</given-names>
          </string-name>
          <article-title>Semantic querying of relational data for clinical intelligence: a semantic web services-based approach”</article-title>
          .
          <source>J. Biomedical Semantics</source>
          .
          <year>2013</year>
          .
          <volume>4</volume>
          (
          <issue>9</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Wilkinson M. D.</surname>
          </string-name>
          ,
          <string-name>
            <surname>McCarthy</surname>
            .
            <given-names>L.</given-names>
          </string-name>
          ,
          <article-title>The SADI plug-in to IO informatics' sentient knowledge explorer</article-title>
          .
          <source>(SWAT4LS '11)</source>
          .
          <year>2011</year>
          . ACM, New York, NY, USA,
          <fpage>116</fpage>
          -
          <lpage>118</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>36. HYDRA: http://ipsnp.co/demo-videos/</mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>