<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Towards a FAIR Sharing of Scienti c Experiments: Improving Discoverability and Reusability of Dielectric Measurements of Biological Tissues</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Md. Rezaul Karim</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Matthias Heinrichs</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Lars Christoph Gleim</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Michael Cochez</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Emily Porter</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alessandra La Gioia</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Saqib Salahuddin</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Martin O'Halloran</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Decker</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oya Beyan</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Faculty of Information Technology, University of Jyvaskyla</institution>
          ,
          <addr-line>Jyvaskyla</addr-line>
          ,
          <country country="FI">Finland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Fraunhofer FIT</institution>
          ,
          <addr-line>Sankt Augustin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Informatik 5, RWTH Aachen University</institution>
          ,
          <addr-line>Aachen</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Translational Medical Device Laboratory, Lambe Institute of Translational Research, National University of Ireland</institution>
          ,
          <addr-line>Galway</addr-line>
          ,
          <country country="IE">Ireland</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Experiments on the dielectric properties of biological tissues generate data that characterizes the interaction of human tissues with electromagnetic elds. This data is vital for designing electromagneticbased therapeutic and diagnostic technologies, and for assessing the safety of wireless devices. Despite the importance of the data, poor reporting and lack of metadata impede its reuse and forgo interoperability. Recently, the minimum information model for reporting Dielectric Measurements of Biological Tissues (MINDER) has been developed as a common framework. In this work, we have developed a metadata model and implemented a data sharing framework to improve ndability and reproducibility of experimental data inspired by FAIR principles. We de ne a process for sharing the reported data and present tools to support rich metadata generation based on existing community standards. The developed system is evaluated against competency questions collected from data consumers, and thereby proven to help to interpret and compare data across studies.</p>
      </abstract>
      <kwd-group>
        <kwd>Scienti c Data</kwd>
        <kwd>Dielectric Measurements</kwd>
        <kwd>Metadata Management</kwd>
        <kwd>Semantic Web</kwd>
        <kwd>FAIR Data Principles</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Data sharing is the release of research data for use by others [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Over the last
three decades, there have been many discussions about sharing primary research
data. Early studies emphasized the role of sharing scienti c data in the practice
of open scienti c query for veri cation and re nement of original resources [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
Within the context of data intensive science, data sharing has become a main
vehicle contributing to scienti c progress by enabling interdisciplinary
interpretation of data, optimizing the use of resources and retaining data integrity for
long term preservation [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. On the other hand, data driven innovation also
requires low barriers to access, interpret and use, rich and widely available data.
One of the data intensive innovation areas in health care is the development of
medical devices, translating novel research ndings to patient care. The design,
development, and clinical evaluation of innovative medical devices for diagnostic
and therapeutic applications is heavily dependent on ndability and reusability
of accurate research data.
      </p>
      <p>
        One of the fastest growing areas for medical device development in Europe is
electromagnetic (EM) imaging and therapeutics. Within the context of an aging
population and exponential growth in healthcare costs, EM-based techniques
provide a very attractive solution for new therapeutics and diagnostic
technologies, since they are low cost, non-ionising and largely non-invasive. Many
European companies have attempted to commercialize their technology. However,
over 75% of medical device companies go out of business within the rst ve
years [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Before a new medical device company is formed or a new product line
is considered, several factors should be carefully analyzed, such as the clinical
need, market size, the regulatory pathway, and, importantly, the technical risk.
While many of these factors can be easily quanti ed, the technical risk often
remains the most elusive. Preliminary clinical data or accurate experimental
data are often required to de-risk the technical challenge. However, gaps or
uncertainty in experimental datasets can mean that the technical risk cannot be
estimated su ciently, and the proposed medical device is ultimately abandoned.
      </p>
      <p>
        In this work, we aim to bridge the experimental data gap in device
development by proposing an approach and implementing tools to improve ndability
and reusability of dielectric measurement experiments. Achieving well
maintained, interoperable, and machine actionable data and metadata are the main
building blocks towards this goal. This can be tackled with Semantic Web
technologies. The Life Sciences domain, as an early adopter of the Linked Data
approach, provides many examples for integrating data from multiple sources and
making them queryable on the web through the SPARQL query language [
        <xref ref-type="bibr" rid="ref1 ref7">1, 7</xref>
        ].
      </p>
      <p>
        Recently, the FAIR guiding principles have been proposed for scienti c data
management and stewardship, and have had an impact on the scienti c
community at large. These principles, rather than prescribing a set of standards,
describe the qualities or behaviours required of data sources to achieve their
optimal discovery and reuse [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. The acronym FAIR stands for:
Findable: Enhancing the ndability of a given dataset using persistent
identiers while maintaining additional metadata.
      </p>
      <p>Accessible: By using a standardized communication protocol, data, as well as
metadata, should be accessible, even if the actual data no longer exists.
Interoperable: Applying controlled vocabularies and quali ed references for
metadata to be used for knowledge representation.</p>
      <p>Reusable: By having a clear and accessible data license and using a well-de ned
set of accurate vocabulary, the data becomes easily re-usable.</p>
      <p>Existing standards can be applied to ful ll the requirements of the FAIR
guidelines in varying degrees. However, the need for developing further standards is
apparent. Our speci c goal is to adapt some of these FAIR principles using
Semantic Web standards to improve discoverability and reusability of experimental
dielectric data sets to support EM device development.</p>
      <p>We follow an incremental approach to achieve optimal FAIRness of the data
sets. This paper reports our rst iteration by application of a set of Semantic
technologies, and achieves some degree of FAIRness. The current
implementation is neither complete in terms of coverage of all FAIR principles nor does it
yet demonstrate the full bene ts of existing standards. However, this work
provides a starting point and a good example of practical applications of Semantic
Web technologies for FAIR data sharing, as well as providing a view on future
directions.</p>
      <p>The rest of the paper is structured as follows: Section 2 gives an overview
of related works. In section 3, we discuss the modeling of Dielectric
Measurements of Biological Tissues (DMBT) experimental data. Section 4 discusses our
proposed pipeline for sharing DMBT data and metadata, domain speci c
vocabulary development, and our RDFization technique. In section 5, we describe
access mechanisms to data and metadata. Finally, we provide a future outlook
and conclude the paper.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>
        Although the knowledge discovery approach was invented more than 400 years
ago, the dissemination of knowledge is still mostly done in the same way as it was
when invented in the 16th century [
        <xref ref-type="bibr" rid="ref17 ref3">3, 17</xref>
        ]. As published articles are isolated from
each other, it is up to the reader to link their information together. This makes
information retrieval more di cult than it could be and it is hardly automated.
      </p>
      <p>
        One of the rst attempts to tackle the problem was the 5 star OPEN DATA
by Tim Berners Lee5. This approach provides ve guidelines for data namely:
the data must be available on the web under an open license, must be structured
in a well-de ned format, accessible in a non-proprietary format like CSV, must
use URIs for denotation, and must be linked to other data to add contextual
information. Although, some organizations, for example, Thomson-Reuters [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]
or Springer-Nature6 are using Semantic Web approaches to construct knowledge
graphs and automating their knowledge retrieval processes, in many other cases
still, the data lacks ndability, making it hard to access and reuse. Therefore,
it is hard to link di erent datasets, resulting in a lower interoperability. As
a complemantary approach the FAIR Data Principles were proposed by the
FORCE11 group7 in 2015 [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] to mitigate these issues as well as to streamline
the work ow of scienti c data.
      </p>
      <sec id="sec-2-1">
        <title>5 http://5stardata.info/en/</title>
      </sec>
      <sec id="sec-2-2">
        <title>6 https://www.springernature.com/cn/researchers/scigraph</title>
      </sec>
      <sec id="sec-2-3">
        <title>7 https://www.force11.org/group/fairgroup/fairprinciples</title>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Modeling Dielectric Measurements Experimental Data</title>
      <p>The dielectric properties, namely, the relative permittivity ("r) and conductivity
( ), of biological tissues quantify the interaction of electromagnetic elds with
the human body. Together, these properties characterize how EM waves are
re ected at, absorbed by, and transmitted through the body. Knowledge of the
dielectric properties of various tissues is vital to the eld of dosimetry (safety
studies, such as for wireless communication devices), and for the implementation
of EM-based medical technologies, such as microwave ablation and imaging.</p>
      <p>
        Dielectric measurements are typically performed using an open-ended
coaxial probe connected to one port of a vector network analyzer (VNA) through a
specialized cable [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ]. First, the dielectric probe is calibrated through
measurements on materials of known dielectric properties. This enables compensation
for systematic measurement errors. Then, the calibration is validated by
measuring on yet another known dielectric material, and calculating the accuracy
of the measurement. Finally, dielectric measurements of biological tissues are
performed by bringing the probe into direct contact with a tissue sample and a
dielectric measurement is recorded. After that, the acquired dielectric data may
be associated with the material composition within the probe sensing volume.
Numerical models may also be tted to the dielectric data, in order to present
the results in closed form.
      </p>
      <p>Although the process of conducting a dielectric measurement on a tissue
sample appears rather straightforward, there are a multitude of confounders that
can impact the measured data. These confounders are a likely source of
inconsistencies in reported data. Both equipment-based measurement confounders and
clinical confounders a ect the accuracy of dielectric data. Uncertainties in the
dielectric data caused by these measurement confounders have been thoroughly
investigated over the years and can now be reduced or eliminated by following
good measurement practice. However, clinical confounders have been relatively
little investigated to date and may introduce a signi cant level of additional
uncertainty into the dielectric data.</p>
      <p>The reusability of dielectric measurement data and reproducibility of
experiments can be improved by capturing metadata that describes the confounders
and by making this metadata a part of the data sharing practice. Moreover,
having confounders' metadata together with the metadata about the study
itself can help data consumers to de ne their data requirements and will improve
the discoverability of datasets.</p>
      <p>
        Recently as part of our earlier work [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], a set of reporting standards, namely
the Minimum Information Model for Dielectric Measurements of Biological
Tissues (MINDER) has been proposed 8. The developed model follows the
Investigation-Study-Assay (ISA) framework and de nes rich domain metadata to
describe the aforementioned clinical confounders such as the tissue source,
physiological parameters, in-vivo versus ex-vivo measurement, time, temperature,
sample dehydration, as well as dielectric data reporting related confounders such as
      </p>
      <sec id="sec-3-1">
        <title>8 https://www.bio-minder.com/</title>
        <p>
          model type selection, number of poles, and tting algorithms. The developed
reporting model is also compliant with the MIRIAM guidelines [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ]
        </p>
        <p>In this work, we report on the implementation of a framework to semantically
express the metadata and data reported via the MINDER reporting schema and
templates. We also developed a platform enabling the discovery of and access to
data and metadata by both individuals and machines. To demonstrate the added
value of our proposed solution, we collected a set of competency question that are
commonly asked by data consumers, as follows:(i) is there any data for pancreas
tissue? (ii) is there any data for porcine bladder tissue? (iii) are there kidney
measurements available at 24:3 C? (iv) are there any measurements available on
biological tissues at 18 GHz? (v) is there any liver data taken between 20 C and
25 C over the frequency range of 1{2 GHz? (vi) is there any tissue-mimicking
phantom data? We present that our realized approach enables us to nd answers
to these questions.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Improving the Reusability of Experimental Data</title>
      <p>Currently there is no standard way to nd and access data on dielectric
measurements of biological tissues (DMBT) generated in labs. In most cases, the
metadata is only partially recorded, if at all, in lab books and the data is stored
separately on hard disks. Some metadata is reported unsystematically in
publications, without any controlled vocabulary, resulting in the lack of both human
and machine discoverability.
4.1</p>
      <sec id="sec-4-1">
        <title>Pipeline for sharing DMBT data and metadata</title>
        <p>In this work, we have created a pipeline to transform the semi-structured,
nonstandardized DMBT data and metadata resulting from experiments in individual
labs to a machine discoverable triple store, and developed a data portal to ful ll
data access requirements of end users. Our semantic pipeline implementation
follows a subset of the FAIR data principles, namely:
{ To make the scienti c data ndable, we assign unique and persistent
identiers to metadata and data, and uploaded it in a publicly accessible
repository. We assigned persistent identi ers for each data object. For the
identiers we used dereferenceable URLs through the MIRIAM registry.
{ To make our data accessible, at rst we reviewed the data and metadata
and decided on required access mechanisms. Metadata is served via machine
interoperable, well de ned SPARQL protocol, whereas data can be accessed
and downloadable as CSV les with prede ned headers. We did not
implement any access control mechanism, since all data currently residing on the
platform is freely available.
{ To make the scienti c data interoperable, we applied Semantic Web
technologies. The metadata is transformed into the Resource Description Framework
(RDF) format utilizing shared, domain speci c vocabularies and ontologies.
{ To make the scienti c data reusable, we provided rich and well de ned
metadata. Moreover, reusing existing vocabularies and ontologies makes the
shared data linkable to other data sources.</p>
        <p>The basic work ow that results from this work is illustrated in g. 1. At
rst, the metadata les are parsed and transformed into Resource Description
Framework (RDF) according to the vocabulary. This process is further explained
in section 4.3. The resulting triples are then transferred into a Virtuoso triple
store9 that is accessible from the web. The web-application then enables the
user to browse this data in various ways, for example, through guided
drillingdown into the experiments or the computation of statistics. Further, the user
can query the data either directly or using pre-speci ed query templates. This
web application is served using an nginx web server and itself programmed in
PHP. Also easy programmable direct access to the data is provided to enable
machine access.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Domain speci c vocabulary development</title>
        <p>
          Vocabularies de ne the terms (concepts and relationships) used to describe and
represent a domain. In this work we developed a vocabulary with terms used
to de ne rich experiment metadata. The data model is based on the MINDER
minimum information model, which followed the ISA framework classi cation.
In order to optimize interoperability, we reuse a variety of existing terms from
established ontologies and vocabularies. Suitable candidates were discovered using
the ontology browse and search tools Ontobee [
          <xref ref-type="bibr" rid="ref11 ref20">11,20</xref>
          ], Linked Open Vocabularies
(LOV) [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] and the BioPortal Ontology Recommender [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ].
        </p>
        <sec id="sec-4-2-1">
          <title>9 https://virtuoso.openlinksw.com/rdf/</title>
          <p>We only reuse terms fully re ecting the semantic meaning of the term in
the context of our application and chose de nitions from more commonly used
ontologies when several suitable candidates were available to simplify
integration with existing datasets. This content reuse enables us to develop a consistent
representation of this domain, reusing content, deploy existing models and align
them to other related datasets. Moreover, this helps us to increase the
interoperability between other ontology-based applications.
4.3</p>
        </sec>
      </sec>
      <sec id="sec-4-3">
        <title>RDFization of the experiment metadata</title>
        <p>RDF is a W3C standard for the description and modeling of data in a
structured way. This standard also provides an abstract and conceptual framework for
de ning and using metadata and metadata vocabularies by applying statements
that consist of subjects, predicates and objects to an ontology. Consequently,
the data model becomes easily searchable, ndable, and accessible.</p>
        <p>The originally generated metadata for our DMBT experiments was stored
in Excel format. To transform this data into RDF, we have developed a Java
application that parses given metadata les into a data structure, which is then
converted into RDF, adhering strictly to the developed vocabulary. The
developed RDFization tool makes use of the Apache Jena framework. Metadata is
stored in an online triple store hosted on Amazon web services. As described
above, this endpoint can be accessed directly or through our web application10.
This web application is designed for non-tech-savvy users to facilate uplaod of
new data, however it can receive as input only a speci c template.
4.4</p>
      </sec>
      <sec id="sec-4-4">
        <title>Using persistent data and metadata identi ers</title>
        <p>To allow reliable referencing of the entities and to enhance the interoperability
between di erent controlled vocabularies and databases, we utilize persistent
identi ers (PIDs). PIDs enable the combination of data concerning the same
entity from multiple data sources via identi er matching. Thus they enhance the
interoperability so that more than one entity can be combined across individual
documents and data sources.</p>
        <p>
          The identifier.org system directly employs dereferenceable URLs through
the MIRIAM registry11 which provides persistent identi cation for life science
data [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. Using the MIRIAM Registry service allows for data to be referenced in
both a location-independent and a resource-dependent manner, which aids direct
resolution of the identi ers via the HTTP protocol [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ]. The service's PIDs ensure
global uniqueness, perennity, standard compliance, and resolvability while being
free of charge to use. The registry is further queryable and features an automated
link monitoring system which checks the registered resources on a daily basis for
reliability.
10 https://datalab.rwth-aachen.de/MINDER/
11 https://www.ebi.ac.uk/miriam/
        </p>
        <p>Overall this system provides a good basis for the persistent identi cation of
data and metadata in our usage scenario and is thus employed as PID provider
for all datasets in the Bio-MINDER tissue database.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Access to data and metadata through web services</title>
      <p>To demonstrate the e ectiveness of our proposed approach, we evaluated our
approach through our web application. The Semantic Web technologies used in
our web application provide the encoding of the entities by assigning resolvable
identi ers. The used vocabulary also de nes the purpose or interpretation of
terms. Additionally, a high-level description of the ontology is available from the
web interface so that user can reuse it. These functionalities help make the data
accessible and enhances the re-usability.
We provided access to data for both human and machine consumption through
SPARQL query interface and web application respectively. Also, as part of the
web application, there is a tab in which all of the above-mentioned competence
questions are answered based on SPARQL queries. These can be executed and
the result browsed. Further, when a user selects a speci c investigation ID, both
the metadata and the description can be accessed. An example is shown in g. 2.
The concrete experimental data can then be downloaded when the user agrees
to the speci ed terms and conditions.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion and Outlook</title>
      <p>In this paper, we demonstrated a use case of Semantic Web and a subset of
the FAIR principles to improve the repeatability of dielectric measurements of
biological tissue and the reusability of the produced data. We showed how to
adopt the MINDER speci cation and developed a domain speci c, controlled
vocabulary which makes the data more ndable and reusable, setting rst steps
towards the FAIR principles. We utilized persistent identi ers (PIDs) for both
the data and metadata from experiments on the dielectric measurements of
biological tissue. This allows the referencing of data in both a location-independent
and resource-dependent manner. The provision of resolvable identi ers (URLs)
ts well with the Semantic Web vision, and the Linked Data initiative.
Moreover, we have reused existing ontologies for terms from our controlled vocabulary
where appropriate. Then, we made the overall system available through a web
interface which also speci cally answers the competence questions which were
gathered from domain experts.</p>
      <p>In this rst iteration, our approach still has several limitations. First, we
currently have only met some aspects of the FAIR principles. In future work,
we could look at whether it is reasonable and feasible to also address other
aspects. For example, we did not deal with licensing properly. We have included
a simple licence for the provided les, but these are not in a form which is
machine interpretable. One reason we have refrained from de ning this is that
there is currently no consensus on what a good way would be. This issue is, for
example also discussed in working groups on the DCAT standard12, and several
application pro les have chosen di erent ways to address this. Hence, it would
be better to wait until a consensus is reached there before reinventing the wheel
ourselves. We have currently also not speci ed any data access restrictions. For
the datasets currently provided, there is no such need, but for data commercially
provided, this has to be amended.</p>
      <p>Currently, we also chose to only reuse existing vocabulary terms in case there
was an exact match. We could consider also adding redundant vocabulary terms,
which are broader as the ones we applied to increase potential reusability. A
related issue is that we did not make use of, for example, the DCAT vocabulary
for specifying our data catalog. The reason is that we were mainly focused on
the domain vocabulary and not on the higher level from the start. This can be
amended in future work.</p>
      <p>This work already showed useful progress. In later work, we would like to
further improve this approach for not only biological experiments but also other
domain like agriculture, nance, marketing, etc.
12 https://www.w3.org/TR/vocab-dcat/</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Beyan</surname>
            ,
            <given-names>O.D.</given-names>
          </string-name>
          , et al.:
          <article-title>Querying phenotype-genotype associations across multiple knowledge bases using semantic web technologies</article-title>
          .
          <source>In: Bioinformatics and Bioengineering (BIBE)</source>
          , IEEE 13th International Conference on. pp.
          <volume>1</volume>
          {
          <issue>5</issue>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Borgman</surname>
            ,
            <given-names>C.L.</given-names>
          </string-name>
          :
          <article-title>The conundrum of sharing research data</article-title>
          .
          <source>Journal of the Association for Information Science and Technology</source>
          <volume>63</volume>
          (
          <issue>6</issue>
          ),
          <volume>1059</volume>
          {
          <fpage>1078</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Decker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Rethinking access to scienti c knowledge: Knowledge graphs</article-title>
          .
          <source>LinkedIn Pulse</source>
          (
          <year>2017</year>
          ), https://www.linkedin.com/pulse/rethinking-scientificknowledge
          <article-title>-graphs-stefan-decker/</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Fienberg</surname>
            ,
            <given-names>S.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martin</surname>
            ,
            <given-names>M.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Straf</surname>
            ,
            <given-names>M.L.</given-names>
          </string-name>
          :
          <article-title>Sharing research data</article-title>
          . National Academy Press (
          <year>1985</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Gage</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>The Venture Capital Secret: 3 Out of 4 Start-Ups Fail the wall street journal (</article-title>
          <year>2012</year>
          ), http://www.wsj.com/articles/ SB10000872396390443720204578004980476429190
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Juty</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le Novere</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Laibe</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Identi ers. org and MIRIAM registry: community resources to provide persistent identi cation</article-title>
          .
          <source>Nucleic acids research</source>
          <volume>40</volume>
          (
          <issue>D1</issue>
          ),
          <source>D580{D586</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Kazemzadeh</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kamdar</surname>
            ,
            <given-names>M.R.</given-names>
          </string-name>
          , et al.:
          <article-title>LinkedPPI: enabling intuitive, integrative protein-protein interaction discovery</article-title>
          .
          <source>In: Proceedings of the 4th International Conference on Linked Science-</source>
          Volume
          <volume>1282</volume>
          . pp.
          <volume>48</volume>
          {
          <fpage>59</fpage>
          .
          <string-name>
            <surname>CEUR-WS. org</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Le</given-names>
            <surname>Novere</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Finney</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Hucka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Bhalla</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.S.</given-names>
            ,
            <surname>Campagne</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Collado-Vides</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.</surname>
          </string-name>
          , et al.:
          <article-title>Minimum information requested in the annotation of biochemical models (MIRIAM)</article-title>
          .
          <source>Nature biotechnology</source>
          <volume>23</volume>
          (
          <issue>12</issue>
          ),
          <volume>1509</volume>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Meaney</surname>
            ,
            <given-names>P.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gregory</surname>
            ,
            <given-names>A.P.</given-names>
          </string-name>
          , Seppala,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Lahtinen</surname>
          </string-name>
          ,
          <string-name>
            <surname>T.</surname>
          </string-name>
          :
          <article-title>Open-ended coaxial dielectric probe e ective penetration depth determination</article-title>
          .
          <source>IEEE transactions on microwave theory and techniques 64(3)</source>
          ,
          <volume>915</volume>
          {
          <fpage>923</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Mons</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Neylon</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Velterop</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , et al.:
          <article-title>Cloudy, increasingly FAIR; revisiting the FAIR data guiding principles for the european open science cloud</article-title>
          .
          <source>Information Services &amp; Use (Preprint)</source>
          ,
          <volume>1</volume>
          {
          <issue>8</issue>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Ong</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lin</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , et al.:
          <article-title>Ontobee: A linked ontology data server to support ontology term dereferencing, linkage, query and integration</article-title>
          .
          <source>Nucleic acids research</source>
          <volume>45</volume>
          (
          <issue>D1</issue>
          ),
          <source>D347{D352</source>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Porter</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>La Gioia</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Salahuddin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Decker</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shahzad</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <article-title>Minimum information for dielectric measurements of biological tissues (MINDER): A framework for repeatable and reusable data</article-title>
          .
          <source>International Journal of RF and Microwave</source>
          Computer-Aided Engineering pp.
          <source>e21201{n/a</source>
          , e21201
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Song</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schilder</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hertz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Saltini</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , et al.:
          <article-title>Building and querying an enterprise knowledge graph</article-title>
          .
          <source>IEEE Transactions on Services Computing</source>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Tenopir</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Allard</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Douglass</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aydinoglu</surname>
            ,
            <given-names>A.U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Read</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mano</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Frame</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Data sharing by scientists: practices and perceptions</article-title>
          .
          <source>PloS one 6</source>
          (
          <issue>6</issue>
          ),
          <year>e21101</year>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Vandenbussche</surname>
          </string-name>
          , P.Y.,
          <string-name>
            <surname>Atemezing</surname>
            ,
            <given-names>G.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poveda-Villalon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vatant</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Linked open vocabularies (LOV): a gateway to reusable semantic vocabularies on the web</article-title>
          .
          <source>Semantic Web</source>
          <volume>8</volume>
          (
          <issue>3</issue>
          ),
          <volume>437</volume>
          {
          <fpage>452</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Whetzel</surname>
            ,
            <given-names>P.L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          , et al.:
          <article-title>BioPortal: enhanced functionality via new web services from the national center for biomedical ontology to access and use ontologies in software applications</article-title>
          .
          <source>Nucleic acids research 39(suppl 2)</source>
          ,
          <source>W541{W545</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Whewell</surname>
          </string-name>
          , W.:
          <article-title>History of inductive sciences (</article-title>
          <year>1858</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Wilkinson</surname>
            ,
            <given-names>M.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aalbersberg</surname>
            ,
            <given-names>I.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Appleton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Axton</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Baak</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , et al.:
          <article-title>The FAIR guiding principles for scienti c data management and stewardship</article-title>
          .
          <source>Scienti c data 3</source>
          ,
          <issue>160018</issue>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Wimalaratne</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bolleman</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Juty</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Katayama</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dumontier</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Redaschi</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Le Novere</surname>
          </string-name>
          , N.,
          <source>othersection 4</source>
          .
          <article-title>2?: SPARQL-enabled identi er conversion with identi ers</article-title>
          .
          <source>org. Bioinformatics</source>
          <volume>31</volume>
          (
          <issue>11</issue>
          ),
          <year>1875</year>
          {
          <year>1877</year>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Xiang</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mungall</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruttenberg</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>He</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Ontobee: A linked data server and browser for ontology terms</article-title>
          .
          <source>In: ICBO</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>