<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>IWSG</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Mapping metadata from different research infrastructures into a unified framework for use in a virtual research environment</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Paul Martin</institution>
          ,
          <addr-line>Laurent Remy</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2018</year>
      </pub-date>
      <volume>13</volume>
      <fpage>13</fpage>
      <lpage>15</lpage>
      <abstract>
        <p>-Virtual Research Environments (VREs) augment research activities by integrating tools for data discovery, data retrieval, workflow management and researcher collaboration, often coupled with a specific computing infrastructure. The drive towards open data science discourages 'walled garden' solutions however, and has led to the creation of dedicated research infrastructures (RIs) that gather data and provide services to particular research communities without prejudice towards any particular science gateway or virtual laboratory technology. There is a need for generic VREs that can be easily customised to the needs of specific communities and coupled with the services and resources of many different RIs, but the resource metadata produced by these RIs rarely adheres perfectly to any particular standard or vocabulary, making it difficult to search and discover resources independently of their provider. Cross-RI search can be expedited by metadata mapping services that can harvest metadata published under different standards to build unified resource catalogues-such an approach poses a number of challenges however. In this paper we take the example of the VRE4EIC e-VRE metadata service, which uses X3ML mappings to build a single CERIF catalogue for describing data products and other resources provided by multiple RIs. We consider the extent to which it addresses the challenge of cross-RI search, and we also discuss how it might take advantage of semantic harmonisation efforts in the environmental science domain.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>I. INTRODUCTION</title>
      <p>
        Virtual Research Environments (VREs) [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], also known as
virtual laboratories or science gateways, are one of three
types of science support environment developed to support
researchers in data science [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], focusing on supporting research
activities on a holistic rather than infrastructural or service
level. VREs provide integrated environments that typically
include tools for activities such as data discovery and retrieval,
collaboration, process scheduling and workflow management,
and many are coupled with a particular computational
infrastructure, often making use of public e-infrastructures or the
Cloud. Data are brought into that infrastructure and
manipulated via a particular data processing platform or scientific
workflow management system [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]—however this approach is
contrary to the recent drive towards open science and open
data, which discourages ‘walled garden’ solutions.
      </p>
      <p>
        Increasingly, what we observe instead is the creation of
dedicated research infrastructures (RIs) that aggregate and
curate scientific data (including real-time observations) for a
particular research community, which then provide access to
these data via unified services [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], usually without prejudice
towards any particular VRE. Complicating this matter, there
is now a substantive push to better integrate these efforts into
a cohesive multidisciplinary commons for open science and
open research data, as embodied by initiatives such as the
European Open Science Cloud (EOSC) [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Developing generic VREs that can be easily coupled with
different RIs and customised for specific communities is a goal
of many recent research projects, including VRE4EIC1 and
BlueBRIDGE2, and is particularly challenging given the lack
of conformity of standards and vocabularies in environmental
science and similar domains. Significant software engineering
effort is often required on the behalf of data scientists to build
specific adaptors for such couplings, but even then it remains
crucial to provide the capability to search across different RIs
for similar data products or services to support integrative and
transdisciplinary research. This entails a complex interaction
between a VRE and multiple RIs, distributing queries through
multiple adaptors and then aggregating the results—or else a
prior harvesting of metadata from all providers to allow
preliminary queries to be conducted on a single logical catalogue.</p>
      <p>
        In this paper we investigate how the use of a flexible
metadata mapping and publication service can expedite the
coupling of a VRE with RI resources using different metadata
schemes to provide cross-RI metadata search and discovery.
As a case study, we take the VRE4EIC metadata service,
developed as a building block for an RI-agnostic VRE, and
we detail how X3ML mappings [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] from standards such as
ISO 19139 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] and DCAT [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] to CERIF [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] are used to
automatically ingest metadata published by different RIs to
1https://www.vre4eic.eu/
2http://www.bluebridge-vres.eu/
produce a single resource catalogue. We weigh the benefits of
this approach and discuss some ways in which such catalogues
can be further augmented, for example to facilitate semantic
search based on the harmonisation of vocabularies used for
describing ecosystem and biodiversity data.
      </p>
    </sec>
    <sec id="sec-2">
      <title>II. BACKGROUND</title>
      <p>Modern environmental research depends on the collection
and analysis of large volumes of data gathered via sensors,
observations, simulations and experimentation. Researchers
are called upon to address societal challenges that are
inextricably tied to the stability of our native ecosystems such as
food security and climate management, challenges intrinsically
interdisciplinary in nature, requiring collaboration across
traditional disciplinary boundaries. The role of RIs in this context
is to support researchers with data, platforms and tools, but no
single RI can hope to encompass the full research ecosystem.
The challenge therefore is to help researchers to freely and
effectively interact with the full range of research assets
potentially available to them across many RIs, allowing them
to collaborate and conduct their research more effectively.</p>
      <p>
        Publishing metadata about resources online (indicating type,
coverage, provenance, etc.) allows RIs to advertise their
facilities and researchers to browse and discover data and other
resources useful to their research. While there exist standards
such as ISOs 19115 [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and 19139 [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] for geospatial metadata
however, the implementation of such standards by RIs can
be somewhat idiosyncratic. Resource catalogues themselves
can be described using standards such as DCAT [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] and
harvested via CSW [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] or OAI-PMH [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], but many RIs
also use Semantic Web [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] technologies such as OWL [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]
and SKOS [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] to describe their resources, adapting ontologies
such as OBOE [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] (for observations) and vocabularies such
as EnvThes [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] (for ecology) to meet their own community’s
needs. Harmonisation of vocabulary and metadata between
RIs thus remains a concern, with cluster projects such as
ENVRIplus3 working to promote common models.
Concurrently, initiatives like RDA4 address broader research data
management issues such as metadata standards cataloguing,
standards for data collections and interoperability between
repositories, providing recommendations to such projects.
      </p>
      <p>
        From the VRE perspective, it is necessary to be pragmatic
when coupling with the services provided by RIs, a process
that can also be assisted by the use of standard models and
vocabularies. Jeffery et al. [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] define a reference architecture for
enhanced VREs (‘e-VREs’) able to work with many different
RIs and e-infrastructures. In this architecture, microservices
are used to implement each of six key building blocks split
across three tiers of operation, as shown in Figure 1 for
the case of the metadata management. Meanwhile Nieva et
al. [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] describe a reference model (ENVRI RM) for
environmental science RIs, defining their archetypical elements
in the context of the research data lifecycle. Being based on
      </p>
    </sec>
    <sec id="sec-3">
      <title>3http://www.envriplus.eu/ 4https://rd-alliance.org/</title>
      <p>GraIpntheicrfaalcUeser
Metadata Manager
Resource Manager</p>
      <p>Data Model</p>
      <p>Mapper
e-VRE Web Service
Message Oriented</p>
      <p>Middleware</p>
      <p>Adapter
Metadata Service
provides functionality</p>
      <p>Authentication, Authorisation, Accounting Infrastructure (AAAI)</p>
      <p>System Manager</p>
      <p>Workflow Manager
Linked Data</p>
      <p>
        Manager
RM-ODP [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], it models RIs from five viewpoints: science,
information, computation, engineering and technology. Each
view has its own concerns that correspond to those of the
other views, and is able to describe various key RI activities
(e.g. Figure 2). Open Information Linking for Environmental
RIs (OIL-E) [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] is a small set of OWL specifications based on
ENVRI RM that provide an upper ontology for RI descriptions
and which can be used to contextualise different kinds of RI
asset from an architectural or interaction-based perspective—
as opposed to being a general-purpose ontology for describing
scientific phenomena like BFO [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]. A conceptual model with
a similar focus on the products and tools of research rather
than on scientific classification itself is CERIF [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], a European
standard for describing research information systems. CERIF
provides a framework for describing relationships between
people, projects, tools and research products (and more), and
has been applied to describing solid earth science RIs [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ].
      </p>
      <p>These models provide both the means to talk about research
support environments such as VREs and RIs in a standard way,
but can also be leveraged as a means to better classify different
kinds of resource as part of a faceted search mechanism, as we
shall discuss later in Section IV. For now, we consider how
VREs can be constructed that support rather than are hindered
by the heterogeneity of RI resources and resource metadata,
and how a VRE can facilitate cross-RI search and discovery.</p>
    </sec>
    <sec id="sec-4">
      <title>III. METHODOLOGY AND CHALLENGES According to Jeffery et al. [18], VREs can retrieve descriptions of RIs’ resources either via separate interfaces with each 10th International Workshop on Science Gateways (IWSG 2018), 13-15 June 2018</title>
      <p>RI’s own resource catalogue, or via a joint resource catalogue
that already encompasses all of the RIs’ resources. The former
approach relies on the construction of separate discovery and
access interfaces with every RI, and makes it difficult to
search over multiple RI resource catalogues simultaneously,
requiring the translation and distribution of queries over every
interface. Meanwhile, the latter approach simplifies search and
discovery, but requires initial harvesting of metadata from all
separate RI catalogues, translation of all metadata into a single
common denominator standard, and careful management as the
number of original data sources scales upwards.</p>
      <p>
        In terms of the e-VRE reference architecture [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ], there are
a few needed steps to harvest resource metadata from an RI:
1) A resource catalogue provided by an RI is identified
for harvesting. Identification might be performed by a
discovery service, or be part of the manual configuration
of a customised VRE metadata catalogue.
2) The VRE’s interoperability manager must provide an
adaptor for the given resource catalogue—essentially,
the VRE must have the means to interact with the
catalogue via the correct protocol (e.g. OAI-PMH or
SPARQL [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]), but also have a model for (at least
partially) mapping metadata retrieved from the source
scheme to the scheme used internally by the VRE.
3) The adaptor can then be used to harvest metadata records
from the source, mapping them into a format suitable for
ingestion into the VRE’s own metadata catalogue.
4) This ingested data is then made available to users of the
      </p>
      <p>VRE via its own search and query interface.</p>
      <p>The main entities involved in this process are shown in
Figure 3. In this example, the result is that metadata can
now be harvested by the VRE’s metadata manager using
the adaptors provided by the interoperability manager. This
activity may be a one-off event, but more likely the metadata
harvested will need to be periodically updated.</p>
      <p>Whatever the chosen approach however, any VRE
cataloguing solution should try to address certain challenges:
1) How best to discover new resources—a VRE catalogue
may be carefully curated for a given community, but
even if automation is rejected, there should be a clear
process for how to expand the catalogue.
2) How to ensure the freshness of catalogue data—ensuring
that updates to source catalogues are propagated to VRE</p>
      <p>catalogues in reasonable time.
3) How to manage the underlying catalogue schema—given
new vocabularies, standards or simply evolution in how
standards are applied, how to update the model
underlying a catalogue without losing existing data coherence.
4) How to manage ever larger quantities of data—whether
by relying on more capable database technologies,
distribution of the catalogue, or dynamic construction of
the catalogue ‘on demand’ based on prior queries.
In light of these challenges, we consider a particular
implementation of the resource metadata harvesting approach
described above based on certain key technologies.</p>
    </sec>
    <sec id="sec-5">
      <title>IV. IMPLEMENTATION</title>
      <p>The VRE4EIC Metadata Portal has been developed in
accordance with the e-VRE reference architecture, providing
the necessary components to implement the metadata manager
functionality. The purpose of the portal is to provide faceted
search over catalogue data harvested from multiple RIs,
aggregated within a single CERIF-based VRE catalogue. Search
is based on the composition of queries based on the context
of the research data, filtering by organisations, projects, sites,
instruments, people, etc., for example as shown in Figure 4.
The portal supports map-based search, the export and storing
of specific queries, and the export of results in various formats.
The CERIF catalogue itself is implemented in RDF (based
on an OWL ontology) as a Blazegraph5 triple store and is
structured according to CERIF version 1.66.</p>
      <p>
        Metadata harvested from external sources is converted to
CERIF RDF using the X3ML mapping framework [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The
mapping process is as illustrated in Figure 5:
1) Sample metadata, along with their corresponding
metadata schemes are retrieved for analysis.
2) Mappings are defined that dictate the transformation of
the selected RDF and XML based schemas to CERIF.
      </p>
    </sec>
    <sec id="sec-6">
      <title>5https://www.blazegraph.com/</title>
      <p>6https://www.eurocris.org/cerif/main-features-cerif</p>
      <p>3) Metadata is retrieved from different data sources in their
native format, e.g. as ISO 19139 or CKAN7 data.
4) These mappings are used to transform the source data
into CERIF format.
5) The transformed data are ingested into the CERIF
metadata catalogue.</p>
      <p>Once ingested, these data become available to users of the
metadata portal, who can query and browse data upon
authentication by the front-end authentication/authorisation service.</p>
      <p>X3ML mappings are described using the 3M Mapping
Memory Manager8. Mappings are described by mapping rules
relating subject-property-object triples from the source scheme
to equivalent structures in the target scheme, subject to various
syntactic conditions, as illustrated in Figure 6. 3M supports the
specification of generators to produce identifiers for new
concepts constructed during translation of terms, and provides test
and analytics facilities. Mappings into CERIF RDF have been
produced for Dublin Core, CKAN, DCAT-AP, and ISO 19139
metadata, as well as RI architecture descriptions in OIL-E, as
part of the technical output of the VRE4EIC project9.</p>
    </sec>
    <sec id="sec-7">
      <title>7https://ckan.org/</title>
      <p>8https://github.com/isl/Mapping-Memory-Manager
9Mappings are accessible at http://www.ics.forth.gr/isl/3M-VRE4EIC,
username ‘vre4eicGuest’ and password ‘vre4eic’.</p>
      <p>In summary, the Portal has many desirable characteristics: a
flexible model in CERIF for integrating heterogeneous
metadata, a tool-assisted metadata mapping pipeline to easily create
or refine metadata mappings or refine existing mappings, and
a mature technology base for unified VRE catalogues. What
we foresee more development needed in is the discovery of
new resources and the acquisition of updates. In this respect,
RI-side services for advertisement of new resources or updates
to which a VRE can subscribe to trigger automated ingestion
of new or modified metadata would be particularly useful.</p>
      <p>The VRE4EIC Metadata Portal has been provided as a
demonstrator to the cluster of environmental science RIs in
Europe via the ENVRIplus project as well as directly to
the European Plate Observing System (EPOS)10, with sample
data harvested from a subset of those RIs. Evaluation of
the demonstrator indicates a number of possible avenues of
development, particularly with regard to supporting richer
cross-RI search, the two most noteworthy here being:
1) Further exploitation of CERIF’s semantic layer.
2) Integration of semantic search facilities.</p>
      <p>A notable feature of CERIF is how it separates its semantic
layer from its primary entity-relationship model. Most CERIF
relations are semantically agnostic, lacking any particular
interpretation beyond identifying a link. Almost every entity and
relation can be assigned though a classification that indicates
a particular semantic interpretation (e.g. that the relationship
between a Person and a Product is that of a creator), allowing a
CERIF database to be enriched with concepts from an external
semantic model (or several linked models).</p>
      <p>
        The vocabulary provided by OIL-E11 has been identified
within VRE4EIC as a means to further classify objects in
CERIF in terms of their role in an RI, e.g. classifying
individuals and facilities by the roles they play in research
activities, datasets in terms of the research data lifecycle,
or computational services by the functions they enable. This
provides additional operational context for faceted search
(e.g. identifying which processes generated a given data
product), but providing additional context into the scientific context
for data products (e.g. categorising the experimental method
applied or the branch of science to which it belongs) is also
necessary. Environmental science RIs such as AnaEE12 and
LTER-Europe13 are actively developing better vocabularies for
describing ecosystem and biodiversity research data, building
upon existing SKOS vocabularies. The AnaEE data
vocabulary (anaeeThes) [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ] and LTER’s environmental thesaurus
EnvThes [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] have mappings to other established domain
vocabularies such as Agrovoc14 and GEMET15. These RIs
are now collaborating with other RIs involved in ENVRIplus
to harmonise their vocabularies in order to provide semantic
linking between terms used in their respective sub-domains.
10https://www.epos-ip.org/
11http://oil-e.net/ontology/
12https://www.anaee.com/
13http://www.lter-europe.net/lter-europe
14http://aims.fao.org/standards/agrovoc
15http://www.eionet.europa.eu/gemet/
The identification of synonymous, subsuming and intersecting
terms (and the publication of links on the Semantic Web)
provides the basis for better semantic search, whereby a greater
range of data products with similar characteristics can be
retrieved on query without necessarily sharing precisely the
same controlled vocabulary for their metadata. Making use of
such linked vocabulary would simplify the task of integrating
resource metadata from multiple catalogues as it would reduce
the need to map all metadata values into a single master
vocabulary (with the likely resulting loss of nuance), while
still retaining the benefits of cross-RI search and discovery.
      </p>
    </sec>
    <sec id="sec-8">
      <title>V. DISCUSSION</title>
      <p>
        The use of linked data [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ] for describing resources (of
all kinds) is already well-established, with research now
focusing on different approaches to generating linked data
from various sources and with how to navigate and query
distributed information—for example, recent research includes
the generation of a navigable Graph of Things from an array
of live IoT data sources [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ] and the use of crowdsourcing
to provide real-time transport data in rural areas [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ], both
topics with relevance to how RIs gather and expose field
observations acquired via sensors or human experts. On the
topic of distributed query, various languages/frameworks have
been proposed such as LDQL [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ] and LILAC [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ], which
may make linked data based search over distributed catalogues
more practical and efficient than is currently the case.
      </p>
      <p>
        The Semantic Web is plagued by many of the problems
of knowledge representation in AI including computability,
inconsistency and incompleteness, adding data redundancy,
unreliability and limited performance versus more tightly
integrated data models. Considerable attention has been given
to the openness, extensibility and computability of Semantic
Web standards, weighing different options (e.g. the use of
SKOS over OWL [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ], [
        <xref ref-type="bibr" rid="ref32">32</xref>
        ]). Most geospatial technologies
used by environmental science RIs today have been developed
independently of the Semantic Web however, with
recommendations such as INSPIRE16 being mostly disjoint from it,
though technologies such as OGC’s GeoSPARQL17 attempt to
address this. This poses a barrier for integration of geospatial
catalogues published via CSW or OAI-PMH into the Semantic
Web, and adaptors are still needed to query such data sources
and present responses in RDF format (e.g. [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ]).
      </p>
      <p>
        For mapping between a modest set of standards,
manual mapping with tool support remains most practical, but
automation may help to accelerate the construction of new
mappings. How to best map between ontologies (or other kinds
of schema) remains an open question, but mapping techniques
can be evaluated by comparing performance against ontology
sets covering the same domain (e.g. OntoFarm for conference
organisation [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]). Multi-lingual support is also important in
collaboration; for example Bella et al. [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ] address how to
conduct mapping based on more than just English syntax.
16https://inspire.ec.europa.eu/
17http://www.opengeospatial.org/standards/geosparql
      </p>
      <p>
        It is not only resource metadata that can be usefully accessed
via a VRE. Access to provenance data (which might be
structured according to a standard such as PROV-O [
        <xref ref-type="bibr" rid="ref36">36</xref>
        ]) for data
products and processes would also be useful to researchers,
and VREs can also be contributors of provenance data via their
own workflow systems (e.g. for Kepler [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ]). CERIF is able to
represent time-bounded role-based semantic relationships, but
the source metadata provided by RIs still often lacks this kind
of information; the adoption of standardised and ubiquitous
provenance by RIs would address this either by enriching
the basic metadata for resources, or by providing additional
sources of provenance data that could be integrated with the
base metadata when producing unified catalogues.
      </p>
      <p>
        The e-VRE reference architecture also addresses the need
for a workflow manager component, for composing processing
tasks in series or parallel on available computational resources.
Most scientific investigations do follow a clear workflow,
and there have been a number of workflow management
systems developed with different characteristics and target
applications [
        <xref ref-type="bibr" rid="ref38">38</xref>
        ], several of which have been applied to
science [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ]. The use of ontologies for verification and validation
of workflows has already been explored (e.g. [
        <xref ref-type="bibr" rid="ref40">40</xref>
        ]), and the
ability to construct and validate such workflow specifications
using metadata from service catalogues demonstrates that the
cataloguing problem is not wholly centred on datasets.
      </p>
    </sec>
    <sec id="sec-9">
      <title>VI. CONCLUSION</title>
      <p>In this paper we linked the development of VREs (also
science gateways and virtual laboratories) to the outgrowth
of dedicated RIs in Europe and beyond, and argued the need
for new VREs that can be freely coupled with different RI
resources based on the requirements of researchers and the
evolving data research environment. We asserted that metadata
mapping is needed to facilitate cross-RI search and discovery
due to the diversity of metadata schemes, vocabularies and
protocols used to access resource catalogue data published by
different RIs, and furthermore that it is useful to be able to
aggregate distributed resource metadata into a single logical
catalogue. We outlined a methodology for building such a
catalogue based on the e-VRE reference architecture and the
adoption of a robust metadata mapping pipeline for handling
heterogeneous data sources. We provided an example in the
VRE4EIC Metadata Portal of how the methodology is applied,
using CERIF as a framework for aggregating resource
metadata from different metadata catalogues provided by EPOS and
ENVRIplus. We described the application of X3ML mappings,
constructed using the 3M editor, to translate ISO 19139 XML,
CKAN, Dublin Core, DCAT-AP and OIL-E data into CERIF
RDF for ingestion into a CERIF catalogue. We considered how
the CERIF semantic layer can be augmented with vocabulary
from OIL-E to further contextualise research entities, and how
recent semantic harmonisation work in environmental science
RIs can further augment the capabilities of VREs as clients for
semantic faceted search of RI resources. Finally, we discussed
the role that some of the technologies identified have in other
research literature, examined some related work, and suggested
future avenues of investigation for coupling VREs with other
types of service provided by RIs, e.g. provenance services.</p>
    </sec>
    <sec id="sec-10">
      <title>ACKNOWLEDGEMENTS</title>
      <p>This work was supported by the European Union’s
Horizon 2020 research and innovation programme under grant
agreements 654182 (ENVRIplus project), 676247 (VRE4EIC
project) and 643963 (SWITCH project).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>L.</given-names>
            <surname>Candela</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Castelli</surname>
          </string-name>
          , and
          <string-name>
            <given-names>P.</given-names>
            <surname>Pagano</surname>
          </string-name>
          , “
          <article-title>Virtual research environments: an overview and a research agenda,” Data Science Journal</article-title>
          , vol.
          <volume>12</volume>
          , pp.
          <fpage>75</fpage>
          -
          <lpage>81</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          de Laat,
          <string-name>
            <given-names>K.</given-names>
            <surname>Jeffery</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Jones</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Taylor</surname>
          </string-name>
          , A. Hardisty,
          <string-name>
            <given-names>M.</given-names>
            <surname>Atkinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Zuiderwijk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Yin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>Chen</surname>
          </string-name>
          , “
          <article-title>Time critical requirements and technical considerations for advanced support environments for data-intensive research,” in 2nd International workshop on Interoperable infrastructures for interdisciplinary big data sciences (IT4RIs 16), in the context of IEEE Real-time System Symposium (RTSS), Porto</article-title>
          , Portugal,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>E.</given-names>
            <surname>Deelman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Gannon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Shields</surname>
          </string-name>
          ,
          <string-name>
            <surname>and I. Taylor</surname>
          </string-name>
          , “Workflows and e-Science:
          <article-title>An overview of workflow system features and capabilities,” Future Generation Computer Systems</article-title>
          , vol.
          <volume>25</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>528</fpage>
          -
          <lpage>540</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>P.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hardisty</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Jeffery</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhao</surname>
          </string-name>
          , “
          <article-title>Computational challenges in global environmental research infrastructures,” in Terrestrial Ecosystem Research Infrastructures: Challenges and</article-title>
          <string-name>
            <surname>Opportunities</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Chabbi</surname>
          </string-name>
          and H. W. Loescher, Eds. CRC Press,
          <year>2017</year>
          , ch. 12, pp.
          <fpage>305</fpage>
          -
          <lpage>340</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          , “
          <article-title>Realising the european open science cloud</article-title>
          ,”
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Marketakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Minadakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Kondylakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Konsolaki</surname>
          </string-name>
          , G. Samaritakis,
          <string-name>
            <given-names>M.</given-names>
            <surname>Theodoridou</surname>
          </string-name>
          , G. Flouris, and
          <string-name>
            <given-names>M.</given-names>
            <surname>Doerr</surname>
          </string-name>
          , “
          <article-title>X3ML mapping framework for information integration in cultural heritage and beyond</article-title>
          ,”
          <source>International Journal on Digital Libraries</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <source>[7] ISO</source>
          <volume>19139</volume>
          :
          <year>2007</year>
          , “
          <article-title>Geographic information-Metadata-XML schema implementation</article-title>
          ,” International Organization for Standardization, ISO/TS Standard,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>J.</given-names>
            <surname>Erickson</surname>
          </string-name>
          and
          <string-name>
            <given-names>F.</given-names>
            <surname>Maali</surname>
          </string-name>
          , “
          <article-title>Data catalog vocabulary (DCAT),” W3C, W3C</article-title>
          <string-name>
            <surname>Recommendation</surname>
          </string-name>
          ,
          <year>2014</year>
          , http://www.w3.org/TR/2014/REC-vocabdcat-
          <volume>20140116</volume>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>B. J</surname>
          </string-name>
          <article-title>o¨rg, “CERIF: The common european research information format model</article-title>
          ,
          <source>” Data Science Journal</source>
          , vol.
          <volume>9</volume>
          , pp.
          <fpage>24</fpage>
          -
          <lpage>31</lpage>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <source>[10] ISO 19115-1</source>
          :
          <year>2014</year>
          , “
          <article-title>Geographic information-Metadata-Part 1</article-title>
          : Fundamentals,” International Organization for Standardization,
          <source>ISO Standard</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Nebert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>U.</given-names>
            <surname>Voges</surname>
          </string-name>
          , and L. Bigagli, “
          <source>OGC catalogue services 3</source>
          .0-general model,” Open Geospatial Consortium,
          <source>OGC Implementation Standard</source>
          ,
          <year>2016</year>
          , http://docs.opengeospatial.org/is/12-168r6/
          <fpage>12</fpage>
          -
          <lpage>168r6</lpage>
          .html.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>C.</given-names>
            <surname>Lagoze and H. Van de Sompel</surname>
          </string-name>
          , “
          <article-title>The making of the open archives initiative protocol for metadata harvesting,” Library hi tech</article-title>
          , vol.
          <volume>21</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>118</fpage>
          -
          <lpage>128</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Hendler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Lassila</surname>
          </string-name>
          et al., “
          <article-title>The semantic web</article-title>
          ,”
          <article-title>Scientific american</article-title>
          , vol.
          <volume>284</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>28</fpage>
          -
          <lpage>37</lpage>
          ,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14] W3C OWL Working Group, “
          <article-title>OWL 2 web ontology language,” W3C, W3C</article-title>
          <string-name>
            <surname>Recommendation</surname>
          </string-name>
          ,
          <year>2012</year>
          , https://www.w3.org/TR/2012/REC-owl2
          <string-name>
            <surname>-</surname>
          </string-name>
          overview-20121211/.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Miles</surname>
          </string-name>
          , “
          <article-title>SKOS simple knowledge organization system reference,” W3C, W3C</article-title>
          <string-name>
            <surname>Recommendation</surname>
          </string-name>
          ,
          <year>2009</year>
          , http://www.w3.org/TR/2009/REC-skos-reference-
          <volume>20090818</volume>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>J.</given-names>
            <surname>Madin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bowers</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Schildhauer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Krivov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Pennington</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>Villa</surname>
          </string-name>
          , “
          <article-title>An ontology for describing and synthesizing ecological observation data,” Ecological informatics</article-title>
          , vol.
          <volume>2</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>279</fpage>
          -
          <lpage>296</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>H.</given-names>
            <surname>Schentz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Peterseil</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N.</given-names>
            <surname>Bertrand</surname>
          </string-name>
          , “
          <article-title>Envthes-interlinked thesaurus for long term ecological research, monitoring, and experiments</article-title>
          .” in EnviroInfo,
          <year>2013</year>
          , pp.
          <fpage>824</fpage>
          -
          <lpage>832</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>K. G.</given-names>
            <surname>Jeffery</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Meghini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Concordia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Patkos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Brasse</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. v.</given-names>
            <surname>Ossenbruck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Marketakis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Minadakis</surname>
          </string-name>
          , and E. Marchetti, “
          <article-title>A reference architecture for virtual research environments</article-title>
          ,”
          <source>in Proceedings of the 15th International Symposium of Information Science (ISI</source>
          <year>2017</year>
          ).
          <source>Verlag Werner Hulsbusch</source>
          ,
          <year>2017</year>
          , pp.
          <fpage>76</fpage>
          -
          <lpage>88</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>A. Nieva de la Hidalga</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Magagna</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Stocker</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Hardisty</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Martin</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Atkinson</surname>
            , and
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>Jeffery</surname>
          </string-name>
          , “
          <article-title>The ENVRI Reference Model (ENVRI RM) version 2</article-title>
          .2,
          <issue>30th</issue>
          <year>October 2017</year>
          ,” Nov.
          <year>2017</year>
          . [Online]. Available: https://doi.org/10.5281/zenodo.1050349
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <source>[20] ISO 10746-1</source>
          , “Information technology-Open Distributed ProcessingReference model: Overview,” International Organization for Standardization, ISO/IEC Standard,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>P.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Grosso</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Magagna</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Schentz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hardisty</surname>
          </string-name>
          , W. Los,
          <string-name>
            <given-names>K.</given-names>
            <surname>Jeffery</surname>
          </string-name>
          , C. de Laat, and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhao</surname>
          </string-name>
          , “
          <article-title>Open information linking for environmental research infrastructures,” in 2015 IEEE 11th International Conference on e-Science (e-Science)</article-title>
          . IEEE,
          <year>2015</year>
          , pp.
          <fpage>513</fpage>
          -
          <lpage>520</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>R.</given-names>
            <surname>Arp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Smith</surname>
          </string-name>
          , and
          <string-name>
            <given-names>A. D.</given-names>
            <surname>Spear</surname>
          </string-name>
          ,
          <article-title>Building ontologies with Basic Formal Ontology</article-title>
          . The MIT Press,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>D.</given-names>
            <surname>Bailo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Ulbricht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. L.</given-names>
            <surname>Nayembil</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Trani</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Spinuso</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          K. G. Jeffery, “
          <article-title>Mapping solid earth data and research infrastructures to CERIF,” Procedia Computer Science</article-title>
          , vol.
          <volume>106</volume>
          , pp.
          <fpage>112</fpage>
          -
          <lpage>121</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24] W3C SPARQL Working Group,
          <source>“SPARQL 1</source>
          .1 overview,” W3C,
          <string-name>
            <given-names>W3C</given-names>
            <surname>Recommendation</surname>
          </string-name>
          ,
          <year>2013</year>
          , http://www.w3.org/TR/2013/REC-sparql11
          <string-name>
            <surname>-</surname>
          </string-name>
          overview-20130321/.
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25] Anaee-France semantic group, “AnaEE Thesaurus,”
          <year>2016</year>
          . [Online]. Available: http://dx.doi.org/10.15454/1.4894016754286177E12
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>T.</given-names>
            <surname>Berners-Lee</surname>
          </string-name>
          , “
          <article-title>Linked data</article-title>
          ,
          <source>” W3C Design Issues</source>
          ,
          <year>2006</year>
          , accessed
          <issue>26th</issue>
          <year>February 2018</year>
          . [Online]. Available: https://www.w3.org/DesignIssues/LinkedData.html
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>D.</given-names>
            <surname>Le-Phuoc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. N. M.</given-names>
            <surname>Quoc</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H. N.</given-names>
            <surname>Quoc</surname>
          </string-name>
          , T. T. Nhat, and
          <string-name>
            <given-names>M.</given-names>
            <surname>Hauswirth</surname>
          </string-name>
          , “
          <article-title>The graph of things: A step towards the live knowledge graph of connected things</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>37</volume>
          , pp.
          <fpage>25</fpage>
          -
          <lpage>35</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>D.</given-names>
            <surname>Corsar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Edwards</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Nelson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Baillie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Papangelis</surname>
          </string-name>
          , and
          <string-name>
            <given-names>N.</given-names>
            <surname>Velaga</surname>
          </string-name>
          , “
          <article-title>Linking open data and the crowd for real-time passenger information</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>43</volume>
          , pp.
          <fpage>18</fpage>
          -
          <lpage>24</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>O.</given-names>
            <surname>Hartig</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Pe</surname>
          </string-name>
          <article-title>´rez, “LDQL: A query language for the web of linked data</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>41</volume>
          , pp.
          <fpage>9</fpage>
          -
          <lpage>29</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <given-names>G.</given-names>
            <surname>Montoya</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Skaf-Molli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Molli</surname>
          </string-name>
          , and M.-E. Vidal, “
          <article-title>Decomposing federated queries in presence of replicated fragments</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>42</volume>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [31]
          <string-name>
            <given-names>A.</given-names>
            <surname>Stellato</surname>
          </string-name>
          , “
          <article-title>Dictionary, thesaurus or ontology? disentangling our choices in the semantic web jungle</article-title>
          ,
          <source>” Journal of Integrative Agriculture</source>
          , vol.
          <volume>11</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>710</fpage>
          -
          <lpage>719</lpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          [32]
          <string-name>
            <given-names>T.</given-names>
            <surname>Baker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Bechhofer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Isaac</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Miles</surname>
          </string-name>
          , G. Schreiber, and E. Summers, “
          <article-title>Key choices in the design of simple knowledge organization system (SKOS</article-title>
          ),
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>20</volume>
          , pp.
          <fpage>35</fpage>
          -
          <lpage>49</lpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          [33]
          <string-name>
            <given-names>K.</given-names>
            <surname>Patroumpas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Georgomanolis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Stratiotis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Alexakis</surname>
          </string-name>
          , and
          <string-name>
            <given-names>S.</given-names>
            <surname>Athanasiou</surname>
          </string-name>
          , “
          <article-title>Exposing INSPIRE on the semantic web</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>35</volume>
          , pp.
          <fpage>53</fpage>
          -
          <lpage>62</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>O.</given-names>
            <surname>Zamazal</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.</given-names>
            <surname>Sva</surname>
          </string-name>
          <article-title>´tek, “The ten-year OntoFarm and its fertilization within the onto-sphere,”</article-title>
          <source>Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>43</volume>
          , pp.
          <fpage>46</fpage>
          -
          <lpage>53</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>G.</given-names>
            <surname>Bella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Giunchiglia</surname>
          </string-name>
          , and
          <string-name>
            <given-names>F.</given-names>
            <surname>McNeill</surname>
          </string-name>
          , “
          <article-title>Language and domain aware lightweight ontology matching</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>43</volume>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>D.</given-names>
            <surname>McGuinness</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Sahoo</surname>
          </string-name>
          , and T. Lebo, “
          <article-title>PROV-O: The PROV ontology,” W3C, W3C</article-title>
          <string-name>
            <surname>Recommendation</surname>
          </string-name>
          ,
          <year>2013</year>
          , http://www.w3.org/TR/2013/RECprov-o-
          <volume>20130430</volume>
          /.
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>I.</given-names>
            <surname>Altintas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Barney</surname>
          </string-name>
          , and E. Jaeger-Frank, “
          <article-title>Provenance collection support in the Kepler scientific workflow system,” Provenance and annotation of data</article-title>
          , pp.
          <fpage>118</fpage>
          -
          <lpage>132</lpage>
          ,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>C. S.</given-names>
            <surname>Liew</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. P.</given-names>
            <surname>Atkinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Galea</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. F.</given-names>
            <surname>Ang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Martin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>and J. I. V.</given-names>
            <surname>Hemert</surname>
          </string-name>
          , “
          <article-title>Scientific workflows: Moving across paradigms</article-title>
          ,
          <source>” ACM Comput. Surv.</source>
          , vol.
          <volume>49</volume>
          , no.
          <issue>4</issue>
          , pp.
          <volume>66</volume>
          :
          <fpage>1</fpage>
          -
          <lpage>66</lpage>
          :
          <fpage>39</fpage>
          ,
          <string-name>
            <surname>Dec</surname>
          </string-name>
          .
          <year>2016</year>
          . [Online]. Available: http://doi.acm.
          <source>org/10.1145/3012429</source>
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>R.</given-names>
            <surname>Mork</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Martin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Z.</given-names>
            <surname>Zhao</surname>
          </string-name>
          , “
          <article-title>Contemporary challenges for dataintensive scientific workflow management systems</article-title>
          ,”
          <source>in Proceedings of the 10th Workshop on Workflows in Support of Large-Scale Science. ACM</source>
          ,
          <year>2015</year>
          , p.
          <fpage>4</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>T.</given-names>
            <surname>Miksa</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Rauber</surname>
          </string-name>
          , “
          <article-title>Using ontologies for verification and validation of workflow-based experiments</article-title>
          ,
          <source>” Web Semantics: Science, Services and Agents on the World Wide Web</source>
          , vol.
          <volume>43</volume>
          , pp.
          <fpage>25</fpage>
          -
          <lpage>45</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>