<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>A study of Information System mutations (changes) using Knowledge Organization System (KOS) applied to biomedical research study</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Amel Raboudi</string-name>
          <email>amel.raboudi@utc.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>FEALINX</institution>
          ,
          <addr-line>37 rue Adam Ledoux 92400 Courbevoie</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>INSERM, UMR970, Paris-Cardiovascular Research Center at HEGP</institution>
          ,
          <addr-line>Paris</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Université de Technologie de Compiègne (UTC), UMR 7337 Roberval</institution>
          ,
          <addr-line>Compiègne</addr-line>
          ,
          <country country="FR">France</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>A biomedical research study is a collaboration process where several experts, institutions, disciplines and data sources are involved. Traceability of data provenance and efficient data management are essential in order to guarantee results integrity. Researchers, however, use different Information Systems (IS) in order to collect, process and analyze their increasingly complex datasets. Accordingly, Research Data Management (RDM) is seen as a tedious, time consuming and error prone task. In a previous work, an IS based on Product Lifecycle Management (PLM) technology was proposed to manage data heterogeneity and provenance throughout the biomedical research lifecycle. However, the fastchanging context of biomedical research causes data, information and knowledge changes, that we hereby call mutations. Mutations can affect IS components and impact IS consistency. In a collaboration context, it is important to have the same shared knowledge for all actors. Therefore, the use of a Knowledge Organization Systems (KOS) is proposed in order to model shared knowledge and enable dealing with knowledge level mutations.</p>
      </abstract>
      <kwd-group>
        <kwd>Information System</kwd>
        <kwd>Knowledge Organization System</kwd>
        <kwd>Ontology evolution</kwd>
        <kwd>Research Data Management</kwd>
        <kwd>Change Management</kwd>
        <kwd>Mutation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Biomedical studies are multisource, multidisciplinary, multimodal, multi-partners and
include longitudinal series. Biomedical researchers are constantly moving back and
forth from one data source to another, in order to collect, curate, process and analyze
heterogenous data. Therefore, biomedical Research Data Management (RDM) is
particularly a complex, time consuming and error prone task. Issues about research
reproducibility, data provenance, data sharing, data interoperability and reuse are major in
biomedical research field. Solutions such as Information Systems (IS), experts, accurate
methods and processes are essential to data management for biomedical RDM.
Biomedical research labs rarely use intensive processes and methods for RDM; in most
cases lab investment in that field is negligible: In 2016, European Union decided for
the first time to allocate 5% of project budget to RDM [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        Several ISs are used for biomedical RDM, each one is dedicated to a type of data:
Laboratory Information Management System (LIMS) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] for biological samples
information; PACS (Picture Archiving and Communication System) and RIS (Radiology
Information System) for imaging data, etc. They are either domain specific or data
format centric or both. Besides, they don’t cover all aspects and steps of a biomedical
research study. In a previous work, an IS based on Product Lifecycle Management
(PLM) technology: Biomedical PLM [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] was proposed to manage heterogeneous data
provenance. It aims at managing all types of biomedical data throughout the biomedical
research lifecycle: (1) specification, (2) acquisition of raw data, (3) processing of
derived data, and (4) scientific publication. Biomedical PLM is a study centric,
lifecycleoriented data management system, that enables sharing among actors, processes,
organizations and distant sites.
      </p>
      <p>The context of our work is the DRIVE-SPC1 project. Its goal is to develop an
integrated solution to manage biomedical research data of the Imaging Research
Laboratory (LRI) - team 2 - at Paris Cardiovascular Research Center (PARCC). Data used by
LRI are mainly preclinical imaging exam results for oncology and cardiology research:
PET-CT, MRI, ultrasound, and histology. A biomedical PLM instance is currently
deployed for the lab members in order to manage data of several studies: cardiotoxicity
of a cancer treatment, tumors metabolism, etc.</p>
      <p>The fast-changing context of biomedical research is an additional issue for data
sharing among the laboratory members. For instance, a researcher changes the way he
organizes his data without informing data users, a change in the measurement unit of a
crucial parameter for analysis after software update, internal changes in a partner
laboratory that affect project schedule and eventually data, discovery in science that must be
taken into consideration, etc. Observations done on the LRI lab reveal that previously
listed unexpected changes can have serious consequences on the IS and the research
project. For instance, limited access for a period of time, errors in automatic
toolkits/routines, loss of data, inconsistency of information, loss of time, issues about
results integrity, impossibility of data sharing and loss of data provenance etc. All these
events have in common data and information changes (lost or gain) that were not
anticipated by the IS original design. Our hypothesis is that unexpected changes are
mainly related to knowledge sharing issues, because motivation behind unexpected
changes exists in people minds and organizations memory. Therefore, changes cannot
be studied without an accurate modeling of the shared knowledge among all IS actors
(users/developers).</p>
      <p>The research problem addressed in this article is how to manage unexpected changes
in an IS (applied to biomedical PLM) in order to guarantee its consistency and
continuous usability, taking into consideration the fast-changing context of biomedical
research and the variable lifespans of different IS components and partners. First, a
literature review is presented. Then, we focus on our proposed preliminary approach to
manage IS changes, and finally our research methodology and discussion are drawn.
1 a collaboration between Fealinx company and LRI, financed by USPC university.</p>
    </sec>
    <sec id="sec-2">
      <title>State of the art</title>
      <p>
        Data-Information-Knowledge-Wisdom (DIKW) framework for IS research highlights
the importance of knowledge: Knowledge is data and/or information that have been
organized and processed to convey understanding, experience, accumulated learning,
and expertise as they apply to a current problem or activity [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. IS definition at [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]
describes two parts of an IS: the known part since the IS design phase, and the
unexpected part, that depends on all other systems (technical/social) composing the IS
environment. In Information Systems, data and information are explicitly managed, but,
knowledge is implicit which prevents unexpected changes to be properly managed. To
make knowledge explicit among actors, and therefore manage the impact of knowledge
changes on IS, we must look for a way to manage knowledge.
2.1
      </p>
      <sec id="sec-2-1">
        <title>Knowledge Organization System (KOS)</title>
        <p>
          Knowledge Organization Systems (KOS) are designed to manage knowledge: KOS are
defined as all types of schemes for organizing information and promoting knowledge
managements [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ]. KOS includes classification schema, standardized terminology,
structured vocabulary, glossaries, semantic networks, ontologies, etc.
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Knowledge Organization System and IS. Managing the knowledge level with KOS</title>
        <p>
          is an important step in the process of ensuring IS consistency: The work on [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] proposed
and validated CoMIS-KMS, a process to guide the conversion of an existing
Information System to a knowledge management system with the use of a knowledge base
(KOS). Haase PhD [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] proved that ontology (KOS) evolution allows to manage
changes in distributed ISs in a consistent manner.
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Knowledge Organization System evolution. Dos Reis et al. [5] studied KOS mapping</title>
        <p>
          maintenance issues after KOS evolution in the biomedical field. Studied KOSs are:
NCIT (Thesaurus), ICD-9-CM (Classification), SCT (Ontology) and MedDRA
(Dictionary). General KOS evolution is rarely addressed in the literature, instead, the
evolution study of certain types of KOS exists and especially ontology [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ] [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ]
[
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ].
2.2
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Ontology evolution</title>
        <p>
          A KOS classification proposed by [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] underlines that ontologies are the most
semantically clear type of KOS. Ontology is an explicit specification of a shared
conceptualization of a domain of interest [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. Ontology change is a largely addressed field in the
literature. An exhaustive analysis is presented in [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] where ten subareas for ontology
change research fields are defined together with their mutual boundaries. Some of them
deals with heterogeneity resolution between ontologies as a proposed method to change
an ontology, through ontology mapping and matching [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. Another concern is about
ontology fusion (integration and merging) issues [
          <xref ref-type="bibr" rid="ref21">21</xref>
          ] [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]. The same article also
presents ontology evolution and separates it from ontology debugging. Both research
fields focus on incorporating changes in an existing ontology while avoiding
inconsistency.
        </p>
        <p>
          A state of the art at [
          <xref ref-type="bibr" rid="ref23">23</xref>
          ] presents ontology evolution as a five step cycle as follow:
(1) Detecting the need for evolution, (2) Suggesting changes, (3) Validating changes,
(4) Assessing evolution impact, (5) Managing changes: (5.a) Recording changes and
(5.b) Versioning. For each step, a review of related literature is presented. Briefly, (1)
is the starting point for ontology evolution process by detecting a need for change that
can be initiated from user behavior [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] or data sources [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. (2) is the phase of change
representation with the help of structured or unstructured resources, for example online
ontologies were used by [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ] as a background knowledge for integrating newly
discovered concepts. (3) assesses the relevance of the suggested change to the domain and its
impact on ontology consistency. (4) treats impact on dependent applications and
external artifacts that uses the ontology under change. (5) applies and traces the change
throughout ontology versions. An example is in [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], it applies provenance W3C
standard [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] in order to trace ontology changes.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Proposed approach</title>
      <p>Our approach consists of two main propositions: first, we develop an analogy between
IS unexpected changes and mutations in genetics, and second, we propose a model for
shared knowledge among IS actors in order to manage unexpected changes. Both are
in their preliminary steps.</p>
      <p>
        Expected and unexpected change. Based on IS definition at [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], we propose to
consider two types of changes: expected and unexpected changes. Expected changes are
managed according to a defined and established process of change management and IS
evolution: identifying a need for change, scheduling the change operation and
executing it. Unexpected changes cannot be managed through a regular process. They can be:
an IS dependency change, a wrong use of an IS functionality, external systems software
update, etc. We focus on unexpected changes as they have serious effects on systems
consistency and usability such as data sharing and data interoperability issues.
Unexpected changes and mutation. We propose to consider unexpected changes as
mutations. A mutation in genetics is a sudden change in DNA code that continuously
occurs in bio-cells and that is fundamental for species evolution with regard to natural
selection [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. In IS research or in genetics, an evolution process for an object (thing)
is a migration from a consistent state A to a consistent state B. The complete analogy
with genetics is not treated in this article but it will be addressed in the course of this
PhD. IS mutations can affect any IS component and can lead to an IS evolution (best
case scenario) or an IS inconsistency otherwise.
DIKW and Knowledge engineering. We choose the DIKW framework to consider IS
mutation concept. Mutations in DIKW framework can occur at each level: data
mutation, information mutation, and knowledge mutation. Observations done at the LRI lab
revealed that available data and information in the IS do not give any indication about
knowledge involved. Besides, knowledge mutations have their origin in external
knowledge sources and Information System technical and social environment. Thus,
we propose to study IS mutations with the use of knowledge engineering in order to
focus on knowledge mutations. Our aim is to ensure knowledge sharing among all
actors. Then, we propose to study knowledge evolution and link it to IS evolution in order
to manage mutations phenomenon in all DIKW levels. To this end, we must deal with
two challenges. First, lab data integration in Biomedical PLM for IS usability
enhancement. Therefore, we proposed a generic data integration method that allows different
research data types to be imported in Biomedical PLM [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. And second, modeling
Biomedical PLM knowledge taking into consideration change management and
mutations issues, which is a work in progress.
      </p>
      <p>Knowledge Organization System (KOS) for Biomedical PLM. IS manages
explicitly data and information levels, whereas Knowledge Organization Systems (KOS)
manages knowledge level. We propose to manage knowledge mutations with the help
of a Biomedical PLM KOS. As presented in the state-of-the-art, ontologies are the
most semantically clear type of KOS. The proposed biomedical PLM KOS is based on
an ontology that models the knowledge of (1) the Biomedical PLM Information System
and (2) the shared knowledge of biomedical research studies: general biomedical
ontologies, domain ontologies, laboratory vocabulary, etc.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Methodology</title>
      <p>The aim of this research is to manage unexpected changes, that we call mutations, in
Information Systems in order to ensure IS consistency and continuous usability.</p>
      <p>Key steps of our work methodology are (1) exploration of the DRIVE-SPC project
context and identification of unexpected changes, (2) state-of-the-art of IS changes
related literature, (3) development of biomedical PLM KOS for biomedical RDM with
the use of ontologies, (4) proposition and modeling of the whole process of managing
mutations in IS with the use of KOS in biomedical research study and (5) test and
validation of the proposed approach according to DRIVE-SPC project context.</p>
      <p>
        Our first PhD year focused on the deployment of the Biomedical PLM IS in LRI lab
in order to identify mutations. It aims to increase usability of Biomedical PLM in the
lab in order to track every type of mutations. Therefore, data of a pilot research study
were integrated retrospectively in the IS in order to give a real-life use case for
researchers [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. And recently, some speed-interviews sessions with five key users were
organized in order to identify more relevant use cases scenarios.
      </p>
      <p>Presently, ontology representing Biomedical PLM knowledge is under construction.
Exploration of available methodologies in literature for ontology construction and
integration, together with ontology development framework choice (Protégé, NEON
Toolkit)2 and language selection (OWL Lite, OWL DL, SKOS, RDFS) are some of the
ongoing work.</p>
      <p>Next, matching and mapping between (1) Biomedical PLM ontology, and (2)
Biomedical PLM Information System, and traceability of mutations in the whole system
will be developed.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Discussion</title>
      <p>In this article, we introduced Information System mutation concept (unexpected
change) based on a preliminary analogy with genetic mutations, and we proposed an
approach to analyze Information System mutations with the help of Knowledge
Organization System (KOS). It aims to provide a shared reference for IS actors and then
facilitate mutations management. In order to succeed the shared knowledge design, a
further literature review must be done concerning ontology integration, mapping and
matching, together with ontology versioning, evolution and debugging.
Actors involvement. IS needs to maintain up-to-date functionalities despite the
fastchanging context of biomedical research studies and the multiple partners involved.
Our methodology involves partners from an early stage. This is done through
interviews, data management behaviors tracking, data preparation, etc. Our proposition
depends on IS actors reactivity and understanding of knowledge acquisition importance.
This is a risk factor to consider in our research.</p>
      <p>System modeling. With the design of Biomedical PLM KOS, a cover of DIKW levels
mutations is assured and a larger vision of system changes is provided, which offers a
comprehensive framework for IS mutations management. However, this choice adds
complexity upon the Biomedical PLM system. Thus, it is interesting to consider a
model for the whole system (IS+KOS) to better clarify the role, boundaries and impact
of each one.</p>
      <p>
        IS customization. When a mutation occurs, IS providers are supposed to act rapidly in
order to manage mutations and ensure continuous IS relevance to customer’s need.
Haller [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] describes the dilemma of IS providers “in-between” the management of all IS
changes and the reduction of IS customization related costs. This is an interesting
requirement to consider while proposing mutation management strategy.
2 https://www.w3.org/wiki/Ontology_editors
      </p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>The author wants to thank her direct supervisor at Fealinx Company Dr. Marianne
Allanic. Her PhD directors Pr. Bertrand Tavitian and Pr. Benoît Eynard. Her supervisors
Dr. Alexandre Durupt (UTC), Dr. Philippe Boutinaud (Fealinx), and DRIVE-SPC
project colleagues: Dr. Pierre-Yves Hervé (Fealinx) and Dr. Daniel Balvay (Inserm).
Special thanks to LRI key users: Dr. Thomas Viel, Anais Certain, Thulaciga Yoganathan,
and Caterina Facchin for their time and help.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Allanic</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          et al.:
          <article-title>PLM as a strategy for the management of heterogeneous information in bio-medical imaging field</article-title>
          .
          <source>International Journal of Information Technology and Management</source>
          .
          <volume>16</volume>
          ,
          <issue>1</issue>
          ,
          <fpage>5</fpage>
          -
          <lpage>30</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Anderson</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mansingh</surname>
          </string-name>
          , G.:
          <article-title>Migrating MIS to KMS: A Case of Social Welfare Systems</article-title>
          . In:
          <string-name>
            <surname>Osei-Bryson</surname>
          </string-name>
          , K.-M. et al. (eds.)
          <article-title>Knowledge Management for Development: Domains, Strategies and Technologies for Developing Countries</article-title>
          . pp.
          <fpage>93</fpage>
          -
          <lpage>109</lpage>
          Springer US, Boston, MA (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bergman</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>An Intrepid Guide to Ontologies</article-title>
          .
          <volume>24</volume>
          (
          <year>2007</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Beynon-Davies</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>The 'language' of informatics: The nature of information systems</article-title>
          .
          <source>International Journal of Information Management</source>
          .
          <volume>29</volume>
          ,
          <issue>2</issue>
          ,
          <fpage>92</fpage>
          -
          <lpage>103</lpage>
          (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Dos</given-names>
            <surname>Reis</surname>
          </string-name>
          ,
          <string-name>
            <surname>J.C.</surname>
          </string-name>
          et al.:
          <article-title>Analyzing and supporting the mapping maintenance problem in biomedical knowledge organization systems</article-title>
          .
          <source>In: Proc. SIMI Workshop at ESWC</source>
          . pp.
          <fpage>25</fpage>
          -
          <lpage>36</lpage>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>European</given-names>
            <surname>Commission</surname>
          </string-name>
          ,
          <article-title>Directorate-General for Research and Innovation: Realising the European open science cloud: first report and recommendations of the Commission high level expert group on the European open science cloud</article-title>
          .
          <source>Publications Office</source>
          ,
          <string-name>
            <surname>Luxembourg</surname>
          </string-name>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Flouris</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          et al. :
          <article-title>Ontology change : classification and survey</article-title>
          .
          <source>The Knowledge Engineering Review</source>
          .
          <volume>23</volume>
          ,
          <issue>2</issue>
          ,
          <fpage>117</fpage>
          -
          <lpage>152</lpage>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Gibbon</surname>
            ,
            <given-names>G.A.</given-names>
          </string-name>
          :
          <article-title>A brief history of LIMS</article-title>
          .
          <source>Laboratory Automation &amp; Information Management</source>
          .
          <volume>32</volume>
          ,
          <issue>1</issue>
          ,
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          (
          <year>1996</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Gruber</surname>
            ,
            <given-names>T.R.:</given-names>
          </string-name>
          <article-title>A translation approach to portable ontology specifications</article-title>
          .
          <source>Knowledge Acquisition. 5</source>
          ,
          <issue>2</issue>
          ,
          <fpage>199</fpage>
          -
          <lpage>220</lpage>
          (
          <year>1993</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Haase</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Semantic Technologies for Distributed Information Systems</article-title>
          . (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Haller</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Information System Maintenance Costs: The "In-between “Challenge</article-title>
          . Presented at the Workshop Software-Reengineering, Germany (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Hodge</surname>
          </string-name>
          , G.:
          <article-title>Systems of Knowledge Organization for Digital Libraries: Beyond Traditional Authority Files</article-title>
          .
          <source>Digital Library Federation, Council on Library and Information Resources</source>
          , 1755 Massachusetts Ave (
          <year>2000</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Jacob</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Evolution and tinkering</article-title>
          .
          <source>Science</source>
          .
          <volume>196</volume>
          ,
          <issue>4295</issue>
          ,
          <fpage>1161</fpage>
          -
          <lpage>1166</lpage>
          (
          <year>1977</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Kondylakis</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Papadakis</surname>
          </string-name>
          , N.:
          <article-title>EvoRDF: evolving the exploration of ontology evolution</article-title>
          .
          <source>The Knowledge Engineering Review</source>
          .
          <volume>33</volume>
          , (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Lebo</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          et al.:
          <article-title>Prov-o: The prov ontology</article-title>
          .
          <source>W3C recommendation. 30</source>
          , (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Noy</surname>
            ,
            <given-names>N.F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klein</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Ontology Evolution: Not the Same as Schema Evolution</article-title>
          .
          <source>Know. Inf. Sys. 6</source>
          ,
          <issue>4</issue>
          ,
          <fpage>428</fpage>
          -
          <lpage>440</lpage>
          (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Raboudi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al.:
          <article-title>Integration and provenance control of proteomics data using SWOMed, a Product Lifecycle Management framework for biomedical research</article-title>
          .
          <source>Presented at the SMMAP Congress October</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Raboudi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          et al. :
          <article-title>Traçabilité de l'intégration de données biomédicales hétérogènes dans le système SWOMed de gestion du cycle de vie des études biomédicales</article-title>
          .
          <source>In: actes du symposium SIIM</source>
          <year>2017</year>
          . , Toulouse (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Stojanovic</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          et al. :
          <article-title>User-Driven Ontology Evolution Management</article-title>
          . In:
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Benjamins</surname>
          </string-name>
          , V.R. (eds.)
          <article-title>Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web</article-title>
          . pp.
          <fpage>285</fpage>
          -
          <lpage>300</lpage>
          Springer Berlin Heidelberg (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Turban</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          et al.: Introduction to Information Technology. Wiley, New York (
          <year>2004</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Xuan</surname>
            ,
            <given-names>D.N.</given-names>
          </string-name>
          et al.:
          <article-title>Ontology Evolution and Source Autonomy in Ontology-based Data Warehouses</article-title>
          .
          <volume>21</volume>
          (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Zablith</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Evolva: Towards Automatic Ontology Evolution</article-title>
          .
          <source>Technical report. Knowledge Media Institute (KMi)</source>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Zablith</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          et al.:
          <article-title>Ontology evolution: a process-centric survey</article-title>
          .
          <source>The knowledge engineering review. 30</source>
          ,
          <issue>1</issue>
          ,
          <fpage>45</fpage>
          -
          <lpage>75</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Zurawski</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Distributed multi-contextual ontology evolution-a step towards semantic autonomy</article-title>
          .
          <source>In: International Conference on Knowledge Engineering and Knowledge Management</source>
          . pp.
          <fpage>198</fpage>
          -
          <lpage>213</lpage>
          Springer (
          <year>2006</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>