<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Mind Mapping and Spreadsheets in Collaborative Design of Knowledge Graphs</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dmitry Kudryavtsev</string-name>
          <email>d.v.kudryavtsev@gsom.pu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tatiana Gavrilova</string-name>
          <email>gavrilova@gsom.pu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Irina Leshcheva</string-name>
          <email>leshcheva@gsom.pu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alena Begler</string-name>
          <email>alena.begler@gmail.com</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Miroslav Kubelskiy</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Olga Tushkanova</string-name>
          <email>tushkanova.on@gmail.com</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Graduate School of Management, St. Petersburg University</institution>
          ,
          <addr-line>St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>InfoWings</institution>
          ,
          <addr-line>St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>82</fpage>
      <lpage>93</lpage>
      <abstract>
        <p>The paper proposes a method for creating a knowledge graph focused on visualization, usage of spreadsheets and group work. A knowledge graph is a set of typed entities (with attributes) related to each other by relationships. Entity, attribute and relationship types are determined by a scheme called ontology. The proposed method was created within the project with an automotive company, which needed systematization, integration and re-use of knowledge about the assembly units of various cars within the company. The created knowledge graph has a complex structure of properties associated with one class and its subclasses, while there is a little number of ontology classes. The need for active involvement of experts in the creation of the knowledge graph determines the scope of the method, since they and their colleagues will use the system in the future (internal customers). The proposed method helped to create a pilot knowledge graph, which includes more than 50 assembly units and about 400 properties.</p>
      </abstract>
      <kwd-group>
        <kwd>knowledge graph</kwd>
        <kwd>ontology</kwd>
        <kwd>ontology engineering</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        A knowledge graph is a set of typed entities (with attributes) relating to one another
by typed relationships. Types of entities and relationships are defined in schemas
called ontologies [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. “Ontology is a formal, explicit specification of a shared
conceptualization” [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], which consists of a hierarchy of concepts of the subject domain, links
between them and constraints that operate within the framework of this model.
Ontology is constructed as a network consisting of concepts and connections between them.
Connections can be of various types (for example, “is a”, “consists of”, “is executor
of”, etc.). The term “ontology” overlaps with the term “knowledge graph”, since
when an ontology is populated with instances it becomes a knowledge graph (or a
knowledge base). However, the ontology primarily focuses on classes, properties and
axioms (TBox), while knowledge graph pays more attention to instances (ABox).
      </p>
      <p>A range of methodologies for ontology development, however, they are not
directly applicable to the knowledge graph creation due to their focus on the classes
structure and omission of population stage (description of instances). Ontology
population, in contrast, is important for the knowledge graph development. Besides existing
ontology engineering methodologies are not differentiated based on the type of
ontology, but certain applications requires specific ontologies and there is a need for
specialized methods. For example, faceted search systems, which are often used in
ecommerce and knowledge management, requires light-weight ontologies with many
properties of classes (faceted taxonomy). The development method for such ontology
type will differ from the creation of heavy-weight ontology for reasoning purposes.</p>
      <p>
        Thus, in line with design science research [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] the requirements for the knowledge
graph development method were specified:
 The knowledge graph, the final result of the method application has a complex
structure of properties (large amount, hierarchical organization) associated with
one class and its subclasses;
 TBox (structure of properties mostly) and ABox (description of instances) are of
equal importance;
 The main source of information for creating the knowledge graph is
semistructured data thus, it assumes manual development
 The knowledge graph development often involves experts and users, thus, its
development should be collaborative at every stage of ontology development.
      </p>
      <p>The purpose of the paper is to suggest and to describe the method of knowledge
graph creation that meets these requirements.</p>
      <p>The paper is structured as follows. The next section describes related work. Section
3 proposes for general description of the method for knowledge graph development,
and the application and demonstration of the method for the automotive industry
assembly units’ case. Section 4 is dedicated to the conclusion and discussion of
suggested method implication.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related Work</title>
      <p>Related work is carried out for ontology engineering methodologies, knowledge graph
development methods and within construction of faceted taxonomies. We will briefly
review these approaches with respect to the aforementioned characteristics of the
applied method: iterations during the building process and the focus on the property
structure. Additionally, visualization methods’ position in the process is reviewed.
2.1</p>
      <sec id="sec-2-1">
        <title>Ontology Engineering Methodologies</title>
        <p>Existing methodologies are focused on ontology schema development, and pay less
attention to ontology population (which is important for knowledge graph).
Nevertheless, these methodologies constitute the core of knowledge graph development.</p>
        <p>
          These methodologies may be split into universal and domain-specific.
Domainspecific frameworks and methodologies for product ontologies [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ] focus mainly on
the result, rather than process of ontological engineering. None of them fits the
aforementioned characteristics, thus, we will not review them in this paper.
        </p>
        <p>
          Several universal methodologies for ontology engineering are widely
disseminated. The most developed and complex universal methodology is the NeOn
(www.neon-project.org), which integrates the achievements of previous
methodologies [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. NeOn methodology offers nine scenarios for ontology networks building and
two types of processes for ontology development. While scenarios for ontology
building are flexible, the development process guidelines are relatively firm and offer only
two models: waterfall and iterative-incremental. None of these models allows moving
back-and-forth between the development stages within the iteration.
        </p>
        <p>
          This problem was solved in the Methontology [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] approach by adding the evolving
lifecycle, which allows to come back to any phase of development to make changes.
On-To-Knowledge [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] applies stricter restrictions on the iterations inside the ontology
building and assumes them at the refinement and evaluation stages, which should
form a cycle. Similar approach with iterations at the building phase was proposed by
the [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ] methodology for the ontology creation in SMEs. This methodology focuses on
development time reduction and its stages are similar to the NeOn’s waterfall model
with the several short iterations in the ontology building phase. The same iterative
process is applied by the [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ] middle-out approach to the ontology terms definition,
which allows to reach the balanced level of detalization and eXtreme Design [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ]
approach, which provides for short iterations and active customer involvement.
        </p>
        <p>
          The majority of mentioned methodologies support collaborative style of ontology
development. They are second generation methodologies focused on centralized
development with the team members’ role differentiation, and they play positive role in
the corporate ontology development [
          <xref ref-type="bibr" rid="ref11">11</xref>
          ].
2.2
        </p>
      </sec>
      <sec id="sec-2-2">
        <title>Knowledge Graph Development</title>
        <p>
          Several attempts to classify methods of knowledge graph design and to create a
methodology have been made. For example, [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ] describes three tasks related to the
knowledge graph usage: knowledge acquisition and integration, storage, and
consumption. The first relates to creation of the knowledge graph. At this stage, ontology
engineering methods can be applied. There are automatic and manual methods for
creating knowledge graph. This paper is devoted to the manual one [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
2.3
        </p>
      </sec>
      <sec id="sec-2-3">
        <title>Methods for Construction of Faceted Taxonomies</title>
        <p>
          The required knowledge graph can be used within faceted search system [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ] and
plays the role of faceted taxonomy. So, methods used for creating faceted taxonomies
are applicable for our purposes. This process typically subdivides into facet term
extraction and hierarchy construction steps in line with existing ontology development
methods. The extraction can be done automatically, semi-automatically or manually
[
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. Since we will use heterogeneous semi-structure data (suppliers' catalogs, expert
knowledge) and high quality of knowledge graph is required, automatic and
semiautomatic methods are not applicable.
2.4
        </p>
      </sec>
      <sec id="sec-2-4">
        <title>Visualization Techniques Usage</title>
        <p>During the ontology development, two visualization techniques were used for
communication within the team: mind maps and tables. These formats were chosen for
being the most easy-to-understand for domain experts and customers (developers of
the system using the knowledge graph). Additionally, both of proved to be efficient as
an ontology development support methods.</p>
        <p>
          Mind maps are good for early stages of ontology engineering, as they do not
involve any implicit semantics [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. Additionally, they serve communication goals, as
they may easily be understood and edited by domain experts. Nodes were transformed
into properties in our methodology mind map; each new level determined
subproperty relationships similar to the OntoEdit [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ] methodology, where mind map
concepts were linked to subConceptOf relationships as well as [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] subClassOf
relationships.
        </p>
        <p>
          Spreadsheets are often used for automatic and semi-automatic ontologies
construction [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. However, they may be used for manual construction as well. Specifically,
spreadsheets may support two tasks. The first one is glossary creation, where
spreadsheets ease synonyms search and terms connection [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. The second one is ontology
enrichment together with classes’ structure identification [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. Additional benefit of
the spreadsheets is their automatically convertibility into ontology.
3
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Method and its Application</title>
      <p>The VITON (VIsual collecTive development of the ONtontological knowledge graph)
method helps to create knowledge graphs with complex structure of properties under
conditions specified in the requirement description (see Introduction).</p>
      <p>
        At the top-level, the suggested method follows the logic of existing ontology
engineering methodologies; particularly, the NeOn methodology was applied [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] as the
basis for the development process with several special features added:
1. Focus on properties and their structure;
2. Usage of mind maps (high-level structure of properties, description of instances) in
order to collaborate with experts, future users (internal customers) of the system,
since they are not familiar with knowledge engineering methods and tools;
3. Usage of spreadsheets (“Properties – Instances” matrix) to structure properties
(about 400), to analyze their usage in instances and to support collaboration within
the development team;
4. Strong integration of ontology development with description of instances, where
each instance description suggests new properties for the ontology.
      </p>
      <p>
        The demo-graph building process followed Scenario 2 of the NeOn methodology
process [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. This scenario includes repeated use of the non-ontological resources stage
in addition to the core scenario stages: requirement specification, search for candidate
knowledge resources for repeated use, scheduling, and development. We reviewed
these stages as a direct sequence, except for scheduling phase that took place after
requirement specification. Two ontology support activities were performed
simultaneously with the development process: knowledge acquisition and documentation.
Knowledge acquisition was performed during the analysis of instances (including
specification documents, data sheets, and interviews with experts). Documentation
was made for different versions of the mind maps, spreadsheets, and ontologies
(version control files), decisions (meeting notes, decision track document), and other
sources in use (list of knowledge resources, wiki pages with references to
instancerelated information). The method was applied to make the demo-graph (about 50
instances). After initial graph development, employees of the enterprise will fill it up.
3.1
      </p>
      <sec id="sec-3-1">
        <title>VITON Method description</title>
        <p>This section gives domain-independent description of the method through a possible
application scenario.</p>
        <p>Ontology requirements specification was performed in close interaction with the
customers (automotive company) and domain experts. The requirements main form
was the use cases.</p>
        <p>Unlike the NeOn methodology, where scheduling is performed after the search of
candidate knowledge resources, our project time was limited to three months by the
consumer. Thus, we defined scope instead of timeframes and established the team at
the project planning stage. Project scope is described in the previous section. Project
team involved a group of analysts led by a knowledge engineer. The group consisted
of four subgroups:
 A subgroup of analysts includes developers of mind maps.
 A subgroup of ontologists creating the knowledge graph using mind maps in RDF
with help of ontology editors.
 A subgroup of domain experts.
 Technical writer-methodologist for the description of internal.</p>
        <p>It was needed to differentiate the knowledge engineering part of the team, because
several activities should be performed simultaneously, namely, the creation of the
mind maps for instances and refinement of the ontology.</p>
        <p>According to the NeOn methodology, reusing of candidate knowledge resources
was performed involving the following activities:
 Search was made for papers describing the domain, standards, and internet
resources devoted to the industry (online shops, suppliers’ websites).
 The source of the resources was assessed (priority was given to the known
providers) and domain experts evaluation.
 Selection was done according to the assess criteria and yielded several resources
for re-use.</p>
        <p>For the conceptualization activities (development stage) mind maps were used as
the language of description, and two modelling techniques were applied:
 First, top-down modelling style was applied and ontology mock-up as the mind
map was created. It made it possible to identify main properties of a central class
and became the main tool for instance description.
 Then, bottom-up style was added. Mind maps were created for the pilot set of
instances provided by the customer on the basis of the mockup and semi-structured
sources of information about instances and then evaluated by the expert group.</p>
        <p>These two processes have been performed iteratively: mind maps for every
instance were based on the mockup, and mockup itself was continuously refined
according to common patterns identified during instances analysis. Additionally,
glossary of terms with definitions was drawn during these activities.</p>
        <p>
          Formalization (development stage) of properties took place and involved
spreadsheets, when mind maps were created for the pilot set of instances and ontology
mockup was established (i.e. additional instance analysis did not add much to the
mockup). Table with properties served as an intermediate stage between mind maps
and ontology. The table was mainly aimed at properties hierarchy creation and
glossary establishment. Mind maps were transformed to create the table. Transformation
technique, similar to the [
          <xref ref-type="bibr" rid="ref14 ref15">14, 15</xref>
          ] was applied with several additions:
 Instances formed the first row (as a subject in RDF notation).
 Ontology mockup concepts were transformed to the top-level properties, and
lower-level concepts were transformed from the instances’ mind maps to sub
properties. The columns of the table showed it as intended list (as predicates). During
transformation, property names were unified according to the chosen naming
convention, informal human-readable names were provided for, when labels and
description were added.
 The lowest level of the mind map was labeled in the table cells with unit of
measurement signs (as objects). All related properties were added to the table together
with their dimensions for each instance. For example, if the instance has a property
“size” measured in millimeters, the name of property (hasSize) was added in the
“Properties” column under relevant group and subgroup of properties and code
“mm” was added to the property with AU intersection. In case there was no unit of
measurement (for example, qualitative property), plus sign was added.
 Initial properties entering according to the mind map ontology mockup.
 Reconstruction of properties structure with respect to their semantic similarity and
generalization level.
 Entering of all the instances mockups in the created properties structure,
verification and refinement of the structure, adding of labels and descriptions of properties.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Implementation (development stage) followed several steps.</title>
        <p>At first, properties were imported. During their transition, joint hierarchy of the
properties was subdivided into two separate hierarchies of object properties and data
properties with the common upper-level groups and (where possible) subgroups of
properties.</p>
        <p>Then, class hierarchy was introduced. This hierarchy creation was not a goal of the
project, thus, classes were used as storage for different types of values. There are
three upper-level classes in the hierarchy:
 CoreEntity for the names of artifacts and organizations.
 QuantitativeValue for the instances describing quantitative values (see further
explanation at the nest translation step).
 Reference for the instances describing repeating qualitative values.</p>
        <p>Finally, all the entities were imported in the ontology. The entities were one of
three types: complex instances (could be split in several parts), their parts and object
properties values. Key objects (instances) of analysis were individuals in the
CoreEntity subclasses, and Values for object properties – in either Quantitative or
Reference subclasses. The values for object properties were linked to the artifacts
(exact instances) by the object property. Unique qualitative values like informal
descriptions were imported as values for data properties .
3.2</p>
      </sec>
      <sec id="sec-3-3">
        <title>Case Project</title>
        <p>The task to create and describe the method for visual collective creation of the
ontological knowledge graph arose from the industrial need to develop such graph for an
automotive company. Elements of the knowledge graph are assembly units (AUs) of
various cars (mainly electric trucks) produced by the company. The created
knowledge graph is intended to form the basis for the new corporate knowledge
management system, where users (engineer, purchasing manager, economist, etc.) will be
able to find an AU they need and relevant information about it. Such system is
important for the company since it produces vehicles using mostly AUs available on the
market, and it takes engineers much time to search for the information about AUs.
The system is supposed to integrate both information about AUs already used in the
company and that related to AUs available on the market and contained in the
suppliers' catalogs. In future, the knowledge graph may be applied in robotics developed in
the company as well. The customer of the method and the knowledge graph is an IT
department that performs digitization of all business processes of the enterprise.</p>
        <p>Requirements on the method of creating knowledge graph and its deliverable
(required AUs’ knowledge graph) were specified by the knowledge graph customer
(automotive company):
 The required knowledge graph should be focused on a property structure, and a
small part of properties is applicable for the top-level class (“AU” or “artifact”)
and a major part of properties is AU-specific.
 TBox (structure of properties) and ABox (description of AUs/instances) are of
equal importance.
 High quality of knowledge graph to use it as a “gold standard data” and for content
demonstration.</p>
        <p>The team was unequally involved in the development process:
 Analysts (2 persons) were involved in knowledge source search, AUs’ mind maps
creation, and in mind maps to spreadsheets transformation.
 Ontologists (2 persons) were involved in ontology mockup creation, development
of spreadsheet structure, and, mainly, re-use of other knowledge resources and
ontology construction and population.
 Domain experts (2 persons) were engaged in the process to check accuracy of the
description once new portion of AUs was described, as well as to verify
newlycreated ontology mockup.
 Methodologist (1 person) consulted the team on the use of methods.</p>
        <p>
          Identified knowledge resources were later used at different stages:
 Core Product Model (CPM) [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ] and the product information domains identified in
the PLM systems were used as the basis for developing the ontology mockup as a
mind map [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ].
 ISO 14050:2009(en), ISO 10303-1:1994(en), ISO/IEC 15288:2008, and STEP AP
242 were used for the initial glossary development and terms definition.
 IEC 81346 (the classification of objects according to their purpose or task) and
“Unit of measure” list of elements were used as a part of ontology to describe
instances at formalization and implementation stages.
        </p>
        <p>Development stage: conceptualization (application of mind maps):
 Top-down modelling style. The initial structure proposed by the customer, as well
as the Core Product Model (CPM).The group of analysts created the visual
generalized structural mockup of ontology as the mind map; this was done during few
iterations and based on discussions with customers. Figure 1 shows the current
version of the ontology mockup. It does not contain formalized relationships between
the concepts (edges have no labels) as it is dedicated to the presentation of the core
concept (“Artifact”) aspects of the artifact functioning in the company settings (in
nodes).
 Bottom-up style. Figure 2 shows the fragment of the filled ontology mockup for
the AU (base-mounted ERC series air compressor). Several important elements are
notable in this mind map:
─ New top-level element appeared (marked in gray): “Has connection”. This
element will further be added into the mockup.
─ Lover-level properties were detailed. For example, “Output” property was
detailed by three sub properties: “Noise”, “Free air delivery”, “Rated pressure”.
─ The lowest level values were added. For example, minimum and maximum
values in decibels are known for the “Noise” property.</p>
        <p>
          Development stage: formalization (application of spreadsheets) was performed
after mind-maps for approximately 50 AUs were created. Mind maps for different
AUs contained characteristics being sub properties of the same top-level property (for
example, ERC series air compressor has “Free air delivery” output characteristic; this
characteristic is air-related output, likewise “Air flow” in the other item).
Additionally, the same AUs’ characteristics can be named differently in different supplier
catalogues, thus, the table can help to catch the synonyms. Similar uses of the table for
ontology constructions were mentioned in [
          <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
          ]. Table 1 represents a fragment of
the table for base-mounted ERC series air compressor AU.
        </p>
        <p>Development stage: implementation (application of ontology editor) followed the
steps described in the previous section. Property hierarchy created at the previous step
was then transferred into OWL with the help of ontology editor (WEB PROTÉGÉ).
Figure 3 represents a fragment of ontological description for the ERC series air
compressor. Several Artifacts (AUs) were imported as instances with rdfs:label and
rdfs:description (when available) properties during instance creation. All quantitative
values were imported as instances with rdfs:label property and properties for values
and units of measurement. For example, ERC series air compressor has the “Free air
delivery” output property with the value range of 5.1 to 460 scfm. This will be
imported as an instance “5.1-460scfm” of the “Flow” class (subclass of
“QuantitativeValue” with data properties hasMaxValue (value: 460), hasMinValue (value: 5.1);
hasUnitCode (value: scfm).
Fig. 3. Fragment of the ontological description for the AU ERC series air
compressor in WEB PROTÉGÉ.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>The paper describes the new method of creating an enterprise knowledge graph.
Although the method has been tested on car assembly units, it may be used in other
spheres (for example, development of online stores, medicine, design, management,
etc.), where the knowledge graph has a complex property structure associated with
one class and its subclasses, and there is a little number of ontology classes. There is
often a need for group development and discussion during the development of
enterprise knowledge graph. Then the visualization of the graph allows faster and better
understanding for the team of developers. One of the main problems is lack of
information (or it is not always clear what is important), so it becomes necessary to discuss
some fragments of the knowledge graph with domain experts. The visual description
helps to focus the expert's attention on puzzling points and makes it easier to find
mutual understanding. The proposed methodology helped to create a pilot knowledge
graph that includes more than 50 assembly units and describes about 400 properties.</p>
    </sec>
    <sec id="sec-5">
      <title>Acknowledgement</title>
      <p>The work is partially supported by the Russian Foundation for Basic Research
(#1707-00228).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>B.</given-names>
            <surname>Villazon-Terrazas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Garcia-Santa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Ren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Srinivas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Rodriguez-Muro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Alexopoulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. Z.</given-names>
            <surname>Pan</surname>
          </string-name>
          ,
          <article-title>Construction of Enterprise Knowledge Graphs (I), Exploiting Linked Data and Knowledge Graphs in Large Organisations</article-title>
          , Cham: Springer (
          <year>2017</year>
          ),
          <fpage>87</fpage>
          -
          <lpage>116</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <given-names>R.</given-names>
            <surname>Studer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Benjamins</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Fensel</surname>
          </string-name>
          , Knowledge Engineering: Principles and
          <string-name>
            <surname>Methods</surname>
          </string-name>
          ,
          <source>Data and Knowledge Engineering</source>
          ,
          <volume>25</volume>
          (
          <year>1998</year>
          )
          <fpage>161</fpage>
          -
          <lpage>197</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>H.</given-names>
            <surname>Österle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Becker</surname>
          </string-name>
          , U. Frank,
          <string-name>
            <given-names>T.</given-names>
            <surname>Hess</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Karagiannis</surname>
          </string-name>
          , H. Krcmar, .... ,
          <string-name>
            <given-names>E. J.</given-names>
            <surname>Sinz</surname>
          </string-name>
          ,
          <article-title>Memorandum on design-oriented information systems research</article-title>
          ,
          <source>European Journal of Information Systems</source>
          ,
          <volume>20</volume>
          (
          <year>2011</year>
          ),
          <fpage>7</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>G.</given-names>
            <surname>Lyu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Chu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Xue</surname>
          </string-name>
          ,
          <article-title>Product modeling from knowledge, distributed computing and lifecycle perspectives: A literature review</article-title>
          , Computers in Industry,
          <volume>84</volume>
          (
          <year>2017</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>M. C. Suárez-Figueroa</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Gómez-Pérez</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Fernandez-Lopez</surname>
          </string-name>
          .
          <article-title>The NeOn Methodology for Ontology Engineering</article-title>
          , Ontology Engineering in a Networked World, Cham: Springer (
          <year>2012</year>
          ),
          <fpage>9</fpage>
          -
          <lpage>34</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>M.</given-names>
            <surname>Fernández-López</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gómez-Pérez</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>N.</given-names>
            <surname>Juristo</surname>
          </string-name>
          . METHONTOLOGY:
          <article-title>From Ontological Art Towards Ontological Engineering</article-title>
          ,
          <source>AAAI Technical Report SS-97-06</source>
          (
          <year>1997</year>
          ),
          <fpage>33</fpage>
          -
          <lpage>40</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sure</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Staab</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Struder</surname>
          </string-name>
          .nOn-
          <string-name>
            <surname>To-Knowledge</surname>
            <given-names>Methodology</given-names>
          </string-name>
          , Handbook on Ontologies, Cham.: Springer (
          <year>2004</year>
          ),
          <fpage>117</fpage>
          -
          <lpage>132</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>A.</given-names>
            <surname>Ohgren</surname>
          </string-name>
          and
          <string-name>
            <given-names>K.</given-names>
            <surname>Sandkuhl</surname>
          </string-name>
          .
          <article-title>Towards a Methodology for Ontology Development in Small and Medium-Sized</article-title>
          ,
          <source>IADIS International Conference on Applied Computing</source>
          (
          <year>2005</year>
          ),
          <fpage>369</fpage>
          -
          <lpage>376</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <given-names>M.</given-names>
            <surname>Uschold</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gruninger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Uschold</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Gruninger</surname>
          </string-name>
          . Ontologies: Principles, Methods and Applications, Knowl. Eng. Rev.,
          <volume>2</volume>
          (
          <year>1996</year>
          ),
          <fpage>93</fpage>
          -
          <lpage>136</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>V.</given-names>
            <surname>Presutti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Daga</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gangemi</surname>
          </string-name>
          , and E. Blomqvist,
          <article-title>eXtreme Design with Content Ontology Design Patterns</article-title>
          ,
          <source>Proc. Workshop on Ontology Patterns</source>
          (
          <year>2009</year>
          ),
          <fpage>83</fpage>
          -
          <lpage>97</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. E. Simperl,
          <string-name>
            <given-names>M.</given-names>
            <surname>Luczak-Rösch</surname>
          </string-name>
          ,
          <article-title>Collaborative ontology engineering: a survey</article-title>
          ,
          <source>The Knowledge Engineering Review</source>
          ,
          <volume>29</volume>
          (
          <year>2014</year>
          ),
          <fpage>101</fpage>
          -
          <lpage>131</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <given-names>H.</given-names>
            <surname>Paulheim</surname>
          </string-name>
          .
          <article-title>Knowledge Graph Refinement: A Survey of Approaches and Evaluation Methods, Semant</article-title>
          . Web,
          <volume>3</volume>
          (
          <year>2017</year>
          ),
          <fpage>489</fpage>
          -
          <lpage>508</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <given-names>B.</given-names>
            <surname>Zheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X. F. B.</given-names>
            <surname>Feng</surname>
          </string-name>
          ,
          <article-title>A survey of faceted search</article-title>
          ,
          <source>Journal of Web engineering</source>
          ,
          <volume>12</volume>
          (
          <year>2013</year>
          ),
          <fpage>41</fpage>
          -
          <lpage>64</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <given-names>Y.</given-names>
            <surname>Sure</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Erdmann</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Angele</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Staab</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Studer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Wenke</surname>
          </string-name>
          .
          <article-title>OntoEdit: Collaborative Ontology Development for the Semantic Web</article-title>
          .
          <source>Semant. Web ISWC</source>
          <year>2002</year>
          ,
          <volume>221</volume>
          -
          <fpage>235</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15. P. Křemen,
          <string-name>
            <given-names>P.</given-names>
            <surname>Mička</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Blaško</surname>
          </string-name>
          , and M. šmíd.
          <article-title>Ontology-driven mindmapping</article-title>
          .
          <source>Proc. 8th Int. Conf. Semant. Syst. - I-SEMANTICS '12</source>
          ,
          <string-name>
            <surname>September</surname>
          </string-name>
          (
          <year>2014</year>
          ),
          <fpage>125</fpage>
          -
          <lpage>134</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <given-names>S.</given-names>
            <surname>Jupp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Horridge</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Iannone</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Klein</surname>
          </string-name>
          ,
          <string-name>
            S. Owen,
            <given-names>... &amp; R.</given-names>
            <surname>Stevens</surname>
          </string-name>
          .
          <article-title>Populous: a tool for building OWL ontologies from templates</article-title>
          ,
          <source>BMC bioinformatics</source>
          ,
          <volume>1</volume>
          (
          <year>2012</year>
          ),
          <fpage>S5</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <given-names>D. L.</given-names>
            <surname>Rubin</surname>
          </string-name>
          .
          <article-title>Creating and curating a terminology for radiology: Ontology modeling and analysis</article-title>
          ,
          <source>J. Digit. Imaging</source>
          ,
          <volume>4</volume>
          (
          <year>2008</year>
          ),
          <fpage>355</fpage>
          -
          <lpage>362</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <given-names>Z.</given-names>
            <surname>Xiang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Zheng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Lin</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Y.</given-names>
            <surname>He</surname>
          </string-name>
          . Ontorat:
          <article-title>Automatic generation of new ontology terms, annotations, and axioms based on ontology design patterns</article-title>
          ,
          <source>J. Biomed. Semantics</source>
          ,
          <volume>1</volume>
          (
          <year>2015</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>10</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Fenves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Foufou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bock</surname>
          </string-name>
          , R. D. Sriram,
          <article-title>CPM2: a core model for product data</article-title>
          ,
          <source>Journal of computing and information science in engineering, 8</source>
          (
          <year>2008</year>
          ),
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <given-names>S.</given-names>
            <surname>Rachuri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Subrahmanian</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bouras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Fenves</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Foufou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. D.</given-names>
            <surname>Sriram</surname>
          </string-name>
          ,
          <article-title>Information sharing and exchange in the context of product lifecycle management: Role of standards</article-title>
          , Computer-Aided Design,
          <volume>40</volume>
          (
          <year>2008</year>
          ),
          <fpage>789</fpage>
          -
          <lpage>800</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>