<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Evaluation of Ontology Quality based on Analysis of Relations in Concept Lattices</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Bato Merdygeev</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sesegma Dambaeva</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>East Siberia State University of Technology and Management</institution>
          ,
          <addr-line>Ulan-Ude</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The paper presents an approach to evaluation of the quality of domain ontology. The approach is based on construction of concept lattice based on ontology relations. The approach allows to evaluate the completeness of the ontology relations. The result of this analysis helps to draw conclusions about the overall quality of the ontology.</p>
      </abstract>
      <kwd-group>
        <kwd>ontology</kwd>
        <kwd>domain</kwd>
        <kwd>ontology analysis</kwd>
        <kwd>concept lattice</kwd>
        <kwd>relation</kwd>
        <kwd>evaluating</kwd>
        <kwd>completeness of the ontology relations</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        In computer science, the term "ontology" means the formal representation of knowledge. It
is used as a form of knowledge representation of the real world, or part of it [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
Currently, many intelligent systems use ontology as a knowledge base. The effectiveness of
this system depends on the effectiveness of knowledge represented in the ontology.
Regardless of the type of ontology its creation is a laborious and expensive task. At the
same time there is a possibility to receive of ineffective product as a result in accordance
with the obsolescence of developed knowledge, priorities change with time or just give
incorrect or contradictory knowledge a part of the ontology. To avoid it is necessary to
evaluate the quality of ontology at every stage of its production. In the existing ontology
analysis methods are based on the expert evaluation. Experts in this case often act domain
experts or knowledge engineers. The main problem here is the amount of time required for
checking the quality of the ontology. Modern methods provide a variety of tools for
ontology analysis, but most of them are only effective in ontologies with a certain structure.
Therefore, a search for new approaches to the analysis of the quality of ontology of various
structures is needed.
      </p>
      <p>
        One such approach could be the approach to ontology evaluation, based on an analysis of
the relations between the terms of concept lattice. This approach analyzes the various
inconsistencies that are detected by comparing the basic structure of the relations of
ontology and concept lattices constructed on the basis of the same relations. Thus, the
approach makes it possible to calculate the completeness of the ontology relations.
We introduce some definitions of key terms used in paper on the basis of [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
The term is a sign of a special semiotic system, which is the minimum carrier of scientific
knowledge, and it is the short name of an established concept of having a definition.
Concept is knowledge, which is expressed by this term at the conceptual modeling domain.
According to [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] conceptual objects are divided as follows:




entities (tangible and intangible objects);
properties (quantitative, qualitative, relative);
actions (operations, processes, state);
dimensions (time, position, space).
      </p>
      <p>Conceptual relations are divided as follows:


quantitative relations (relations of identity, inclusion, exclusion, intersection, union);
qualitative relations (hierarchical and functional relations).
2</p>
    </sec>
    <sec id="sec-2">
      <title>Domain ontology</title>
      <p>
        In [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] the history of the sign in semiotics and logic was analyzed. Categories and their
design of signs representing them were defined on the basis of a pentagon of Nikitina S.E.,
described in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ], and the concept structure and classification of conceptual objects of
Dahlberg.
      </p>
      <p>This approach of building structures of signs of conceptual objects of Dahlberg as the main
categories of abstraction allows you to create a common conceptualization of the domain,
which will be able to understand the different systems.</p>
      <p>
        On the basis of this approach the basic design of structure of the terms of the domain
ontology, proposed in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], was created. Therefore the object of the analysis the studied
approach is the ontology built on the basis of this ontology. The ontology is represented in
this case in the form of groups of related terms, divided into categories: concept, action,
state, event, property, quantity. Each term is a vector structure, a certain term category. The
structure contains a full description of the term, including its name, relations to other terms
meta-signed representation, etc.
      </p>
      <p>Each term in this case is represented by a specific set of names, definitions and relations.
Categorical sign is a sign that represents the general structure of the term of a certain
category. Construction of categorical sign is represented as a vector of sets of definitions
and relations represented by the term. Each categorical sign corresponds to one category of
ontology terms.</p>
      <p>This representation of domain ontology introduces sematic differences between terms of
different categories, making this ontology structure semantically active.</p>
      <p>Consider some of the categorical construction signs and the possible relations between the
ontology terms.
"Concept" and "Action" categories have most semantic meaning in the ontological structure
than others.</p>
      <p>The design "Concept" sign is eight:</p>
      <sec id="sec-2-1">
        <title>The design of the "Action" sign is nine: Fig. 1. Graphic representation of "concept" sign</title>
        <p>
          (1)
(2)
Here the elements of t and a - the term name, the type of object and the conceptual view of
nature: material or immaterial. Most of the other data elements of the vectors represent the
relations between the terms. Set of substantial definitions (D) and methods metalinguistic
representation (M) in this case are not considered. Detailed design of categorical signs
presented in [
          <xref ref-type="bibr" rid="ref1">1</xref>
          ].
        </p>
        <p>Concerning types of conceptual relationships qualitative relations between ontology terms
can be classified as follows:
 hierarchy (abstract-concrete area)
 Concept-Concept (T)
 Action-Action (A)
 Property-Quantity (Q)
 aggregation (attachment area)
 Concept-Concept (T)
 Action-Action (A)
 Concept-State (S)
 State-Event (E)
 &lt;term&gt;-Property (P)
 functional (processuality area)
 Concept-Action (A, I)
 Concept-Action \ Action-Concept (SO)
 Action-Event (E)
 Event-State (S)
 Property-Quantity (Q)
 semiotic relations (area of content and form) relate to methods of metalinguistic
representation (M)</p>
      </sec>
      <sec id="sec-2-2">
        <title>Concept C, T</title>
      </sec>
      <sec id="sec-2-3">
        <title>Action</title>
      </sec>
      <sec id="sec-2-4">
        <title>Event P</title>
      </sec>
      <sec id="sec-2-5">
        <title>Quantity A, SO, I C, T</title>
        <p>E
Q
C
C
E, S</p>
      </sec>
      <sec id="sec-2-6">
        <title>Property S C</title>
      </sec>
      <sec id="sec-2-7">
        <title>State</title>
        <p>Also present quantitative relations in the ontology (the identity of the scope and correlation,
C). Analysis of these relations will determine the consistency of concepts and relations of
the ontology.</p>
        <p>Domain ontology contains a structured open data, which makes it possible to assess the
application of certain properties of formal concept analysis methods. Our study is to
analyze the relations within these structures through the use of concept lattices.
3
3.1</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>The approach to ontology evaluation</title>
      <sec id="sec-3-1">
        <title>The purpose of the analysis</title>
        <p>The purpose of the analysis of this approach is the completeness of the ontology relations.
This property shows the extent to which knowledge about the relations between domain
terms displayed in the ontology.</p>
        <p>To evaluate this property is necessary to determine whether the ontology relations complete
and consistent. In this paper, we consider only the qualitative relations.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Description of the approach</title>
        <p>The basis of the analysis is to find inconsistencies between the grid concepts, built on a
certain relation, and ontology relations.</p>
        <p>
          Analysis in accordance with the approach consists of several sequential steps (figure 4):
1. Select the type of term relation that you want to analyze. Every relation type has its
semantic meaning, so the result of the analysis is interpreted according to the selected
type.
2. Construction of concept lattices. On certain relations between the concepts of the lattice
constructed ontology terms where terms are considered categories are taken as objects
and attributes. The theme of constructing a formal context and concept lattice is
mentioned in a large number of works devoted to the FCA, such as [
          <xref ref-type="bibr" rid="ref10 ref11 ref12 ref13">10-13</xref>
          ] and etc.
This theme has been well studied. Depending on the relation type it is possible to use
different methods of constructing a formal context to maximize the effectiveness of
analysis.
3. Search lattice inconsistencies and the structure of the ontology relations. Here are
compared with corresponding lattice of concepts relating to the structure of the
ontology. A search of all relations, which are absent in the resulting lattice or structure
of ontology relations. When constructing lattices on the basis of terms between the
different categories of objects and attributes are taken in such a lattice terms of different
categories.
4. Analysis of the inconsistencies. This analysis is performed by an expert, however, can
be made automatically concluded terms with the greatest discrepancy coefficient, ie,
terms which are associated with greater inconsistencies.
Relations
`
Domain expert
        </p>
        <p>Inconsistencies analysis
Concept lattice building
Inconsistencies search</p>
        <p>Completeness of
ontology relations
By the terms of categorical signs exist qualitative relations that define some hierarchy of
terms relative to each other. However, only the terms of "Concept" and "Action" categories
are qualitative relations with the terms of its category.</p>
        <p>The relations between the terms of these categories can be divided into two types: relations
of one category (Сoncept-Сoncept, Action-Action) and relations between categories
(Сoncept- Action, Action-Сoncept). When looking for inconsistencies using both types of
relations, and they have different effects on the result of the analysis.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Relations of one category</title>
        <p>"Concept-Concept" and "Action-Action" relations have different semantics. However, they
are similar to the structure, so the relations are equivalent to the analysis of terms.
Consider the example of such relations "Class-Kind" between the terms of the "Concept"
category of ontology. Table 1 provides a formal context received on the relation.
In the construction of the formal context the known methods of its constructing can be
used. In this example, we use a simple method: all terms that do not take the role of "Class"
in any relations are formal objects, and other terms are formal attributes.
For example, in this example, fragment structure of " Class-Kind " relations of ontology is
as follows:



overland. Connected with:
 cow
 rabbit
 wolf
herbivorous. Connected with:
 rabbit
 cow
hoofed. Connected with:
 cow
From this it follows that the relation between the terms "overland" and "herbivorous" and
the relation between the terms "herbivorous" and "hoofed" obtained during the construction
of the lattice are absent in the source ontology (relations are marked in Figure 3). Thus, we
can infer the probability that the set of relations of the ontology is incomplete. Found
relations probably must be included in the ontology.</p>
        <p>Let the set of relations of a particular type of source ontology is TO, and the set of relations
derived from a concept lattice of relations of the same type is TR. Then the set of
inconsistencies relations of one category is defined as</p>
        <p>NT : TO\TR  TR\TO.
(3)
However, it should be separated by a set of lattice inconsistencies (NTR : TR\TO) and
ontology inconsistencies as they may have a different weight in determining the
completeness of the ontology relations.</p>
        <p>As a result, we get a lot of incredible inconsistencies. Such inconsistencies can be a great
multitude, which may confuse the expert. Therefore, relations between categories should be
considered.
"Concept-Action" and "Action-Concept" relations have different semantics. However, they
are similar to the structure, so the relations are equivalent to the analysis of terms.
Consider the example of such "Concept-Action" relation of ontology. Table 2 presents a
formal context received on the relation. Unlike the previous example, where the objects and
attributes are terms of the same category, in this case the objects are all terms of "Concept"
category, and attributes are terms of "Action" category.
Assume in this example in the initial ontology actions "moos", "jumps", "eats meat" and
"floats" are not connected qualitative relations between each other.</p>
        <p>It follows from this relation between the terms "eats meat" and "floats" and the relation
between the terms "jumps" and "moos" are absent in the source ontology and may be
included therein (the relation of marked in Figure 4).</p>
        <p>Let the union of qualitative relations of one category of original ontology is TOi, and the
set of relations derived from the concept lattice of relations of the same type is AR.
Then the set of inconsistencies of the relation is defined as</p>
        <p>NA : (TOi)\AR  AR\(TOi).
(4)
However, it should be separated by a sets of lattice inconsistencies (NAR : (TOi)\AR) and
ontology inconsistencies (NTO : AR\(TOi)) as they may have a different weight in
determining the completeness of the ontology relations.</p>
        <p>Unlike lattices of relations of one category in this case is not specified the type of relations
based on the qualitative, which searches for inconsistencies. On the basis of the terms of
relations with the other categories of construction abstract terms this category hierarchy.
Because of lack of a particular type of relations such inconsistencies have little weight in
the analysis, however, together with the inconsistencies obtained by relations of one
category define a more detailed analysis of the completeness of the ontology relations.
Thus, inconsistencies, which are available to the expert for consideration, determined by
N : NT  NA.</p>
        <p>(5)
As a result, the expert receives the set is not appropriate for the two parameters of relations.
This allows it to draw a conclusion about the completeness of the ontology relations.
4</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>Formal Concept Analysis provides additional opportunities for analysis of the ontology of
the model. Formal context and concept lattice allows sharing the concepts of the ontology
of individual relations, which provides a more detailed analysis of ontological knowledge.
The presented approach allows us to evaluate the coherence of concepts and relations of
ontology based concept lattice. Lattice allows you to identify the logical dependencies
based on the relations of one category or hidden depending based relations with the terms
of different categories.</p>
      <p>To develop an accurate and effective method for the analysis of completeness of ontology
relations requires further research relations and properties of the ontology. In this paper, we
considered only the basic relations on the terms of the "Concept" and "Action" categories.
For complete analysis there is needed for further study of the relations and the inclusion in
the analysis of the terms of other categories.</p>
      <p>At the moment, the approach is still under development. For further development of the
approach required to examine all possible relations between the terms of ontology. It is
necessary to determine the exact relations between the types of relations for a full analysis
of inconsistencies in the ontology and the completeness of the ontology relations.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Klesh</surname>
          </string-name>
          <article-title>'eva</article-title>
          <string-name>
            <given-names>A.S.</given-names>
            ,
            <surname>Shalfeeva</surname>
          </string-name>
          <string-name>
            <surname>E.A.</surname>
          </string-name>
          :
          <article-title>Classification of ontology properties. Ontologies and their classification</article-title>
          .
          <source>In: IACP</source>
          ,
          <year>2005</year>
          , 20 p.,
          <string-name>
            <surname>Preprint</surname>
          </string-name>
          , Vladivostok (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Naihanova</surname>
            <given-names>L.V.</given-names>
          </string-name>
          :
          <article-title>The technology of building methods for automatic construction of ontologies using genetic and automata programming</article-title>
          .
          <source>Monograph. BSC SB RAS</source>
          ,
          <volume>244</volume>
          p.,
          <string-name>
            <surname>Ulan-Ude</surname>
          </string-name>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Ganter</surname>
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wille R. Elliot H. Applied Lattice Theory: Formal Concept Analysis</surname>
          </string-name>
          . - http://citeseerx.ist.psu.edu/viewdoc/summary?doi
          <source>=10.1.1.42.9907</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Rudolf</given-names>
            <surname>Wille</surname>
          </string-name>
          :
          <article-title>Formal Concept Analysis as Applied Lattice Theory</article-title>
          .
          <source>In: CLA</source>
          <year>2006</year>
          , pp.
          <fpage>42</fpage>
          -
          <lpage>67</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Dambaeva</surname>
            <given-names>S.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Merdygeyev</surname>
            <given-names>B.D.</given-names>
          </string-name>
          :
          <article-title>Ontology structures: New Information Technologies and Systems (NITS-</article-title>
          <year>2014</year>
          ).
          <source>In: 11th International scientific-technical conference</source>
          , pp.
          <fpage>222</fpage>
          -
          <lpage>227</lpage>
          , PSU,
          <string-name>
            <surname>Penza</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Shalfeeva</surname>
            <given-names>E.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gribova</surname>
            <given-names>V.V.</given-names>
          </string-name>
          <article-title>The internal properties of ontology</article-title>
          .
          <source>In: SICPRO'05</source>
          . IV International conference. pp.
          <fpage>1109</fpage>
          -
          <lpage>1128</lpage>
          , Moscow (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Uta</given-names>
            <surname>Priss</surname>
          </string-name>
          <article-title>: Knowledge Discovery in Databases Using Formal Concept Analysis</article-title>
          .
          <source>In: Bulletin of the American Society of Information Science 27</source>
          , vol.
          <volume>1</volume>
          , p.
          <fpage>18</fpage>
          -
          <lpage>20</lpage>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Dahlberg</given-names>
            <surname>Ingetraud</surname>
          </string-name>
          :
          <article-title>Knowledge Organization: its scope and possibilities / Knowledge Organization: problems</article-title>
          and trends // Proceedings of Conference reports, Moscow (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Nikitina</surname>
            <given-names>S.E.</given-names>
          </string-name>
          :
          <article-title>Semantic analysis of the language of science</article-title>
          .
          <source>In linguistics material. Monograph. Book House "LIBROKOM"</source>
          , 146 p.,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Stumme</surname>
            <given-names>G.</given-names>
          </string-name>
          ,
          <article-title>Maedche A.: FCA-merge: Bottom-Up Merging of Ontologies //</article-title>
          <source>IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence</source>
          ,
          <fpage>2001</fpage>
          - https://www.researchgate.net/publication/2475502_FCA-Merge_
          <article-title>Bottom-up_merging_ of_ontologies</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Stumme</surname>
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cimiano</surname>
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hotho</surname>
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tane</surname>
            <given-names>J</given-names>
          </string-name>
          .:
          <article-title>Conceptual Knowledge Processing with Formal Concept Analysis</article-title>
          and
          <string-name>
            <surname>Ontologies</surname>
          </string-name>
          . - http://citeseerx.ist.psu.edu/viewdoc/ summary?doi=10.1.1.94.1946
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Wille</surname>
            <given-names>R.</given-names>
          </string-name>
          :
          <source>Restructuring Lattice Theory: An Approach Based on Hierarchies of Concepts In: I. Rival (ed.): Ordered sets. Reidel</source>
          , Dordrecht-Boston, p.
          <fpage>445</fpage>
          -
          <lpage>470</lpage>
          (
          <year>1982</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. Uta Priss:
          <article-title>Lattice-based Information Retrieval Knowledge Organization</article-title>
          . - http://www.upriss.org.uk/papers/ko00.pdf
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>