=Paper= {{Paper |id=Vol-1625/proposal1 |storemode=property |title=Evaluation of Ontology Quality based on Analysis of Relations in Concept Lattices |pdfUrl=https://ceur-ws.org/Vol-1625/proposal1.pdf |volume=Vol-1625 |authors=Bato Merdygeev,Sesegma Dambaeva |dblpUrl=https://dblp.org/rec/conf/cla/MerdygeevD16 }} ==Evaluation of Ontology Quality based on Analysis of Relations in Concept Lattices== https://ceur-ws.org/Vol-1625/proposal1.pdf
       Evaluation of Ontology Quality based on Analysis of
                  Relations in Concept Lattices

                             Bato Merdygeev1, Sesegma Dambaeva1
        1
         East Siberia State University of Technology and Management, Ulan-Ude, Russia
                             mainisjusticeone@gmail.com
                                     damseg@gmail.com


         Abstract. The paper presents an approach to evaluation of the quality of domain
         ontology. The approach is based on construction of concept lattice based on
         ontology relations. The approach allows to evaluate the completeness of the
         ontology relations. The result of this analysis helps to draw conclusions about the
         overall quality of the ontology.

         Keywords: ontology, domain, ontology analysis, concept lattice, relation,
         evaluating, completeness of the ontology relations


1        Introduction
In computer science, the term "ontology" means the formal representation of knowledge. It
is used as a form of knowledge representation of the real world, or part of it [1].

Currently, many intelligent systems use ontology as a knowledge base. The effectiveness of
this system depends on the effectiveness of knowledge represented in the ontology.
Regardless of the type of ontology its creation is a laborious and expensive task. At the
same time there is a possibility to receive of ineffective product as a result in accordance
with the obsolescence of developed knowledge, priorities change with time or just give
incorrect or contradictory knowledge a part of the ontology. To avoid it is necessary to
evaluate the quality of ontology at every stage of its production. In the existing ontology
analysis methods are based on the expert evaluation. Experts in this case often act domain
experts or knowledge engineers. The main problem here is the amount of time required for
checking the quality of the ontology. Modern methods provide a variety of tools for
ontology analysis, but most of them are only effective in ontologies with a certain structure.
Therefore, a search for new approaches to the analysis of the quality of ontology of various
structures is needed.

One such approach could be the approach to ontology evaluation, based on an analysis of
the relations between the terms of concept lattice. This approach analyzes the various
inconsistencies that are detected by comparing the basic structure of the relations of
ontology and concept lattices constructed on the basis of the same relations. Thus, the
approach makes it possible to calculate the completeness of the ontology relations.

We introduce some definitions of key terms used in paper on the basis of [10].

The term is a sign of a special semiotic system, which is the minimum carrier of scientific
knowledge, and it is the short name of an established concept of having a definition.
Concept is knowledge, which is expressed by this term at the conceptual modeling domain.

According to [1] conceptual objects are divided as follows:

       entities (tangible and intangible objects);
       properties (quantitative, qualitative, relative);
       actions (operations, processes, state);
       dimensions (time, position, space).

Conceptual relations are divided as follows:

     quantitative relations (relations of identity, inclusion, exclusion, intersection, union);
     qualitative relations (hierarchical and functional relations).

2        Domain ontology
In [2] the history of the sign in semiotics and logic was analyzed. Categories and their
design of signs representing them were defined on the basis of a pentagon of Nikitina S.E.,
described in [11], and the concept structure and classification of conceptual objects of
Dahlberg.

This approach of building structures of signs of conceptual objects of Dahlberg as the main
categories of abstraction allows you to create a common conceptualization of the domain,
which will be able to understand the different systems.

On the basis of this approach the basic design of structure of the terms of the domain
ontology, proposed in [2], was created. Therefore the object of the analysis the studied
approach is the ontology built on the basis of this ontology. The ontology is represented in
this case in the form of groups of related terms, divided into categories: concept, action,
state, event, property, quantity. Each term is a vector structure, a certain term category. The
structure contains a full description of the term, including its name, relations to other terms
meta-signed representation, etc.

Each term in this case is represented by a specific set of names, definitions and relations.
Categorical sign is a sign that represents the general structure of the term of a certain
category. Construction of categorical sign is represented as a vector of sets of definitions
and relations represented by the term. Each categorical sign corresponds to one category of
ontology terms.

This representation of domain ontology introduces sematic differences between terms of
different categories, making this ontology structure semantically active.

Consider some of the categorical construction signs and the possible relations between the
ontology terms.

"Concept" and "Action" categories have most semantic meaning in the ontological structure
than others.
The design "Concept" sign is eight:

                          𝐶𝑜𝑛𝑐𝑒𝑝𝑡 = < 𝑡, 𝐷, 𝑃, 𝐴, 𝐶, 𝑆, 𝑇, 𝑀 >                           (1)




                      Fig. 1. Graphic representation of "concept" sign

The design of the "Action" sign is nine:

                           𝐴𝑐𝑡𝑖𝑜𝑛 = < 𝑎, 𝐷, 𝑃, 𝑆𝑂, 𝐶, 𝐼, 𝐴, 𝐸, 𝑀 >                       (2)




                       Fig. 2. Graphic representation of "action" sign

Here the elements of t and a - the term name, the type of object and the conceptual view of
nature: material or immaterial. Most of the other data elements of the vectors represent the
relations between the terms. Set of substantial definitions (D) and methods metalinguistic
representation (M) in this case are not considered. Detailed design of categorical signs
presented in [1].
Concerning types of conceptual relationships qualitative relations between ontology terms
can be classified as follows:

    hierarchy (abstract-concrete area)
      Concept-Concept (T)
      Action-Action (A)
      Property-Quantity (Q)
    aggregation (attachment area)
      Concept-Concept (T)
      Action-Action (A)
      Concept-State (S)
      State-Event (E)
      -Property (P)
    functional (processuality area)
      Concept-Action (A, I)
      Concept-Action \ Action-Concept (SO)
      Action-Event (E)
      Event-State (S)
      Property-Quantity (Q)
    semiotic relations (area of content and form) relate to methods of metalinguistic
     representation (M)


                 Concept                  C, T


                               A, SO, I
                                                            S
                   Action           C, T

                                                                         State
                               E                                C
                                                 E, S
                   Event           C

                           P
                                                 Property
                                   C

                               Q
                Quantity


           Fig. 3. Diagram of the relations between the terms of categorical signs

Also present quantitative relations in the ontology (the identity of the scope and correlation,
C). Analysis of these relations will determine the consistency of concepts and relations of
the ontology.
Domain ontology contains a structured open data, which makes it possible to assess the
application of certain properties of formal concept analysis methods. Our study is to
analyze the relations within these structures through the use of concept lattices.

3        The approach to ontology evaluation
3.1      The purpose of the analysis

The purpose of the analysis of this approach is the completeness of the ontology relations.
This property shows the extent to which knowledge about the relations between domain
terms displayed in the ontology.

To evaluate this property is necessary to determine whether the ontology relations complete
and consistent. In this paper, we consider only the qualitative relations.

3.2      Description of the approach

The basis of the analysis is to find inconsistencies between the grid concepts, built on a
certain relation, and ontology relations.

Analysis in accordance with the approach consists of several sequential steps (figure 4):

1. Select the type of term relation that you want to analyze. Every relation type has its
   semantic meaning, so the result of the analysis is interpreted according to the selected
   type.
2. Construction of concept lattices. On certain relations between the concepts of the lattice
   constructed ontology terms where terms are considered categories are taken as objects
   and attributes. The theme of constructing a formal context and concept lattice is
   mentioned in a large number of works devoted to the FCA, such as [10-13] and etc.
   This theme has been well studied. Depending on the relation type it is possible to use
   different methods of constructing a formal context to maximize the effectiveness of
   analysis.
3. Search lattice inconsistencies and the structure of the ontology relations. Here are
   compared with corresponding lattice of concepts relating to the structure of the
   ontology. A search of all relations, which are absent in the resulting lattice or structure
   of ontology relations. When constructing lattices on the basis of terms between the
   different categories of objects and attributes are taken in such a lattice terms of different
   categories.
4. Analysis of the inconsistencies. This analysis is performed by an expert, however, can
   be made automatically concluded terms with the greatest discrepancy coefficient, ie,
   terms which are associated with greater inconsistencies.
                       Ontology                  Concept lattice building



                       Relations                 Inconsistencies search
                       `

                    Domain expert                Inconsistencies analysis


                                                      Completeness of
                                                     ontology relations


                              Fig. 4. Sequence of analysis steps

By the terms of categorical signs exist qualitative relations that define some hierarchy of
terms relative to each other. However, only the terms of "Concept" and "Action" categories
are qualitative relations with the terms of its category.

The relations between the terms of these categories can be divided into two types: relations
of one category (Сoncept-Сoncept, Action-Action) and relations between categories
(Сoncept- Action, Action-Сoncept). When looking for inconsistencies using both types of
relations, and they have different effects on the result of the analysis.

3.3     Relations of one category

"Concept-Concept" and "Action-Action" relations have different semantics. However, they
are similar to the structure, so the relations are equivalent to the analysis of terms.

Consider the example of such relations "Class-Kind" between the terms of the "Concept"
category of ontology. Table 1 provides a formal context received on the relation.

In the construction of the formal context the known methods of its constructing can be
used. In this example, we use a simple method: all terms that do not take the role of "Class"
in any relations are formal objects, and other terms are formal attributes.

            Table 1. Example of formal context

             G\M            hoofed     herbivorous      overland    predator
             Cow            X          X                X
             Rabbit                    X                X
             Wolf                                       X           X
             Piranha                                                X
Figure 3 shows a lattice of concepts on the formal context.
                              Fig. 5. Example of concept lattice

For example, in this example, fragment structure of " Class-Kind " relations of ontology is
as follows:

 overland. Connected with:
   cow
   rabbit
   wolf
 herbivorous. Connected with:
   rabbit
   cow
 hoofed. Connected with:
   cow

From this it follows that the relation between the terms "overland" and "herbivorous" and
the relation between the terms "herbivorous" and "hoofed" obtained during the construction
of the lattice are absent in the source ontology (relations are marked in Figure 3). Thus, we
can infer the probability that the set of relations of the ontology is incomplete. Found
relations probably must be included in the ontology.

Let the set of relations of a particular type of source ontology is TO, and the set of relations
derived from a concept lattice of relations of the same type is TR. Then the set of
inconsistencies relations of one category is defined as

                                     NT : TO\TR  TR\TO.                                    (3)

However, it should be separated by a set of lattice inconsistencies (NTR : TR\TO) and
ontology inconsistencies as they may have a different weight in determining the
completeness of the ontology relations.

As a result, we get a lot of incredible inconsistencies. Such inconsistencies can be a great
multitude, which may confuse the expert. Therefore, relations between categories should be
considered.
3.4      Relations between categories

"Concept-Action" and "Action-Concept" relations have different semantics. However, they
are similar to the structure, so the relations are equivalent to the analysis of terms.

Consider the example of such "Concept-Action" relation of ontology. Table 2 presents a
formal context received on the relation. Unlike the previous example, where the objects and
attributes are terms of the same category, in this case the objects are all terms of "Concept"
category, and attributes are terms of "Action" category.

       Table 2. Example of formal context

       G\M             moos          jumps              eats meat      floats
       Cow             X             X
       Rabbit                        X
       Wolf                          Х                  X
       Piranha                                          X              X
       overland        Х             Х                  Х
       herbivorous     Х             Х
       Hoofed          Х             Х
       predator                      Х                  Х              Х
Figure 4 shows concept lattice of the formal context.




                              Fig. 6. Example of concept lattice

Assume in this example in the initial ontology actions "moos", "jumps", "eats meat" and
"floats" are not connected qualitative relations between each other.

It follows from this relation between the terms "eats meat" and "floats" and the relation
between the terms "jumps" and "moos" are absent in the source ontology and may be
included therein (the relation of marked in Figure 4).

Let the union of qualitative relations of one category of original ontology is TOi, and the
set of relations derived from the concept lattice of relations of the same type is AR.
Then the set of inconsistencies of the relation is defined as

                                     NA : (TOi)\AR  AR\(TOi).                            (4)

However, it should be separated by a sets of lattice inconsistencies (NAR : (TOi)\AR) and
ontology inconsistencies (NTO : AR\(TOi)) as they may have a different weight in
determining the completeness of the ontology relations.

Unlike lattices of relations of one category in this case is not specified the type of relations
based on the qualitative, which searches for inconsistencies. On the basis of the terms of
relations with the other categories of construction abstract terms this category hierarchy.

Because of lack of a particular type of relations such inconsistencies have little weight in
the analysis, however, together with the inconsistencies obtained by relations of one
category define a more detailed analysis of the completeness of the ontology relations.

Thus, inconsistencies, which are available to the expert for consideration, determined by

                                              N : NT  NA.                                  (5)

As a result, the expert receives the set is not appropriate for the two parameters of relations.
This allows it to draw a conclusion about the completeness of the ontology relations.

4        Conclusion
Formal Concept Analysis provides additional opportunities for analysis of the ontology of
the model. Formal context and concept lattice allows sharing the concepts of the ontology
of individual relations, which provides a more detailed analysis of ontological knowledge.

The presented approach allows us to evaluate the coherence of concepts and relations of
ontology based concept lattice. Lattice allows you to identify the logical dependencies
based on the relations of one category or hidden depending based relations with the terms
of different categories.

To develop an accurate and effective method for the analysis of completeness of ontology
relations requires further research relations and properties of the ontology. In this paper, we
considered only the basic relations on the terms of the "Concept" and "Action" categories.
For complete analysis there is needed for further study of the relations and the inclusion in
the analysis of the terms of other categories.

At the moment, the approach is still under development. For further development of the
approach required to examine all possible relations between the terms of ontology. It is
necessary to determine the exact relations between the types of relations for a full analysis
of inconsistencies in the ontology and the completeness of the ontology relations.
References
1. Klesh’eva A.S., Shalfeeva E.A.: Classification of ontology properties. Ontologies and
    their classification. In: IACP, 2005, 20 p., Preprint, Vladivostok (2005)
2. Naihanova L.V.: The technology of building methods for automatic construction of
    ontologies using genetic and automata programming. Monograph. BSC SB RAS, 244
    p., Ulan-Ude (2008)
3. Ganter B., Wille R. Elliot H. Applied Lattice Theory: Formal Concept Analysis. –
    http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.42.9907
4. Rudolf Wille: Formal Concept Analysis as Applied Lattice Theory. In: CLA 2006,
    pp.42-67 (2006)
5. Dambaeva S.V., Merdygeyev B.D.: Ontology structures: New Information
    Technologies and Systems (NITS-2014). In: 11th International scientific–technical
    conference, pp. 222-227, PSU, Penza (2014)
6. Shalfeeva E.A., Gribova V.V. The internal properties of ontology. In: SICPRO'05. IV
    International conference. pp. 1109-1128, Moscow (2005)
7. Uta Priss: Knowledge Discovery in Databases Using Formal Concept Analysis. In:
    Bulletin of the American Society of Information Science 27, vol. 1, p. 18-20 (2000)
8. Dahlberg Ingetraud: Knowledge Organization: its scope and possibilities / Knowledge
    Organization: problems and trends // Proceedings of Conference reports, Moscow
    (1993)
9. Nikitina S.E.: Semantic analysis of the language of science. In linguistics material.
    Monograph. Book House "LIBROKOM", 146 p., Moscow (2010)
10. Stumme G., Maedche A.: FCA-merge: Bottom-Up Merging of Ontologies // IJCAI'01
    Proceedings of the 17th international joint conference on Artificial intelligence, 2001 -
    https://www.researchgate.net/publication/2475502_FCA-Merge_Bottom-up_merging_
    of_ontologies
11. Stumme G., Cimiano P., Hotho A., Tane J.: Conceptual Knowledge Processing with
    Formal Concept Analysis and Ontologies. – http://citeseerx.ist.psu.edu/viewdoc/
    summary?doi=10.1.1.94.1946
12. Wille R.: Restructuring Lattice Theory: An Approach Based on Hierarchies of Concepts
    In: I. Rival (ed.): Ordered sets. Reidel, Dordrecht-Boston, p. 445-470 (1982)
13. Uta Priss: Lattice-based Information Retrieval Knowledge Organization. –
    http://www.upriss.org.uk/papers/ko00.pdf