Semantic analysis of textual information is a problem that does not lose its relevance. It has to be solved when solving such tasks as automation of filtering, classification, and clustering of text documents, automation of abstracting a given text, automation of evaluation of answers to open test tasks, automatic construction of a semantic network for a given text, etc.
All such tasks are limited to quantifying the elements of a text document and the relationships between them.
Many quantitative characteristics approaches are essentially parsing because they use a frequency approach based on the number of occurrences of keywords. Some techniques use the conversion of texts into real number vectors and the use of the mathematical apparatus of vector algebra to quantify the corresponding text documents. Such approaches are also reduced to the number of occurrences of certain keywords or comparison with a templatethe basic body of textual information. This paper will use semantic analysis based on an inverse-additive metric that takes into account the semantic distance between ontology terms in the text document being analyzed. This metric allows you to correctly process cases where there are several paths in the oriented graph of the ontology from one concept node to another. Semantic analysis will be considered for scientific documents, as such texts have a clear structure. To do this, introduce the concept of semantic distance between the terms of a scientific text and the semantic weight of a scientific text. The semantic weight of individual fragments of a scientific text will be used to solve the problem of automatic abstracting. word vectors are grouped and associated according to the morphological features of Ukrainian language suffixes have been studied. [19] describes the use of generating grammars in linguistic modeling. To automate the study and synthesis of natural language texts, sentence syntax analysis is used. The main differences in the grammatical and phonetic structure of English and Ukrainian languages are analyzed. The optimal method of automatic processing of the text set of Ukrainianlanguage content in relation to essential keywords and identification of content categories, analysis of syntax, and semantics of the text is determined. Article [20] defines the specification language for high-level testing scenarios for testing critical systems based on the built-in Uppaal Timed Automata model. The scalability of the method is demonstrated by the example of satellite software testing.
[21] describes the web system developed by the authors to visualize the structure of the ontology data. The creation of the system of visualization of ontologies of the subject area on the example of ontology models is described in detail. The system provides tools for a dynamic display of different types of ontographs in accordance with the established visualization criteria, which allows their use in information systems for the operational management of objects. creation of a system of visualization of ontologies of the subject area on the example of ontology models. Here is an example of visualizing the concept of "computer network attack". [22] describes the developed system of production environment management, which simplifies the process of analyzing a large amount of information from different sources. [23] describes the results of a study of the process of forming a semantic core for a web resource. The study expands the concept of the semantic network based on four components: URI, ontology, data, and semantic language. This concept is implemented in the work with the help of the semantic core. The core is formed on the principle of annotation based on an algorithm based on the semantic network and the method of Data Mining technology. Thus, an alternative implementation of Semantic Web components is proposed. The RDF scheme is used to represent the semantic core. The software is implemented using JavaScript using the Node JS library. [24] describes an approach based on the fact that ontology is a mechanism for obtaining information on the Internet in a more structured way using the semantic network. The focus is on choosing the presentation of documents suitable for creating user-profiles and supporting the content-based search process. The semantic web solves this problem, makes data understandable by machines in the form of an ontology, and the multi-agent extracts useful knowledge hidden in this data and makes it available. [25] describes the ontological decision support system in automated military control systems. The core of the system is an ontology that combines three levels: 1) an ontology focused on the domain, subject area -contains the concept of taxonomy, relationships, instances of classes, and different types of constraints -axioms. Axioms establish semantic rules for the system of relations; 2) task-oriented ontology -describes the solution of specific problems, contains knowledge of the specifications of structures (databases) and methods of data processing; 3) ontology of the upper level -describes the categories -the concept of the upper level. Examples are physical, functional, and behavioral concepts and attitudes that relate to general scientific concepts. A decision support system has been developed -a prototype of an automated control system for the Land Forces of the Armed Forces of Ukraine according to the standards of NATO member countries. In [26] the authors describe their unique technology of organizing data warehouses on the basis of consolidated data from libraries, archives, and museums. The technology is based on multidimensional data analysis and building a data hypercube. This technology is interesting because in combination with the semantic analysis of textual information will simplify and increase the efficiency of the social and communication environment in general and information processing technologies in it. [27] describes the developed system of automated compilation and formation of digests of electronic publications in the media, the selection of critical content from one or more documents, and the formation of concise reports based on them. The system monitors information, receives large amounts of data, analyzes, organizes data using an automatic header, collects information, indexes material and stores it in a database, solves thematic filtering, and generates digests automatically. [28] describes the developed unified methodology for processing information resources in e-content commerce systems. A formalized method of content analysis is used, which allows you to fully automate the process that occurs when an author adds a new article. The method identifies articles whose topics are similar to those viewed by the user.
The inverse-additive metric [29] allows calculating the distance between ontology concepts in the case when there are several paths from one concept to another. Consider the representation of ontology concepts and the relationships between them in the form of an oriented graph. Then each concept will correspond to a certain node. If the ontology is organized in the form of an explanatory dictionary, then each term is a keyword and its interpretation; and the text of the interpretation contains keywords -references to other terms. This is the reason for the existence of several paths from one node to another in the oriented graph of the ontology.
Define the distance R(A, B) between the concepts A and B as follows:
where π πis the number of transitions from concept A to concept B on the i-th path, π=1, β¦, πΎ, πΎis the number of different paths that can be taken on the oriented graph of a particular ontology from concept A to concept B.
If there is a single path between concepts A and B, then the distance between them is equal to the number of transitions from one concept to another:
The more paths there are between concepts, the smaller the distance will be, that is, the semantically closer the corresponding terms will be.
It is proved that this definition satisfies the axioms of the metric. Note that a pair of complementary symmetric connections must be introduced for the axiom of symmetry. For example, for an explanatory dictionary ontology, it is a pair of "uses-of" -used-in relationships, which allows the symmetry axiom to be met for the proposed metric in the following interpretation:
Scientific texts have a clear hierarchical structure, as shown in Fig. 1. Here: Level 1 -the name of the document (root node); Level 2 -authors, keywords, abstract, sections, list of sources used. Information content of this level: list of authors, list of keywords, the text of the annotation, titles of sections, names of used sources;
Level 3 -sections. Information content of this level: the names of sections. Other levels are possible.
Level N -sentences. Information content of level N: words that are part of one sentence.
Paper title Level 1: Consider the problem of calculating the semantic distance between two terms A and B from the ontology, which are in some text. That is, the ontology contains these terms as concepts A and B. The distance R(A, B) between these concepts in the ontology is determined by the formula (1).
The distance between two terms in a scientific text should be defined to take into account the following. 1) Repeated occurrence of each of these terms in the scientific text. 2) The hierarchical structure of the document. 3) The presence of many paths from each occurrence of the term A to each occurrence of the term B. 4) The distance between the corresponding concepts of these terms in the ontology.
where π (π΄, π΅)is the semantic distance between the terms A and B from the ontology in the scientific text;
π π΄the number of occurrences of the term A in the scientific text; π π΅the number of occurrences of the term B in the scientific text; π (π΄ π , π΅ π )is the semantic distance between π΄ πthe i-th instance of the term A, and π΅ πthe k-th instance of the term B from the ontology in the scientific text.
It is necessary to consider in what places of the text there are the specified terms.
Consider the example shown in Fig. 2. Suppose that in the ontology used to evaluate a scientific text, the distance between concepts A and B is L. Assume that in the text under study, the term A (the keyword of concept A) is contained only in sentence 1 (see Fig. 2). Suppose also that the term B (concept keyword B) is contained in the same sentence 1, the title of subsection 2, the list of keywords 5, and the sentence of another section 8 (Fig. 2). Thus, there are K = 4 different paths from term A to term B in the graph of the hierarchical structure of this text:
According to formula (1):
Thus, the more occurrences of ontology terms in a scientific text, the smaller the semantic distance between them.
For the semantic analysis of scientific texts, it is necessary to define the concept of semantic weight. The semantic weight SW of a scientific text relative to a certain ontology is the sum of the inverse distances between all terms of the ontology in the scientific text:
where π (π΄, π΅)is the semantic distance between the terms A and B from ontology in a scientific text (4). Thus, the more terms there are in a scientific text (or its fragment) and the smaller the semantic distance between them -the greater the semantic weight of this text (fragment).
The inverse value can be considered as the semantic size of a scientific text (then the semantic size will have the same dimension as the semantic distance).
Semantic analysis of scientific texts based on semantic weight (5) will solve the problem of automatic abstracting based on the selection of sentences (paragraphs) with the highest semantic weight.
To do this, first define the sentence π πππ₯ ππ with the largest semantic weight:
where π (π΄ π , π΅ π )is the semantic distance between the terms π΄ π and π΅ π from the ontology in the sentence s of the scientific text (4).
ππ(π )is the semantic weight of the sentence s. Next, we determine the degree of compression π in automatic abstracting: the result of π πππ π’ππ‘ will include those sentences whose semantic weight differs from the maximum by no more than π:
π πππ π’ππ‘set of sentences, the result of automatic abstracting; ππ(π πππ₯ ππ )the maximum semantic weight of a sentence in a scientific text. Thus, automatic abstracting will be implemented as a selection of sentences and compression of the scientific text in 1/π times relative to the initial number of sentences based on their semantic weight.
The algorithm for calculating the distance between two concepts of ontology is based on the calculation of the maximum flow between two given nodes of an oriented graph (Ford-Fulkerson method [30]).
Consider the ontology of computer science terms. The fragment of the corresponding owl file has the form shown in Fig. 3. Parsing the owl ontology file will reveal the connections between the concepts. The Computer Science Ontology is an explanatory dictionary that contains a set of terms, each term being a <keyword, definition> pair. The Individuals section of the ontology will be of interest to us in the first place because it contains the definition of terms. The definition of each concept term begins with the tag owl:NamedIndividual, its identifier is contained in the rdf:about attribute. A subsection that begins with the keyword tag contains the keyword of the term, and a subsection that begins with the definition tag contains its definition. Concepts related to the current term "uses-of" are listed in subsections that correspond to UsesOf tags, and their identifiers are the value of the rdf:resource attribute. The terms-concepts associated with the current used-in concept are listed in the subsections that correspond to the UsedIn tags, and their identifiers are also the value of the rdf:resource attribute. Thus, the "uses-of" relationship between the terms of the ontology can be schematically depicted as follows (Fig. 4): To calculate the distance between two terms-concepts of ontology, one must find all the ways from one concept to another. To do this, solve the traffic flow problem in an oriented ontology graph from the source node corresponding to the first concept to the receiving node corresponding to the second concept.
To simplify the calculations, discard all paths with a length of more than 4 transitions. Such paths will not be essential for calculating the semantic size of the text.
The algorithm is implemented by means of C#, Neo4j database is used to store intermediate results.
The SDIO (Semantic Distance In Ontology) function gets the ID of two terms:
public async Task<decimal> SDIO(long from, long to)
We need to get the number of paths from one term to another in an ontology with a certain number of transitions (from one to four):
The result of the developed program is verified on the example of an ontology formed based on an explanatory dictionary of computer science [31]. Since the created program has a Ukrainian-language interface, the English translation of the inscriptions on the controls is provided with the help of notes.
The text from Wikipedia, the article "Computer programming" (Fig. 6) was used for testing: The result: 30394.102 is a very large number. This means that such a text really applies to the field of "Computer Science" (Fig. 7). For comparison, we test a text that is not related to computer sciencean article about coffee (Fig. 10).
The result is 1,999a very small number, which means that the analyzed text does not belong to the field of relevant ontology.
The implementation of these algorithms should take into account cases where the ontology graph contains "critical nodes", which are the intersections of different from one concept term to another.
Consider the case where there is a "crossroads" of paths leading from one concept of ontology to anotherthat is, a "crossroads" of paths between nodes of the oriented ontology graph.
Assume that the distance between nodes A and E along the path that passes through node B is N1; the distance between A and E through nodes C and D is equal to N2; the distance between E and I through nodes F, G is equal to N3; the distance between E and I through H is N4 (Fig. 11):
Here, node E is critical because it is the "crossroads" of the A-B-E-H-I and
The second way is to consider each path independently of the others, ignoring the "crossroads": Thus, the presence of critical nodes-"crossroads" does not allow the use of formula (1) to calculate the distance between the concepts of ontology in a way that ignores such critical nodes. Therefore, the algorithm for detecting nodes-"crossroads" will be significant.
A critical node is a node that corresponds to a single minimum section of the graph, i.e. the smallest section is equal to 1. The problem of finding the smallest section of the graph is twofold to the problem of the largest flow [30].
This paper proposes a method of semantic analysis based on inverse-additive metrics, which takes into account the semantic distance between the terms of the ontology in the text document being analyzed. This metric allows you to correctly process cases where there are several paths in the oriented graph of the ontology from one concept node to another.
Semantic analysis of scientific documents is considered, as such texts have a clear structure. The concept of semantic distance between the terms of a scientific text and the semantic weight of a scientific text is introduced. The semantic weight of individual fragments of a scientific text can be used to solve the problem of automatic abstracting. Some of the difficulties in implementing the proposed approach related to critical nodes on the path in the oriented ontology graph from one concept node to another are discussed.
for (int i = 0; i < 4; i++) { var countResult = await session.RunAsync( _transactions.GetCountOfTransitions(from, to, i) ); var record = await countResult.SingleAsync(); var count = (long)(record.Values.Single().Value); dictionary.Add(i + 1, count); }
We write down the results in the dictionary, with the keythe number of transitions. After obtaining the number of paths between terms, calculate their distance in the ontology: var N = 0m; foreach (var item in dictionary.Keys) { N += dictionary[item] / item; } var L = 1m / N; Lthe result of calculations, the result of the function. For optimization, you can save the results of calculating the distance between a pair of terms, because the distance between the terms of the ontology does not change often (only when editing the ontology). At the beginning of the algorithm, we will check whether the algorithm has already been executed for this pair of terms, if so, we will return the result, without re-execution.
The calculation of the distance between two terms from the ontology in the scientific text will be based on the calculation of the sum of pairwise distances between each occurrence of these terms in the scientific text.
The SDIT (Semantic Distance In the Text) function gets two terms, between which you need to find the distance and structured text (an object in which paragraphs and sentences are clearly separated, as well as the terms used in it). Terms are passed using their ID. Text structuring is implemented using regular expressions. We obtain the semantic distance between these terms in the ontology: var L = await SDIO(from, to);
We will record the results in a collectiona dictionary, the keys of which will be the number of transitions between terms from the text:
Implementation of the calculation of the number of transitions between terms in the text: Rethe result of the functionthe semantic distance between terms in the text.
Semantic weight is the sum of the inverse distances between all ontology terms in a scientific text.
The SWOT (Semantic Weight Of the Text) function gets structured text:
Implementation is quite simple, as all the necessary algorithms have already been implemented. All you need to do is find the semantic distances between each pair of terms in the text and sum up the inverse values.
First, we get all the terms:
These algorithms can be used to solve the problem of automatic abstracting of texts. To do this, select fragments of text (sentences, paragraphs) with the greatest semantic weight.