<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Parametric Adjectives in the Context of Sentiment Analysis</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>St. Petersburg State University</institution>
          ,
          <addr-line>Universitetskaya Emb. 7/9, 199034 St. Petersburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>1987</year>
      </pub-date>
      <fpage>0000</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>This paper presents preliminary corpus-based research of special words of the Russian language - parametric adjectives. Parametric adjectives are adjectives whose semantics are associated with the denotation of physical parameters such as size, length, width. Characteristics of parametric adjectives seem to be poorly investigated from the perspective of Sentiment analysis. Therefore, our research is the first step in this direction. We identify and classify the most common contexts for adjectives belonging to four semantic classes such as size, height, weight, and strength.</p>
      </abstract>
      <kwd-group>
        <kwd>parametric adjectives</kwd>
        <kwd>sentiment-related words</kwd>
        <kwd>sentiment analysis</kwd>
        <kwd>the Russian language</kwd>
        <kwd>Yandex</kwd>
        <kwd>Market</kwd>
        <kwd>customers' product reviews</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>In recent years, the Internet is rapidly developing, including its Russian-speaking
segment. In our daily life we face a variety of opinions every day: we read reviews
before we buy anything, click “like” button, write comments, read news. We are
surrounded by the world of opinions, the world of rating. Society in the modern world is
highly exposed to the evaluation activity both in culture and discourse. This
phenomenon has become so widespread and has made essential the need for its careful
exploration, using the analysis of the sentiment-related words of the Russian language.
Different sciences are engaged in research on sentiment analysis: from philosophy
and axiology to psychology, political science and linguistics. Linguistics studies the
means for opinion and sentiment expression in text and speech at all levels of the
language system: phonetics, morphology, lexicology, and syntax.</p>
      <p>Opinions and sentiment can be expressed most clearly and fully on the lexicology
level. Sentiment-related words can explicitly express positive or negative sentiment in
a text or speech.</p>
      <p>
        Sentiment analysis is one example of the practical use of sentiment-related
words [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Sentiment analysis is one of the areas of computational linguistics, which
deals with the task of identifying positive and negative opinions, feelings and
emotions of people in relation to various objects. Sentiment analysis allows to know not
what people say about an object, but how emotionally they talk about it [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
      </p>
      <p>One of the most numerous classes of sentiment-related words is adjectives. Among
evaluative adjectives, parametric adjectives occupy a special place. Parametric
adjectives are adjectives whose semantics are associated with the denotation of physical
parameters such as size, length, width. Parametric adjectives in Russian are
qualitative adjectives with a nominative size value.</p>
      <p>This class of words deserves a separate study, since they form a lexico-semantic
class of words, which has distinctive features:
1. They form antonymic pairs, expressing opposite values on the same mental scale.</p>
      <p>For example, bolshoy (big) - malenkiy (small), vysokiy (high) - nizkiy (low),
uzkiy (narrow) - shirokiy (wide).
2. Parametric adjectives can reverse their polarity depending on the context.
As for the first point, the semantics of parametric adjectives are based on the idea of
the parameter of objects as a quantity whose values serve to distinguish between
objects of a certain subclass.</p>
      <p>
        Words marking the extreme elements of the mental scale can be defined as
follows: for example, large – “one that is larger than normal”, low – “one that is lower
than normal” [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>Very often, the use of one or another parametric adjective is subjective, since there
is no measurement standard. A person, depending on the situation, can choose his
own standard. Thus, different persons can use words with the opposite meanings,
describing the same objects in the same situations. For one person, the volume level
may seem high, and for another person it may be low.</p>
      <p>The second feature is related to the fact that parametric adjectives are able to
change their polarity to the opposite, depending on which aspect they relate to. For
example, the adjective “small” has a positive polarity in combination with the “price”
aspect and a negative polarity in combination with the “memory capacity”. In this
case, subjectivity cannot be avoided too. For example, two people can consider an
object small (for example, a tea-pot), but for one it will be a positive moment, and for
another it will be negative.</p>
      <p>In our study, we will focus on the study of the reverse polarity. The relevance of
the study is determined, on the one hand, by its belonging to the field of cognitive
linguistics. And on the other hand, by the applied aspect, namely the possibility of
using the results of research in Sentiment analysis systems in order to improve the
quality of analysis. The purpose of the article is to analyze and systematically
represent the most frequent contexts of parametric adjectives, indicating their most
probable polarity in these contexts on the material of product reviews. All of the above
makes the task of the parametric adjectives contexts study very relevant now.
2</p>
    </sec>
    <sec id="sec-2">
      <title>The studies of parametric vocabulary</title>
      <p>There are many studies of parametric vocabulary, and basically most of them have
been conducted in terms of comparative linguistics, cognitive linguistics,
linguoculturology or psycholinguistic.</p>
      <p>
        Mikheeva S.L. in her study [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] considers parametric adjectives as the linguistic
embodiment of the measurement system used by people. She claims that the semantic
basis of these adjectives is connected with the acceptance of a person as a standard of
measurements. For example, for a pair big-small the standard is the body itself, for a
pair high-low – the height of a person, for a pair heavy-light – one that is
difficult/easy for person to lift. Therefore, parametric adjectives are anthropocentric in
nature.
      </p>
      <p>
        In the work [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] it is shown that the secondary semantic of the parametric adjectives
is the expression of the good/bad opposition. For example, adjectives denoting large
sizes express a positive assessment, adjectives denoting small sizes express a
negative. This is due to the primary value of axiological potencies. The complexity of the
analysis of assessment values is due not only to a higher level of abstraction, but also
to the fact that the assessment modality is determined by the statement as a whole,
and not by its individual elements.
      </p>
      <p>
        The article [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] is devoted to the study of the characteristics of the use of
parametric adjectives in the English, Bashkir and Russian languages in a comparative aspect.
The main aim of this research is to characterize the features of interpersonal
communication, to identify moral, ethical, axiological and other attitudes of native speakers
of Bashkir, Russian and English in the framework of their practical life not only in
society, but also in the family.
      </p>
      <p>
        The paper [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] focuses on the cognitive aspect of the parametric vocabulary that
reflect how a person measures, evaluates, classifies certain phenomena, events and
objects of the real world. This research is devoted to the study of the process of
parametric adjectives acquisition by a child. The article shows semantic and structural
characteristics of parametric adjectives of the Russian language on the example of adjectives
‘large’, ‘high’, ‘long’, ‘short’, ‘small’, ‘low, thick’, ‘thin’, ‘narrow’, ‘wide’, as well as
synonymous series formed by these adjectives.
      </p>
      <p>
        M.S. Achaeva in her work [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] studies parametric adjectives ‘wide’ and ‘narrow’ in
Russian and English. In both languages, this pair of words is a representative of the
category of space and has a complex semantic structure in terms of lexical
compatibility, as well as a high metaphor for its meanings.
      </p>
      <p>
        The article [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] raises another question related to parametric adjectives – the
question of a parametric norm. The main element of the content of the parametric norm is
the idea of the average degree of the parameter evaluated from the point of view of
norm. The parametric norm is the middle part of the scale of the development of a
process or manifestation of a sign, and its mismatch is associated with two extreme
points: ‘not enough’ and ‘too much’. For example, non-compliance with a parametric
quantitative norm arises due to its lack (small) or excess (many).
      </p>
      <p>We were able to find only a small number of works studying parametric
vocabulary from the perspective of applied linguistics.</p>
      <p>
        The study [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] attempts a preliminary systematized description of parametric
vocabulary, focused on the parametric information extraction in the future. This paper is
devoted to Russian parametric adverbs. The author suggests that the features of
parametric adverbs seem to be much less investigated (in particular, in the perspective of
information extraction) than those of parametric nouns, adjectives, and verbs. The
article identifies eight main groups of adverbs, that are able to express the quantitative
meaning. Also, some connections with more studied classes of parametric vocabulary
(adjectives, nouns) are shown in this article.
      </p>
      <p>
        In the paper [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] the main features of parametric vocabulary in the analysis of
banking services opinions are studied. For this research the authors have used the material
of customer reviews on the quality of banking services. On the material of these
reviews, contexts for words ‘large’, ‘small’, ‘long’, ‘fast’, ‘maximum’, ‘minimum’,
(and some others) were extracted.
      </p>
      <p>The research results show that parametric words can expresses the opinion
implicitly. Some of the parametric vocabulary may be assigned to one of the main classes:
positive or negative. Such classification is specific to the given subject sphere. And
some of the parametric vocabulary refers to the auxiliary classes (increments,
decrements, modifiers).</p>
      <p>Increments are words that enhance the polarity of other words in a sentence (for
instance, ‘very’). Polarity modifiers are words that reverse the polarity of other words in
a sentence (for instance, ‘not’). Decrements are words that cancel the change in
polarity, despite the presence of polarity modifiers in the sentence (for example, the word
‘so’ in the sentence “I’ve never been so deceived”).</p>
      <p>Parametric adjectives sense disambiguation task is similar to the well-known word
polarity disambiguation task which aims to resolve polarity of the sentiment
ambiguous words in a specific context.</p>
      <p>
        One of the first appearances of the disambiguating word polarity task was in
competition SemEval-2010 [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. The participants were asked to predict polarity of
14 frequently used sentiment ambiguous Chinese adjectives. There were 8 teams and
16 systems. The best results were shown by the following systems: the system [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]
using heuristic rules and the relationship between sentiment ambiguous adjectives and
the keywords; the system [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] is based on collocation of opinion words and their
targets, context words and neighboring sentences.
      </p>
      <p>
        This problem is still under an active investigation. Xia, Y., Cambria, E.,
Hussain, A., &amp; Zhao, H. [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] explored methods based on the Bayesian model. They
propose to resolve the polarity ambiguity problem with opinion-level features:
opinion target, modifying word and indicative words, as well correlative words in
sentence, discourse and application-level features.
      </p>
      <p>As can be seen from the above, while investigations of adjectives polarity
disambiguation were conducted in the past, very few systematic and fine-grained studies of
the parametric adjectives contexts are available at the moment, especially for Russian
language.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Text collection</title>
      <p>For the study in this paper, we use the set of reviews for products placed on the
Internet resource Yandex.Market. For automatic reviews extraction the program in python
was developed that uses the API Yandex.Market.</p>
      <p>In this way, we’ve constructed a corpus of 41913 reviews (4 739 010 usage) on
32 categories of products.</p>
      <p>For representativeness, we have chosen a variety of product groups that are not like
each other. So, we have selected several groups of products from the categories:
household appliances, electronics, health and beauty goods, goods for children, pet
goods, goods for hobbies and leisure. The distribution of the number of reviews by
categories is presented in Table 1.
We have chosen to investigate the most frequent parametric adjectives and have
extracted for them all the contexts in which they appeared in the corpus: previous and
next word.</p>
      <p>Word
большой (big)
)маленький (little)
) лёгкий (light)
высокий (tall)
)небольшой (small)
тяжёлый (heavy)
низкий (low)
слабый (weak)
сильный (strong)
41913</p>
    </sec>
    <sec id="sec-4">
      <title>Positive and negative contexts for different classes of parametric adjectives</title>
      <p>The category “size”: ‘большой’(large) – ‘небольшой’/ ‘маленький’
(little/small)
‘Большой’(large)
1. The first context for the word ‘большой’(large) is significant in physical size. This
adjective often expresses a positive assessment in combination with the component
parts of the object. For example, ‘большой экран’ (large screen) ‘+’. But it also
can be used in a negative context. For example, ‘большие габариты
велотренажера’ (the huge size of an exercise bike) ‘-’. There is a connotation “takes a lot of
space”.
2. The second context of the use of the adjective ‘большой’(large) is the expression
of the characteristics of the physical volume. For example, ‘большой объём
резервуара’ (large volume of the tank) ‘+’. In this context, this word usually has
only positive polarity.
3. The adjective ‘большой’(large) is often found in a combination with the words
expressing that one can choose from something or assortment/variety. For example,
‘большой выбор цветов’ (a large selection of colors) ‘+’, ‘большой набор
функций’ (a large set of functions) ‘+’. In this context, this word also has only positive
polarity.
4. The fourth context is the use of an adjective with nouns characterizing advantages
and disadvantages. In this context the adjective ‘большой’(large) has an
amplifying meaning and can have both positive and negative polarities. For example,
‘большой плюс’ (the great advantage) ‘+’, ‘самый большой минус’ (the biggest
disadvantage) ‘-’.
5. The last context includes all other uses, most often expressing technical and time
characteristics. The common meaning of the word ‘большой’(large) in this case is
significant in strength, intensity or duration. For instance, one can find phrases
‘большое время работы от аккумулятора’ (long battery life) ‘+’, ‘большая
мощность’ (high power) ‘+’, ‘большой объем памяти’ (large amount of
memory) ‘+’, ‘большой шум’ (a lot of noise) ‘-’, ‘большой люфт’ (a big
backlash) ‘-’.
‘Небольшой’/ ‘маленький’ (little/small)
For words ‘небольшой’/ ‘маленький’ (little/small), the opposite tendency is
observed: in almost all cases when large will have a positive polarity, ‘небольшой’ and
‘маленький’ (little and small) will have a negative one. For example, ‘маленькая
цена’ (small price) has a positive polarity.</p>
      <p>Both the positive contexts and the negative contexts for adjectives ‘большой’
(large) – ‘небольшой’/ ‘маленький’ (little/small), are available, see Table 3.
Type of context</p>
      <p>Context</p>
      <p>Example
Positive contexts
Negative contexts
Positive contexts
Negative contexts</p>
      <p>большой (large)
The size of the component экран (screen), горлышко(neck),
parts of the object колеса(wheels)
Volume объем загрузки(loading volume),
вме</p>
      <p>стительность(capacity)
Time and technical charac- время работы от аккумулятора
(operteristics ating time from batteries), время работы
в автономном режиме (work offline)
громкость звука (sound volume)
Assortment/variety выбор цветов (choice of colors),</p>
      <p>функционал(functional)
Pros and cons плюс (plus),преимущество (advantages)
The size of the component габариты автокресла (car seat
dimenparts of the object</p>
      <p>sions)
Time and technical charac- вес велосипеда (bike weight), вес
teristics смартфона (smartphone weight)
расход воды (water consumption)
шум при работе (noise at work)
Pros and cons минус (minus), недостаток (</p>
      <p>disadvantage)
небольшой/маленький(little/small)
Time and technical charac- вес ноутбука (laptop weight)
teristics потребление электроэнергии
(electrici</p>
      <p>ty consumption)</p>
      <sec id="sec-4-1">
        <title>The size of the component размер чайника (the size of teapot)</title>
        <p>parts of the object
The size of the component кнопки (buttons), морозилка(freezer)
parts of the object
Volume
объем резервуара (tank volume), объем
чаши (bowl volume)
Time and technical charac- время работы без подзарядки (work
teristics without recharging)</p>
        <p>мощность (power)</p>
        <p>Assortment/variety набор программ (set of programs)
4.2</p>
        <p>The category “height”: ‘высокий’ (high) – ‘низкий’ (low)
‘Высокий’ (high)
1. The most frequent context of using the adjective ‘высокий’ (high) is the intention
to emphasize the intensity of the sentiment feature. It usually has a positive
polarity. For example, ‘высокое качество’ (high quality) ‘+’, ‘высокая
износостойкость’ (high wear resistance) ‘+’.
2. Also quite often the adjective ‘высокий’ (high) evaluates the level of technical
characteristics. It can have both positive and negative polarities: ‘высокое
разрешение экрана’ (high screen resolution) ‘+’, ‘высокая светочувствительность’
(high light sensitivity) ‘+’, ‘высокий уровень шума при работе’ (high noise
during operation) ‘-’.
3. The next context is the price characteristic: ‘высокая цена’ (high price) ‘-’. It
always has only negative polarity.
4. In its main meaning - long extension from bottom to top – the adjective ‘высокий’
(high) is used much less frequently in reviews. For example, ‘высокие бортики
коляски’ (high sides of a stroller) ‘+’.
5. In reviews on food or nutritional supplements, animal feed, stable combinations
with the adjective ‘высокий’ (high) are used, indicating the composition of the
product. For example, ‘высокое содержание белка’ (high protein content) ‘+’,
‘высокое содержание химикатов’ (high chemical content) ‘-’.
‘Низкий’ (low)
The adjective ‘низкий’ (low) in almost all cases will have opposing contexts of use.
In a positive context, it will most often denote a price, and in a negative context, it
will indicate a low degree of positive tonal sign, for example, ‘низкое качество
сборки’ (low build quality).</p>
        <p>Both the positive contexts and the negative contexts for adjectives ‘высокий’
(high) – ‘низкий’ (low), are presented in Table 4.
поддон (pallet)
содержание минералов(content of
minerals)</p>
        <p>The category “weight”: ‘тяжелый’ (heavy) – ‘легкий’ (light)
‘Тяжелый’ (heavy)
1. The most frequent for the word ‘тяжёлый’ (heavy) is weight of the object. This
adjective can express a positive sentiment. For example, ‘тяжелый металлический
корпус смартфона’ (heavy metal case of the smartphone) ‘+’. In such cases, there
is a “strong”, “reliable” or “steady” connotation. It also can express negative
sentiment: ‘тяжелое зарядное устройство’ (heavy power bank) ‘-’.
2. This adjective may also be used in negative contexts expressing difficulty in
implementing a process or the need to put a lot of effort.
‘Легкий’ (light)
This adjective can occur in all three contexts described above as the adjective
‘тяжёлый’ (heavy).</p>
        <p>But also, it can express the intensity of the negative sentiment feature: ‘легкий
скрежет’ (light rattle) ‘-’, ’легкий запах пластика’ (light plastic smell) ‘-’, ‘легкое
дребезжание’ (light chatter) ‘-’.</p>
        <p>Both the positive contexts and the negative contexts for adjectives ‘тяжелый’
(heavy) – ‘легкий’ (light), are available in Table 5.</p>
      </sec>
      <sec id="sec-4-2">
        <title>It takes a lot of effort ход велосипеда(bike ride)</title>
        <p>Difficulty in implementing a настройка(adjustment),
process очистка(cleaning)
лёгкий (light)
Simplicity in implementing a навигация по меню(menu
navigaprocess tion), эксплуатация(exploitation)
Weight ноутбук(laptop)
It takes a little of effort</p>
        <p>ход(baby carriage run)
Intensity of the negative
sentiment feature
скрежет(rattle), запах
пластика(plastic smell)</p>
        <p>The category “strength”: ‘сильный’ (strong) – ‘слабый’ (weak)
1. The first context for the word ‘сильный’ (strong) is significant in physical
strength, powerful. For example, ‘сильный адаптер’ (strong adapter) ‘+’. In this
context it always expresses a positive sentiment.
2. The second context of the use of the adjective ‘сильный’ (strong) is impressive.</p>
        <p>For example, ‘сильный дизайн’ (strong design) ‘+’. In this context it also usually
expresses a positive sentiment.
3. The adjective ‘сильный’ (strong) is used in context of the intensity of the
sentiment feature. Most often this is a negative context: ‘сильное искажение’ (strong
distortion) ‘-’, ‘сильный нагрев’ (strong heat) ‘-’.
‘Cлабый’ (weak)
We did not reveal explicit positive contexts for the adjective ‘слабый’ (weak). In
negative contexts, the adjective is most often used to describe the construction,
assembly or for expression the intensity of the negative sentiment feature.</p>
        <p>Both the positive contexts and the negative contexts for adjectives ‘сильный’
(strong) – ‘слабый’ (weak) are shown in Table 6.
Several observations can be made on the basis of the results presented above. First,
some contexts of the given adjectives can carry varying polarities: positive or
negative. Other contexts have only one polarity – either positive or negative. Second,
disambiguation contexts of the same words provide information about the semantics
of these words. Besides, it partially solves the polarity disambiguation problem for
those classes that carry only one polarity.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Experiment</title>
      <p>We set the task to automatically determine the contexts the parametric adjective
«big». It was chosen as the most frequently used parametric word in our corpus. We
formed a dataset of 750 sentences in which the word "big" is used across the 29
domains. The dataset was divided into training and test. There were 375 sentences in
each dataset. Both datasets were manually tagged with the target cluster.</p>
      <p>
        We tokenized the sentences and extracted aspect terms for word «big» for each
sentence using UDPipe [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. We used aspect terms as features. Using only the aspect
terms as features we employ some well-known classical classifiers: Support Vector
Classification (SVC), Random Forest and KNeighbors classifier. We adopt micro and
macro precision, micro and macro recall and micro and macro F1-score as the
measures of evaluation. Our algorithm produced better results when used with the
SVC classifier. The results are presented in the Table 7 and Table 8.
It can be seen from Table 8 and Fig. 2 that the classifier scores for some clusters
significantly outperform the scores in other clusters. This is partly due to the fact that the
number of sentences per cluster is unevenly distributed in our datasets. Besides, some
classes such as «Technical and other characteristics» is less consistent than the “The
physical size” class. Thus, more training data and additional features are required to
achieve significant improvement in such context disambiguation.
6
      </p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>This study is the first step in the study of parametric vocabulary of customer reviews
in the perspective Sentiment analysis. Parametric adjectives can reverse their polarity
depending on the context, which makes it difficult to automatically determine their
tonality.</p>
      <p>In this paper, we highlighted the most common contexts for adjectives of four
semantic classes such as size, height, weight, and strength. Our experiment
demonstrates that it is possible to determine the context automatically using machine
learning with the sufficiently high precision.</p>
      <p>As future work, we can conduct a more detailed quantitative study of the use of
parametric adjectives in different contexts and the development of rules or other
methods for automatic determining their polarity depending on the context.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Achaeva</surname>
            ,
            <given-names>O. I.</given-names>
          </string-name>
          :
          <article-title>Parametrical adjectives wide/narrow in Russian and English: the semantic aspect [Parametricheskie prilagatelnie Shirokiy/Uzkiy v russkom I angliyskom yazykah: semanticheskiy aspect]. Bulletin of the Kemerovo State University [Vestnik Kemerovskogo gos</article-title>
          . un-ta]
          <volume>2</volume>
          (
          <issue>62</issue>
          ),
          <volume>3</volume>
          ,
          <fpage>120</fpage>
          -
          <lpage>122</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Apresyan</surname>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
          </string-name>
          . D.:
          <article-title>Lexical semantics: synonymous means of language [Leksicheskaya semantika: sinonimicheskiye sredstva yazyka]</article-title>
          .
          <source>Nauka</source>
          , Moscow (
          <year>1995</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Brunova</surname>
            ,
            <given-names>E.G.</given-names>
          </string-name>
          :
          <article-title>Features of parametric vocabulary in content analysis of opinions [Osobennosti parametricheskoy leksiki pri kontent analize mneniy]</article-title>
          .
          <source>In: Philological sciences. Questions of theory and practice [Philologicheskie nauki. Voprosy teorii I praktiki]</source>
          ,
          <volume>12</volume>
          (
          <issue>42</issue>
          ),
          <fpage>35</fpage>
          -
          <lpage>39</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bulgakova</surname>
            ,
            <given-names>M.P.</given-names>
          </string-name>
          :
          <article-title>Evaluative derivites of parametric adjectives of German and French languages in comparative aspect. [Otsenochnyye derivaty parametricheskikh prilagatelnykh nemetskogo I frantsuzskogo yazykov v sopostavitelnim aspecte]</article-title>
          . In:
          <article-title>Materials of the annual scientific conference of teachers and graduate students of the MSLU [Materialy ezhegodnoy nauchnoy konferentsii prepodavateley i aspirantov MSLU]</article-title>
          ,
          <volume>118</volume>
          -
          <fpage>120</fpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Efanova</surname>
            ,
            <given-names>L.G.</given-names>
          </string-name>
          :
          <article-title>To the question of parametric norms [K voprosu o parametricheskikh normakh]</article-title>
          . Bulletin of Tomsk University [Vestnik Tomskogo universiteta],
          <volume>1</volume>
          (
          <issue>21</issue>
          ),
          <fpage>22</fpage>
          -
          <lpage>31</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Sentiment analysis and opinion mining</article-title>
          .
          <source>Synthesis lectures on human language technologies</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>167</lpage>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Mikheeva</surname>
            ,
            <given-names>S.L.</given-names>
          </string-name>
          :
          <article-title>Russian parametric adjectives: Antropocentricity of semantic and causative potential [Parametricheskie prilagatelnie russkogo yazykah: antropocentrichnost and cauzativniy potencial]</article-title>
          .
          <source>Bulletin of I.Y. Yakovlev ChSPU [Vestnik ChGPU im I.Y. Yakovleva]</source>
          ,
          <volume>3</volume>
          (
          <issue>103</issue>
          ),
          <fpage>135</fpage>
          -
          <lpage>140</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Pang</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lee</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Opinion Mining and Sentiment Analysis</article-title>
          .
          <source>Foundations and Trends in Information Retrieval</source>
          ,
          <volume>2</volume>
          (
          <issue>1-2</issue>
          ),
          <fpage>1</fpage>
          -
          <lpage>135</lpage>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Puzanova</surname>
            ,
            <given-names>Y.S.:</given-names>
          </string-name>
          <article-title>Parametrical adjectives of Russian language: research of ontogenesis on the material of spontaneous speech data [Parametricheskie prilagatel'nye russkogo yazyka: issledovanie ontogeneza na materiale dannyh spontannoy rechi]. News of the Russian State Pedagogical University A.I. Herzen [Izvestia Rossiyskogo gosudarstvennogo pedagogicheskogo gosudarstvennogo universiteta im A.I</article-title>
          . Gertsena],
          <fpage>137</fpage>
          -
          <lpage>141</lpage>
          (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Sanyarova</surname>
            ,
            <given-names>R.R.</given-names>
          </string-name>
          :
          <article-title>Comparative study of parametric adjectives in the paremiological picture of the world (on material English, Bashkir and Russian languages) [Sopostavitelnoye izuchenie parametricheskih prilagatelnyh v paremiologicheskoy kartine mira (na materiale angliyskogo, bashkirskogo I russkogo yazykov)</article-title>
          .
          <source>Bulletin of the Bashkir University [Vestnik Bashkirskogo universiteta]</source>
          ,
          <volume>24</volume>
          (
          <issue>3</issue>
          ),
          <fpage>671</fpage>
          -
          <lpage>676</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Schramm</surname>
            ,
            <given-names>A. N.:</given-names>
          </string-name>
          <article-title>Essays on the semantics of quality adjectives: on the material of modern Russian language [Ocherki po semantike kachestvennyh prilagatelnyh: na material sovremennogo russkogo yazyka]</article-title>
          . Publishing House of Leningrad State University [Izdatelstvo LGU],
          <string-name>
            <surname>Leningrad</surname>
          </string-name>
          (
          <year>1979</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Sеmenova</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Ju</surname>
          </string-name>
          .:
          <article-title>On the Class of Russian Parametric Adverbs [O klasse russkikh parametricheskikh narechiy]</article-title>
          .
          <source>In: Computational Linguistics and Intellectual Technologies: Proceedings of the International Conference “Dialogue</source>
          <year>2014</year>
          ”,
          <fpage>573</fpage>
          -
          <lpage>585</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Wu</surname>
            ,
            <given-names>Y</given-names>
          </string-name>
          , Jin,
          <string-name>
            <surname>P.</surname>
          </string-name>
          : Semeval-2010 task 18:
          <article-title>disambiguating sentiment ambiguous adjectives</article-title>
          .
          <source>Language Resources and Evaluation</source>
          ,
          <volume>47</volume>
          (
          <issue>3</issue>
          ),
          <fpage>743</fpage>
          -
          <lpage>55</lpage>
          (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Xia</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cambria</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hussain</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          :
          <article-title>Word Polarity Disambiguation Using Bayesian Model and Opinion-Level Features</article-title>
          .
          <source>Cognitive Computation</source>
          ,
          <volume>7</volume>
          (
          <issue>3</issue>
          ),
          <fpage>369</fpage>
          -
          <lpage>380</lpage>
          (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>R</given-names>
          </string-name>
          , Xu,
          <string-name>
            <given-names>J</given-names>
            ,
            <surname>Kit</surname>
          </string-name>
          ,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>HITSZ_CITYU: Combine collocation, context words and neighboring sentence sentiment in sentiment adjectives disambiguation</article-title>
          .
          <source>In: Proceedings of the 5th international workshop on semantic evaluation SemEval</source>
          '
          <volume>10</volume>
          ,
          <fpage>448</fpage>
          -
          <lpage>451</lpage>
          . ACM, Stroudsburg, PA, USA (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>SC</given-names>
          </string-name>
          , Liu,
          <string-name>
            <surname>MJ.</surname>
          </string-name>
          <article-title>YSC-DSAA: an approach to disambiguate sentiment ambiguous adjectives based on SAAOL</article-title>
          .
          <source>In: Proceedings of the 5th international workshop on semantic evaluation SemEval</source>
          '
          <volume>10</volume>
          ,
          <fpage>440</fpage>
          -
          <lpage>443</lpage>
          . ACM, Stroudsburg, PA, USA (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>