<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Method “Mean - Risk” for Comparing Poly-Interval Objects in Intelligent Systems</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute for Systems Analysis of Federal Research Center “Computer Science and Control” of Russian Academy of Sciences</institution>
          ,
          <addr-line>Moscow</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>National Technical University “Kharkiv Polytechnic Institute”</institution>
          ,
          <addr-line>Kharkiv</addr-line>
          ,
          <country country="UA">Ukraine</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0002</lpage>
      <abstract>
        <p>Problems of comparing poly-interval alternatives under risk in the framework of intelligent computer systems are considered. The problems are common in economy, engineering and in other domains. “Mean-risk” approach was chosen as a tool for comparing. Method for calculation of both main indicators of the “mean-risk” approach - mean and semideviation - for case of polyinterval alternatives is proposed. Method permits to calculate mentioned indicators for interval alternatives represented as fuzzy objects and as generalized interval estimates.</p>
      </abstract>
      <kwd-group>
        <kwd>interval alternatives</kwd>
        <kwd>risk estimating techniques</kwd>
        <kwd>“mean-risk” approach</kwd>
        <kwd>fuzzy poly-interval objects</kwd>
        <kwd>generalized interval estimates</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Problems of comparing alternatives on the effectiveness of achieving some goals play
an important role in studying and using of intelligent computer systems as essential
part of artificial intelligence research. A lot of practical tasks are analyzed under
uncertainty and parameters of the tasks, if they are measured in numerical scales, receive
due to uncertainty interval representations. But in future, after completion of the
relevant project, when uncertainty will be removed, interval estimates will have certain
one- numeric (point) values.</p>
      <p>It is supposed further at the paper that mentioned interval estimates of task
parameters contain all possible, but with different chances, their point implementations. This
assumption is controversial. Its non-faultlessness is overcome in mathematical
statistics by specifying, together with interval estimate, the chances, which are determined
by sampling data, that such estimate contains an unknown point value of the analyzed
quantity. When parameters of tasks are defined on the basis of primarily expert
judgments that are not supported by the statistics of the required volume, they try to
overcome this difficulty by switching from mono-interval to poly-interval estimates.</p>
      <p>The need for a poly interval approach is also caused by the fact that in some cases
it is difficult for an expert to express her/his knowledge about the analyzed parameter
through a single interval estimate: an excessive range of estimate reduces the
usefulness of expert knowledge, and the narrow interval often leads to prediction errors. It is
therefore advisable to give an expert the opportunity not to be limited only to
monointerval estimates, but to allow the expert to express own knowledge about the
parameters of the task with a set of intervals characterizing the uncertainty of expert
knowledge concerning the length and position of the estimate interval of each
characteristic of the task.</p>
      <p>If, as it is common in practice, it is required to compare the available options of the
problems solutions (alternatives) by their effectiveness to achieve the goals set, some
resulting indicators of the problems can, for meaningful reasons, be translated into the
category of quality indicators i.e. into comparison criteria. One will call at the paper
alternatives with interval quality indicators how interval alternatives (IAs).</p>
      <p>One can see that the problems of IAs comparing have the inherent risk of making
the wrong decision during choosing an effectiveness object. Indeed, already for two
compared IAs with a non-zero intersection of interval estimates of their quality
indicators, any alternative may be effective in the future, although with varying degrees of
confidence in the truth of this statement.</p>
      <p>Thus, the tasks of comparing IAs by their effectiveness are at least two-criterial:
along with the criterion associated with the quality indicator of the alternative and
evaluating the alternative by its preference it is necessary to take into account on an
equal basis the indicator characterizing the risk of making the wrong decision about
choosing the "best" alternative.</p>
      <p>It should be noted that there are risks of different nature in the area of comparing
IAs by effectiveness. Among them, firstly, the risk as the possibility of obtaining
losses or the possibility of obtaining a real outcome that differs from the desired
predicted result; and, secondly, the risk that an IA, which seems like effective in their
presented set at the time of comparison, will not actually be such at the time of
removing the uncertainty. In reality some another alternative may be effective. To
evaluate both the preference of an IA and the risk of making decision about preference the
most common using distribution functions tools, similar to the probability theory.</p>
      <p>
        At the present there are two main approaches to evaluate values of measures of
preference and risk. In the framework of the first method, “mean-risk” method [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ],
compared alternatives are treated as isolated, non-interacting objects. The value of the
mathematical expectation of a random variable given on the interval estimate of the
quality indicator is the criterion of preference in this method. Such indicators as
variance, left and right semi-variance, mean semi-deviation and others can be treated as
the risk criterion. In the framework of the second method, method of “collective risk
estimating” [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], IAs are treated as interacting objects, which form a system of
compared objects. Here calculated risks depend on the number of compared objects, the
value of risk is increased with the number of objects.
      </p>
      <p>
        At present, there are no approaches or methods for solving the problems of
choosing the best interval alternatives that are superior to others in terms of the quality of
the recommendations. Each method and approach has its advantages and
disadvantages, different interpretations of risk and methods for calculating their indicators
complement each other. If the problem of comparing mono-intervals can be to a
certain extent considered as resolved [
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3-5</xref>
        ], for poly-intervals this is not so.
      </p>
      <p>The purpose of this paper is to extend the “mean-risk” method as the first stage of
studying the problem of comparing IAs to the case of poly interval estimates. This is
essential since the information, which is necessary for comparison, can be obtained
within the framework of both mono and poly interval pictures. It is advisable for
comparability to obtain the results of a comparison using the same method. A study of
the method of collective risk estimating for this case will be carried out later.
2.</p>
    </sec>
    <sec id="sec-2">
      <title>The main features of the method "mean-risk"</title>
      <p>
        Deviations from the desired value of the quality indicator to the better side are
difficult to associate with risk. Therefore, starting from a long-standing paper [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], risk is
associated with indicators predicting the possibility of deviations for the worse
(downside risk measures), the risk of getting losses. This concept was developed in
articles [
        <xref ref-type="bibr" rid="ref1 ref7">1, 7</xref>
        ], and after this, as the results of papers [
        <xref ref-type="bibr" rid="ref8 ref9">8, 9</xref>
        ] showed, risk measures of
losses became the de facto standard in the risk management. Now indicator of the
mean semi-deviation SI [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ], which shows the value of the average deviation of a
random variable given on the interval estimate [L, R] from its mathematical
expectation E, took the central place among these risk measures.
      </p>
      <p>It is customary to distinguish between left SIl and right SIr semi-deviation
indicators. If f(x) is the distribution density of a random variable X, then, by definition,
L</p>
      <p>E</p>
      <p>E R
S Il   (E  x) f ( x)dx, S Ir   ( x  E) f ( x)dx.
(1)
One can be shown that SIl = SIr = SI for any, not necessarily symmetric, distribution.
Indeed, since</p>
      <p>L</p>
      <p>L</p>
      <p>E
R E R
 (E  x) f ( x)dx   (E  x) f ( x)dx   ( x  E) f ( x)dx  0,
(2)
then SIl = SIr = SI. Conveniently, that SI have dimension of E.</p>
      <p>Thus, the mathematical expectation E of the random variable X, given in the
interval estimate of the quality indicator of the IA, is chosen in the considered version of
the “mean – risk” method as a measure of preference, and the mean semi-deviation as
a risk measure.</p>
      <p>
        The behavior of SI for a uniform and triangular distribution of chances on mono
intervals is studied in [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. The uniform distribution implements the principle of
maximum entropy in the absence of any a priori information about the quantity under
study. The triangular distribution is quite often used by experts in their practical work,
serving for them as a simple approximation of other unimodal distributions. Let us
turn to the study of the properties of this method for poly-interval alternatives.
      </p>
      <p>
        Two main directions can be distinguished within the poly-interval approach: the
description by means of the apparatus of fuzzy sets [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] and using the formalism of
generalized interval estimations (GIE) [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. Consider first the case of fuzzy
polyinterval objects.
3.
objects
      </p>
      <p>
        Method "mean - risk" for poly-interval alternatives: fuzzy
Suppose firstly that we work with the most common in practice triangular
membership functions of fuzzy objects. The use of indicators of preference (mean) and risk
(mean semi-deviation) for the method “mean-risk” requires now clarification. The
simplest way to obtain the desired indicators, in which the membership function is
treated as the density of the distribution function, hardly can be considered as
reasonable. The point of view [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], according to which various numerical characteristics
associated with fuzzy objects and similar to the corresponding characteristics of
probability theory, ought to have interval values, it seems more consistent. Since it is
desirable to communicate with expert practitioners in their usual language, it is
imperative to move from such interval values to one-numeric estimates that characterize
former. Defuzzification procedures will be used for such transition.
      </p>
      <p>
        The triangular membership function is given by a triple (L, T, R) such that L &lt; T &lt;
&lt;R. We will use for the description of poly-interval fuzzy objects their decomposition
into a set of α-levels. Assume that the membership functions are normal so that α [
        <xref ref-type="bibr" rid="ref1">0,
1</xref>
        ]. Then for the left L(α) and right R(α) boundaries of the intervals I(α), embedded in
the triangular membership function, we have:
      </p>
      <p>
        L(α) = (1 – α)L + αT, R(α) = (1 – α)R + αT
(3)
Assuming that on all (regular, not fuzzy) intervals I(α), corresponding to α-levels, are
set uniform chances distributions [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], for mathematical expectations E(α) on α-levels
we get: E(α) = αT + (1 – α)EU, where EU = (L + R)/2. One can see that the possible
values of E(α) lie in the interval [EU, T] for EU &lt; T and in the interval [T, EU] for EU&gt;
&gt;T.
      </p>
      <p>We will use two methods for defuzzification of E(α). In the first of these all I(α)
are considered on a parity basis in obtaining an one-numeric characteristic EF, and in
the second, in the center of gravity method, the contribution I(α) to the integral
onenumeric characteristic EF1 is changed with changing α. Then
Here 2 is the normalizing factor. Then EF = (EU + T)/2, EF1 = (EU + 2T)/3. One can
see that EF is greater than EF1 for EU &gt; T, less otherwise and coincides for EU = T.</p>
      <p>One-numeric characteristics for indicators of the mean semi-deviations can be
obtained similarly. We have for each interval estimate on the α-level for the mean
semideviation Sl(α):</p>
      <p>L( )</p>
      <p>E( )
Sl ( )   dx[E( )  x] / ( )  [E( )  L( )]2 / 2( ) 
 (1  )(EU  L)2 / 2(R  L),
where Δ(α) = R(α) – L(α).</p>
      <p>It can be seen that the possible values of Sl(α) lie in the interval [0, (R – L)/8]. The
defuzzification by the first method now gives for the indicator of the mean
semideviation SlF= (R – L)/16, and by the center of gravity method SlF1 = (R – L)/24, i.e.
SlF = 3SlF1/2. Thus, if EF can be either greater than EF1 or less than EF1, then SlF is
always greater than SlF1. Moreover, if both EF and EF1 depend on the position of the
vertex T of the membership function, then the values of the indicators of the mean
semi-deviation do not depend on it.</p>
      <p>The proposed method for constructing one-numeric estimates for interval fuzzy
values can also be applied to other one-numeric characteristics, for example, for a
one-numeric estimate of an analogue of variance of a random variable. So in the case
of triangular membership function we have for variance Var(α) on an α-level:
L( )</p>
      <p>R( ) [x  E( )]2 dx
Var( )  </p>
      <p>
( )
(1  )2 (R  L)2
12</p>
      <p>Thus, the possible values of the variance lie in the interval [0, (R – L)2/12].
Defuzzification by the first method gives then for one-numeric variance estimate VarF: VarF =
=(R – L)2/36, and by the center of gravity method VarF1 = (R – L)2/72. So VarF =
=2VarF1.</p>
      <p>This method of constructing one-numeric estimates for interval fuzzy values can be
used for other types of membership functions, in particular, for trapezoidal. The
trapezoidal membership function is given by a quadruple (L, T1, T2, R) such that L &lt; &lt;T1 &lt;
T2 &lt; R. For the left L(α) and the right R(α) boundaries of the intervals I(α), nested in
the trapezoidal membership function, we then have:</p>
      <p>L(α) = (1 – α)L + αT1, R(α) = (1 – α)R + αT2.
(7)
We now obtain for the mathematical expectations E(α) on the α-levels the relation
E(α) = α(T1 + T2)/2 + (1 – α)EU. Possible values of E(α) lie in the interval [EU, (T1 +
+T2)/2] for EU &lt; (T1 + T2)/2 and in the interval [(T1 + T2)/2, EU] otherwise.
Defuzzification by the first method gives for mean indicator EF = [EU + (T1 + T2)/2]/2 and using
center of gravity method we get EF1 = (EU + T1 + T2)/3. It can be seen that EF is
greater than EF1 for L + R + T1 + T2 &gt; 0 and less otherwise.</p>
      <p>Just as above, for the mean semi-deviations Sl(α) on α-levels we obtain that their
possible values lie in the interval [(T2 – T1)/8, (R – L)/8], and for one-numeric
estimates SlF and SlF1 we have SlF = (R – L + T2 – T1)/16, SlF1 = [R – L + 2(T2 – T1)]/24.
Here the values of the indicators of the mean semi-deviation depend on the position of
the upper corner points of the membership function. The sign of the difference SlF and
(5)
(6)
SlF1 is determined by the sign of the value R – L + T2 – T1, and therefore here, as for
the triangular membership functions, SlF is always greater than SlF1.</p>
      <p>As above for the variance Var(α) on the α-level we have:</p>
      <p>R( )
Var( )  </p>
      <p>L( )
[x  E( )]2 dx
( )

[(1  )(R  L)  (T2  T )]2</p>
      <p>1
12
Here the possible values of the variance lie in the interval [(T2 – T1)2/12, (R – L)2/12].
With the first method of defuzzification for one-numeric estimate of the variance VarF
we then get VarF = (T2 – T1 + R – L)2/36, and for defuzzification with the center of
gravity method for one-numeric estimate of the variance VarF1 we have: VarF1 = [(R –
– L)2 + (R – L)(T2 – T1) + 3(T2 – T1)2]/72. It can be shown that VarF&gt; VarF1. Note that
all relations obtained for the trapezoidal case pass into the corresponding relations for
the triangular membership function at T1 = T2 = T.
4. Method "mean - risk" for poly-interval alternatives: general
interval estimations
The approach of general estimations (GIE) is a direct extension of the mono-interval
approach to the poly-interval case. In the first of them the initial point estimate of the
analyzed parameter, to account for the uncertainty of knowledge about it, is “blurred”,
not necessarily symmetrically, filling in a certain interval of possible values of the
parameter. To describe the chances of realizing possible point implementations x of
the parameter, the apparatus of distribution functions is used. The distribution
function is specified on the interval-carrier by the density of the chance distribution
function f(x). In the GIE approach the initial estimate is the interval Iu = [Lu, Ru] and it is
already blurred, again not necessarily symmetrically, generating, as the final
parameter estimate, a system of intervals with an interval of maximum length Id = [Ld, Rd].
Which intervals will be included in the resulting system, delimited by Iu and Id, is
determined by the form of the so-called poly-interval estimate (PIE), - a curvilinear
trapezium containing all the intervals included in their system. To specify the chances
of realization of the intervals forming the system, a random variable β is inserted. It is
placed on the ordinate axis of the two-dimensional plane and has a chance distribution
density f1(β). The value of β serves as a label for the intervals included in their
system. At each of the intervals labeled β, implementation chances of possible point
realizations x, placed on the abscissa axis of a two-dimensional plane, are described by a
conditional distribution function with density f2(x|β). Thus GIE is PIE with a given on
the last density of the joint distribution function f(β, x) = f1(β)f2(x|β).</p>
      <p>Hence the GIE formalism allows experts to distinguish mono intervals included in
such PIE according to the degree of entry into their system not only by defining the
form of the PIE, - certain analogue of the membership function of the apparatus of
fuzzy sets, but also by defining the distribution of chances of their inclusion in the
GIE. Note that distribution of the chances of realizing the values of the parameters on
mono intervals that form the PIE can be arbitrary, not only uniform.</p>
      <p>We will further assume that the sides of the PIE are straightforward, estimates are
normalized so that 0 &lt; β &lt; 1, the label β = 0 corresponds to the interval [Ld = L, Rd =
=R], β = 1 to the interval [Lu, Ru] and Ld &lt; Lu &lt; Ru &lt; Rd. Such configurations most
often arise when expert knowledges about the parameters of the solved problems are
presented by GIE.</p>
      <p>Quite often triangular PIEs are used in practice. It corresponds to the situation
when the initial point estimate T is replaced by the interval system. As above
triangular PIE is defined by a triple of corner points L, T, R and L &lt; T &lt; R.</p>
      <p>
        Let, for simplicity, the distributions of chances on the coordinate axes of the PIE
are uniform. Then, integrating joint distribution function over all β on the PIE of a
triangular form, we obtain on [L, R] – on the interval with the label β = 0 - density of
the marginal distribution function f(x), specifically density of the generalized uniform
distribution (GUD). The GUD on [L, R] is a probabilistic mixture of uniform
distributions f2(x|β) with the mixing function f1(β), which is also uniform. The GUD
properties for trapezoidal and, as a special case, for triangular PIE were studied in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>Using the results obtained there, we have for the density f(x) of GUD on the
triangular PIE: for L &lt; x &lt; T f(x) = fl(x), where fl(x) = ln[(T – L)/(T – x)]/(R – L) is the left
branch; for T &lt; x &lt; R f(x) = fr(x), fr(x) = ln[(R – T)/(x – T)]/(R – L) is its right branch
of the distribution density of GUD. Doing in the usual way, for the mathematical
expectation EGU of GUD we get: EGU = (L + 2T + R)/4. For the case of symmetric
PIE, when T = (L + R)/2, EGU = EU.</p>
      <p>It can be seen that EGU &gt; T for T &lt; EU otherwise for EGU &lt; T. With this in mind we
obtain for T &lt; EU (and, therefore, for EGU &gt; T)</p>
      <p>R
EGU
EGU</p>
      <p>L
and for T &gt; EU (and, therefore, for EGU &lt; T)
Integrating, we get for T &lt; EU</p>
      <p>S I  S Ir   (x  EGU ) f r (x)dx.</p>
      <p>SI  SIl   (EGU  x) fl (x)dx.
(EGU  T )2 ln</p>
      <p>R  T
EGU  T
 R  EGU [R  EGU  2(EGU  T )]
2
(12)
and for T &gt; EU</p>
      <p>SI 
It can be shown that SI(T) as a function of the upper corner point T is convex
downward, monotonously decreases on the interval [L, (L + R)/2] and monotonously
increases on the interval [(L + R)/2, R]. The function is symmetric about the vertical
axis T = (L + R)/2 = EU, its minimum SImin is reached at the point T = EU, and the
maximum SImax at the points T = L and T = R:</p>
      <p>SImin = (R – L)/16, SImax = SI(L) = SI(R) = (R – L)(ln4+3/2)/32.
(13)
We draw attention to the fact that SImin coincides with mean semi-deviation SIU for a
uniform distribution on the interval estimate of the maximum length in their PIE
system.</p>
      <p>It is useful for experts, during choosing the chances distribution functions to
describe their knowledge of interval estimates of quality indicators, to take in their
minds the following. The transition from uniform distributions to other, for example,
GUD, means having more knowledge about the object. This leads to a decrease in the
risk indicator, moreover SIma &lt; SIU. The choice of an upper corner point T for PIE,
which equals to mean of the corresponding uniform distribution EU, results in the
lowest value of the risk indicator. Deviations of the values of T from EU in both
directions lead to an increase in the risk indicator. However, these deviations from the
standpoint of comparing alternatives are not equivalent. Deviations of T to the right of
the EU lead to an increase in the mean EGU, an indicator of preference in the mean-risk
approach, and to the left of the EU to a decrease in EGU.</p>
      <p>Now, we present the final minimum Kmin and maximum Kmax values of the
coefficients at the length parameter R – L in the risk indicator SI for the cases considered
here. This information may be useful to experts during working with interval
estimates. Generalized uniform distributions: Kmin = 0.062; Kmax = 0.09; one-numeric
estimates for triangular membership functions: for the first method of defuzzification
Kmin = Kmax = 0.062; for the defuzzification using the center of gravity method Kmin =
=Kmax = 0.041.</p>
      <p>Thus, in the framework of the “mean-risk” method the GIE approach leads to more
cautious risk estimating in comparison with the “fuzzy” approach.
5.</p>
    </sec>
    <sec id="sec-3">
      <title>Conclusion</title>
      <p>
        In real problems it is necessary to be able to compare alternatives, the quality
indicators of which are presented and as point estimates (deterministic case) and as
monointervals and as poly-intervals. Numerous methods have been proposed for
comparison of fuzzy alternatives. Their advantages and disadvantages are analyzed in [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
However, for comparability of the comparison results, it is advisable to use methods
suitable for alternatives of all the above types. The “mean-risk” method and the
collective risk estimating method are such methods. The lack of methods for calculating
one-numeric estimates for the criteria of the methods hindered their applicability for
poly-interval alternatives.
      </p>
      <p>New methods of constructing one-numeric estimates for interval quantities of
fuzzy objects, which are analogs of such characteristics of probability theory as
mathematical expectations, variance, mean semideviation and others, are proposed in the
paper. Namely it permits to use “mean-risk” method for comparing poly interval
alternatives represented as fuzzy alternatives. So far, there has been no justification for
doing this. The method is also extended to the case of generalized interval estimates, a
new direction in the presentation of knowledge and objects of comparison in the form
of poly interval alternatives.</p>
      <p>The advantage of the “mean-risk” method consists in the possibility of calculating
for each individual IA both main criterion indicators that are necessary for evaluating
such objects, namely, indicator of the preference of an alternative and indicator of
concomitant risk (in particular, mean semideviation). However, the dependence of
risk on the context, i.e. on the fact that there are other alternatives in their compared
group and that they effect on the magnitude of the risk, is not taken into account. It is
a disadvantage of the method. It should be mentioned another drawback inherent in
all methods of the class of the downside risk with the calculation of indicators that
take into account only the left “tail” of the distribution of chances. Specifically,
comparison with the chances of obtaining benefits (right “tail), that is taking into account
the risk of possible loss of profits, is not done.</p>
      <p>The disadvantage of the “mean-risk” method, associated with the need to take into
account collective effects in the group of compared IAs, is overcome in the method of
“collective risk” estimating. However, this method is also not without flaws. Only the
relative effectiveness of an IA is estimated with its using. In this case, the alternative,
recognized as effective in such a comparison, may in itself be ineffective
(unprofitable). It cannot be if the “mean– risk” method is used.</p>
      <p>Thus, at the present there are no approaches or methods for solving the problems of
choosing the best interval alternatives that are superior to others in terms of the
quality of recommendations for decision-makers. Each method and approach has its
advantages and disadvantages, different interpretations of risk and methods for
calculating their indicators complement each other. In this regard, it seems reasonable to
attempt to create a comprehensive method for evaluating interval alternatives,
combining the merits of various particular methods. At the first stage of applying the
comprehensive method the “mean-risk” method is used to select acceptable IAs, but IAs
are considered separately from others in their compared group. At the second stage
effective IAs are choose on base of collective risk estimating method in the
framework of such already narrowed subgroup of IAs. To implement such comprehensive
method for poly-interval objects, the method of “collective risk” estimating should be
developed for them. It will be done later.</p>
      <p>The paper is partially supported by Russian Foundation for Basic Research
(projects No. 16-29-12864, 17-07-00512, 17-29-07021, 18-07-00280).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Fishburn</surname>
            ,
            <given-names>P.C.</given-names>
          </string-name>
          :
          <article-title>Mean-risk analysis with risk associated with below-target returns</article-title>
          . American Economic Review,
          <string-name>
            <surname>V.</surname>
          </string-name>
          <year>67</year>
          , pp.
          <fpage>116</fpage>
          -
          <lpage>126</lpage>
          (
          <year>1977</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Shepelev</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          :
          <article-title>Risk behaviour in a set of interval alternatives</article-title>
          .
          <source>International Journal ”Information models and analyses”</source>
          ,
          <string-name>
            <surname>V.</surname>
          </string-name>
          <year>4</year>
          ., pp.
          <fpage>303</fpage>
          -
          <lpage>323</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Diligensky</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dymova</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sevastiyanov</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Nechetkoe modelirovanie i mnogokriterialnaya optimizatsiya proizvodstvennykh system v usloviyakh neopredelennosti: tekhnologiya, ekonomika, ekologiya [Fuzzy modeling and multi-criteria optimization of production systems under uncertainty: technology, economy</article-title>
          , ecology], Moscow: Engineering-1
          <source>Publs</source>
          . 397 p.
          <article-title>(in Russian) (</article-title>
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Podinovsky</surname>
          </string-name>
          , V.:
          <article-title>Chislovye mery riska kak kriterii vybora pri veroyatnostnoi neopredelennosti [Numerical risk measures as selection criteria for probabilistic uncertainty]</article-title>
          . In:
          <article-title>Iskusstvenny intellekt i prinyatie resheny [Artificial intelligence and decision-making]</article-title>
          <volume>2</volume>
          :
          <fpage>60</fpage>
          -
          <lpage>74</lpage>
          (in Russian) (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Shepelyov</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sternin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Methods for comparison of alternatives described by interval estimations</article-title>
          .
          <source>International Journal of Business Continuity</source>
          and
          <string-name>
            <given-names>Risk</given-names>
            <surname>Management</surname>
          </string-name>
          ,
          <string-name>
            <surname>V.</surname>
          </string-name>
          <year>2</year>
          ., Issue 1, pp.
          <fpage>56</fpage>
          -
          <lpage>69</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Roy</surname>
            ,
            <given-names>A.D.</given-names>
          </string-name>
          :
          <article-title>Safety first and the holding of assets</article-title>
          . In: Econometrica, V.
          <volume>20</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>431</fpage>
          -
          <lpage>449</lpage>
          (
          <year>1952</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bawa</surname>
            ,
            <given-names>V. S.</given-names>
          </string-name>
          :
          <article-title>Optimal Rules For Ordering Uncertain Prospects</article-title>
          .
          <source>In: Journal of Financial Economics, V</source>
          <volume>2</volume>
          (
          <issue>1</issue>
          ), pp.
          <fpage>95</fpage>
          -
          <lpage>121</lpage>
          (
          <year>1975</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Sortino</surname>
            ,
            <given-names>F.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meer</surname>
            ,
            <given-names>R.V.</given-names>
          </string-name>
          :
          <article-title>Downside Risk</article-title>
          . In: Journal of Portfolio Management, V.
          <volume>17</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>27</fpage>
          -
          <lpage>31</lpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Nawrocki</surname>
            ,
            <given-names>D. A.</given-names>
          </string-name>
          :
          <article-title>Brief History of Downside Risk Measures</article-title>
          .
          <source>In: The Journal of Investing</source>
          , V.
          <volume>8</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>9</fpage>
          -
          <lpage>25</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Ogryczak</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ruszczyński</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>From stochastic dominance to mean-risk models: semideviations as risk measures</article-title>
          .
          <source>In: European journal of operational research</source>
          , V.
          <volume>116</volume>
          , pp.
          <fpage>33</fpage>
          -
          <lpage>50</lpage>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Grechuk</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Molyboha</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zabarankin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Mean-deviation analysis in the theory of choice</article-title>
          . In:
          <article-title>Risk analysis</article-title>
          , V.
          <volume>32</volume>
          , pp.
          <fpage>1277</fpage>
          -
          <lpage>1292</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Shepelev</surname>
          </string-name>
          , G.:
          <article-title>Decision-making in groups of interval alternatives</article-title>
          .
          <source>In: International journal “Information theories and applications”</source>
          , V.
          <volume>23</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>303</fpage>
          -
          <lpage>320</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Dubois</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prade</surname>
          </string-name>
          , H.:
          <source>Fuzzy Sets and Systems</source>
          , Academic Press, New York (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Sternin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shepelev</surname>
          </string-name>
          , G.:
          <article-title>Generalized interval expert estimates in decision making</article-title>
          . In: Doklady Mathematics,V.
          <volume>81</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>1</fpage>
          -
          <lpage>2</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Dubois</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prade</surname>
          </string-name>
          , H.:
          <article-title>Theorie des possibilities</article-title>
          , Paris: Masson (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Dorohonceanu</surname>
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Marin</surname>
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>A simple method for comparing fuzzy numbers</article-title>
          . Rutgers University, Piscataway, CAIP Center (
          <year>2002</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>