<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Markov Processes in Modeling Life Cycle of Economic Clusters</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Galina Boush</string-name>
          <email>gboush@narod.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vitaly Shamis</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Oksana Kulikova</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Svetlana Neiman</string-name>
          <email>svetlana1414@bk.ru</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Omsk Humanities Academy</institution>
          ,
          <addr-line>Omsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Omsk Institute of Service</institution>
          ,
          <addr-line>Omsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Siberian Automobile and Road Academy</institution>
          ,
          <addr-line>Omsk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>545</fpage>
      <lpage>557</lpage>
      <abstract>
        <p>The object is economic clusters' life cycle (ECLC). The aim is to model its regulations algorithm. The hypothesis: ECLC transitions are stochastic processes independent of past. The method is Markov processes with discrete time. The algorithm is implemented in programming language Eсlipse. The results are: 1) mathematical model of ECLC with life-cycle stages, stochastic transitions, transition values. For mature clusters their borders and actors are defined; 2) ECLC modeling algorithm with given stochastic transition matrix considering influence of different environments; 3) software "Modeling _Cluster_v1" for Androids to model online cluster development based on ECLC regulations. The novelties: for the first time ECLC model considers stochastic character of life-cycle stages simulating the number of actors at each stage, cluster's size, diameter and delimitation. Practical application: Program is applied to education, for interest groups involved in cluster development and projects to model of clusters' evolution trajectories under different environmental changes.</p>
      </abstract>
      <kwd-group>
        <kwd>stage in the life cycle</kwd>
        <kwd>life cycle patterns</kwd>
        <kwd>operational research</kwd>
        <kwd>computer simulations of life cycle</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>The development of operational research in different subject areas seems to be quite
relevant nowadays. One area where such methods are of great demand is the Science
of Economics. This is due to the fact that improved management of the large-scale
highly-sophisticated economic systems is associated today with the latest
mathematical tools since traditional economic methods used to solve the problems in the field
demonstrate the tunnel vision and poor performance.</p>
      <p>One of the most promising economic systems of this kind is a cluster structure.
However, despite the wide use of cluster approach to different areas and in different
Copyright © by the paper's authors. Copying permitted for private and academic purposes.
countries, its comprehensive and detailed description and analysis in scientific
literature are absent; the processes of clusters’ formation and development remain poorly
studied. As a consequence, it is difficult to consider and evaluate properly the
development and management of cluster structures in the projects targeted for that.
However, it is absolutely necessary in order for the clusters to ensure maximum generation of
positive externalities. One of the most pressing issues in this regard is their life cycle.</p>
      <p>Further development of the theory of economic clusters and their practical
implementation within the cluster approach requires mathematical and computer
modeling.</p>
      <p>
        The bibliographic survey reveals that in recent years some attempts have been
made to simulate the life cycle [
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4 ref5 ref6">1, 2, 3, 4, 5, 6</xref>
        ], degradation and collapse of cluster
structures [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], etc.
      </p>
      <p>
        In these works nondeterministic model [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], Lotka-Volterra model [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], network
theory [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] are used.
      </p>
      <p>However, as the analysis sums up, operational research methods have not been
implemented yet to the study and modeling the selected aspects of the economic
clusters, even though the methods have high heuristic perspectives. The considerations
mentioned above, define the objective of the study to search for and apply the
methods of operational research, which allows accurate and adequate simulating economic
clusters’ life cycle.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Theory and Methodology</title>
      <p>In the article the economic clusters are understood as non-institutionalized association
of independent economic entities in a joint arrangement based on proximity
(territorial, sectorial, cultural), complementarity (product, resource, process), interconnectivity
(material, nonmaterial, informational) [9, p. 162]; then the life cycle of the economic
clusters is considered as the shift or change leading to transition in its basic state and
pattern [9, p. 238].</p>
      <p>Like any functional institutions, economic clusters have a life cycle, which
represents a certain set and a sequence of stages, each of which is characterized by the
special institutional structure and the status of the cluster.</p>
      <p>As a tool for simulating the life cycle of the cluster structure the Markov
processes with discrete time are used. The choice of the method is determined by the fact
that the life cycle of the economic clusters is a stochastic process independent of past.
Hence, the discrete Markov processes with high confidence can describe the transition
in the life-cycle stages.</p>
      <p>
        It should be noted that at present the Markov processes are applied to the
studies in various fields: in naval shipbuilding industry for planning and control the
outfitting process in ships [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]; for industrial environments to predict the long-term
evolution of composting processes on an industrial scale [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]; for optical diagnostic
purposes to simulate angular distribution of photons through turbid slabs [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]; in genetic
studies for modeling the complex dynamics of mobile genetic elements within
genomes [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]; in chemistry to simulate interaction potential between particles in a
colloidal system and to control their assembly into a close-packed crystalline objects
[
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]; in cattle farming for unbiased prediction of the future performance of the
animals [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]; in building industry for cracking prediction on civil structures [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]; in
medical science for optimization of anemia treatment in hemodialysis patients [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ]; and
even in music for enforcement of structure and repetition within music for bagana
[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ].
      </p>
      <p>
        In economics according to the survey of the scientific literature the Markov
processes are used to model optimal dynamic resource allocations between various
companies to prevent defaults [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], to regulate social exchanges toward producing
social equilibrium [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ], to implement a social choice function [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], to maximize the
expected discounted value of the total future profits [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ], to solve optimal lending
problem to certain types of borrowers [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ], to examine the desirable sizes and policies
of a strategic petroleum reserve for oil consumption countries [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ], to show the
optimality of a so-called save-up-to level policy and the existence of the optimal initial
stock [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ], to examine the financial optimality of disaster risk reduction measures [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
etc. But the Markov methods used to model clusters or in any other complex
socialeconomic systems have not yet been found.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Model</title>
      <p>In the mathematical model of the economic clusters there are three types of actors: 1)
Producers [products]; 2) Providers [resources]; 3) Consumers [products].</p>
      <p>Each actor in the cluster implements the goal which determines its behavior in
the market and is characterized by a number of indicators.</p>
      <p>1) Producers constitute the basis of the market and are characterized by the two
groups of indicators: a) indicators measuring the productive potential; b) indicators
defining the rules of behavior.</p>
      <p>
        a) The group of the indicators measuring the productive potential of Producers
includes:
─ innovative activity – discovering the potential of Producer for innovative
activity is determined by the method given in [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. The range of values of the indicator
is 0-40. The higher the value, the more easily Producer ventures into innovative
markets;
─ internal capacity – , measuring the financial, manufacturing and human
potential of Producer is determined by the expert method based on the analysis of his
financial conditions, productive and human capacities. Evaluation criteria: high,
medium, low;
─ potential for adaptation and management – , reflecting the ability of Producer to
adapt to changes in the environment is determined by the expert method on the
basis of the analysis of the management and the capacity to adapt to the external
environment. Evaluation criteria: high, medium, low.
b) The group of indicators that define the rules of behavior of Producers is specified
by the tuple or set of rules:
(1)
where – rules for acquiring all necessary resources for the manufacture of
products and their storage, including purchase price, volume, quality, warehousing system;
– rules of production, simulating the production cycle and the quality of products;
– rules of storage and realization of products that simulate warehousing of the
finished products, cost and sales rules; – rules of behavior on the market,
determining the Producer’s goodwill, advertising policy, dealing with clients.
2) Providers supplying resources for Producers are the second group of actors in the
economic cluster. Since the basic indicators for the analysis of interaction between
Producers and Providers are the rules for acquiring resources included in the set of the
Producers’ behavior rules, Providers in the model defines the indicators of the
resources supplied. This is due to the fact that the relations of Producers and Consumers
play the main part in the processes of cluster formation and development and,
consequently, in implementing or patterning the life cycle of the economic clusters. The
activities of Providers under these conditions are aimed at rapid offtake of the
resources supplied.
      </p>
      <p>Providers are characterized by the following indicators:
─ price of a resource unit – in model monetary units;
─ amount of resource produced by one supplier – defined in model volumetric
units;
─ quality of the resource – defined by the expert method based on the analysis of
resources. Evaluation criteria: high, medium, low.
3) Consumers are characterized by the two groups of indicators: a) indicators
determining capacity; b) indicators defining the rules for inflow of funds and purchase of
products.
a) The group of the indicators determining the potential of Consumers includes:
─ amount of money that Consumer is willing to spend on the purchase of products –
in model monetary units;
─ volume of purchased products – is defined as the ratio of available funds from</p>
      <p>Consumer to the value of the products.
b) The group of indicators that define the rules of Consumer’s behavior is specified
by the set of rules:
(2)
where – rules for the purchase of products on the market, including the
Producer’s evaluation based on the rules of the group and the group , as well as the
quality of the products manufactured (or sold); – funding rules.</p>
      <p>The economic clusters in the model discussed appear to be a system arranging the
three interrelated components: production, resources and consumption. Each
component is represented by the special type of actors.</p>
      <p>
        Production component serves as the core for the cluster system, determining the
processes of cluster formation, the development of a uniform cluster structure or pattern
and implementation of a certain life-cycle trajectory of a cluster [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. The core of the
economic cluster is a set of homogeneous enterprises producing goods with similar
characteristics (Producers). The companies included in the cluster core form a
compact set in (n)-dimensional space of characteristics. Once the core of the cluster is
formed, it attracts Providers and Consumers. With it, between all the actors in the
cluster the relations and ties of various levels of sustainability with the parameters and
rules for cluster behavior are inevitably formed. Thus, the economic cluster can be
selected when used the clustering methods of the (n)-dimensional space based on the
analysis of distances between actors of the cluster [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ].
      </p>
      <p>Economic clusters are characterized by the following parameters:
─ availability of a cluster core, and relationships (informational, resource,
communicative) between Producers;
─ the number of Producers in the cluster core structure;
─ the diameter of the cluster, which is defined on the basis of calculating the location
of the cluster actors in space characteristics. The higher the level of development of
the cluster, the smaller is the diameter;
─ the number of Providers in the cluster defined on the basis of the analysis of the
conditions of enterprises entering the diameter of the cluster;
─ – the number of Consumers in the cluster, defined in the same way as the previous
indicator;
─ the synergistic effect defined as the increase in production volumes with the
increase of professional communication within the cluster without changing the
production capacity of Producers.</p>
      <p>The economic clusters are self-organizing natural systems, in their life cycle they go
through several stages: 1) diffuse group; 2) emerging cluster; 3) growing cluster; 4)
mature cluster; 5) stagnant cluster.</p>
      <p>Shift in the economic life-cycle stages of a cluster is shown in Fig. 1.
Characteristics of life-cycle stages of economic cluster are provided in Table 1.
Indicators characterizing Providers in economic cluster are given in Table 3.
Stagnant
cluster</p>
      <p>Determined by
capacity
of market
Changing slightly,
de</p>
      <p>pending on market
Determined
by needs of
Producers in
cluster and
capacity of</p>
      <p>market
Not changing or slightly
changing
Stage name
Designation
Resource Unit</p>
      <p>Price</p>
      <p>Resource
Volume
Produced by one
Provider
Quality of
Resource</p>
      <p>Stage name
Designation
Funding
Volume of
Purchased
Products
Rules for
Purchase of
Products on Market
Funding Rules
Consumers’ indicators in economic cluster are listed in Table 4.
Changing stages in the life cycle of the economic clusters operates in external
environment.</p>
      <p>Classification of external environmental conditions is given in Table 5.</p>
      <p>
        As noted above, the life cycle of the economic clusters is a probabilistic stochastic
process independent of past. This enables modeling and description of the transition
processes in stages or phases of their cluster life cycle by means of the discrete
Markov process. Matrix of transitions between stages in the cluster life cycle is as
follows:
(3)
Calculations for each for each quantum of modeling time are performed according to
the algorithms used for Markov process modeling [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. The possible trajectories of
life-cycle stage changes in economic clusters are calculated on the basis of the
appropriate calculating matrixes on the indices which have the maximum probability
meaning if the particular cluster is studied at a certain life-cycle stage. There can be several
such trajectories. After that, the indices of the number of the actors of the cluster and
the change in its characteristics within the modeled time can be calculated.
      </p>
      <p>The transition matrix between life-cycle stages in the cluster is formed with the
help of expert analysis and the results of the research in the functioning of the real
economic clusters. For example, innovative economic clusters are developing more
intensively and transforming into the stage of growth much more rapidly but as well
they can be transforming into the stage of stagnation with the same high speed. It is
due to the speed of the processes developing in them, the innovative ones being
included. Agro-industrial clusters, for instance, are characterized by slower
development as traditionalism and slow innovations are quite typical for them. Most of the
Agro-industrial clusters in the world as well in Russia are mature clusters and they
seldom transfer to the stagnation stage. Such regulations may be taken into account
when building transition matrices between the life-cycle stages of economic clusters
of various types.</p>
      <p>Calculation of the probability of economic cluster development at each stage
of its life cycle can be performed for each quantum of modeling time considering
specific environment.
4</p>
      <p>An Algorithm of Modeling the Life Cycle of the Economic
Clusters
Modeling algorithm of the economic clusters’ life cycle includes the following stages:</p>
      <p>Stage 1. Setting a baseline of initial parameters for modeling life cycle of
economic cluster, including the number of actors in each group (Producers, Providers,
Consumers).</p>
      <p>Stage 2. Specifying the number of quanta or tacts of modeling time.</p>
      <p>Stage 3. Setting parameters for the life cycle of economic cluster.</p>
      <p>Stage 4. Specifying external environment for economic cluster.</p>
      <p>Stage 5. Developing a matrix of transitions between stages of the life cycle of
economic cluster.</p>
      <p>For each condition of an external environment for the cluster the default range of the
probabilities of transition from one life-cycle stage to another is specified. Developing
matrices (2) is carried out on the basis of the random number generator considering
the specified range of values.</p>
      <p>Stage 6. Visualization of the results of the Stage 5. If there is no need to adjust
the matrix (2), you should go to the Stage 8, if it is necessary to correct the matrix (2),
you should go to the Stage 7.</p>
      <p>Stage 7. User adjustment and correction of the matrix values (2).</p>
      <p>Stage 8. Calculation of the matrix values (2) for each quantum of modeling
time.</p>
      <p>Stage 9. Visualization of calculation in the Stage 8.</p>
      <p>Stage 10. The choice of the most probable cluster life-cycle stages for each
quantum of modeling time. The selection is done by ranking the values
considering the specified range of values. If all values miss the specified range, you should
go to the Stage 5, if not – you should go to Stage 11.</p>
      <p>Stage 11. Visualization of calculation of the Stage 10.</p>
      <p>
        Stage 12. Delimitation of the cluster and cluster actors for each quantum of
modeling time using algorithm FOREL [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ].
      </p>
      <p>Stage 13. Calculation of the life cycle of economic cluster for each quantum of
modeling time.</p>
      <p>Stage 14. Calculation of indicators for all actors in the economic cluster, and
for each quantum of modeling time. In the transition from the first to the subsequent
stages of the economic cluster life cycle averaging the cluster indicators for the cluster
actors takes place by reducing the confidence interval and, vice versa, when you
return from the subsequent stages of the life cycle of the cluster to the previous ones,
there is an increase in the dispersion of values or in the variance indicator for each of
the indicators of cluster actors. Also in the transition from one stage of the economic
cluster life cycle to another the number of cluster actors can vary.</p>
      <p>
        Stage 15. Cognitive visualization of results of the calculations using the
Dashboard technology [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
      </p>
      <p>The Simulation Program of the Life Cycle of the Economic
Clusters
Based on the algorithm of simulating the economic clusters’ life-cycle the Program
"Modeling_Cluster_v1" for Android-based devices is developed. The choice of the
Android operating system is due to the independence of this device from hardware
and to its performance characteristics as well.</p>
      <p>In Fig. 2 a screenshot of the main window of the Program is given.
The following results were obtained in the article presented, namely:
1. mathematical model of life cycle of the economic clusters including the life-cycle
stages and transitions between them; probability values of transitions. For stages
with a mature economic cluster, the problem of determining the boundary or
delimitation parameters of the cluster is solved, its actors are defined, changing in its
number at different stages of the life cycle is considered;
2. modeling algorithm of the life cycle of the economic clusters with given transition
probability matrices between the stages of the cluster life cycle, for the impacts of
different types of environment can be specified. The algorithm allows calculating
the most probable trajectory of the life cycle of the economic clusters, as well as
determining their sizes and actors at each stage;
3. software product "Modeling_Cluster_v1" implemented for Android-based devices
which allows online management of the cluster development on the basis of the
identified patterns of transition between the stages of the economic clusters life
cycle to implement modeling its evolution taking into account environment impact.
Simulation results are presented in the form of Dashboard, visualizing the changes of
stages in the life cycle of economic clusters and the behavior of its actors at each
stage.</p>
      <p>Thus, such methods as the Markov processes with discrete time provide
modeling the life cycle of the economic clusters. This made possible to identify the
regulations in the development of the specific economic clusters and determine both their
sizes and characteristics of their actors at each stage of the life cycle.</p>
      <p>The novelty of the results obtained is that for the first time the model of the
economic cluster life cycle takes into account the probability character of transitions
between the stages, allows model the number of actors participating in each of the
stages, the size, the diameter and the delimitation of the cluster.</p>
      <p>The software product may be used for the educational purposes, as well as for
executive bodies and interest groups involved in the development and implementation
of cluster programs and projects, also for modeling possible trajectories of economic
cluster evolution in changing economic environments.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Ratner</surname>
            ,
            <given-names>S.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Akinkina</surname>
            ,
            <given-names>M.M.:</given-names>
          </string-name>
          <article-title>Vyibor parametrov optimalnogo upravlencheskogo vozdeystviya na regionalnyiy neftegazovyiy klaster na osnove imitatsionnogo modelirovaniya</article-title>
          .
          <source>Regionalnaya ekonomika: teoriya i praktika. 20</source>
          ,
          <fpage>2</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2011</year>
          )
          <article-title>[Ратнер, С</article-title>
          .В.,
          <string-name>
            <surname>Акинкина</surname>
          </string-name>
          , М.М.:
          <article-title>Выбор параметров оптимального управлвенческого воздейст- вия на региональный нефтегазовый кластер на основе имитационного моделирования</article-title>
          .
          <source>Региональная экономика: теория и практика. 20</source>
          ,
          <fpage>2</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2011</year>
          )]
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Smirnova</surname>
            ,
            <given-names>S.M.:</given-names>
          </string-name>
          <article-title>Modelirovanie stadii razvitiya promyishlennogo klastera</article-title>
          .
          <source>Nauchnoe obozrenie. 8</source>
          ,
          <fpage>159</fpage>
          -
          <lpage>162</lpage>
          (
          <year>2013</year>
          )
          <article-title>[Смирнова, С</article-title>
          .М.:
          <article-title>Моделирование стадии развития про- мышленного кластера</article-title>
          .
          <source>Научное обозрение. 8</source>
          ,
          <fpage>159</fpage>
          -
          <lpage>162</lpage>
          (
          <year>2013</year>
          )]
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Popp</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , Wilson, J.:
          <article-title>Life cycles, contingency, and agency: Growth, development, and change in English industrial districts and clusters</article-title>
          .
          <source>Environment and Planning A</source>
          .
          <volume>39</volume>
          (
          <issue>12</issue>
          ),
          <fpage>2975</fpage>
          -
          <lpage>2992</lpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4. Press,
          <string-name>
            <surname>K.</surname>
          </string-name>
          :
          <article-title>Divide to conquer? Limits to the adaptability of disintegrated, flexible specialization clusters</article-title>
          .
          <source>J. of Economic Geography</source>
          .
          <volume>8</volume>
          (
          <issue>4</issue>
          ),
          <fpage>565</fpage>
          -
          <lpage>580</lpage>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Suire</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vicente</surname>
          </string-name>
          , J.:
          <article-title>Clusters for life or life cycles of clusters: in search of the critical factors of clusters' resilience</article-title>
          .
          <source>Entrepreneurship and Regional Development</source>
          .
          <volume>26</volume>
          (
          <issue>1-2</issue>
          ),
          <fpage>142</fpage>
          -
          <lpage>164</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Tsai</surname>
            ,
            <given-names>B.-H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Cluster evolution of IC industry from Taiwan to China</article-title>
          .
          <source>Technological Forecasting and Social Change</source>
          .
          <volume>76</volume>
          (
          <issue>8</issue>
          ),
          <fpage>1092</fpage>
          -
          <lpage>1104</lpage>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Bek</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bek</surname>
            ,
            <given-names>N.N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sheresheva</surname>
            ,
            <given-names>M.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Johnston</surname>
          </string-name>
          , W.J.:
          <article-title>Perspectives of SME innovation clusters development in Russia</article-title>
          .
          <source>J. of Business and Industrial Marketing</source>
          .
          <volume>28</volume>
          (
          <issue>3</issue>
          ),
          <fpage>240</fpage>
          -
          <lpage>259</lpage>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Zeng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiao</surname>
          </string-name>
          , R.:
          <article-title>Modelling of cluster supply network with cascading failure spread and its vulnerability analysis</article-title>
          .
          <source>International J. of Production Research</source>
          .
          <volume>52</volume>
          (
          <issue>23</issue>
          ),
          <fpage>6938</fpage>
          -
          <lpage>6953</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Boush</surname>
          </string-name>
          , G.D.:
          <article-title>Klasteryi v ekonomike: nauchnaya teoriya, metodologiya issledovaniya, kontseptsiya upravleniya</article-title>
          .
          <source>Omskiy gosudarstvennyiy universitet</source>
          ,
          <source>Omsk</source>
          (
          <year>2013</year>
          )
          <article-title>[Боуш, Г</article-title>
          .Д.:
          <article-title>Кластеры в экономике: научная теория, методология исследования, концепция управ- ления. Омский государственный университет</article-title>
          ,
          <source>Омск</source>
          (
          <year>2013</year>
          )]
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Dong</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Deglise-Hawkinson</surname>
            ,
            <given-names>J.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Oyen</surname>
            ,
            <given-names>M.P.</given-names>
          </string-name>
          , van, Singer,
          <string-name>
            <surname>D.J.:</surname>
          </string-name>
          <article-title>Dynamic control of a closed two-stage queueing network for outfitting process in shipbuilding</article-title>
          .
          <source>Computers &amp; Operations Research</source>
          .
          <volume>72</volume>
          ,
          <fpage>1</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Fernández</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mateu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moral</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sole-Mauri</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>A predictor model for the composting process on an industrial scale based on Markov processes</article-title>
          .
          <source>Environmental Modelling &amp; Software. 79</source>
          ,
          <fpage>156</fpage>
          -
          <lpage>166</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Li</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Northrop</surname>
            ,
            <given-names>W.F.</given-names>
          </string-name>
          :
          <article-title>A Markov Chain-based quantitative study of angular distribution of photons through turbid slabs via isotropic light scattering</article-title>
          .
          <source>Computer Physics Communications</source>
          .
          <volume>201</volume>
          ,
          <fpage>77</fpage>
          -
          <lpage>84</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Drakos</surname>
            ,
            <given-names>N.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wahl</surname>
            ,
            <given-names>L.M.:</given-names>
          </string-name>
          <article-title>Extinction probabilities and stationary distributions of mobile genetic elements in prokaryotes: The birth-death-diversification model</article-title>
          .
          <source>Theoretical Population Biology</source>
          .
          <volume>106</volume>
          ,
          <fpage>22</fpage>
          -
          <lpage>31</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Bevan</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ford</surname>
            ,
            <given-names>D.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grover</surname>
            ,
            <given-names>M.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shapiro</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maroudas</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thyagarajan</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sehgal</surname>
            ,
            <given-names>R.M.:</given-names>
          </string-name>
          <article-title>Controlling assembly of colloidal particles into structured objects: Basic strategy and a case study</article-title>
          .
          <source>J. of Process Control</source>
          .
          <volume>27</volume>
          ,
          <fpage>64</fpage>
          -
          <lpage>75</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Kristensen</surname>
            ,
            <given-names>A.R.</given-names>
          </string-name>
          :
          <article-title>From biological models to economic optimization</article-title>
          .
          <source>Preventive Veterinary Medicine</source>
          .
          <volume>118</volume>
          (
          <issue>2-3</issue>
          ),
          <fpage>226</fpage>
          -
          <lpage>237</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Kobayashi</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kaito</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lethanh</surname>
          </string-name>
          , N.:
          <article-title>A competing Markov model for cracking prediction on civil structures</article-title>
          .
          <source>Transportation Research Part B: Methodological</source>
          .
          <volume>68</volume>
          ,
          <fpage>345</fpage>
          -
          <lpage>362</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Escandell-Montero</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chermisi</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martínez-Martínez</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gómez-Sanchis</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barbieri</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Soria-Olivas</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mari</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vila-Francés</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stopper</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gatti</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Martín-Guerrero</surname>
            ,
            <given-names>J.D.</given-names>
          </string-name>
          :
          <article-title>Optimization of anemia treatment in hemodialysis patients via reinforcement learning</article-title>
          .
          <source>Artificial Intelligence in Medicine</source>
          .
          <volume>62</volume>
          (
          <issue>1</issue>
          ),
          <fpage>47</fpage>
          -
          <lpage>60</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Herremans</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Weisser</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sörensen</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Conklin</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Generating structured music for bagana using quality metrics based on Markov models</article-title>
          .
          <source>Expert Systems with Applications</source>
          .
          <volume>42</volume>
          (
          <issue>21</issue>
          ),
          <fpage>7424</fpage>
          -
          <lpage>7435</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Ayesta</surname>
            ,
            <given-names>U.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Erausquin</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ferreira</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jacko</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Optimal dynamic resource allocation to prevent defaults</article-title>
          .
          <source>Operations Research Letters</source>
          .
          <volume>44</volume>
          (
          <issue>4</issue>
          ),
          <fpage>451</fpage>
          -
          <lpage>456</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Dimuro</surname>
            ,
            <given-names>G.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Costa</surname>
            ,
            <given-names>A.C.</given-names>
          </string-name>
          , R.,
          <article-title>da: Regulating social exchanges in open MAS: The problem of reciprocal conversions between POMDPs and HMMs</article-title>
          .
          <source>Information Sciences</source>
          .
          <volume>323</volume>
          ,
          <fpage>16</fpage>
          -
          <lpage>33</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Renou</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tomala</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Approximate implementation in Markovian environments</article-title>
          .
          <source>J. of Economic Theory. 159 (A)</source>
          ,
          <volume>401</volume>
          -
          <fpage>442</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Ben-Zvi</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chernonog</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Avinadav</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>A two-state partially observable Markov decision process with three actions</article-title>
          .
          <source>European J. of Operational Research</source>
          .
          <volume>254</volume>
          (
          <issue>3</issue>
          ),
          <fpage>957</fpage>
          -
          <lpage>967</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>So</surname>
            ,
            <given-names>M.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thomas</surname>
            ,
            <given-names>L.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Lending decisions with limits on capital available: The polygamous marriage problem</article-title>
          .
          <source>European J. of Operational Research</source>
          .
          <volume>249</volume>
          (
          <issue>2</issue>
          ),
          <fpage>407</fpage>
          -
          <lpage>416</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Bai</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhou</surname>
            ,
            <given-names>D.Q.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meng</surname>
            ,
            <given-names>F.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ju</surname>
          </string-name>
          , K.Y.:
          <article-title>Desirable policies of a strategic petroleum reserve in coping with disruption risk: A Markov decision process approach</article-title>
          .
          <source>Computers &amp; Operations Research</source>
          .
          <volume>66</volume>
          ,
          <fpage>58</fpage>
          -
          <lpage>66</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Wen</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xu</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hu</surname>
            ,
            <given-names>Q.</given-names>
          </string-name>
          :
          <article-title>Dynamic capacity management with uncertain demand and dynamic price</article-title>
          .
          <source>International J. of Production Economics</source>
          .
          <volume>175</volume>
          ,
          <fpage>121</fpage>
          -
          <lpage>131</lpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Espada</surname>
            , Jr.,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Apan</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>McDougall</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Spatial modelling of natural disaster risk reduction policies with Markov decision processes</article-title>
          .
          <source>Applied Geography</source>
          .
          <volume>53</volume>
          ,
          <fpage>284</fpage>
          -
          <lpage>298</lpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Balashov</surname>
            ,
            <given-names>A.I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rogova</surname>
            ,
            <given-names>E.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tkachenko</surname>
            ,
            <given-names>E.A.</given-names>
          </string-name>
          :
          <article-title>Innovatsionnaya aktivnost rossiyskih predpriyatiy: problemyi izmeneniya i usloviya rosta. Sankt-Peterburgskiy gosudarstvennyiy politehnicheskiy universitet, Sankt-</article-title>
          <string-name>
            <surname>Peterburg</surname>
          </string-name>
          (
          <year>2010</year>
          )
          <article-title>[Балашов, А</article-title>
          .И, Рогова, Е.М., Тка- ченко Е.А.:
          <article-title>Инновационная активность российских предприятий: проблемы измере- ния и условия роста. Санкт-Петербургский государственный политехнический уни- верситет,</article-title>
          <string-name>
            <surname>Санкт-Петербург</surname>
          </string-name>
          (
          <year>2010</year>
          )]
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Boush</surname>
            ,
            <given-names>G.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kulikova</surname>
            ,
            <given-names>O.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shelkov</surname>
            ,
            <given-names>I.K.</given-names>
          </string-name>
          :
          <article-title>Agentnoe modelirovanie protsessov klasteroobrazovaniya v regionalnyih ekonomicheskih sistemah</article-title>
          .
          <source>Ekonomika regiona. 1</source>
          ,
          <fpage>64</fpage>
          -
          <lpage>77</lpage>
          (
          <year>2016</year>
          )
          <article-title>[Боуш, Г</article-title>
          .Д.,
          <string-name>
            <surname>Куликова</surname>
            <given-names>О</given-names>
          </string-name>
          .М.,
          <string-name>
            <surname>Шелков</surname>
          </string-name>
          , И.К.:
          <article-title>Агентное моделирование про- цессов кластерообразования в региональных экономических системах</article-title>
          .
          <source>Экономика ре- гиона. 1</source>
          ,
          <fpage>64</fpage>
          -
          <lpage>77</lpage>
          (
          <year>2016</year>
          )]
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Daniel</surname>
          </string-name>
          , W.: Stroock An Introduction to Markov
          <source>Processes (Graduate Texts in Mathematics)</source>
          . Springer Berlin Heidelberg (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>30. Mashinnoe obuchenie. Raspoznavanie, http://www.machinelearning.ru</mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Infographer</surname>
          </string-name>
          , http://www.infographer.ru/dashboard_practice
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>