<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Computer Cognitive Modeling of the Innovative System for the Exploration of the Regional Development Strategy?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Southern Federal University</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rostov-on-Don</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Russia</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>helen_makarova@mail.ru</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Saratov State University</institution>
          ,
          <addr-line>Saratov</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The purpose of this research is to propose a methodology for cognitive modeling decision making and establishing a set of control actions to develop and strengthen the sustainability of the regional innovation system. The subject of the study is the functional interrelationships of the elements of the regional innovation system. The scientific hypothesis of the research is based on the need for a correlating synergetic interaction between the regional system of higher education and the innovation system of the region to stimulate and develop innovative activity and commercialize innovation. The novelty of the approach consists in applying the methodology of cognitive modeling, which allows modeling the consequences of decisions taken on the interaction of all factors of the regional innovation system: state, science and business at the regional level and lays the foundation for the effective use of higher education institutions potential in promoting opportunities for region development. The authors proposed a model for analyzing the relationship between the regional system of higher education and the regional innovation system and developed a cognitive map of their interrelationships based on scenario impulse modeling of possible development scenarios. The results of the study provide an opportunity to show a detailed and objective assessment of the interrelationship between the regional system of higher education and the regional innovation system, which has great potential in assessing the effectiveness and quality of innovative development of the regions for monitoring their investment prospects and public administration objectives.</p>
      </abstract>
      <kwd-group>
        <kwd>computer modeling</kwd>
        <kwd>cognitive modeling</kwd>
        <kwd>impulse modeling</kwd>
        <kwd>decision-making</kwd>
        <kwd>regional development</kwd>
        <kwd>regional innovation system</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>According to the concept of regional innovation systems, the specific
socioeconomic conditions of the region have a decisive influence on its innovative
development and the development of companies located in it. The territorial
distribution of innovation, the presence of inter-sectoral differences and the power
of the influence of various factors on the processes of innovative development of
the regions attract a lot of attention and are studied in foreign and domestic
scientific works to find potential mechanisms by which they can stimulate
regional innovation activity and economic growth. The questions of determining
the composition of factors, the methodology for measuring this influence and
the development of tools are debatable. The present research is devoted to the
substantiation of approaches to solving these problems.</p>
      <p>The special individual characteristics of the region and the spatial proximity
of certain factors of the regional innovation system contribute to the creation
of innovations, the effect of the spillover effect and the “overflow” of knowledge
in innovative systems which serves as a catalyst for their dissemination, the
degree of involvement of regional structures in innovative processes stimulates
the transfer of information, reduces costs and risks associated with innovations.</p>
      <p>
        The problem of indicators search for modeling the innovative development of
the region is relevant in the context of the need to build an innovative economy.
The phenomenon of regional economic growth, the positive impact of academic
institutions on it through the transfer of R&amp;D results from universities to other
factors in the regional innovation system and the emerging spillover effects have
been actively discussed in foreign and domestic scientific papers for a long time
[
        <xref ref-type="bibr" rid="ref14 ref3">3, 14</xref>
        ]. In general, a lot of attention is paid to domestic and foreign research in
developing a criteria system for assessing the innovative development of regions
and a set of indicators that make it possible to produce such an assessment.
      </p>
      <p>
        Foreign researchers [
        <xref ref-type="bibr" rid="ref1 ref11 ref4 ref5 ref7 ref8">1, 4, 5, 7, 8, 11</xref>
        ] distinguish and analyze such economic
factors as human capital, the existence of individual institutions, the activities
of local authorities, the interaction between different factors, and others. Most
studies are based on measurable indicators of the number of scientific personnel
and patent activity as an indicator and measure of the level of effectiveness of
innovation activity in the region.
      </p>
      <p>
        Domestic research is mainly focused on the innovative development of the
region through the HR component and education system, such aspects of the
regionalization of innovation development as personnel support are singled out;
social and environmental problems of innovation; innovative infrastructure
development; predominantly regional character of small innovative entrepreneurship;
social and legal issues of innovation activity regulation; quantitative and
qualitative composition of employment [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>Given the importance, complexity and multidimensionality of the
interrelationships between the regional system of higher education and the regional
innovation system, it is necessary to develop a system of effective measures, weighted
management decisions with a view to building a strategy for innovative
development of the region. In this case, it is possible to use the tools for researching
problems and methods for providing conditions for the rational development of
socio-economic systems, methods for system analysis of possible instruments and
ways to achieve goals at different levels of the socio-economic system. Today, the
most common tools for researching and modeling complex systems are various
methods of mathematical linear programming for solving optimization problems;
statistical regression methods for solving problems of identification of the object
under study and forecasting its future states; cybernetic models for solving the
problem of “input-output” type in management.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Theoretical Analysis</title>
      <p>
        To assess the role of regional higher education system institutions in regional
development, various models are used in foreign studies that allow a multilateral
analysis of the contribution of universities to the socio-economic and
innovative development of regions. Methods for analyzing the impact of universities
on regional development and assessing their contribution to the socio-economic
development of the region, depending on the indicators used, are divided into
qualitative and quantitative, theoretical and empirical methods for investigating
the university’s interaction with other subjects of the region economy [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ].
      </p>
      <p>
        The influence degree of the universities activities on regional innovation
development, as a rule, is estimated in the long run and by measurable indicators:
the number of scientific personnel, the number of patents, the level of
university developments sales to the direct amount of scientific development costs; the
number of patents granted and dissertations defences; the number of scientific
articles published annually; number of university graduates. The main aspect
of the assessment is the significant relationship between the effects of university
research and corporate patent activity [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ].
      </p>
      <p>In Russia, these models are applicable with significant limitations. Special
methods for estimating and predicting irregular chaotic and quasiperiodic
stationary time series generated by complex nonlinear systems, such as regional
innovation systems, have not been sufficiently developed in Russian practice,
including, due to the lack of specific data for analyzing the performance of the
higher education system and the regional innovation system (for example, the
specifics of procedures for patenting and the application of patent law). The
general methodology for quantitative and qualitative assessment of the higher
education effectiveness and the degree of its impact on the region innovative
development, as well as the study of the relationship between the regional
system of higher education and the regional innovation system has not yet been
developed.</p>
      <p>To explore such relationships, it is possible to use the cognitive approach
which allows formulating and refining hypotheses about the functioning of the
education system viewed as a complex, semistructured system that consists of
separate but interconnected elements and subsystems. These approaches can
complement methods for assessing the effectiveness of innovation activities in
the regions in the field of research processes of regional innovation development
in the Russian conditions.</p>
      <p>In this work, the authors used the method of cognitive modeling to study the
problems of complex systems and compiled a cognitive map for a semistructured
system of interrelations between the regional system of higher education and the
regional innovation system.
3
3.1</p>
    </sec>
    <sec id="sec-3">
      <title>Research Methodologyate</title>
      <sec id="sec-3-1">
        <title>Cognitive modeling</title>
        <p>
          Under cognitive modeling, the authors mean solving a set of system tasks:
identifying an object in the form of a cognitive model, analyzing ways and cycles of
a cognitive map, impulse modeling (scenario analysis), analyzing the
observability, stability, controllability, optimization, the problem of analyzing the
characteristics of adaptivity, self-organization, decision making, structural analysis of
systems (analysis of connectivity and complexity), analysis of the relationship
between the structural properties of the system and the nature of the impulse
processes. The solving possibility of these problems is supported by the software
system of cognitive modeling [
          <xref ref-type="bibr" rid="ref12">12</xref>
          ].
        </p>
        <p>When using the cognitive approach, it is necessary to compile a cognitive
model for analyzing relationship between the regional system of higher education
and the regional innovation system:</p>
        <p>
          G = hV; Ei;
where G is the sign oriented graph (digraph) in which: V is the set of nodes
Vi 2 V , i = 1; 2; : : : ; k are elements of researched system; E is the set of edges,
where edges eij 2 E, i; j = 1; 2; : : : ; N reflect the relations between the nodes
Vi and Vj (positive if the increase (decrease) of one factor leads to an increase
(decrease) of the other, negative, when the increase (decrease) of one factor leads
to a decrease (increase) in another factor) [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ].
        </p>
        <p>The set E can be represented in the form E = E+ [ E , in which E+ is a
subset of positive constraints, and E is a subset of negative constraints.</p>
        <p>The exponent eij characterizes the direction and intensity (force) of the
influence of the ei factor on ej .</p>
        <p>eij = E(ei; ej )
where: eij is the norm indicator of the force influence of ei concept on ej . The
estimate eij has the following properties:
1. The estimate eij is assigned in the interval from -1 to 1.
2. eij = 1, if ei has the greatest positive effect on ej .
3. eij = 0, in the absence of influence between ei and ej factors.
4. eij = 1, if ei has the largest negative influence on the ej factor.</p>
        <p>Obviously, the education system and the innovation system are
interconnected at the regional level. To construct the initial cognitive map, a model
is constructed that reflects the current state of the education system and the
regional innovation system and their impact on the region’s innovative
development.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>Cognitive mapping</title>
        <p>
          In the model under consideration [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ], the variables recommended by the
Ministry of Education will be used to assess the impact of the education system,
including indicators of educational activities, scientific and innovative activities,
human resource development, international activities, infrastructure, graduate
employment and financial indicators.
        </p>
        <p>In addition to the main factors, the subjects of regional innovation system
interaction: the state (in the name of federal regulatory systems – node B1),
business (providing the production of goods, works, services and the entire process of
regional economy reproduction – node B2) and science (education system – node
B3), on the innovative development of the region – the node B0 is influenced by
the following groups of indicators.</p>
        <p>The first group of indicators named “economic development of the region”
(node B4) includes GRP per capita, investment in fixed assets per capita and
consumer expenses per capita. This group depends on the investment from the
federal regulatory systems and production, and influences innovative
development of the region (node B0).</p>
        <p>The second group of indicators “financial indicators of innovation activity”
(node B5) is divided into internal costs for research and development (R&amp;D),
costs for technological innovation of enterprises and costs for radical innovation
of enterprises.</p>
        <p>The third group of indicators “innovative and industrial potential of the
region” (node B6) unites innovative activity of enterprises, the share of innovative
goods and services in the total volume of shipped goods and services, and the
innovative attractiveness of the region.</p>
        <p>The fourth group of indicators “intellectual potential of the region” (node
B7) includes the advanced production technologies used, the number of patent
applications, the number of personnel engaged in research and development, and
directly related to the education system (node B3).</p>
        <p>Risks group (node В8) include market risk which is determined by the
probability of investment loss due to changes in supply and demand for innovative
products; business or production risk which is expressed in mistakes of the
innovation evaluation, the duration of the investment period, the selection and
training of personnel engaged in research and development; financial risk
associated with the depreciation of money and assets during the period of investment
and commercial implementation of innovations, as well as the risk of lack of the
necessary finance amount for investment. This group has a negative impact on
the education system and the regional innovation system, so they need to be
taken into account when building an innovative development strategy for the
region.</p>
        <p>6</p>
        <p>State and Regulatory Systems
В1</p>
        <p>Innovation
В0 development</p>
        <p>Business and
В2 production</p>
        <p>Regional Innovation System</p>
        <p>Economic
development of
В4 the region
GRP per capita
Investments in
fixed capital per</p>
        <p>capita
Consumer
expences per
capita</p>
        <p>B5</p>
        <p>Financial
indicators of
region innovation</p>
        <p>activity
Internal costs of
research and
development</p>
        <p>Costs for
technological
innovation
organizations
Costs of radical
enterprise
innovation
В8</p>
        <p>Risks</p>
        <p>Market risk
Production risk
Financial risk
В6</p>
        <p>Innovation
potential of the</p>
        <p>region
Innovative activity
of enterprises</p>
        <p>The share of
innovative goods
and services in the
total volume of
shipped goods and
services</p>
        <p>Innovative
attractiveness of the
region
В7
Intellectual potential</p>
        <p>of the region
Number of patent</p>
        <p>applications
Number of staff
engaged in
research and
developmen
Advanced production</p>
        <p>technologies uses
Science and Higher Education System
В3
Educational activity</p>
        <p>Infrastructure</p>
        <p>Scientific and
innovative activity
Human resource
development
International
activity</p>
        <p>Employment of</p>
        <p>graduates
Financial stability
Science-based
income
systefmor bfuoirldbinugiltdheinrgegtiohnestrreagteigoynosftirnantoevgatyivoefdeinvenloopvmateinvte(Gd1e)velopment (G1)
An enlarged cognitive map of the interrelationship between the regional system of
higher education and the regional innovation system for building the region strategy
Aofninennolvaartgiveeddceovgelnoiptmiveentmisacponosftrtuhcete din.terrelationship between the regional
system of higher education and the regional innovation system for building the
region strategy of innovative development is constructed.</p>
        <p>The results of the analysis of such an “aggregated” cognitive model (G2) are
easier to interpret without distorting the conclusions outlined above.</p>
        <p>In this cognitive map (G2), all edges between nodes are positive and there are
sixteen (even number) interconnected positive feedback cycles, which indicates
the structural instability of this system. This model scenario and analysis of
its variants can supplement the conclusions drawn and show possible ways of
overcoming the indicated problems.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>Interrelations Establishment between Factors</title>
        <p>There are four blocks of factors affecting the innovative development of the
region as a whole, allocated in this research. A heuristic meaning description of
individual parameters and the relationships between them is presented below in
the form of cognitive block models. The fact that there are causal relationships
(or lack thereof) between the sources of risk factors – the nodes of cognitive
maps, as well as the nature of the mutual influence of such nodes on each other
– has been established by expert methodology.</p>
        <p>Block 1: 1) Innovation development of the region; 2) Financial indicators of
innovation activity; 3) Innovative-industrial potential (Fig. 3). Improving the
financial performance of innovative activities +! for innovation and industrial
potential, there is an increase in the number of industrial innovations, a growing
share of innovative goods and services in the total volume of goods and services
shipped, which affects the innovative development of the region.</p>
        <p>Block 2: 1) Innovation development of the region; 2) Economic development;
3) Financial indicators of innovation activity (Fig. 4). The increase in the
financial indicators of innovation activity +! for economic development, which
causes the growth of investments in fixed capital per capita and consumer
expenses per capita, creates favorable conditions for the innovation development
of the region.</p>
        <p>Block 3: 1) Innovation development of the region; 2) Production; 3) Economic
development; 4) Innovation-industrial potential (Fig. 5). The positive influence of
the innovation and industrial potential +! on the production of goods, works,
services and the entire process of reproduction of the regional economy,
combining the innovative activity of enterprises, the share of innovative goods and
services in the total volume of goods and services shipped, increasing the region’s
innovative attractiveness.</p>
        <p>Block 4: 1) Innovation development of the region; 2) Production; 3)
Economic development; 4) Financial indicators of innovation activity (Fig. 6). The
positive impact of financial indicators +! on economic development leads to
an increase in GRP per capita, investment in fixed capital per capita and
increases consumer expenses per capita, which has a positive effect on the region’s
innovative attractiveness.</p>
        <p>If you carefully review the chains and cycles of the cognitive map (G2) in
Fig. 2, then it is possible to combine a number of indicators of the society and
the higher education system state into larger blocks (Fig. 7). The results of
the analysis of such an “enlarged” cognitive model (G3) are easier to illustrate
without distorting the above-mentioned conclusions.</p>
        <p>The next stage of cognitive analysis operation is the scenarios construction
for the development of situations based on impulse modeling, which will allow
us to substantiate the main results of this study.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Impulse Modeling</title>
      <p>Carrying out a computational experiment by impulse simulation requires
preliminary planning which consists in identifying among the early cognitive maps
the ones that will be managers, target and indicative. The chosen will be those
nodes into which perturbing (control) impacts must be introduced; target will
be those whose specified change is necessary to achieve; edges-indicators will be
those that characterize the development of the economic processes of the model.</p>
      <p>On the constructed cognitive map of the interrelation of the regional
innovation system for building the strategy of innovation development of the region
(Fig. 7), an impulse simulation of possible scenarios of the system development
was carried out.</p>
      <p>
        In our research we use the model of the impulse process, known in the theory
of automatic control, proposed by F. Roberts [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] for modeling the behavior of
complex systems identified by the graph, as well as used in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], in the form (1):
xi(n + 1) = xvi(n) +
(1)
k 1
X fij Pj (n) + Qi(n)
j=1
It should be noted that the impulse (control action) in the impulse process
on cognitive maps during theoretical investigation is represented by an ordered
sequence of values xi(n); xi(n + 1); : : : in i nodes without time-bound, which
may be given in interpreting the results of a computational experiment.
      </p>
      <p>As a result of the computational experiment, it became possible to construct,
in accordance with the experimental plan, 15 scenarios for the development of
situations in the region – the modeling object obtained by successively
introducing perturbations into one, two, three nodes of the cognitive map.</p>
      <p>The number of simulation cycles was determined from the observation of the
processes development trend until the changes in trends ceased to be observed,
and their character became quite obvious.</p>
      <p>There are examples of the three most characteristic scenarios of the system
development (based on the factors of region sustainable development) and their
analysis is given. These results give grounds to recommend the appropriate
mechanism of decision making and set of control actions with the aim of enhancing
the sustainability of the development of the regional innovation system.
4.1</p>
      <sec id="sec-4-1">
        <title>Scenario 1</title>
        <p>The impulse enters one node of the financial indicators of innovation activity
(B5).</p>
        <p>The growth of financial indicators of innovation activity after the third tact
leads to an increase in production, economic development and innovative and
industrial potential, and after n &gt; 5, all factors rapidly grow (Fig. 8).</p>
        <p>Results. The growth of financial indicators of innovation activity also affects
production (B2), economic development (B4) and innovative and industrial
potential of the region (B6).</p>
        <p>Fig. 8. Impulse processes in node financial indicators of region innovation activity (B5),
Q = fq1 = 0; 0; 0; +1; 0g
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Scenario 2</title>
        <p>The impulse arrives at two nodes. Growth of financial indicators of innovation
activity (B5) +1 and 1 decrease in economic development (B4).</p>
        <p>The increase in the growth of financial indicators of innovation activity due
to the reduction of economic development also leads to positive results (Fig. 9).</p>
        <p>Results. The growth of financial indicators of innovation activity due to the
reduction of economic development leads to sustainable development of the
region due to factors of production and innovative industrial potential.
4.3</p>
      </sec>
      <sec id="sec-4-3">
        <title>Scenario 3</title>
        <p>The impulse comes in two nodes. Growth of financial indicators of innovation
activity (B5) +1 and 1 decrease in innovation-industrial potential (B6).</p>
        <p>The growth of financial indicators of innovation activity, with a decrease in
innovation – industrial potential, entails multidirectional impacts at the first
stages of the simulation. At n &gt; 2, a sharp decrease in all indicators is observed
(Fig. 10).</p>
        <p>Results. The reduction of innovation-industrial potential negatively affects
the innovation development of the region.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Conclusion</title>
      <p>In order to find the most effective management tools and tools for interaction
between the regional higher education system and the regional innovation
system, it is possible to analyze their mutual influence through cognitive analysis.
Fig. 9. Impulse processes in two nodes: financial indicators of region innovation activity
(B5), economic development (B4) Q = fq1 = 0; 0; 1; +1; 0g
Using impulse modeling on the basis of the cognitive model, the basic
prerequisites of the concept of sustainable development on the influence of the higher
education system and the regional innovation system for building the strategy
of innovative development of the region were tested.</p>
      <p>The innovative and industrial potential of the region unites innovative
activity of enterprises; the share of innovative goods and services in the total volume
of shipped goods and services, the innovative attractiveness of the region directly
affects the innovative development of the region.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Arbo</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Benneworth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Understanding the regional contribution of higher education institutions</article-title>
          .
          <source>OECD Education Working Papers</source>
          <volume>9</volume>
          ,
          <article-title>Organisation for Economic Co-operation and</article-title>
          <string-name>
            <surname>Development</surname>
          </string-name>
          (Jul
          <year>2007</year>
          ), http://www.oecdilibrary.
          <article-title>org/education/understanding-the-regional-contribution-of-highereducation-institutions_161208155312</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Asheim</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boschma</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cooke</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Constructing regional advantage: Platform policies based on related variety and differentiated knowledge bases</article-title>
          .
          <source>Regional Studies</source>
          <volume>45</volume>
          (
          <issue>7</issue>
          ),
          <fpage>893</fpage>
          -
          <lpage>904</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Autant-Bernard</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Science and knowledge flows: evidence from the French case</article-title>
          .
          <source>Research Policy</source>
          <volume>30</volume>
          (
          <issue>7</issue>
          ),
          <fpage>1069</fpage>
          -
          <lpage>1078</lpage>
          (
          <year>2001</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Benneworth</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          : The engaged university in practice? In: Benneworth,
          <string-name>
            <surname>P</surname>
          </string-name>
          . (ed.)
          <article-title>University engagement with socially excluded communities</article-title>
          , pp.
          <fpage>329</fpage>
          -
          <lpage>344</lpage>
          . Springer (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Broekel</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brenner</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Regional factors and innovativeness: an empirical analysis of four German industries</article-title>
          .
          <source>The Annals of Regional Science</source>
          <volume>47</volume>
          (
          <issue>1</issue>
          ),
          <fpage>169</fpage>
          -
          <lpage>194</lpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Casti</surname>
            ,
            <given-names>J.L.</given-names>
          </string-name>
          :
          <article-title>Connectivity, complexity, and catastrophe in large-scale systems</article-title>
          .
          <source>Wiley IIASA international series on applied systems analysis</source>
          , John Wiley and Sons, Chichester - New York - Brisbane - Toronto (
          <year>1979</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Doran</surname>
            ,
            <given-names>H.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lockwood</surname>
            ,
            <given-names>J.R.</given-names>
          </string-name>
          :
          <article-title>Fitting value-added models</article-title>
          .
          <source>Journal of Educational and Behavioral Statistics</source>
          <volume>31</volume>
          (
          <issue>2</issue>
          ),
          <fpage>205</fpage>
          -
          <lpage>230</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Etzkowitz</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leydesdorff</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>The triple helix - university-industry-government relations: A laboratory for knowledge based economic development</article-title>
          .
          <source>EASST Review</source>
          <volume>14</volume>
          (
          <issue>1</issue>
          ),
          <fpage>14</fpage>
          -
          <lpage>19</lpage>
          (
          <year>1995</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Firsova</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makarova</surname>
          </string-name>
          , E.:
          <article-title>Cognitive modelling the impact of a regional system of higher education in the innovative development of the region</article-title>
          . Izvestiya of Saratov University. New series. Series: Economics.
          <source>Management. Law</source>
          <volume>15</volume>
          (
          <issue>4</issue>
          ),
          <fpage>411</fpage>
          -
          <lpage>417</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Firsova</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makarova</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>Factors affecting the innovative development of the region</article-title>
          . Izvestiya of Saratov University. New series. Series: Economics.
          <source>Management. Law</source>
          <volume>17</volume>
          (
          <issue>2</issue>
          ),
          <fpage>141</fpage>
          -
          <lpage>147</lpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Goddard</surname>
            ,
            <given-names>J.B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chatterton</surname>
            ,
            <given-names>R.:</given-names>
          </string-name>
          <article-title>The response of universities to regional needs</article-title>
          .
          <source>European Journal of Education</source>
          <volume>35</volume>
          (
          <issue>4</issue>
          ),
          <fpage>475</fpage>
          -
          <lpage>496</lpage>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Gorelova</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Makarova</surname>
          </string-name>
          , E.:
          <article-title>Simulation of socio-economical system and high education system problem correlation by means of cognitive approach</article-title>
          .
          <source>Large-scale Systems Control 30.1</source>
          ,
          <fpage>431</fpage>
          -
          <lpage>452</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Roberts</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Graph theory and its applications to problems of society</article-title>
          .
          <source>Society for Industrial and Applied Mathematics</source>
          , Philadelphia (
          <year>1978</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14. T¨odtling,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Trippl</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          :
          <article-title>One size fits all?: Towards a differentiated regional innovation policy approach</article-title>
          .
          <source>Research Policy</source>
          <volume>34</volume>
          (
          <issue>8</issue>
          ),
          <fpage>1203</fpage>
          -
          <lpage>1219</lpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>van Vught</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Westerheijden</surname>
            ,
            <given-names>D.F.</given-names>
          </string-name>
          :
          <article-title>Multidimensional ranking: a new transparency tool for higher education and research</article-title>
          .
          <source>Higher Education Management and Policy</source>
          <volume>22</volume>
          (
          <issue>3</issue>
          ),
          <fpage>6</fpage>
          -
          <lpage>11</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>