<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Workbench for vulnerability analysis of Vietnam energy sector</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Matrosov Institute for System Dynamics and Control Theory of SB RAS</institution>
          ,
          <addr-line>134 Lermontov St., Irkutsk, Russia, 664033</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Melentiev Energy Systems Institute of Siberian Branch of SB RAS</institution>
          ,
          <addr-line>Lermontov Str. 130, Irkutsk, Russia, 664033</addr-line>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0003</lpage>
      <abstract>
        <p>The paper addresses the problem of supporting research of the Vietnam energy sector vulnerability. The vulnerability study is understood as search for system weak points. A mathematical model has been developed to describe the energy sector of Vietnam. The model takes into account the characteristics and constraints of all objects of the energy sector: suppliers, consumers and the transport system. To study the vulnerability of the energy sector and make decisions, we have created a workbench that allows simulating increased loads and calculating the consequences. Specification-based database application development technology was applied to create the workbench. This technology allows you to quickly develop applications that provide interaction with databases and digital maps, as well as support interaction with external software modules. The main advantage of the proposed workbench is its flexibility and applicability at all stages of the study of the Vietnam energy sector vulnerability starting from gathering the energy operation and development information and ending with evaluation of satisfying demand in energy.</p>
      </abstract>
      <kwd-group>
        <kwd>Decision Support System</kwd>
        <kwd>Vulnerability Analysis</kwd>
        <kwd>Energy Sector</kwd>
        <kwd>Specification</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The resilience of an energy system can be understood as the system ability to prevent
damage before disturbance events, mitigate losses during the events, and improve the
recovery capability after the events [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The interdependent national energy system
are united to form a country energy sector.
      </p>
      <p>
        The main stages of the interdependent energy systems resilience research scheme
are presented in [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The central role in the resilience research plays the vulnerability
analysis [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. The vulnerability characterizes the scale of negative system
consequences caused by a disturbance impact on interdependent energy systems.
      </p>
      <p>The vulnerability analysis process consists of the following general stages:
Copyright © 2020 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
1. gathering an energy sector operation and development information
2. calculation on an energy sector model
3. solution data processing
4. solution data presentation
5. evaluation of satisfying demands</p>
      <p>A workbench presented in this paper supports the vulnerability analysis of Vietnam
energy sector and automates the stages from 2 to 5.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Related work</title>
      <p>
        Decision support systems have a critical role in assessing the natural disasters risk of
energy systems networks and in enabling their managers to test the effectiveness of
alternative mitigation strategies and investments on resilience [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. For example,
CIPCast decision support system can predict scenarios of punctual damages to the
different critical infrastructure components and impact scenarios, where services outages
induced by the physical damage to critical infrastructure components, are assessed at
different scales [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. CIPCast was as a combination of free/open source software
environments including Geographic Information System (GIS) [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        A GIS technology play a major role in the construction of such decision support
systems [
        <xref ref-type="bibr" rid="ref7 ref8 ref9">7-9</xref>
        ] because multi-source data and GIS-integrated analysis can contribute to
a better disturbance prediction and mitigation planning [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ].
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Methodology</title>
      <p>The workbench represents ways of energy sector development as a directed graph
(see Fig. 1). The first moment is always equal 0 and presents the current year. Each
node of the graph represents the energy sector state at specific moment (year) in the
future. Each arc defines a transition from state at one moment in time (year) to
another state at next moment in time (year).</p>
      <p>Each node of the energy sector development graph is associated with the following
information about the energy sector:
• demands in energy;
• energy transmission capacity and cost;
• energy production capacity and cost;
• energy transformation capacity and cost.</p>
      <p>Thus energy sector development scenario is described as sequence of nodes at
different time moments:</p>
      <p>Node 0 — the energy sector model data for initial time moment
Node 1 — the energy sector model data for second time moment
Node 2 — the energy sector model data for third time moment</p>
      <p>Node 3 and further — energy sector model data for next time moment
3.1</p>
      <sec id="sec-3-1">
        <title>General view of energy sector balance model</title>
        <p>The Vietnam energy sector model is based on the initial information of one of the
national energy sector perspective development plans. Analysis of such options by
means of the energy sector model can address the following specific strategic
challenges of Vietnam energy sector development:
• the deployment of new energy sources of different kinds around the country,
including nuclear power plants;
• the deployment of energy resources import entries on the area of the country;
• the order of the creation of new facilities of coal mining, natural gas extraction,
crude oil extraction and refining taking into account the capabilities of existing and
new energy resources transmission lines, etc.</p>
        <p>A general energy sector model consists from the following equations and
inequalities:
(C,X) + ( ,g) →</p>
        <p>AX− = 0
0 ≤  ≤ 
0 ≤  ≤ 
(1)
(2)
(3)
(4)</p>
        <p>The first part of the goal function represents total costs of the FEC operation. The
 is the cost vector of the energy resources production and transmission facilities.</p>
        <p>The second part of the goal function characterizes financial losses due to energy
resource shortages. The vector  is equal to the difference ( −  ). The  is cost
vector of energy resource shortages. The estimation of real costs of damage from a
shortage is difficult due to variety of shortage after-effects, which are not always possible
to identify and quantify.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>The energy sector state visualization</title>
        <p>There is a one digital map per each energy recourse distribution net. Each digital map
should consists of 3 layers:
1. Consumers as polygon type layer;
2. Producers as point type layer;
3. Transmission links as line type layer.</p>
        <p>To show state by color coloring rules for each layer type were created. Coloring rules
for consumers are shown in Table 1.
Colors of energy resource producer according to 1 are shown in 4.
Colors of energy resource transmission link according to 2 are shown in 5.
Colors of energy resource consumer according to Table 3 are shown in table 6.</p>
        <sec id="sec-3-2-1">
          <title>Nondelivery</title>
        </sec>
        <sec id="sec-3-2-2">
          <title>Satisfied</title>
        </sec>
        <sec id="sec-3-2-3">
          <title>Consumer has zero value demand</title>
        </sec>
        <sec id="sec-3-2-4">
          <title>Consumer needs are not satisfied</title>
        </sec>
        <sec id="sec-3-2-5">
          <title>Consumer needs are fully satisfied</title>
          <p>4
4.1</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Vietnam energy sector model</title>
      <sec id="sec-4-1">
        <title>Assumptions</title>
        <p>The energy sector model describes the following major energy systems of
Vietnam:
• Gas supply system consists of natural gas fields which are combined into
gasproducing areas and possible entries of imported liquefied natural gas. Natural gas
transport within the country is represented by network of existing and new gas
pipelines.
• Coal supply system. Coal mines can be aggregated by locality. The qualitative
structure of coals can be taken into account by separation of particular kinds.
Transport of coal between regions matches directions of the main cargo transfer
paths.
• The crude oil refinery products supply system can be represented by the production
and distribution of light oil and fuel oil. Transportation of petroleum products is
represented by set roads, marine links and railways between producers and
consumers.
• Power system. Power plants are divided into several types: thermal, hydro, nuclear
power plants and renewable energy sources. Thermal power plants are classified by
type of main fuel: natural gas, coal and fuel oil. Renewable energy source are
divided into the solar cells, wind farms and thermal power plants using biomass.</p>
        <p>Except for the production and transportation blocks in the energy sector model
there is a block of consumption, which is represented by the main consumers of the
energy sector, ranked by category of importance.
4.2</p>
      </sec>
      <sec id="sec-4-2">
        <title>Nomenclature</title>
        <p>The main symbols used in this paper are described below for quick reference.
Indices
 – amount of regions
p, r ∈ {1, } – order number of region
 ∈ {a,b,g,z,e,o,u,h,d,k,w} – energy resource, where

 – anthracite;
 – brown coal;
 – natural gas;
 – LPG;
 – electricity;
 – crude oil;
 – gasoline;
ℎ – FO;
 – DO;
 – kerosene;</p>
        <p>– aviation gasoline;
Input parameters
 ∈a,b,g,z,o,u,h,d,k,w
 ¯ – up value of capacity to produce or extract energy resource  in region  ,
 ¯rp – up value of capacity to transmit energy resource  from region  to region  ,

 ∈ {a,b,g,e,z,o,u,h,d,k,w}
 ¯rp – up value of capacity to export energy resource  from region  to region  ,

  – up value of energy resource  demand in region  ,  ∈ {e,z,o,u,k,w}
– up value of total capacity of TPS burning fuel  in region  ,  ∈ {a,b,g,h,d}
   – value of burning fuel  to generate one unit of electricity on TPS in region  ,
 ¯ oth – up value of others sources total capacity in region 
 ¯ NPP – up value of total nuclear power plants (NPP) capacity in region 
 ¯ HPS – up value of total hydro power stations (HPS) capacity in region 
 
 =</p>
        <p>¯ – crude oil refinery coefficient for energy resource  production in region
 ∈ {a,b,g,e,z,o,u,h,d,k,w}</p>
        <p>¯ TPS,l
 ∈ {a,b,g,h,d}


 rp
 rp
 
–
–
 ,  ∈ {h,d,k,w,z}
Output parameters
 ∈ {a,b,g,z,e,o,u,h,d,k,w}
 ∈ {a,b,g,z,e,o,u,h,d,k,w}
  – energy resource  production in region  ,  ∈ {a,b,g,z,o,u,h,d,k,w}
transport
of
energy
resource 
from
region 
export
of
energy
resource

from
region

to
to
region  ,
region
 ,
  NPP – power generation by NPP in region 
  HPS – power generation by HPS in region 
   – energy resource  consumption in region  ,  ∈ {e,z,o,u,k,w}
  TPS,l – power generation by TPS burning fuel  in region  ,  ∈ {a,b,g,h,d}</p>
        <p>oth – power generation by other sources in region 
Cost




 
 
 rp
 
 rp
  
   – cost of energy resource  produced in region  ,  ∈ {a,b,g,z,o,u,h,d,k,w}
TPS,l – cost of power generated by TPS burning fuel  in region  ,  ∈ {a,b,g,h,d}
 HPS – cost of power generated by HPS in region 
 NPP – cost of power generated by NPP in region 
 oth – cost of power generated by other sources in region 
from region  to region  ,  ∈ {a,b,g,z,e,o,u,h,d,k,w}
– cost of one unit of energy resource  transmission (transportation or import)
– losses due to one unit of exported energy resource  non-delivery from
region  to region  ,  ∈ {a,b,g,z,e,o,u,h,d,k,w}
region  ,  ∈ {a,b,g,z,e,o,u,h,d,k,w}
– losses due to one unit of energy resource  non-delivery for consumption in

Q</p>
        <p>+ ∑
 ≠  pr − ∑
 ≠  rp − ∑</p>
        <p>≠  rp −   S
Anthracite balance in region 
Brown coal balance in region</p>
        <p>Q

 + ∑</p>
        <p>≠  pr − ∑</p>
        <p>≠  rp − ∑</p>
        <p>≠  rp −   S
Q

 + ∑</p>
        <p>≠  pr − ∑</p>
        <p>≠  rp − ∑</p>
        <p>≠  rp −   S
Crude oil balance in region</p>
        <p>TPS,g
TPS,a
TPS,b
-D
-D
-D
g
a
b
≥ 0
≥ 0
≥ 0
4.3</p>
      </sec>
      <sec id="sec-4-3">
        <title>Generalized Network Flow Model Mathematical Formulation</title>
      </sec>
      <sec id="sec-4-4">
        <title>Energy resource balance</title>
        <p>Natural gas balance in region 
Q

 + ∑</p>
        <p>≠  pr − ∑</p>
        <p>≠  rp − ∑</p>
        <p>≠  rp −  
≥ 0</p>
        <p>+    

+ ∑</p>
        <p>≠  pr − ∑</p>
        <p>≠  rp − ∑
 ≠  rp -D
≥ 0
Aviation gasoline balance in region 

Q
 +    


+ ∑</p>
        <p>≠  pr − ∑</p>
        <p>≠  rp − ∑</p>
        <p>≠  rp -D

≥ 0
Electricity balance in region 
∑</p>
      </sec>
      <sec id="sec-4-5">
        <title>Bound constraints</title>
        <p>Up values of energy resource  production in region</p>
        <p>0 ≤   ≤  ¯  ,  ∈ {a,b,g,z,o,u,h,d,k,w}
Up values of power generation by TPS burning fuel  in region  ,  ∈ {a,b,g,h,d}
Up values of NPP power generation in region 
Up values of HPS power generation in region 
Up values of power generation by other sources in region 
0 ≤   TPS,l ≤  ¯ TPS,l
0 ≤   NPP ≤  ¯ NPP
0 ≤   HPS ≤  ¯ HPS
0 ≤   oth ≤  ¯ oth
Up values of energy resource  transport between region  and 
0 ≤  rp ≤  ¯ rp,  ∈ {a,b,g,e,z,o,u,h,d,k,w}</p>
        <p>Up values of energy resource  export between region  and</p>
        <p>0 ≤  rp ≤  ¯ rp,  ∈ {a,b,g,e,z,o,u,h,d,k,w}
Up values of consumption of energy resource  in region</p>
        <p>0 ≤    ≤   ,  ∈ {e,z,u,k,w}
4.4</p>
      </sec>
      <sec id="sec-4-6">
        <title>Goal function</title>
        <p>EXPORT + LOSS ]</p>
        <p>GEN = ∑l={a,b,g,h,d}</p>
        <p>TPS,l  TPS,l +c NPP  NPP+c HPS  HPS+c oth  oth
EXPORT = ∑ ≠ ∑l={a,b,g,e,z,o,u,h,d,k,w}   rp</p>
        <p>rp
LOSS = ∑l={a,b,g,e,z,o,u,h,d,k,w}</p>
        <p>−</p>
        <p>To find minimum of goal function (24) is to find costs minimum. Equation (25) is
energy resources non-delivery inside country.
total power generation of region  . Equation (26) is total region  losses due to energy
resources non-delivery outside country. Equation (27) is total region  losses due to
∑ [∑l={a,b,g,z,o,u,h,d,k,w}      + GEN + ∑ ≠ ∑l={a,b,g,e,z,o,u,h,d,k,w}   rp
  rp +
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Workbench for vulnerability analysis of Vietnam energy sector</title>
      <p>For vulnerability study of energy sector, an expert needs to be able to interact with
source data of the energy sector model, prepare data for calculations, configure and
execute calculations, and view results. Energy sector model objects are represented as
relational database entities. Therefore, database interaction is one of base functions of
the information system for studying the vulnerability of the energy sector.
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)</p>
      <p>
        Information systems that provide the implementation of СRUD (create, read,
update, delete), search and some other operations (for example, reports generation) are
called database applications. Database application development is a routine and
timeconsuming process because you have to perform many repetitive steps. Indeed, the
code parts, which implement the typical operations for different tables usually have
no substantial differences, besides from the names of the used tables and fields. There
are approaches to partially automate the development of database applications. For
example, using the Hibernate / NHibernate [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], Entity Framework [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] libraries
allows you to automate the building of the object model of database tables. However,
instead of interacting with tables, the application interacts with objects. In any case,
the rest of the application code still needs to be written.
      </p>
      <p>
        Also, a model-oriented approach is used for automate the development of database
applications. For example, "Model-Based User Interface Development" [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] or
"Model Driven Architecture" [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. The formal representation of information about
AIS structure is used to generate database objects and the code of client application.
The generated code is very schematic and requires further development to make it of
production quality. As a result it becomes very hard to reflect the changes in the
specification, which usually happen during the application life-cycle.
      </p>
      <p>
        We used an approach based on the use of specifications of database applications
(SDA) [
        <xref ref-type="bibr" rid="ref16 ref17">16, 17</xref>
        ] to create a system for vulnerability study of the energy sector. SDA is
a declarative representation of a database application model. SDA contains the
minimum information required in a pure form about database tables, their fields,
relationships between them and their use in the database application. All the other tasks are
performed by general algorithms, controlled by SDA. In addition, in the SDA, you
can configure the call of external subsystems and the references of database tables
with objects of digital maps. To create the SDA, we used the GeoARM tool, which
provides an interactive setup of all the necessary database objects. Interpreting SDA
GeoARM becomes an applied information system that provides a user interface for
interacting with a database, building user queries, calling external subsystems and
interacting with digital maps.
      </p>
      <p>The Workbench for vulnerability analysis of energy sector (see Fig. 2) created with
the help of GeoARM provides interaction with the entities of the ES database in the
modes of tables and individual records, and also allows you to build user queries and
display information on digital maps. Researcher can generate map objects if there are
fields in the database with the coordinates of the objects. You can also display on the
map the result of a user query to the database. In this case, you can set the color of
objects on the map depending on the values of a specific field of the query result. We
can run compute modules that return results to the database. Further, based on the
results obtained, we can create digital map objects and carry out analysis. In addition,
you can display the result of a custom query to the database on the map. At the same
time, you can set the color of objects on the map depending on the values of a specific
characteristic of objects in the energy sector.</p>
      <p>A special tool has been developed to provide calculation on the model (5)-(27).
The calculation module reads the Vietnam energy sector operation and development
information from database and arranges that data into a development scenario (Fig 1).
Then the module transforms the particular data associated with each node of directed
graph shown in Fig. 1 into the linear programming problem (5)-(27) and solves the
constructed problems sequentially. Thus the module can help to analyze time series of
different energy sector parameters.
7</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusions</title>
      <p>In the paper, we considered the problems concerned supporting the research of the
Vietnam energy sector vulnerability. Conducting vulnerability studies requires a lot of
efforts to prepare data, process data, perform calculations and analyze the results. The
vulnerability analysis support requires user-friendly software that allows one to
process data, run calculation modules, analyze and display the results.</p>
      <p>We have developed a workbench to support the vulnerability analysis of
interdependent national energy systems. The workbench is based on structural specifications
that allow standardized solutions to the wide range of problems. The developed
workbench allows us to solve the following tasks:
• Interact with the database through a convenient user interface,
• Execute external calculation modules,
• Conduct data analysis: build queries to the database, build thematic maps in the
GIS.</p>
      <p>An example of the workbench to support finding the Vietnam energy sector
vulnerability analysis was considered. It is shown that the described tools provides the
flexible prototyping and fast implementation of applications. And in comparison with
other approaches, the main advantage of proposed workbench is that it is applicable
for all stages of the vulnerability analysis starting from gathering the energy operation
and development information and ending with evaluation of satisfying demand in
energy.
8</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>The research was supported by the Program of the Fundamental Research of the
Siberian Branch of the Russian Academy of Sciences, project no. IV.38.1.2 (reg. no.
АААА-А17-117032210079-1). The development of the calculation module was
supported by the Russian Foundation of Basic Research and Government of Irkutsk
Region, project no. 20‑47‑380002 (reg. no. АААА-А20-120021090008-7). Results are
achieved using the Centre of collective usage «Integrated information network of
Irkutsk scientific educational complex».</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Voropai</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rehtanz</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          <article-title>Flexibility and Resiliency of Electric Power Systems: Analysis of Definitions and Content</article-title>
          .
          <source>In EPJ Web of Conferences</source>
          , vol.
          <volume>217</volume>
          , p.
          <fpage>01018</fpage>
          . EDP Sciences.
          <article-title>(</article-title>
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Edelev</surname>
            <given-names>AV</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fereferov</surname>
            <given-names>ES</given-names>
          </string-name>
          .
          <article-title>A software platform to support the energy system resilience study</article-title>
          .
          <source>Proceedings of the 2nd International Workshop on Information, Computation</source>
          , and
          <article-title>Control Systems for Distributed Environments</article-title>
          .
          <string-name>
            <surname>CEUR-WS Proceedings</surname>
          </string-name>
          .
          <year>2020</year>
          . Vol.
          <volume>2638</volume>
          . pp
          <fpage>79</fpage>
          -
          <lpage>88</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Zio</surname>
            <given-names>E.</given-names>
          </string-name>
          <article-title>Challenges in the vulnerability and risk analysis of critical infrastructures</article-title>
          .
          <source>Reliability Engineering &amp; System Safety 152</source>
          , pp
          <fpage>137</fpage>
          -
          <lpage>150</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Palutikof</surname>
            ,
            <given-names>J.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Street</surname>
            ,
            <given-names>R.B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Gardiner</surname>
            ,
            <given-names>E.P.</given-names>
          </string-name>
          <article-title>Decision support platforms for climate change adaptation: an overview and introduction</article-title>
          .
          <source>Climatic Change</source>
          ,
          <volume>153</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>459</fpage>
          -
          <lpage>476</lpage>
          . (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Tofani</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Di</surname>
            <given-names>Pietro</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Lavalle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.L.</given-names>
            ,
            <surname>Pollino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Rosato</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            ,
            <surname>Alessandroni</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.:</surname>
          </string-name>
          <article-title>CIPRNet decision support system: modelling electrical distribution grid internal dependencies</article-title>
          .
          <source>J. Polish Saf. Reliab. Assoc</source>
          .
          <volume>6</volume>
          ,
          <fpage>133</fpage>
          -
          <lpage>140</lpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Pollino</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Modica</surname>
          </string-name>
          , G.:
          <article-title>Free web mapping tools to characterise landscape dynamics and to favour e-participation</article-title>
          . In: Murgante,
          <string-name>
            <given-names>B.</given-names>
            ,
            <surname>Misra</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Carlini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Torre</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.M.</given-names>
            ,
            <surname>Nguyen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.-Q.</given-names>
            ,
            <surname>Taniar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Apduhan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.O.</given-names>
            ,
            <surname>Gervasi</surname>
          </string-name>
          ,
          <string-name>
            <surname>O. (eds.) ICCSA</surname>
          </string-name>
          <year>2013</year>
          .
          <article-title>LNCS</article-title>
          , vol.
          <volume>7973</volume>
          , pp.
          <fpage>566</fpage>
          -
          <lpage>581</lpage>
          . Springer, Heidelberg (
          <year>2013</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Steiniger</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bocher</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          :
          <article-title>An overview on current free and open source desktop GIS developments</article-title>
          .
          <source>Intern. Journal of Geographical Information Science</source>
          . vol.
          <volume>23</volume>
          ,
          <string-name>
            <surname>N</surname>
          </string-name>
          <year>10</year>
          . pp.
          <fpage>1345</fpage>
          -
          <lpage>1370</lpage>
          . (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Steiniger</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hay</surname>
            ,
            <given-names>G.J.</given-names>
          </string-name>
          :
          <article-title>Free and open source geographic information tools for landscape ecology</article-title>
          .
          <source>Ecological Informatics</source>
          , vol.
          <volume>4</volume>
          ,
          <issue>iss</issue>
          . 4, pp.
          <fpage>183</fpage>
          -
          <lpage>195</lpage>
          . (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Chen</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shams</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Carmona-Moreno</surname>
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leone</surname>
            <given-names>A</given-names>
          </string-name>
          .
          <article-title>Assessment of open source GIS software for water resources management in developing countries</article-title>
          .
          <source>Journal of Hydroenvironment Research</source>
          , vol.
          <volume>4</volume>
          ,
          <issue>iss</issue>
          . 3, pp.
          <fpage>253</fpage>
          -
          <lpage>264</lpage>
          . (
          <year>2010</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Pollino</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fattoruso</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>La Porta</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Della</surname>
            <given-names>Rocca</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A.B.</given-names>
            ,
            <surname>James</surname>
          </string-name>
          ,
          <string-name>
            <surname>V.</surname>
          </string-name>
          :
          <article-title>Collaborative open source geospatial tools and maps supporting the response planning to disastrous earthquake events</article-title>
          .
          <source>Futur. Internet</source>
          .
          <volume>4</volume>
          ,
          <fpage>451</fpage>
          -
          <lpage>468</lpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Fathi</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          <article-title>and</article-title>
          <string-name>
            <surname>Ghavami</surname>
            ,
            <given-names>M.S. Using</given-names>
          </string-name>
          <article-title>GIS data and satellite images to manage hazard zone in earthquake</article-title>
          .
          <source>Advances in Computer Science: an International Journal</source>
          ,
          <volume>4</volume>
          (
          <issue>3</issue>
          ), pp.
          <fpage>104</fpage>
          -
          <lpage>110</lpage>
          . (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Liljas</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zaytsev</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dentler</surname>
            ,
            <given-names>J.J.:</given-names>
          </string-name>
          <article-title>NHibernate 4.x Cookbook. 2nd edn</article-title>
          . Packt Publishing, UK. p.
          <fpage>448</fpage>
          . (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Smith</surname>
            ,
            <given-names>J.P.</given-names>
          </string-name>
          : Entity Framework Core in Action. Manning Publications company, New York. p.
          <fpage>520</fpage>
          . (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Yigitbas</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fischer</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sauer</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <article-title>Model-Based User Interface Development for Adaptive Self-Service Systems</article-title>
          . In: Marcus A. (
          <article-title>eds) Design, User Experience, and Usability</article-title>
          . Theories, Methods, and
          <article-title>Tools for Designing the User Experience</article-title>
          .
          <source>DUXU 2014. Lecture Notes in Computer Science</source>
          , vol.
          <volume>8517</volume>
          , pp
          <fpage>206</fpage>
          -
          <lpage>213</lpage>
          . Springer, Cham. (
          <year>2014</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Rhazali</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hadi</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mouloudi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <article-title>Model Transformation with ATL into MDA from CIM to PIM Structured through MVC. Procedia Computer Science</article-title>
          , vol.
          <volume>83</volume>
          , pp.
          <fpage>1096</fpage>
          -
          <lpage>1101</lpage>
          . (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Bychkov</surname>
            ,
            <given-names>I.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hmelnov</surname>
            ,
            <given-names>A.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fereferov</surname>
            ,
            <given-names>E.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rugnikov</surname>
            ,
            <given-names>G.M.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Gachenko</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          <string-name>
            <surname>Methods</surname>
          </string-name>
          and
          <article-title>Tools for Automation of Development of Information Systems Using Specifications of Database Applications</article-title>
          .
          <source>In: Proc. of the 3rd Russian-Pacific Conf. on Computer Technology and Applications</source>
          (RPC) pp
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Hmelnov</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Fereferov</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          <article-title>Development of cross-platform problem-oriented systems using specifications of database applications</article-title>
          .
          <source>In: Proc. of the 2nd Scientific-Practical Workshop Information Technologies: Algorithms</source>
          , Models, Systems (ITAMS'
          <year>2019</year>
          ),
          <source>CEUR Workshop Proceedings</source>
          , vol.
          <volume>2463</volume>
          , pp.
          <fpage>59</fpage>
          -
          <lpage>69</lpage>
          . (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>