<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Supercomputer Technologies for Long-term Modeling of Permafrost Changes</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Krasovskii Institute of Mathematics and Mechanics of UrB RAS</institution>
          ,
          <addr-line>16 S.Kovalevskaya Str., Yekaterinburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Ural Federal University</institution>
          ,
          <addr-line>19 Mira street, Yekaterinburg</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>0000</fpage>
      <lpage>0001</lpage>
      <abstract>
        <p>A model of propagation of thermal fields in permafrost from various engineering objects operating in Arctic regions is considered. The proposed model includes the most significant technical and climatic parameters affecting the formation of thermal fields in the surface layer of the soil. The main objective of the study is a long-term forecasting of changes in the dynamics of permafrost boundaries during operation of cluster sites of northern oil and gas fields. Such a forecast is obtained by simulation of complex system consisting of heat or cold sources and frozen soil, thawing of which can lead to the loss of the bearing capacity and possible technogenic and environmental accidents. For example, the sources of heat can be production wells, and the sources of cold can be seasonal cooling devices that are used to stabilize the soil. To minimize the impact of heat sources on permafrost, various options for thermal insulation are used, and to preserve the original temperature regime of the top layer of soil, riprap materials consisting of sand, concrete, foam concrete, or other heat insulating material are used. The developed set of programs was used in the design of 12 northern oil and gas fields. To solve the described problem in a complex three-dimensional area, substantial computational resources are required. The computing time of one variant can often exceed 10-20 hours of machine time on a supercomputer. To speed up the numerical calculations, multicore processors are used. Numerical calculations illustrate the possibility of a developed set of programs for making long-term forecasts for determining changes in the boundaries of the permafrost zones, and show that on multicore processors it is possible to achieve acceleration close to the theoretical one.</p>
      </abstract>
      <kwd-group>
        <kwd>Heat and Mass Transfer</kwd>
        <kwd>Cryolithozone</kwd>
        <kwd>Simulation</kwd>
        <kwd>Parallel Computing</kwd>
        <kwd>OpenMP</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        The term “permafrost” was introduced into the English literature by S.W. Muller [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]
as an abbreviation of the original Russian term “Permanently frozen ground (soil)”
suggested by M.I. Sumgin [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The permafrost zone occupies about 25% of all the
land of the globe [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and is located in the northern or mountainous regions under
Copyright © 2020 for this paper by its authors.
      </p>
      <p>
        Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
the zone of seasonal thawing of the soil, which is determined by geographical
coordinates, the intensity of solar radiation, and other climatic factors. The climate changes
related with, for example, the warming may lead to the essential permafrost
degradation especially in high-latitudes regions, which may influence on the environment of
the globe [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], in particular, due to the release of methane.
      </p>
      <p>
        The development of the permafrost regions is especially important for Russia,
since about 93% of Russian natural gas and 80% of oil are produced in these areas. At
the same time, the development of these regions leads to negative consequences
associated with the thawing of permafrost, which leads to the formation of dangerous
geological phenomena called thermokarst. The average thickness of the permafrost
varies from 10 to 800 meters, and the components of the permafrost soils have various
physicochemical properties that can vary in all directions. In summer, as a result of
positive temperatures and solar radiation, seasonal thawing of the upper soil layer
occurs; in winter, the reverse process is observed. Computer simulation of such
seasonal processes is described in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], and, in particular, with using multicore processors
and OpenMP technology in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. A significant effect on the formation of thermal fields
in the soil is also caused by anthropogenic conditions, often leading to more extensive
changes in the boundaries of the permafrost [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. In well pads of northern oil and
gas fields the following technical systems may have the same effect of a massive heat
source: production and injection wells [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], flare systems [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] having some
periodical operation conditions [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] and other engineering facilities. For thermal
stabilization of the soil (including additional cooling or refreezing), the cooling devices
(SCDs) are used that can reduce thermal effects from heat sources on the surrounding
soil and can be used to prepare a construction site in the permafrost distribution zone
by freezing the upper part of the soil [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ].
      </p>
      <p>
        To solve the described problems, mathematical models, numerical methods of
solution, and codes are developed for modeling non-stationary thermal fields in the
near-surface soil layer in a complex three-dimensional area. The computational time
of the problems solution, for which a large number of variants with different
parameters are required, could exceed tens of hours of computer time on a supercomputer.
The parallel approaches are considered [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ], and cloud technologies were also used,
which allow to carry out remote computing to solve certain problems arising from the
placement and operation of northern oil and gas fields [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. In this work, we
studied the use of multicore processors and OpenMP technology to solve the
problems of long-term forecasting of changes in the thawing boundaries of permafrost
around a production well. The results of numerical calculations and evaluation of the
effectiveness of multicore processors are presented.
2
      </p>
      <p>Problem Statement and Mathematical Model
Let  =  ( ,  ,  ,  ) be the soil temperature at the time moment  , where ( ,  ,  ) is
a point of the computational area Ω = {( ,  ,  ): 0 ≤  ≤   , 0 ≤  ≤   , −  ≤
 ≤ 0}. The area is a 3D “box” (see Fig. 1), in which the cylinder-shaped well Ω1 and
the cold sources (SDCs) Ω2 are excluded. The axes x and y are parallel to the soil
surface, and the axe z is directed vertically down into Ω. In Fig. 1 there presented two
variants of the unit combinations: a single well and a well surrounded by SCDs.
(1)
(2)
y
Ω
solar radiation
z
x
insulation
Ω1
e
g
n
a
h
c
x
e
l
a
m
r
e
h
t
Ω2
y
t
i
v
i
s
s
i
m
e</p>
      <p>T (0, x, y, z)  T0 (x, y, z),
where ρ=ρ(x,y,z) is density [kg/m3], T*=T*(x,y,z) is temperature of phase transition,
с1(x, y, z), for T  T *
сν(T) = 
с2 (x, y, z), for T  T *</p>
      <p>is specific heat [J/(kg K)],</p>
      <p>
        1(x, y, z), for T  T *
λ(T)= 2 (x, y, z), for T  T * is thermal conductivity [W/(m K)], δ is Dirac
δfunction, k=k(x,y,z) is specific heat of phase transition. The justification of the
applicability of this equation for solving problems of the Stefan type is presented in
[
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ]. In [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ] as a result of the heat balance on the surface, the following
boundary condition is proposed:
 q(t)  b(Tair (t)  T z0
)   (T 4  Ta4ir (t))  
T
z z0
(3)
and an algorithm for adaption of the mathematical model to a specific geographic
location is described. In condition (3) Tair(t) denotes the temperature in the surface
layer of air, which varies from time to time in accordance with the annual cycle of
temperature, σ = 5,67∙10-8W/(m2K4) is Stefan-Boltzmann constant, b=b(t,x,y) is heat
transfer coefficient, ε=ε(t,x,y) is the coefficient of emissivity. The coefficients of heat
transfer and emissivity depend on the type and condition of the soil surface. Total
solar radiation q(t) is the sum of direct solar radiation and diffuse radiation. Soil is
absorbed only a part of the total radiation which equal to αq(t), where α=α(t,x,y) is the
part of energy that is formed to heat the soil, which in general depends on
atmospheric conditions, angle of incidence of solar radiation, i.e. latitude and time. The
technical objects Ω1 and Ω2 are additional sources of heat or cold in the permafrost soil.
At these inner boundaries we set the following conditions:
      </p>
      <p>To use the numerical methods it is necessary to set the boundary conditions at the
lateral boundaries of Ω. Let suppose</p>
      <p>T
i</p>
      <p> Ti (t), i  1, 2.
T
x xLx</p>
      <p>T
 0,
y yLy
 0, T
z zLz
 0.</p>
      <p>In this case, the computational domain should be chosen large enough to avoid the
influence of the boundary conditions (5) on the thermal fields in the computational
domain Ω created by the objects Ωi.
3</p>
      <p>
        Numerical Calculations and Performance Study
To apply a numerical method of solution of the problem (1)–(5) it is necessary to
evaluate the parameters included into boundary condition (3). In [
        <xref ref-type="bibr" rid="ref19">19</xref>
        ], [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] an iterative
algorithm is described to determine these parameters. The choice of these parameters
allows to indirectly take into account the influence of snow cover, climatic, and
environmental conditions associated with the geographical coordinates of the considered
well pad. In the numerical implementation of the solution of problem (1)–(5), the
finite-difference method is used, which allows to apply the method of splitting into
(4)
(5)
5
10 x
(a)
spatial variables for better organization of numerical calculations. Following [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ] and
[
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] equation (1), for each of the spatial directions, the equation is approximated by
an implicit central-difference three-point scheme, and the system of difference linear
algebraic equations having the tri-diagonal form is solved by the sweep method. On
the ground surface, in view of condition (3), a fourth-degree algebraic equation arises,
for the solution of which the Newton method is used [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. In the computations, an
orthogonal grid is used, which is uniform or condensing near the soil surface, or the
surfaces Ωi.
      </p>
      <p>The described algorithm is implemented in the “Wellfrost” certified software
package and in the various modifications, which was tested at 12 northern oil and gas
fields. Also the experimental data and the results of numerical calculations was
compared in view to determining the boundary of the location of the zero isotherm, which
determines the boundary of the area of soil thawing around the producing well. In
2012 the accuracy of numerical calculations was verified for the Russkoye oil field
(Yamalo-Nenets Autonomous Okrug, Russia), for which the obtained numerical
results are in accordance with the experimental results, and the accuracy reached 5%
after 3 years from the start of the field operation.</p>
      <p>In Figures 2 and 3 the calculated thermal fields are shown for 5 years of operation
around the well without heat-insulating shells (a) and with a combined heat-insulating
shell (b), as well as with a system of 8 SCDs.</p>
      <p>The permafrost soil temperature is -0.7°С, the temperature of the fluid in the well
is 50°С. Calculations allow to evaluate the influence of heat or cold sources, the zone
of seasonal thawing and freezing of the upper soil layer. To assess the long-term
impact, calculations are carried out for a time period of up to 50 years, the time step does
not exceed 24 hours. The calculation time depends both on the size of the
computational grid and on the complexity of the objects introduced into the computational
domain.</p>
      <p>Table 1 shows the considered variants of the calculations. Fig. 4 shows a graph of
the change of calculation time for each of the model variants. The calculations were
carried out on a grid with 91x91x51 nodes.
6 FSrCeDezsi.ng and thawing of the soil around the well without thermal insulation and 8
7 SFrCeDezsi.ng and thawing of the soil around the well with a simple insulation and 8
8 FSrCeDezsi.ng and thawing of the soil around the well with a complex insulation and 8
The computing time increases nonlinearly when the number of the included object
grows, as well as, the complexity of the objects, even if the grid size remains the
same.
T1, s
T6, s
1
2
3
4
5
6
7</p>
      <p>8</p>
      <p>The model variants
For studying the parallel algorithm running on  cores, the speedup Sn  T1 Tn and
efficiency En  Sn n coefficients were used. The resulted values are consistent with
the theoretical ones, obtained by the Amdahl’s law Sn    11    2.2 , where
n
  0.35 is the serial code proportion.</p>
      <p>Conclusion
The developed models and algorithms make it possible to simulate the propagation of
unsteady thermal fields in frozen ground from producing wells at well pads, taking
into account the possible placement of cooling devices around the wells. The
numerical experiments show the possibility of obtaining a long-term forecast in the dynamics
of permafrost boundaries for various options for well operation using additional
technical systems and heat-insulating materials. The complications and additional
constructions inserted into the model by taking into account various additional sources of
cold, for example the SCDs, and the use of thermal insulation increase the
computational time. Parallel computations approaches significantly reduced the computational
time in solving such problems. A parallel software package for multicore processors
using OpenMP technology has been developed.</p>
      <p>Acknowledgments
This work was supported by the RFBR (project No. 19-07-00435).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Muller</surname>
            ,
            <given-names>S.W.</given-names>
          </string-name>
          :
          <article-title>Permafrost or Permanently Frozen Ground and Related Engineering Problems</article-title>
          . Ann Arbor:
          <string-name>
            <given-names>J.W.</given-names>
            <surname>Edwards</surname>
          </string-name>
          (
          <year>1947</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Sumgin</surname>
            ,
            <given-names>M. I.</given-names>
          </string-name>
          :
          <article-title>Permafrost in the USSR Boundary</article-title>
          . Vladivostok:
          <string-name>
            <surname>Far-East Geophysical Observatory</surname>
          </string-name>
          (
          <year>1927</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Nelson</surname>
            ,
            <given-names>F.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anisimov</surname>
            ,
            <given-names>O.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shiklomanov</surname>
            ,
            <given-names>N.I.</given-names>
          </string-name>
          :
          <article-title>Subsidence risk from thawing permafrost</article-title>
          .
          <source>Nature</source>
          <volume>410</volume>
          , pp.
          <fpage>889</fpage>
          -
          <lpage>890</lpage>
          (
          <year>2001</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Nelson</surname>
            ,
            <given-names>F.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Anisimov</surname>
            ,
            <given-names>O.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shiklomanov</surname>
            ,
            <given-names>N.I.</given-names>
          </string-name>
          :
          <article-title>Climate Change and Hazard Zonation in the Circum-Arctic Permafrost Regions</article-title>
          .
          <source>Natural Hazards 26</source>
          , pp.
          <fpage>203</fpage>
          -
          <lpage>225</lpage>
          (
          <year>2002</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Akimova</surname>
            ,
            <given-names>E.N</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Misilov</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Supercomputer modelling of thermal stabilization processes of permafrost soils</article-title>
          .
          <source>In: 18th Intern. Conf. Geoinformatics: Theoretical and Applied Aspects</source>
          ,
          <year>Geoinformatics 2019</year>
          ,
          <volume>15482</volume>
          .
          <string-name>
            <surname>Kyiv</surname>
          </string-name>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Akimova</surname>
            ,
            <given-names>E. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.Yu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Misilov</surname>
            ,
            <given-names>V.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Simulation of thermal processes in permafrost: parallel implementation on multicore CPU</article-title>
          .
          <source>In: CEUR Workshop Proceeding</source>
          , vol.
          <volume>2274</volume>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Simulation of freezing and thawing of soil in Arctic regions</article-title>
          .
          <source>Conference Series: Earth and Environmental Science</source>
          <volume>72</volume>
          ,
          <issue>012005</issue>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
          </string-name>
          , M.Y.:
          <article-title>Computer simulation of nonstationary thermal fields in design and operation of northern oil and gas fields</article-title>
          .
          <source>AIP Conference Proceedings 1690 020016</source>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
          </string-name>
          .:
          <source>Simulation of Engineering Systems in Permafrost. Vestnik Novosibirskogo Gosudarstvennogo Universiteta. Seriya Matematika, Mekhanika, Informatika</source>
          <volume>13</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>37</fpage>
          -
          <lpage>42</lpage>
          (
          <year>2013</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          :
          <article-title>Simulation of technogenic and climatic influences in permafrost for northern oil fields exploitation</article-title>
          .
          <source>Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9045</source>
          , pp.
          <fpage>185</fpage>
          -
          <lpage>192</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
          </string-name>
          , N.:
          <article-title>Short and Long Scale Regimes of Horizontal Flare System Exploitation in Permafrost</article-title>
          .
          <source>In: CEUR Workshop Proceedings</source>
          , vol.
          <volume>1662</volume>
          , pp.
          <fpage>253</fpage>
          -
          <lpage>260</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M. Yu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <source>Simulation of Influence of Special Regimes of Horizontal Flare Systems on Permafrost. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11386</source>
          , pp.
          <fpage>233</fpage>
          -
          <lpage>240</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
          </string-name>
          , M. Y.:
          <article-title>Simulation of Cooling Devices and Effect for Thermal Stabilization of Soil in a Cryolithozone with Anthropogenic Impact</article-title>
          .
          <source>Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11386</source>
          , pp.
          <fpage>580</fpage>
          -
          <lpage>587</lpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Parallel splitting and decomposition method for computations of heat distribution in permafrost</article-title>
          .
          <source>In: CEUR Workshop Proceedings</source>
          , vol.
          <volume>1513</volume>
          , pp.
          <fpage>42</fpage>
          -
          <lpage>49</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Bersenev</surname>
            ,
            <given-names>A. Iu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasev</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Igumnov</surname>
            ,
            <given-names>A. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Klasternye vychisleniia kak servis na primere zadachi modelirovaniia teplovykh polei ot skvazhin na severnykh neftegazovykh mestorozhdeniiakh</article-title>
          . In.:
          <article-title>Nauchnyi servis v seti Internet: mnogoobrazie superkompiuternykh mirov: trudy Mezhdunarodnoi superkompiuternoi konferentsii</article-title>
          (
          <volume>22</volume>
          -
          <fpage>27</fpage>
          sentiabria
          <year>2014</year>
          g.,
          <source>g. Novorossiisk)</source>
          , pp.
          <fpage>147</fpage>
          -
          <lpage>151</lpage>
          .
          <string-name>
            <surname>Izd-vo</surname>
            <given-names>MGU</given-names>
          </string-name>
          , Moscow, Russia (
          <year>2014</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasev</surname>
            ,
            <given-names>P. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gusarova</surname>
            ,
            <given-names>V. V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Igumnov</surname>
            ,
            <given-names>S. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Ispolzovanie oblachnykh tekhnologii pri modelirovanii ekspluatatsii severnykh neftegazovykh mestorozhdenii</article-title>
          . In: Trudy IMekh UrO RAN «
          <article-title>Problemy mekhaniki i materialovedeniia». Materialy konferentsii «Aktualnye problemy matematiki, mekhaniki</article-title>
          , informatiki», pp.
          <fpage>23</fpage>
          -
          <lpage>28</lpage>
          .
          <article-title>IM UrO RAN</article-title>
          , Izhevsk, Russia (
          <year>2014</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Samarsky</surname>
            ,
            <given-names>A. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vabishchevich</surname>
            ,
            <given-names>P. N.</given-names>
          </string-name>
          :
          <article-title>Computational Heat Transfer</article-title>
          . Vol.
          <volume>2</volume>
          . The Finite Difference Methodology.Wiley, Chichester (
          <year>1995</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Samarskii</surname>
            ,
            <given-names>A. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moiseenko</surname>
            <given-names>B. D.</given-names>
          </string-name>
          :
          <article-title>Ekonomicheskaia skhema skvoznogo scheta dlia mnogomernoi zadachi Stefana</article-title>
          .
          <source>ZhVMiMF</source>
          <volume>5</volume>
          (
          <issue>5</issue>
          ),
          <fpage>816</fpage>
          -
          <lpage>827</lpage>
          (
          <year>1965</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M. Yu.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          :
          <article-title>On Boundary Conditions Setting for Numerical Simulation of Thermal Fields Propagation in Permafrost Soils</article-title>
          .
          <source>In: CEUR Workshop Proceedings</source>
          , vol.
          <volume>2109</volume>
          , pp.
          <fpage>115</fpage>
          -
          <lpage>122</lpage>
          (
          <year>2018</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
          </string-name>
          .:
          <article-title>Dolgosrochnoe prognozirovanie dinamiki zon ottaivaniia mnogoletnemerzlykh porod v uste kusta dobyvaiushchikh skvazhin</article-title>
          .
          <source>In: XXXI Sibirskii teplofizicheskii seminar, posviashchennyi 100-letiiu akademika S.S. Kutateladze: sb. tr. Vserossiiskoi konferentsii</source>
          , pp.
          <fpage>42</fpage>
          -
          <lpage>48</lpage>
          . IT SO RAN, Novosibirsk, Russia (
          <year>2014</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Bashurov</surname>
          </string-name>
          ,
          <string-name>
            <surname>Vl</surname>
          </string-name>
          . V.,
          <string-name>
            <surname>Vaganova</surname>
            ,
            <given-names>N. A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Filimonov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Yu</surname>
          </string-name>
          .:
          <article-title>Chislennoe modelirovanie protsessov teploobmena v grunte s uchetom filtratsii zhidkosti</article-title>
          .
          <source>Vychislitelnye tekhnologii 16(4)</source>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>18</lpage>
          (
          <year>2011</year>
          ) [in Russian].
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>