<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Visualization of the Dynamics of Changes in Structured Data by the Example of Covid-19 Development*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Bryansk State Technical University</institution>
          ,
          <addr-line>Bryansk</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>It is very important to visualize the initial data in a decision-making system with human participation in a proper way. Decision-making complexity, the correctness of the decisions made often depend on it. Nowadays there are many different data visualizations today such as graphs, bar charts, pie and histograms, etc. However, the situation becomes more difficult, if it comes to visualizing the dynamics of changes of structured data. Structured data is understood in this paper as data in which the observed value has an internal structure and consists of a large number of components (characteristics). This paper provides a formal description of structured data and proposes an approach to displaying the graph of their change, by which one can judge not only the general process of the observed value, but also the change in the internal structure (components included in it and their influence on human decision-making). The area of potential application of this approach, as well as its structure features and capabilities are demonstrated in the work. The description of the developed software is given for modeling the situation with the spread of COVID-19 in Bryansk region where the proposed version of visualization is used. Examples of specific situations are considered in which this approach turned out to be useful and helpful. The possibility to use the proposed method in other applied areas is described at the end of the work.</p>
      </abstract>
      <kwd-group>
        <kwd>Data Visualization</kwd>
        <kwd>Structured Data</kwd>
        <kwd>Making Decisions</kwd>
        <kwd>SIR Model</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>It is an obvious fact that the amount of data that needs to be analyzed when making
management decisions greatly grows every year. At the same time, man remains
responsible for the analysis and final decision, that is, they depend on the decision-maker
(DM). Modern decision support systems (DSS), based on mathematical methods, can
partially replace human resources at the stage of processing initial data, but not at the
stage of final decision-making. The lack of clear and structured information during the
* Publication is supported by RFBR grant № 19-07-00844.
decision-making process makes it difficult, due to processing data of various nature,
frequency of information updates over a short period of time, while the support and
decision-making is always left to DM. Due to this need for operational research, it is
required to provide high-quality visualization of constantly growing and developing
volume of data that rapidly appears as a result of global scientific research around the
world.</p>
      <p>It is especially important to develop visualization methods if we deal with analyzing
unusual data, dynamically changing over time. In this case, visualization methods are
faced with a very important and not easy task of visual and intuitive display of unrolling
a certain value change over time, showing the nature of this change, analysis and
cooperation with the accepted solutions, the result of these solutions. To do this,
visualization types such as graphs, bar charts, and histograms are used.</p>
      <p>However, the situation with visualization can become very complicated if the value
in question is composite (consisting of several components). In certain cases, it is useful
and very important for DM to analyze not just the change in the observed value, but
also the impact of measures taken on the structure of its components, the dynamics of
changes in the structure and the contribution of components. This paper is devoted to
these data.
2</p>
    </sec>
    <sec id="sec-2">
      <title>Problems of monitoring changes in structured values</title>
      <p>Let us introduce the concept of a structured value, the visualization of dynamic changes
in which we will consider in this paper. Let's suppose we have some observed value P.
This value includes several components ki:
 = ∑   .
(1)</p>
      <p>Thus, the observed value is decomposed into a number of components. And from
the point of view of visualizing such values, two cases can be distinguished:
• P value is decomposed into a small number of components (less than 5);
• P value consists of a large number of components.</p>
      <p>
        Let's consider both cases using practical examples. During the quarantine period of
the first half of 2020, a group of students and teachers at Bryansk State Technical
University was engaged in constructing COVID-19 distribution models in AnyLogic [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].
At the same time, a number of modeled and observed values were just composite and
had the character described above.
      </p>
      <p>
        One of the most important and critical indicators of spreading COVID-19 is the
number of infected people (let's call it INF). It is this indicator that primarily determines
quarantine measures, the complexity of epidemic control in a particular region, and
various management decisions [
        <xref ref-type="bibr" rid="ref2 ref3">2,3</xref>
        ]. However, as practice has shown, the total number
of cases in a particular region (or even a country) does not adequately describe the
situation. Even if this value is normalized by the region population (that is make the
value relative), this is clearly not enough for the analysis. The fact is that INF value
itself is a composite one by its nature and its constituent parts have quite different
degrees of criticality and importance. For example, INF value can be decomposed into
      </p>
      <p>Visualization of the Dynamics of Changes in Structured Data… 3
such components as the number of seriously ill patients (requiring connection to an
artificial lung ventilator), the number of moderate-severity patients, and the number of
patients who do not require hospital admission. Therefore, the same INF value in
different regions may show the overall situation in completely different ways. To
understand the situation correctly, it is important to see not only the indicator itself, but also
the structure of its components, and evaluate the contribution of each component.</p>
      <p>
        Besides, if the number of components is not very large, we can use traditional
schemes for displaying and visual analysis, such as multiple graphs (for each criterion
separately), column graphs, histograms and Temporal Networks. In recent years, the
research community has also accumulated overwhelming evidence in favor of complex
and heterogeneous connectivity patterns based on Temporal networks [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. However,
the situation becomes more complicated if the number of components increases. In this
case, the visibility of traditional approaches is greatly reduced.
      </p>
      <p>
        Let's take another example. According to the World Health Organization (WHO),
the incidence and severity of the disease in COVID-19 depends very much on the age.
Therefore, it can be very useful to analyze the number of cases (INF indicator
introduced before), but only in the context of the age of cases. That is, the components of
this indicator should be considered as the number of cases of what age contributed to
the total number of cases. This indication and analysis can be useful for evaluating
actions and decisions taken. For example, some restrictive measures may not lead to a
decrease in the total number of cases, but may change the structure of this value,
reducing the number of elderly patients, which is also a very important factor in the epidemic
control [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
      </p>
      <p>
        At the same time, visual analysis by age is very time-consuming. It is difficult to
estimate this indicator due to the large number of age options. Therefore, in most cases,
reduction of the variants (components) is done by rounding the age to certain ranges
[
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. An example of such rounding, taken from official statistics on age, gender, and
disease, depending on the death of patients from infection caused by COVID-19, based
on an official document dated February 28, 2020 from the WHO-China Joint Mission
report [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], is shown in Table 1.
However, such rounding is associated with certain problems. Firstly, poorly chosen age
ranges can lead to incorrect analysis and a strong distortion of the real situation.
Secondly, by rounding up age ranges, we lose some of the information for analysis, which
can be very significant. Thirdly, the selected ranges may vary greatly for different
regions and countries, and to make the selection in each specific situation is a very
timeconsuming task [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Therefore, the important point is not to abandon the full range of
ages, but to develop new principles for visualizing such data.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Existing render methods</title>
      <p>There are a lot of ways to show the dynamics of data changes. Let us consider the most
commonly used options by the example of dynamics of developing COVID-19 on the
territory of Bryansk region (see Fig. 1). The graphs show the dynamics of infections,
recoveries, deaths due to COVID-19, the dynamic number of new infections, identified
on the territory of Bryansk region, compared with the previous day and according to
days since the first revealed infected person.</p>
      <p>
        The most common option is to use traditional charts. In this case, time is X-axis, and
the value under consideration is Y-axis. If the data are structured, then several graphs
are constructed for each of the components. An example of such graphs is shown in the
first diagram of Fig. 1. However, it is good to analyze such graphs if the number of the
observed values is small enough (one or two). If there are a lot of such values, the graph
is difficult to read and it becomes very hard to draw any conclusions in this situation.
Another problem is the difficulty of estimating the contribution of each component to
the total. Based on such render methods, it is often impossible to analyze the overall
situation of the epidemic growth in terms of the patient's age, gender, illness illnesses,
activities, etc. [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>Another option, which is also often found in open sources of statistics, is a column
chart. In this case, each component is displayed as a separate column of its own color,
and the dynamics is displayed as a set of such columns. According to Yandex, Apple
and Otonomo data, there is given an example of a column chart grouping changes in
the level of activity of the Russian population in the period from February to June.</p>
      <p>
        Another fairly good rendering option is a radar chart and a pie chart [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. In contrast
to the previous versions, these methods are very good at visualizing the data structure,
clearly showing the contribution of each component. However, they are very difficult
to apply for showing the dynamics of changes in this data over time.
4
      </p>
    </sec>
    <sec id="sec-4">
      <title>Method of rendering the graph of colour markers</title>
      <p>As it was described above, in the framework of research and simulation of the situation
with spreading COVID-19, conducted in Bryansk State Technical University, we used
an approach to show the dynamics of changes in structured values, which is
conventionally called the method of color stripes or color marker graph. The main idea of this
approach is as follows. Let us assume that we have a certain value P(t), which value
changes over time (the value under study depends on t parameter). In this case, this
value consists of different components. That means that at t time moment P(t) value
can be decomposed into some components:</p>
      <p>( ) = ∑   ( ).</p>
      <p>For visual image of these data (both the graph of changes in the value itself and its
components), we assign each component part kj a certain color (the so-called color
marker):</p>
      <p>{ 1 ↔ цвет1;  2 ↔ цвет2; … ;   ↔ цвет }.</p>
      <p>Then the curve of the value change P(t) is rendered as a standard graph, plotting time
along the abscissa axis, and the observed value itself along the ordinate axis. At the
same time, kj(t) component parts should be painted with the corresponding color
marker. In this case, the graph of changes P(t) will look like color bars of different
widths (depending on the value of kj(t) components).</p>
      <p>Now let us consider the example described in the previous chapter (analysis of
changes in the number of cases in the context of disease severity). Let the analyzed
value P(t) be the total number of infected by COVID-19 at a certain time. At the same
time, as it is described above, not the graph of changes in the number of cases is of
interest, but the analysis of the components of this number, that is how many of these
cases are severe, how many are moderate, how many people do not require hospital
admission, and how many are asymptomatic. In this case this value at time moment ti
is decomposed as follows:

( ) = ∑4=1   ( ).
(4)
where: k1(t) is the number of seriously ill at time moment t; k2(t) is the number of
hospital moderate-severity patients; k3(t) is the number of infected people who do not need
hospital admission; k4(t) is the number of asymptomatically infected.</p>
      <p>Let us assign a color marker to each value. Then the general graph of changes in the
epidemiological situation will take the form shown in Fig. 2.</p>
      <p>This graph is a more visual way to show than tabular data or other options discussed
earlier. This display provides more information for analysis and additional conclusions,
allows to see patterns or effects that are not visible in other versions of the image. For
example, according to the graph above, it can be seen that at time moment tk marked on
the graph with a stipple line, some measures were taken that did not significantly reduce
the increase in the total number of patients, but as a result, they significantly changed
the structure of this value in the direction of reducing the number of seriously ill and
moderate-severity patients.</p>
      <p>Let us consider another example. In this case the observed value P(t) consists of a
large number of components. An example of such data is the previously considered
analysis of morbidity rate in the context of patients’ age. As practice has shown, this
parameter is also very important for analyzing the situation.</p>
      <p>Formally, this task is expressed as follows. As before, we will use the number of
patients at time moment t as the observed value. However, we will consider the value
of the composite value kage(t) as the number of cases at time t at the age, where age is
in the range:
0 ≤ 
≤ 
,
(7)
where MaxAge is the maximum age of infected people.</p>
      <p>
        Visual representation of such a value by conventional methods (graphs, charts,
tables) is quite problematic [
        <xref ref-type="bibr" rid="ref11 ref12">11,12</xref>
        ]. In the proposed approach, in order to use color
markers, we should enter a smoothly changing color marker for ages. In this case, the graph
shown in Fig. 4 will be obtained.
      </p>
      <p>This display does not require analysis and selection of rounding limits, but it is a
simpler and more visual way to display a composite value.
5</p>
    </sec>
    <sec id="sec-5">
      <title>Data visualization in the software system for modeling the situation with COVIND-19 in Bryansk region</title>
      <p>
        Epidemic outbreaks in various regions represent a special situation with a high level of
uncertainty. In some regions, there was a noticeable repetition of the situation in the
same scenario. In others, the situation was significantly different. A software package
in AnyLogic environment was developed in Bryansk State Technical University.
Classical methods of epidemic modeling based on SIR model were suggested as a basis
[
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. As a result of analyzing a series of experiments conducted with COVID-19 disease
development model it is possible to visualize the rate of infection spread with different
behavior of people and various parameters, conditions and constrains. The screenshot
of the system is shown in Fig. 5. The system was presented at the contest for the best
scientific work "Modern scientific achievements. Bryansk-2020".
      </p>
      <p>
        Taking the known criteria as a basis, it is possible to demonstrate the development of
infection spread, indicators of the level of disease severity [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. We used a model that
incorporated the main factors known at that time about the spread of infection among
people. Specific indicators and coefficients were calculated based on similar data for
Moscow region [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] and included in the complex for modeling the situation in Bryansk
region. As a result, a model was built (see Fig. 6) that takes into account the following
factors:
1. Immunity. The better the person's immunity, the lower is the probability of
COVID19 infection (ImmunityRatio parameter of double type, which takes value from 0 to
1). Each object Person in the constructor is assigned with a random value in the
range specified above.
2. Social responsibility (IsolationRate parameter of double type has a default value of
0.45) [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. According to the emergency response centre of the Russian Federation,
the level of social responsibility is approximately 45% (exactly following the
doctor's prescription and recommendations, as well as quarantine or self-isolation
measures). The value of this parameter changes dynamically based on data received
from Rospotrebnadzor and Johns Hopkins University.
3. Accompanying coronavirus diseases (factor of a person's going to the hospital in
case of infection, accompanyingIllness parameter of boolean type).
4. The time to make a decision after infection symptoms onset is a factor that can be
used to make a conclusion about the disease severity (whatToDoDays parameter is
of int type and is set randomly from the above range for each object Person).
According to statistics in the region [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], a person goes to the hospital or goes to
self
      </p>
      <p>Visualization of the Dynamics of Changes in Structured Data… 9
isolation within 1-5 days. In this time range, a person begins to notice symptoms
onset and deterioration of his health condition.</p>
      <p>The structure of the simulation model of the disease development according to the
unit of model time equal to one day is shown in Fig. 6.</p>
      <p>The color marker approach described above was used to display and visualize data on
the dynamics of changes in structured values. This made it possible to present the
results more clearly.</p>
      <p>The data on the infection spread in Bryansk region obtained during modeling on the
basis of open and publicly available information shows the feasibility of the model. The
discrepancy between the currently modeled and real curves does not exceed 12%.
6</p>
    </sec>
    <sec id="sec-6">
      <title>Conclusion</title>
      <p>In this paper, we have proposed a method that combines analysis and visualization of
structured data. Most of the examples in the paper are given on the situation with
COVID-19 development. This is due to the fact that we have tried and tested this
visualization approach on the basis of the corresponding complex. However, the proposed
method of displaying the dynamics of changes in the data structure in the form of color
markers and gradients can be used in absolutely any areas where there is a need to
display the dynamics of composite values, see and analyze the structure of these values.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. AnyLogic, https://www.anylogic.ru/,
          <source>last accessed</source>
          <year>2020</year>
          /07/10.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>L.Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yan</surname>
            ,
            <given-names>L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wan</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xiang</surname>
          </string-name>
          , T.-X.,
          <string-name>
            <surname>Le</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>J.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Peiris</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poon</surname>
            ,
            <given-names>L.L.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          , W.:
          <article-title>Viral dynamics in mild and severe cases of Covid 19</article-title>
          .
          <source>Lancet Infect Dis</source>
          . (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Murray</surname>
            ,
            <given-names>C.J.L.</given-names>
          </string-name>
          :
          <article-title>Forecasting COVID 19 impact on hospital bed-days, ICU-days, ventilatordays and deaths by US state in the next 4 months. IHME COVID 19 health service utilization forecasting team</article-title>
          , https://doi.org/10.1101/
          <year>2020</year>
          .03.27.20043752, last accessed
          <year>2020</year>
          /07/10.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Kapoor</surname>
            ,
            <given-names>A</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ben</surname>
            ,
            <given-names>X</given-names>
          </string-name>
          , Liu,
          <string-name>
            <surname>L</surname>
          </string-name>
          , et al.:
          <source>Examining COVID-19 Forecasting using Spatio-Temporal Graph Neural Networks. July 06</source>
          ,
          <year>2020</year>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Koltsova</surname>
            ,
            <given-names>E.М.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kurkina</surname>
          </string-name>
          , Е.S., Vasetsky, А.М.:
          <article-title>Mathematical modeling of the spread of COVID-19 coronovirus epidemic in a number of European, Asian countries, Israel and Russia. Economic problems and legal practice</article-title>
          ,
          <source>no.2</source>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>Russell</given-names>
            <surname>Timothy</surname>
          </string-name>
          ,
          <string-name>
            <surname>W</surname>
          </string-name>
          , Hellewell,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Jarvis</surname>
          </string-name>
          <string-name>
            <surname>Christopher</surname>
          </string-name>
          , I., van Zandvoort,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>Abbott</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Ratnayake</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            ,
            <surname>Flasche</surname>
          </string-name>
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Eggo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.M.</given-names>
            ,
            <surname>Edmunds</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.J.</given-names>
            ,
            <surname>Kucharski</surname>
          </string-name>
          ,
          <string-name>
            <surname>A.J.:</surname>
          </string-name>
          <article-title>Estimating the infection and case fatality ratio for coronavirus disease (COVID-19) using age-adjusted data from the outbreak on the Diamond Princess cruise ship</article-title>
          ,
          <year>February 2020</year>
          , https://doi.org/10.2807/
          <fpage>1560</fpage>
          -
          <lpage>7917</lpage>
          .ES.
          <year>2020</year>
          .
          <volume>25</volume>
          .12.2000256, last accessed
          <year>2020</year>
          /07/10.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7. World Health Organization.
          <source>Coronavirus disease 2019 (COVID-19): Situation Report - 38 from 27 February</source>
          <year>2020</year>
          , http://www.who.int/docs/default-source/coronaviruse/ situation-reports/20200227-sitrep-38
          <string-name>
            <surname>-</surname>
          </string-name>
          covid-19. pdf,
          <source>last accessed</source>
          <year>2020</year>
          /07/10.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>S-H</given-names>
          </string-name>
          , Cai,
          <string-name>
            <given-names>Y</given-names>
            ,
            <surname>Li</surname>
          </string-name>
          <string-name>
            <surname>J.:</surname>
          </string-name>
          <article-title>Visualization of COVID-19 spread based on spread and extinction indexes</article-title>
          .
          <source>Sci China Inf Sci</source>
          ,
          <volume>63</volume>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Yang</surname>
            ,
            <given-names>X</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>Y</given-names>
          </string-name>
          , Xu,
          <string-name>
            <surname>J</surname>
          </string-name>
          , et al.:
          <article-title>Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study</article-title>
          .
          <source>Lancet Respir Med</source>
          <volume>8</volume>
          (
          <issue>5</issue>
          ), pp.
          <fpage>475</fpage>
          -
          <lpage>481</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Dimara</surname>
            ,
            <given-names>E</given-names>
          </string-name>
          , Perin,
          <string-name>
            <surname>C.</surname>
          </string-name>
          :
          <article-title>What is interaction for data visualization</article-title>
          ?
          <source>IEEE Trans Visual Comput Graph 26</source>
          , pp.
          <fpage>119</fpage>
          -
          <lpage>129</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Robertson</surname>
            ,
            <given-names>G</given-names>
          </string-name>
          , Fernandez,
          <string-name>
            <surname>R</surname>
          </string-name>
          , Fisher,
          <string-name>
            <surname>D</surname>
          </string-name>
          , et al.:
          <article-title>Effectiveness of animation in trend visualization</article-title>
          .
          <source>IEEE Trans Visual Comput Graph 14</source>
          , pp.
          <fpage>1325</fpage>
          -
          <lpage>1332</lpage>
          (
          <year>2008</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Kosara</surname>
          </string-name>
          , R.:
          <article-title>Presentation-oriented visualization techniques</article-title>
          .
          <source>IEEE Comput Grap Appl</source>
          ,
          <year>2016</year>
          ,
          <volume>36</volume>
          , pp.
          <fpage>80</fpage>
          -
          <lpage>85</lpage>
          (
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Khrapov</surname>
            ,
            <given-names>P.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loginova</surname>
            ,
            <given-names>A.A.</given-names>
          </string-name>
          :
          <article-title>Mathematical modelling of the dynamics of the сoronavirus COVID-19 epidemic development in China</article-title>
          .
          <source>International Journal of Open Information Technologies</source>
          <volume>8</volume>
          (
          <issue>4</issue>
          ), pp.
          <fpage>13</fpage>
          -
          <lpage>16</lpage>
          , http://www.injoit.org/index.php/j1/article/view/908/874, last accessed
          <year>2020</year>
          /07/10.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>D.Q</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Guo</surname>
            ,
            <given-names>D.H</given-names>
          </string-name>
          , Zhang, H.:
          <article-title>Spatial temporal data visualization in emergency management: a view from data-driven decision</article-title>
          .
          <source>In: Proceedings of the 3rd ACM SIGSPATIAL Workshop on Emergency Management</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Matveev</surname>
          </string-name>
          , А.V.:
          <article-title>Mathematical modeling of evaluating the effectiveness of measures against the spread of COVID-19. Natsionalnaya Bezopasnost I Strategicheskoe Planirovanie (National Security and Strategic Planning)</article-title>
          ,
          <source>no.1</source>
          (
          <issue>29</issue>
          ), pp.
          <fpage>23</fpage>
          -
          <lpage>39</lpage>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Jüni</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rothenbühler</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bobos</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thorpe</surname>
            ,
            <given-names>K.E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>da Costa</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fisman</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Slutsky</surname>
            ,
            <given-names>A.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gesink</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          :
          <article-title>Impact of climate and public health interventions on the COVID-19 pandemic: A prospective cohort study</article-title>
          .
          <source>CMAJ May 08</source>
          ,
          <year>2020</year>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Rodkin</surname>
          </string-name>
          , М.V.,
          <string-name>
            <surname>Shikhova</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <article-title>М: Mathematical modeling of COVID-19 epidemic, an attempt to forecast</article-title>
          .
          <source>Uralian Geological Journal, no.3</source>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>