<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Digital Transformation of Government Communications in Russia: from 2011 to 2020</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>omir Bolgov</string-name>
          <email>r.bolgov@spbu.ru</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>ITMO University</institution>
          ,
          <addr-line>49 Kronverksky Pr., St. Petersburg, 197101</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>St. Petersburg State University</institution>
          ,
          <addr-line>199004 St. Petersburg, 7 Universitetskaya Emb.</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>169</fpage>
      <lpage>180</lpage>
      <abstract>
        <p>The paper presents the results of two studies conducted with an interval of 9 years, which allow us to identify trends of government communications in digital public sphere of Russia. The authors draw conclusions about the active, but generally ineffective development of such communications that do not allow citizens to actively participate in political decision-making.</p>
      </abstract>
      <kwd-group>
        <kwd>political communications</kwd>
        <kwd>public communications</kwd>
        <kwd>digital public sphere</kwd>
        <kwd>e-participation</kwd>
        <kwd>social media</kwd>
        <kwd>Russia</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Last few decades, the concept of "public sphere" has become so widely and frequently
used that there are few intellectuals who did not know who is Jürgen Habermas and
how his works are related to this concept. However, starting from the period of active
development of social media, the subject of intense theoretical debate and numerous
empirical studies is the emergence and existence of the digital public sphere as the
online equivalent of the traditional, seemingly imperfect, “old” public sphere. The
advent of the digital public sphere has attracted a lot of attention in recent years
because it has been conceptualized as an addition or even replacement of a previously
existing, “classical”, “old” concept of the public sphere as an essential element of
modern democracy [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. The digital public sphere is mainly defined as the sphere of
online communication, participation in which is openly and freely available to
everyone who is interested in discussing issues of common interest. The contemporary
studies show that a distinctive feature of the digital public sphere is the visibility of
the discussion or the results of the joint work of all actors in the network and that at
least sometimes they affect the decision-making by other people. Among these studies
are the ones presented in this paper.
      </p>
      <p>
        In 2011, we carried out a structural analysis of public communications of the
authorities in the Web 2.0 space at the federal and regional levels of government as part
of a grant project of the Faculty of Applied Communications of St. Petersburg State
University [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>In January 2020, we conducted a second study, which allowed us to identify trends
in the development of government communications in the digital public sphere</p>
      <p>Copyright ©2020 for this paper by its authors.</p>
      <p>Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
of Russia. The 2020 study can be called a trend study, since it was carried out on the
same sample and relied on the same methodology that was used in 2011, with some
adjustments. To compile a sample of the study, a list of servers of state authorities
was used, available on the Official Russia website at www.gov.ru.</p>
      <p>The main research questions were resolved during the study:
1. Can we see the growth of channels, tools and services used by public authorities
to communicate with the citizens?</p>
      <p>2. Do social media really open up wide opportunities for communication between
public authorities and the audience, or is this just a political myth?</p>
      <p>3. Do the authorities have an adequate and effective set of means of participation
and cooperation with citizens for making democratic decisions?</p>
      <p>Below we will try to answer these questions.
1</p>
    </sec>
    <sec id="sec-2">
      <title>Research methodology</title>
      <p>First of all, it is necessary to pay attention to the fact that representatives of all
theories note the extreme importance of political communication in public administration.
It should also be noted that the goal of political communication in public
administration is not just the manipulation of the audience, but the achievement of agreement
between the citizens and the government.</p>
      <p>
        The study of government communications was developed by us within the
framework of the post-classical paradigm, according to which modern communication
technologies are not just a way of adapting to the external environment and the
interaction of social actors with the external environment. It is, first of all, a way of
constructing a social environment, forming public opinion on a variety of scales and the
transformation of public capital into “informational” capital in the terminology of
Castells [
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3-5</xref>
        ]. The foundations of the Castells’ concept are close to the ideas of
Arendt [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] (the basis of society is the open public space) and Luhmann (society is
generated by communication) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Habermas's works on public sphere are also of great
importance for our study [
        <xref ref-type="bibr" rid="ref8 ref9">8-9</xref>
        ].
      </p>
      <p>It should be noted that the term “government communications” seems to us broader
than “communications of public authorities”. This is due to the fact that in the latter
case, only public authorities designated as such in the constitution act as
communicative actors who create, direct, and receive messages. Due to the nature of government
actors whose functioning is connected with the implementation of state power, the
communications they carry out are a priori political and public. The subject of
government communications is information relations regarding the exercise of state
power. At the same time, messages have the necessary attributes of public
communication. They affect the needs / interests / values of citizens and have a public status.
Accordingly, when in the future we will use the term “government communications”,
we will imply their political nature and public status. As a method of the study we
used the network approach. Using network analysis accompanied by other methods
such as case study, descriptive statistics, etc.</p>
      <p>To search for knowledge about the really existing types of the studied
phenomenon, typological and structural analysis was used. Methods of collecting and
analyzing empirical data:</p>
      <p>1. The formalized method is content analysis. It is carried out separately for each
site and account in social media. It includes analysis of the total number of messages,
the frequency of publications, general topics of messages, the use of special means of
expression (links, photos, videos).</p>
      <p>2. An unformalized method, which consists in adapting the content of a document
to a research task based on an intuitive understanding, generalization of the content,
and the rationale for the conclusions made.</p>
      <p>3. Statistical methods.</p>
      <p>The advantages of the selected methods are profitability, efficiency and versatility
of the study. So the unformalized method is based on the understanding,
comprehension and interpretation of the content of documents in accordance with the purpose of
the study. A formalized analysis (content analysis) is designed to extract information
from large arrays of documentary sources inaccessible to intuitive analysis.</p>
      <p>Next, we will present in retrospect, first, the results of the analysis of Russian
government digital communications in 2011, and then move on to the results of the 2020
study. In this text, the analysis is limited to government communications at the federal
level.
2
2.1</p>
    </sec>
    <sec id="sec-3">
      <title>Research results</title>
      <p>Study 2011
An empirical study was conducted from September 1 to November 1, 2011. We
analyzed the official websites of authorities, as well as blogs, microblogging (Twitter),
social networks, video hosting (Youtube). First of all, we revealed that in 2011 all
official bodies had the official website. We analyzed 62 sites of all branches of the
federal government: legislative, judicial, and executive (52 of 78 sites) using the basic
array method. Only 7 federal authorities had official blogs. 6 authorities did not have
official blogs, however there were personal blogs, blogs of the public persons, or
simply officials of the department. As for microblogging, it turned out that they were
much more popular than regular blogs: 15 ministries had official Twitter accounts.</p>
      <p>12 official YouTube channels were identified during a 2011 study. Social networks
were not as popular as expected. The most popular was the social network Vkontakte,
on which 17 official pages and two personal pages were registered. The local
authorities had 12 pages on Facebook in 2011.</p>
      <p>In general, the analysis showed that Twitter is the most convenient communication
tool for the authorities on the Internet. VKontakte was a popular network. Although it
is difficult to talk about any mass activity of federal government bodies on the
Internet, because, as it turned out, only a little more than 10% of government departments
at the federal level went beyond the boundaries of their own site (see Fig. 1)</p>
      <p>Thus, the use of Web 2.0 technologies in public communications of the federal
authorities of the Russian Federation in 2011 could not be considered effective.
The wide interactive possibilities of social media, which imply the priority of bilateral
and multilateral communication, were generally unclaimed.
In 2020, a continuous sample was used, according to which digital public
communications of all 83 federal government bodies of the Russian Federation were analyzed
in accordance with the data of the Official Russia.</p>
      <p>The study was conducted from 10.11.2019 till 01.15.2020. It should be noted that it
was completed on the day when the government resigned. For convenience, the study
is divided into two rounds. The first round is the analysis of websites; the second one
is the analysis of social media. The main goal of the study is to compile a rating of
authorities in the context of e-participation.</p>
      <p>Tasks of the study:
1. determine the basic state of electronic means of participation provided by
government websites by complete analysis of the websites, tools, services and content
they provide;</p>
      <p>2. identify the most effective social media used by federal authorities for
communication between government and society;</p>
      <p>3. assess the scale and degree of effectiveness of the use of e-communication by
federal authorities for making democratically sound and technically rational decisions
in the interests of all citizens on the one hand, and creating the image of a modern and
effective government on the other hand.</p>
      <p>A desk-top study was conducted — an inventory of available means of
participation and cooperation on official websites and accounts of federal authorities.</p>
      <p>Websites Analysis. Obviously, by the beginning of the 2020s, almost all sites at
the federal level are regularly filled up, updated, have all the necessary sections and,
accordingly, there is no need to evaluate their information and interactive
components. Moreover, there is no point in evaluating the design of the site, its usability and
search new optimization.</p>
      <p>
        Therefore, for the analysis of sites, it was decided to apply almost the same list of
criteria that was used in our other studies [
        <xref ref-type="bibr" rid="ref10 ref11">10-11</xref>
        ] related to the measurement of
electronic participation opportunities provided by government websites (see Table 1).
This list of criteria correlates with the methodology for evaluating e-participation,
which is used by the United Nations [
        <xref ref-type="bibr" rid="ref12 ref13 ref14">12-14</xref>
        ].
      </p>
      <p>In the case of the presence of investigated component, a rating “1” was set; in the
case of absence - “0”. Then the average value was calculated for each criterion for
each authority. The results are presented in Figure 2.
Figure 2 clearly demonstrates that by the beginning of 2020, almost all federal bodies
of the Russian Federation provide feedback opportunities (97.3%), faithfully reports
on their work (79.7%) and have accounts on social networks (77%).</p>
      <p>However, only 9.6% of websites provide opportunities for e-consultations, a little
more offer to vote on the website (20.5%). And, which is very strange in 2020, almost
77% of websites do not indicate the presence of mobile versions and there are no links
to any other mobile applications.
In general, the conclusions regarding the provision of e-participation opportunities on
the websites of federal authorities turned out to be disappointing. Most sites are only
at the first (information) stage of e-participation (but perform it good). Some websites
allow to organize and to hold consultations, but most of the government is still far up
to the stage of decision-making.</p>
      <p>Analysis of communications of federal authorities in social media. For analysis,
we used those accounts, the link to which is posted on official websites, as well as on
the portal of the Government of the Russian Federation.</p>
      <p>It turned out that the federal authorities are very differently integrated into social
media: some of them do not have accounts there at all, some are registered on the
same social network, and some try to register on almost all popular networks at once.
By the beginning of 2020, Facebook (65.8%) was the most popular social network
among the federal government bodies of the Russian Federation. 59.7% used Twitter.
Moreover, the government bodies represented on VKontakte (47.5%), Youtube
(45.1%) and Instagram (40.2%) (see Fig. 3).
In terms of the number of subscribers to government bodies accounts, Twitter leads
with more than 5 million users. The number of Vkontakte subscribers is approaching
3 million. Odmoklassniki with their 18 accounts are ahead of Facebook with 54
accounts in terms of the number of users. About 0.5 million users are subscribed to the
channels of government authorities on Youtube (Fig. 4).
If we turn to a study conducted in 2011 (see Fig. 5), we can conclude that by 2020,
the popularity of text blogs has faded. However, in 2011 it was not large: only 7
authorities had official text blogs, 6 ones had personal blogs of top officials, and one
government body had an unofficial blog, that totally accounted for 22.6% of the
analyzed authorities.</p>
      <p>Figure 5 shows that the popularity of social networks is undoubtedly noticeable.
Facebook demonstrates the greatest growth. The most popular social network in 2011
(Vkontakte) significantly lost to Facebook. The number of accounts on Youtube and
Twitter almost doubled. Accounts on Instagram and Odnoklassniki were not analyzed
in 2011.
In a detailed way, we have analyzed and identified some trends and tendencies in the
activity of federal authorities on Instagram, since Instagram is now becoming
increasingly popular among a wide audience and opinion leaders.</p>
      <p>We found Instagram accounts with 33 federal authorities (40.2%) (Fig. 6). The
total number of subscribers at the time of the study was 1977447 people (Fig. 7.)
It can be stated that the absolute majority of accounts of federal authorities on
Instagram have an only information function. Among the topics discussed, all accounts
unanimously lead news content, and almost all accounts contain congratulations on
holidays. Some departments dilute their content with reference material for citizens,
contests, etc. In two accounts of departments there is even a humorous content.</p>
      <p>In almost all representative offices, there is a very low activity. Even in accounts
with more than 20 thousand subscribers, the number of likes and comments is
disproportionately small. In almost all departments, there is no official representative who
could communicate with users in the comments and respond online to questions
arising on topics.</p>
      <p>The most active are the State Duma, the Federal Agency for Youth Affairs, the
Ministry of Internal Affairs, and the Ministry of Defense. The most active account by
a wide margin must be recognized as the profile of Dmitry Medvedev, chairman (at
the moment, former) of the Government of the Russian Federation. At the time of the
study he had more than 2.6 million subscribers and 581 posts.</p>
      <p>Among the least active body are the Accounts Chamber, the Federal Agency for
State Property Administration, the Ministry of Science and Higher Education, and the
Federal Service for Alcohol Market Regulation. The account with the lowest activity
indicator was recognized as the profile of Valentina Matvienko as the head of the
Council of Federation (higher chamber of Russian parliament) with 13 publications
and the last update a year ago.</p>
      <p>Based on the analysis, we built a ranking of information activity on Instagram and
an index of involvement of federal authorities.</p>
      <p>The following formula was used to calculate the information activity index:
Information activity index = number of posts / number of subscribers
(1)
To compile the ranking, the indicators were ranked in descending order.</p>
      <p>Engagement rate is the level of audience engagement in the activity of an account
(an indicator of user interaction with published content).</p>
      <p>To provide engagement formula, we used the program Xprofile. Engagement
formula (a week metrics) is following:</p>
      <p>ER = (likes + comments) / followers * 100%
(2)</p>
      <p>In our activity ranking (if we divide the number of posts by the number of
subscribers), the leader was the Federal Agency for the Commonwealth of Independent
States, as well as the Central Election Commission. The last three places are occupied
by the State Duma, the President of the Russian Federation and the Ministry of
Culture. Accounts of D. Medvedev and V. Matvienko were not included in the ranking,
because only the accounts of departments were analyzed.</p>
      <p>But the activity ranking does not coincide with the engagement index, which
shows how many people interact with publications (like or comment). Only one
agency, Federal Agency for State Property Management, provides the content that is
interesting to the user, that is, subscribers really react to it. Four more departments can be
considered more or less active on Instagram. They have average indicators for the
audience engagement index. These are the Federal Biomedical Agency, the Federal
Customs Service, the Federal Service for Supervision of Natural Resources and the
Ministry of Defense. The vast majority of accounts do not fall into any standards on
the level of involvement.</p>
      <p>It should be noted that the engagement index was calculated from indicators for the
week and was fully relevant only on January 13, 2020. That is, in different weeks,
different agencies are leaders or outsiders. But, nevertheless, our experience in
conducting such studies shows that, on average, this index reflects the trends correctly.</p>
      <p>Thus, at this stage, keeping Instagram accounts by federal authorities is rather
attributive and image-based instrument than a valid communicative tool. All imagine
flats are more like abbreviated press centers. Due to the low activity of the audience,
most departments cannot effectively use all the tools of this social network in order to
spread their influence on the audience. The lack of feedback from departments in the
comments also greatly inhibits this process. Therefore, at the moment, it cannot be
said that Instagram is an effective platform for communication between federal
authorities and the public. Unfortunately, the similar conclusion can be made virtually
with respect to all the analyzed social media.</p>
      <p>So, it cannot be denied that over ten years, Russian ministries and departments
have gradually improved the content of their Internet websites. The number of pages
in different social networks was increased significantly. However, these changes are
more visible than substantial. With an abundance of websites and social media
accounts, only a few of them contribute to improving the image of the government or its
bodies. The presence of a website or an account on a social network in the
government does not mean that it effectively uses these public communication tools.</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>
        In conclusion, we note that the digital public sphere of modern Russia is undergoing
changes, which Habermas largely foresaw. The Internet is actively developing in all
areas of life; “ordinary citizens efficiently and creatively interact with each other
online“ [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ]. Like most researchers, we cannot but agree with the thesis that modern
Internet technologies have fundamentally transformed and changed communications
in all areas.
      </p>
      <p>Nevertheless, the impact of the Internet on government communications in Russia
today can be called insignificant, and the wide interactive possibilities of social
media, which suggest the priority of bilateral and multilateral communication, remain
generally unclaimed.</p>
      <p>Unlike Western European and American practice, in which blogs and social
networks are most often a full-fledged platform for communication between public
persons and citizens, in Russia, social media in the political sphere serve primarily as a
modern and technological analogue of a message board used for information or
propaganda. Most of both politicians and officials are trying to apply new technologies to
implement outdated communication models. They are not yet ready for dialogue and
open two-way communication with users, or simply not interested in them. This
situation can apparently be explained both by national managerial traditions and by the
features of the political system that has developed in Russia today.</p>
      <p>
        The comparative results of two studies presented in this paper demonstrate that the
main achievement of the Russian “digital democracy” was only improved access to
information. The government supports e-information rather than e-consultation and,
moreover, not joint decision making, as is assumed in the concept of e-participation.
Government authorities prefer to inform about the decisions made, rather than consult
with citizens before the making decisions. Unfortunately, we have not yet been able to
detect the tangible impact of existing digital communication platforms, forums that
provoke online discussions, on decision-making by “institutional policy” [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] and
find evidence of an increase in e-participation today compared with a ten-year-old
situation. This is consistent with the observation by a number of scholars that
government actors tend to use online campaigns for information and education purposes,
while civil society actors usually conduct campaigns in an attempt to influence
current political debate or political decisions, mobilizing for certain actions and
increasing social pressure [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ].
      </p>
      <p>The answer to the research question (whether the Russian authorities have a
sufficient and effective means of participation and cooperation with citizens for making
democratically sound decisions) is negative. Despite the growth of the online
channels, tools and services, they are inefficiently used by public authorities to
communicate with the citizens.</p>
      <p>And yet, despite the ambiguity of the digital public sphere of Russia, there are
communication platforms in the Russian segment of the Internet that, at least from
time to time, influence other discussion platforms and contribute to finding collective
solutions. However, this conclusion needs further substantiation and identification of
the conditions under which such digital public communications can develop.</p>
      <p>Of course, it is necessary to continue research in this direction. The research
methodology, of course, needs to be improved. In such a dynamic environment as the
Internet, many indicators quickly become obsolete, but new ones appear.</p>
      <p>We need projects focused on the study of factors contributing to communication,
and, in general, the effective functioning of the system of e-interaction between
government bodies, business and citizens in digital environment. Moreover, an important
component of this issue is not only theoretical study, but also the implementation of
applied research using social science methods and tools of modern Internet research.
It seems that the studies described above allow us to identify problems and areas for
further work by communication specialists in government.</p>
      <p>Acknowledgement. This work was supported by the Russian Science Foundation, project No.
18-18-00360 “E-participation as Politics and Public Policy Dynamic Factor”.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Schaefer</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Digital public sphere</article-title>
          .
          <source>The International Encyclopedia of Political Communication</source>
          . Ed. Mazzoleni, Gianpietro et al. London: Wiley Blackwell,
          <fpage>322</fpage>
          -
          <lpage>328</lpage>
          (
          <year>2015</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <source>2. Report 4.23.720</source>
          .
          <year>2011</year>
          on
          <article-title>the research "Public Communication of the Government of the Russian Federation in the WEB 2.0. Space: Structure, Channels and Instruments in the Early 2010s</article-title>
          .
          <string-name>
            <surname>St</surname>
          </string-name>
          . Petersburg State University (
          <year>2011</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Castells</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : The Information Age: Economy, Society and Culture Vol.
          <article-title>I: The Rise of the Network Society</article-title>
          . Cambridge MA. Oxford UK: Blackwell Publishers (
          <year>1996</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Castells</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : The Information Age: Economy, Society and Culture Vol.
          <article-title>II: The Power of Identity</article-title>
          .
          <source>Malden MA</source>
          . Oxford UK: Blackwell Publishers (
          <year>1997</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Castells</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          : The Information Age: Economy, Society and Culture Vol.
          <article-title>III: End of Millennium</article-title>
          .
          <source>Malden MA</source>
          . Oxford UK: Blackwell Publishers (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Arendt</surname>
          </string-name>
          , Н.:
          <article-title>The Human Condition</article-title>
          (Second ed.). University of Chicago Press (
          <year>1998</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Luhmann</surname>
          </string-name>
          , N.:
          <article-title>The World Society as a Social System</article-title>
          .
          <source>International Journal of General Systems</source>
          ,
          <volume>8</volume>
          (
          <issue>3</issue>
          ),
          <fpage>131</fpage>
          -
          <lpage>138</lpage>
          (
          <year>1982</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Habermas</surname>
          </string-name>
          , J.:
          <article-title>Moral consciousness and communicative action</article-title>
          . Cambridge: Polity Press (
          <year>1992</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Habermas</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>The Structural Transformation of the Public Sphere: An Inquiry into a Category of Bourgeois Society</article-title>
          , Thomas Burger, Cambridge Massachusetts: The MIT Press (
          <year>1989</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Authors</surname>
          </string-name>
          :
          <article-title>E-Government in the Eurasian Economic Union: A comparative study of member states</article-title>
          .
          <source>In: ACM International Conference Proceeding Series. 11th International Conference on Theory and Practice of Electronic Governance, ICEGOV</source>
          <year>2018</year>
          , pp.
          <fpage>27</fpage>
          -
          <lpage>33</lpage>
          (
          <year>2018</year>
          ).
          <source>DOI: 10.1145/3209415</source>
          .3209435.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Authors</surname>
          </string-name>
          :
          <article-title>E-participation in EEU countries: a case study of government websites</article-title>
          .
          <source>Proceedings of the International Conference on Electronic Governance and Open Society: Challenges in Eurasia, EGOSE</source>
          ,
          <fpage>145</fpage>
          -
          <lpage>151</lpage>
          (
          <year>2017</year>
          ).
          <source>DOI: 10.1145/3129757</source>
          .3129782.
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>E-Participation Index</surname>
          </string-name>
          . URL: https://publicadministration.un.org/ egovkb/enus/About/Overview/E-Participation.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13. Concept paper “
          <article-title>Developing capacity for participatory governance through e-participation”</article-title>
          .
          <source>DPADM</source>
          (
          <year>2013</year>
          ). http://workspace.unpan.org/sites/internet/Documents/ CONCEPT%20PAPER%
          <fpage>20e</fpage>
          -Participation%
          <year>2001</year>
          .
          <volume>30</volume>
          .13.pdf .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>United Nations E-Government</surname>
            <given-names>Survey</given-names>
          </string-name>
          <year>2018</year>
          .
          <article-title>Gearing E-Government to Support Transformation Towards Sustainable</article-title>
          and Resilient Societies // United Nations E-Government
          <string-name>
            <surname>Survey</surname>
          </string-name>
          (
          <year>2018</year>
          ). https://www.un
          <article-title>-ilibrary.org/democracy-and-governance/united-nations-egovernment-survey-2018_d54b9179-en.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Сoleman</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Can the Internet Strengthen democracy</article-title>
          ? Polity: Cambridge; Malden, MA (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Van Dijk</surname>
            ,
            <given-names>J. A. G. M.:</given-names>
          </string-name>
          <article-title>Digital democracy: Vision and reality</article-title>
          . In:
          <article-title>Public administration in the information age</article-title>
          : Revisited. Ed. I. Snellen,
          <string-name>
            <given-names>W.</given-names>
            <surname>Thaens</surname>
          </string-name>
          , &amp; W. van de Donk. Amsterdam: IOS-Press (
          <year>2012</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Baringhorst</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          : Introduction.
          <article-title>Political campaigning in changing media cultures - typological and historical approaches. Political campaigning on the web</article-title>
          . Ed.
          <string-name>
            <given-names>S.</given-names>
            <surname>Baringhorst</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Kneip</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Niesyto</surname>
          </string-name>
          . Bielefeld: Transcript (
          <year>2009</year>
          ).
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>