<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>An Analysis of Civility in American Online Discussions</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Daniil Volkovskii</string-name>
        </contrib>
      </contrib-group>
      <pub-date>
        <year>2021</year>
      </pub-date>
      <fpage>199</fpage>
      <lpage>205</lpage>
      <abstract>
        <p>In this study research focus is on the culture of speech in online discussions, therefore, the purpose of the paper is to analyze the civility (culture of speech) in online deliberations on political topics. Civility in American online discussions is analyzed according to the criteria of the deliberative standard developed on the basis of the Habermas theory by Misnikov. It reveals what criteria are used to describe the culture of online communication and what factors can potentially influence it. To assess the level of communication culture it is necessary to analyze how participants relate to each other, their positions and comments towards objects of discussion. The author comes to conclusion that American discussions can be characterized positively from the point of view of civility and called rational as small percentages of rude attitude were recorded.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Deliberative democracy</kwd>
        <kwd>deliberation</kwd>
        <kwd>online deliberation</kwd>
        <kwd>social media</kwd>
        <kwd>civility</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>second impeachment of Donald Trump. The main purpose of the article is to show the civility (culture
of communication) between participants of online discussions on relevant political themes.</p>
      <p>The main research questions to be answered:
Q1. What exact criteria allow to determine the culture of communication in online deliberations?
Q2. How can American discussions be characterized in terms of a culture of communication?
Q3. What factors determine the communication culture of participants in online discussions on
political topics?</p>
    </sec>
    <sec id="sec-2">
      <title>2. Theoretical basis</title>
      <p>To understand what role online deliberation on political issues plays in improving the quality of
citizen participation in politics and decision-making, turn to various foreign studies conducted by J.S.
Fishkin, V. Price, R. Cavalier., M. Kim, Z.S. Zaiss, J. Kelly, D. Fisher, M. Smith, A. Lev-On, B. Manin,
D. Schloss-berg, S. Zavenoski, S. Schulman, P. M. Shane, T. Ohlin, J. Wung Ri, Y. Mi Kim, S. Wright,
G. Leshed, M. Trenel, K.S. Ramsey, M.W. Wilson.</p>
      <p>
        J. S. Fishkin [
        <xref ref-type="bibr" rid="ref3 ref4 ref5">3, 4, 5</xref>
        ] examines the historical background and theoretical foundations of "deliberative
polling", analyzes the results of polls conducted using the voice interface. The researcher notes that the
results of online survey are broadly similar to the “deliberative weekend” in which participants meet
face-to-face. We suppose that the author of this article came to approximately the same conclusion in
his studies devoted to the analysis of citizens' discussions on raising the retirement age in Russia in
which the results of online deliberation and a sociological survey were compared. We believe that online
deliberation is more convenient and flexible as well as low cost compared to opinion polls. Based on
this we optimistically assert that this method can be extended to longer periods of time, more issues
discussed which will ultimately lead to better political judgments.
      </p>
      <p>
        V. Price [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ] demonstrates the results of two of his extended surveys of invited contributors to
online writing on presidential elections and health policy. He was able to establish a positive correlation
between the participation of individuals in these sessions and their political involvement. Based on the
results obtained, it can be assumed that online text chats contribute to a more even distribution of the
participation of individuals in the discussion than face-to-face format. Indeed, based on our analysis of
civic discussions on social networks, we can say that participants are approximately equally involved
in online deliberation.
      </p>
      <p>
        R. Cavalier, M. Kim and Z.S. Zaiss [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] are conducting analysis in the field of structured online
deliberation and they used a multimedia environment where participants of discussion communicated
with the moderators via audio and video channels. Experiments have shown that there are no significant
differences in the values of the measured dependent variables compared to face-to-face discussions
constructed in a similar way.
      </p>
      <p>
        J. Kelly, D. Fisher and M. Smith [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] analyzed the debates unfolding in the politicized newsgroups
of the Usenet network, which is part of the Internet. They found that such groups are usually
ideologically heterogeneous and that most commentators are more inclined to debate with opponents
than deliberate with like-minded people.
      </p>
      <p>
        H. Lev-On and B. Manin [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] are considering whether the Internet is conducive to network
clustering of like-minded people. Based on their empirical data, they believe that communication on
the Internet generates mixed trends in the context of online deliberation. People are trying to filter out
content that is foreign to their views and with the help of various tools that help isolate opposing
opinions.
      </p>
      <p>
        Another group of studies is devoted to the tools that the state uses to involve citizens in online
discussions of political decisions made by it and tries to establish how it can improve the effectiveness
of civic participation in decision-making and making both at the local and regional levels. For example,
D. Schlossberg, S. Zavenoski and S. Schulman [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] in their study did not find any fundamental
differences between the comments of citizens on bills submitted to government agencies in electronic
form and in the traditional (paper). At the same time, they tend to believe that the websites of authorities
have potential, though underestimated because they contribute to the receipt of suggestions, comments
from specific individuals who, in certain cases, can have a greater impact on politics than comments
presented in format of letters by organizations whose ambitions and efforts are aimed at mobilizing
their voters.
      </p>
      <p>
        P. M. Shane [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] believes that the potential of online public consultation allows the modification of
government work towards the cyber-democratic model of Empowered Participatory Governance
(EPG), which was proposed by A. Fang and E.O. Wright [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. In their view, the model seeks to "broaden
the ways in which ordinary people can more effectively influence the policies that shape their lives."
P.M. Shane simultaneously analyzes the technological and inertial barriers to the development of both
“empowered government” and a more advanced form of online public consultation than the one
practiced by the US federal government and concludes that it is necessary to apply local efforts to push
the US federal government towards a new model that allows for more inclusive and wider citizen
participation in lawmaking and policy making. This point of view should be taken into account, since
it may be relevant at the present time for the Russian authorities both at the federal and local levels.
      </p>
      <p>
        T. Ohlin [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ] analyzes the outcomes of a public consultation using a combination of face-to-face
formats and networking, in which many senior citizens of one of Stockholm suburbs actively
participated in the discussion of priority areas of urban planning.
      </p>
      <p>We will pay special attention to research devoted to various ways of promoting deliberative forums
and the introduction of factors on which their quantitative and qualitative characteristics depend. This
group of papers can answer questions about whether moderators influence the course of discussion,
what is the impact on the discussion of such variables as anonymity, the composition of the deliberation
group and the system of reward, reward of participants.</p>
      <p>
        Joon Wung Ri and Yoon Mi Kim [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] analyzing the results of online field experiment with the
electorate who participated in the Korean general election in 2004 concluded that moderation reduced
the number of voter posts in the forum, anonymous participants were more active and the system
incentive points for participating in the discussion had a positive effect.
      </p>
      <p>
        Scott Wright [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] touches upon the problem of moderating discussion forums initiated by the
authorities. He notes that such moderation can take many different forms and based on the results of
previous studies argues that the functions of filtering messages (censoring) and facilitating discussion
should be differentiated between different moderators, and the function of deleting messages in case
such a need must be fulfilled by independent body in accordance with publicly avail-able rules,
regulations.
      </p>
      <p>
        Gilly Leshed [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ] presents the results of a natural experiment in which the company's management
drew on the possibility of anonymous employee participation in the internal online community of the
organization after a series of inappropriate messages emerged. It can be noted that the results obtained
by Jun Wung Ri and Yoon Mi Kim are to some extent confirmed, and the author himself points out a
noticeable decrease in the number of posts and dialogues due to the removal of anonymous
commentators in the online community.
      </p>
      <p>
        Matthias Trenel [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] based on an analysis of a field experiment conducted in an online forum where
the future of the territory (where the World Trade Center was located in New York) was discussed came
to the conclusion that a more pro-active approach, i.e. facilitating discussion may involve
underrepresented categories of participants.
      </p>
      <p>
        Kevin S. Ramsey and M.W. Wilson [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] criticize the current practice of online consultation and
offer recommendations on how to increase the ability of panelists to critically reflect on the information
provided to them during the discussion.
      </p>
      <p>
        In our research an important role is played by the concept of deliberative democracy by J. Habermas,
his theory of communicative action and discursive ethics [
        <xref ref-type="bibr" rid="ref17 ref18">17, 18</xref>
        ]. We assess the quality of deliberative
discourse in order to identify characteristics, patterns, models thanks to which the process of
deliberation, in particular online deliberation, can be improved both between citizens and between civil
society and the state. In this study focus is on the culture of speech in online discussions, therefore, the
purpose of the paper is to analyze the civility (culture of speech) that develops in online deliberations
on political topics. The object of the research is the quality of online deliberation and the subject is the
culture of speech in online discussions. Accordingly, our main hypothesis (H1) is that American
discussions are civil, i.e. participants are polite, tolerant, neutral towards each other, statements of other
participants and objects of discussion. Accordingly, we assume that the main factor determining the
culture of communication in online discussions is the political development of the country, especially
the level of democracy.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Research data</title>
      <p>The empirical material for the discourse analysis was online discussions on the second impeachment
of US President Donald Trump on Facebook pages of the leading American printed and TV media
distributed into three categories in dependence of affiliation to political parties (conservative and
liberal). We have selected two media sources for analysis: the conservative Washington Times and Fox
News, the liberal New York Times and MSNBC, as well as additionally we took a neutral Wall Street
Journal. In the Facebook accounts of these media, discussions were chosen on the topic of the second
impeachment of the American president in connection with the attempted capture of the Capitol on
January 6, 2021. A total of 2,931 comments were analyzed.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Research approach and findings</title>
      <p>
        To achieve the goals of our investigation we used discourse analysis which is simultaneously a key
moment and a method of online deliberations’ research. Our analysis is based on a modification of the
methodology developed by UN expert Yu. Misnikov (in line with the ideas of Yu. Habermas), already
tested by us earlier and presented in previous publications [
        <xref ref-type="bibr" rid="ref19 ref20">19, 20</xref>
        ]. The scientist has generated
«deliberative standard to assess discourse quality» where thematically different discursive parameters
of the deliberative standard, corresponding to specific research issues and using for guiding the process
of encoding messages of Internet discussions, are described.
      </p>
      <p>
        In Misnikov's methodology civility is a synonym for speech culture which is used to characterize
the qualitative nature of a public online discussion and is associated with demonstrating a tolerant
attitude towards the participant in the discussion, his position and the object of discussion. Data about
it are not so easy to interpret since there is no universal approach to its definition [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. There are
situations when messages contain both polite and impolite speech aspects which causes difficulty in
post’s coding. In addition to the use of harsh language that clearly demonstrates willful impoliteness,
some messages may only imply unpleasant connotations, irony and sarcasm. If we talk about polite
messages, then they can have a special purpose and be addressed to certain participants in a more
personalized manner both with the mention of the name and with emphasis on some aspects of the topic
which contributes to more involvement of people in the discussion in dialogic form.
      </p>
      <p>We analyzed the civility recorded in the discussions on the topic of pension reform from two
positions (see Table 1):</p>
      <p>- interpersonal character = posts are directly addressed to another member with a mention of the
name or personal appeals:
(a) posts do not relate to issues, i.e. they are exclusively personalized;
(b) posts are clearly rude and offensive in relation to a person, his nationality, religion, ideology,
etc. (distinguish from irony, humor, sarcasm);
(c) posts are clearly rude and offensive in relation to the objects of discussion;
(d) posts are clearly polite and respectful towards a person (may contain irony, humor, sarcasm in a
positive aspect);</p>
      <p>- posts do not include an explicit mention of the participant's name, can be directly or indirectly
addressed to a specific person, someone else or all people:</p>
      <p>(e) posts contain rude, offensive language, vocabulary in relation to the participant (irony, humor
and sarcasm are excluded from this category);
(f) posts contain rude, offensive language, vocabulary in relation to the objects of discussion;
(g) posts are clearly polite and respectful (include deliberate politeness, irony, humor, non-offensive
sarcasm).</p>
      <p>According to the results of the analysis of civility (see table 1), we can see that their percentages are
not high (they do not even exceed 10%), respectively, the general indicators of negative civility are low
which means that such discussions can be called rational. According to the aggregate calculations, users
on republican media were more polite than users on democratic media, however, the lowest percentage
of overall negative civility was recorded on a neutral platform, where, on the contrary, opinions
polarized in approximately equal proportions clashed. It is interesting that the participants practically
did not distract from the discussion of the topic, did not discuss each other and the percentages of rude
Thematically empty posts
with participant name’s
mention, only interpersonal
communication
Posts with participant name’s
mention, discussion on topic,
but rude towards participant
Posts with participant name’s
mention, discussion on topic,
but rude towards object of
discussion
Posts with participant name’s
mention, discussion on topic
in a polite, tolerant way
Posts without participant
name’s mention, with
discussion on topic, but rude
towards participant
Posts without participant
name’s mention, with
discussion on topic, but rude
towards object of discussion
Posts without participant
name’s mention, with
discussion on topic in a polite
way
Negative civility towards
participant
Negative civility towards
object of discussion
Average negative civility in
dependence of parties</p>
      <p>Total civility
5. Conclusion
0
0,2
0,6
0
7,1
0
0
7,3
7,9
0,8
1,2
0,1
0
4,4
0,1
0,8
5,6
6,7
0,75
0,75
0
0
0
2,8
0,75
3,55
4,3
attitude towards the participants were minimal while more negative and intolerant statements were
directed towards the objects of discussion (D. Trump, his supporters, Biden, the Democratic Party, N.
Pelosi and politicians in general).</p>
      <p>To sum up, we can confirm our main hypothesis and provide an answer to the first research question
(Q1). To assess the level of communication culture it is necessary to analyze how participants relate to
each other, positions and comments of other participants, objects of discussion. It is important to clearly
and specifically formulate the criteria in order to assess the diverse palette of cultural interaction which
has been demonstrated in this work. American discussions can be characterized positively from the
point of view of civility and called rational as small percentages of rude attitude were recorded,
moreover, in relation to the objects of discussion. In general, Americans are neutral and without
excessive respect for each other, insults to participants in online deliberation are kept to a minimum.
Mostly, abusive behavior was demonstrated in cases where the participant's position was different and
when the participant did not understand the other's point of view despite different forms of
argumentation. Then, instead of a rational force, an emotional one appeared, manifested in the form of
a non-rude or very rude insult towards another participant. It is significant that the participants focused
on the discussion of the problem and not on meaningless interpersonal communication distracting from
the topic for the sake of which people gathered (Q2).</p>
      <p>It can be assumed that such indicators of civility and such a culture of communication, especially in
relation to the participants, are justified not by the heterogeneity of positions, indicators of the quantity
and quality of argumentation, dialogicity, the degree of dialogue but by factors correlating with the
mentality, socio-psychological attitudes, values, upbringing, education and culture in general, including
political, the level of political development, especially democracy. We cannot determine with 100%
accuracy which factors influence the level of civility but we can definitely understand the culture of
communication and interaction of participants based on the analysis of this parameter which is
important when studying online deliberation as a form of civil interaction (Q3). If the participants are
able to conduct a discussion based on respect for the positions and personality of each other, especially
if this is a format of discussion, polemics where participants are trying to win and not come to a
consensus and mutual understanding, then, no doubt, there are wide opportunities for genuine public
dialogue between representatives of civil society and government authorities in the development and
adoption of decisions on significant political issues.</p>
      <p>In the future we will analyze Russian discussions on acute political topics in social networks
according to various parameters of the deliberative standard for assessing discourse including civility.
The results will be compared with the results of analysis of participants’ civility in American online
deliberation in order to determine the set of potential factors influencing the communication culture of
participants in the online environment, especially those related to the political development of the state
as well as criteria for assessing the quality of deliberation. Moreover, in addition to social networks, we
will take forums for analysis since there are discussions initiated not by the media as the discussions
taken for this study but by the citizens themselves. Consequently, the culture of communication and its
levels can differ significantly, as, for example, there are no moderators and other restrictive factors as
in the case of Facebook media pages.</p>
    </sec>
    <sec id="sec-5">
      <title>6. Acknowledgements</title>
    </sec>
    <sec id="sec-6">
      <title>7. References</title>
      <p>This work was supported by the Russian Science Foundation, project No. 21-18-00454.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Held</surname>
          </string-name>
          , Models of Democracy. Moscow,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D.</given-names>
            <surname>Chandler</surname>
          </string-name>
          ,
          <article-title>Democracy unbound? Non-linear politics and the politicization of everyday life</article-title>
          , in
          <source>European Journal of Social Theory</source>
          , Vol.
          <volume>17</volume>
          ,
          <string-name>
            <surname>N 1</surname>
          </string-name>
          ,
          <year>2014</year>
          , pp.
          <fpage>42</fpage>
          -
          <lpage>59</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.S.</given-names>
            <surname>Fishkin</surname>
          </string-name>
          ,
          <article-title>The nation in a room: Turning public opinion into policy</article-title>
          , in Boston review,
          <year>2006</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>J.S.</given-names>
            <surname>Fishkin</surname>
          </string-name>
          ,
          <article-title>The televised deliberative poll: An experiment in democracy, in Annals of the American academy of political and social science</article-title>
          , Vol.
          <volume>546</volume>
          ,
          <string-name>
            <surname>July</surname>
          </string-name>
          ,
          <year>1996</year>
          , pp.
          <fpage>132</fpage>
          -
          <lpage>140</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J.S.</given-names>
            <surname>Fishkin</surname>
          </string-name>
          ,
          <article-title>Virtual public consultation: Prospects for internet deliberative democracy</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>23</fpage>
          -
          <lpage>35</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>V.</given-names>
            <surname>Price</surname>
          </string-name>
          ,
          <article-title>Citizens deliberating online: Theory and some evidence</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>37</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>V.</given-names>
            <surname>Price</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.N.</given-names>
            <surname>Capella</surname>
          </string-name>
          ,
          <article-title>Online deliberation and Its Influence: The electronic dialog project in campaign 2000</article-title>
          ,
          <string-name>
            <surname>in</surname>
            <given-names>IT</given-names>
          </string-name>
          &amp; Society,
          <year>2002</year>
          , Vol.
          <volume>1</volume>
          (
          <issue>1</issue>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>R.</given-names>
            <surname>Cavalier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.S.</given-names>
            <surname>Zaiss</surname>
          </string-name>
          ,
          <article-title>Deliberative democracy, online discussion, and project PICOLA Public informed citizen online assembly)</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>71</fpage>
          -
          <lpage>79</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>J.</given-names>
            <surname>Kelly</surname>
          </string-name>
          , D. Fisher,
          <string-name>
            <given-names>M.</given-names>
            <surname>Smith</surname>
          </string-name>
          , Friends, Foes, and
          <article-title>Fringe: Norms and Structure in Political Discussion Networks</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>83</fpage>
          -
          <lpage>93</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>A.</given-names>
            <surname>Lev-On</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Manin</surname>
          </string-name>
          ,
          <article-title>Happy accidents: Deliberation and online exposure to opposing views</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>105</fpage>
          -
          <lpage>122</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>D.</given-names>
            <surname>Schlosberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Zavestoski</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Shulman</surname>
          </string-name>
          ,
          <article-title>Deliberation in ERulemaking? The problem of mass participation</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>133</fpage>
          -
          <lpage>148</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>T.</given-names>
            <surname>Davies</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Chandler</surname>
          </string-name>
          ,
          <article-title>Online deliberation design: Choices, criteria, and evidence</article-title>
          , in Nabatchi T.,
          <string-name>
            <surname>Weiksner</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gastil</surname>
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leighninger</surname>
            <given-names>M</given-names>
          </string-name>
          . (Eds.),
          <article-title>Democracy in motion: Evaluating the practice and impact of deliberative civic engagement</article-title>
          , Oxford: Oxford univ. press,
          <year>2013</year>
          , pp.
          <fpage>103</fpage>
          -
          <lpage>131</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>A.</given-names>
            <surname>Fung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.O.</given-names>
            <surname>Wright</surname>
          </string-name>
          .
          <article-title>Thinking about empowered participatory governance, in</article-title>
          <string-name>
            <surname>A</surname>
          </string-name>
          . Fung,
          <string-name>
            <given-names>E.O.</given-names>
            <surname>Wright</surname>
          </string-name>
          (Eds.),
          <article-title>Deepening democracy: Institutional innovations in empowered participatory governance</article-title>
          , N.Y.:
          <string-name>
            <surname>Routledge</surname>
          </string-name>
          ,
          <year>2003</year>
          , pp.
          <fpage>3</fpage>
          -
          <lpage>45</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>T.</given-names>
            <surname>Ohlin</surname>
          </string-name>
          ,
          <article-title>Local democracy in the telecommunications age</article-title>
          ,
          <source>in Svenska dagbladet, August, N. 1</source>
          ,
          <year>1971</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>S.</given-names>
            <surname>Wright</surname>
          </string-name>
          ,
          <article-title>The role of the moderator: Problems and possibilities for government-run online discussion forums</article-title>
          , in T. Davis,
          <string-name>
            <surname>S.P.</surname>
          </string-name>
          Gangadadharan (Eds.), Online deliberation: Design, research, and practice, Stanford, CA:
          <article-title>Center for the study of language</article-title>
          and information,
          <source>2009</source>
          , pp.
          <fpage>233</fpage>
          -
          <lpage>242</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Y.</given-names>
            <surname>Misnikov</surname>
          </string-name>
          , Public Activism Online in Russia: Citizens'
          <article-title>Participation in Webbased Interactive Political Debate in the Context of Civil Society</article-title>
          . Development and Transition to Democracy:
          <source>PhD thesis … Ph. D. / Leeds</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>J.</given-names>
            <surname>Habermas</surname>
          </string-name>
          ,
          <article-title>Involvement of the other</article-title>
          .
          <source>Essays on political theory. SPb</source>
          .,
          <year>2001</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>J.</given-names>
            <surname>Habermas</surname>
          </string-name>
          ,
          <source>The Theory of Communicative Action. Reason and the Rationalization of Society. Beacon</source>
          , Boston,
          <year>1984</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>O.</given-names>
            <surname>Filatova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Volkoskii</surname>
          </string-name>
          ,
          <article-title>Key Parameters of Internet Discussions: Testing the Methodology of Discourse Analysis</article-title>
          , in
          <string-name>
            <surname>Alexandrov</surname>
          </string-name>
          , D.A.,
          <string-name>
            <surname>Boukhanovsky</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chugunov</surname>
            ,
            <given-names>A.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kabanov</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koltsova</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musabirov</surname>
          </string-name>
          , I. (Eds.),
          <source>Digital Transformation and Global Society (DTGS</source>
          <year>2020</year>
          ).
          <source>Proceedings of the 5th International Conference, St. Petersburg</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>32</fpage>
          -
          <lpage>46</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>O.</given-names>
            <surname>Filatova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Volkoskii</surname>
          </string-name>
          ,
          <article-title>The online discourse as a form of e-Participation: the experience of internet discourse research</article-title>
          ,
          <source>in Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance (ICEGOV2020)</source>
          , Athens, Greece, April 1-
          <issue>3</issue>
          ,
          <year>2020</year>
          . ACM New York, NY, USA, pp.
          <fpage>326</fpage>
          -
          <lpage>333</lpage>
          . doi:
          <volume>10</volume>
          .1145/3428502.3428547
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>