<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Behavior Mining Methods for Dynamic Risk Analysis in Social Media Communication</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Jan Ole Berndt</string-name>
          <email>berndt@uni-trier.de</email>
        </contrib>
      </contrib-group>
      <fpage>77</fpage>
      <lpage>84</lpage>
      <abstract>
        <p>Spreading information through social media can be bene cial in crisis situations as well as harmful for a person's or company's reputation. Which and how information is spread depends on network structures and individual behaviors. Simulation-based methods are suitable to systematically explore potential system behavior, its potentials, and its risks. This paper introduces behavior mining from social media to develop such simulations. It provides an integrated analysis work ow and gives an overview of applicable methods for each process step.</p>
      </abstract>
      <kwd-group>
        <kwd>Social Media Risk Analysis User Behavior Data Mining</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Communication in social media plays a major role for crisis, risk, and
reputation management. Crucial information as well as misinformation spreads rapidly
through online social networks which can be either bene cial (e.g., for crisis
management) or harmful (e.g., endangering reputation) [
        <xref ref-type="bibr" rid="ref1 ref23">1, 23</xref>
        ]. In fact, these
processes can lead to severe cascading e ects in economy, politics, and other
domains [
        <xref ref-type="bibr" rid="ref25 ref3">3, 25</xref>
        ]. Consequently, understanding communication processes in social
media is crucial for making the right decisions in the event of a crisis.
      </p>
      <p>
        Simulation-based methods are particularly suitable to systematically explore
potential system behavior which emerges from individual interactions between
media users [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The dynamics in social networks are highly dependent on
network structures and individual behaviors. Even for very simple behavioral
patterns, the overall result on the system level can become completely unpredictable
[
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. Therefore, it is necessary to use realistic user interconnections and
communication patterns in social media simulation for obtaining meaningful results.
While there is a wealth of network analysis and computer linguistic approaches
to social media, less research has been conducted to infer patterns of actor
behavior from social media data.
      </p>
      <p>This contribution introduces behavior mining from social media data. Its goal
is to provide an overview of available methods and a work ow incorporating them
to develop simulations as a method for dynamic risk analysis in networked
communication. To that end, Section 2 further elaborates on systemic risks in social
media and Section 3 presents the process of behavior mining with a discussion
of available methods for each process step. Finally, Section 4 concludes on the
ndings of this paper.</p>
    </sec>
    <sec id="sec-2">
      <title>Analyzing Systemic Risks in Social Media</title>
      <p>
        In social media, users are interconnected in complex networks of friendship,
acquaintance, and general interest. Formally, these networks can be modeled as
graphs with media users as nodes and their connections as edges [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ].
Communication takes place along these edges and becomes visible to nodes connected to
the active user. For instance, Twitter1 users can follow each other, resulting in all
followers of a speci c user to get noti ed about that user's activities. By reacting
to or forwarding messages, communication cascades through the network.
      </p>
      <p>From the perspective of systemic risks, the e ects of cascading
communication can be either bene cial or hazardous. Consequently, existing work on social
media and risks focuses on the following two main lines of research.
1. Social media usage for risk management and crisis communication
2. Social media endangering reputation or spreading misinformation</p>
      <p>
        As a means for risk management, social media provide communication
infrastructures which allow for spreading information rapidly to those who are a ected
by a crisis. Prime examples are disasters like earthquakes, epidemic diseases, or
plane crashes [
        <xref ref-type="bibr" rid="ref15 ref26">26, 15</xref>
        ]. In these instances, it is necessary to provide information
about the situation and advice for recommended action to those immediately
endangered, their relatives, as well as any helpers. In addition, planners and risk
managers need to listen to their audience and take account of their concerns in
crisis communication [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. Thus, risk and crisis management requires channels
for multi-directional communication with large numbers of people.
      </p>
      <p>
        Using social media has been proposed for providing information and
monitoring the situation in the event of a crisis [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. To that end, researchers have
derived best practices for pre-event management, collaboration with the
public, and communication strategies from real-world examples of successful social
media usage in crisis situations [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. To support these, sentiment analysis and
emotion detection techniques are available for monitoring public opinion and
adapting communication strategies accordingly [
        <xref ref-type="bibr" rid="ref15 ref17">17, 15</xref>
        ]. These techniques are
complemented with static analyses of the underlying network structures in
social media to identify the most in uential users who can serve as multipliers
for spreading information [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Information spreads throughout a network in a
process of so-called social contagion [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ]. The most common approach to analyze
such a process is the SIR model which groups users into those being potentially
attentive to information (or: susceptible, S), those actively spreading the
information (or: infected, I), and those being already informed but no longer active
(or: recovered, R) [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ]. Based on a given network structure, this model allows for
dynamic analyses of information ows in social media by means of simulation.
Moreover, such an approach facilitates optimizing communication policies by
identifying the best set of users to be informed rst in the event of a crisis for
maximizing the reach of that information. This kind of in uence maximization
has been applied to various elds including marketing and public health [
        <xref ref-type="bibr" rid="ref16 ref31">16, 31</xref>
        ].
1 https://twitter.com/
      </p>
      <p>
        Nevertheless, crisis communication using social media also bears risks in
itself. Among other challenges, it is important to prevent rumors and the spreading
of misinformation which can lead to panic, to avoid information overload, and
to ensure that information cannot be abused for criminal purposes [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. This
requires careful planning of whom to address with which information in what
way. Even outside crisis situations, these are challenges companies and
individuals face when utilizing social media for marketing, political communication, or
personal interests. While the speed of information di usion can be bene cial, it
can also become harmful and potentially uncontrollable in case of rumors and
misinformation being spread (fake news) or in mass protests (storms of protest
or Twitterstorms) [
        <xref ref-type="bibr" rid="ref2 ref23">2, 23</xref>
        ]. These phenomena endanger a company's or person's
reputation and can even lead to severe systemic e ects in economy and politics,
ranging from a loss of revenue to social upheaval [
        <xref ref-type="bibr" rid="ref25 ref3">3, 25</xref>
        ].
      </p>
      <p>
        In order to understand the aforementioned phenomena, computer simulation
has been proposed as a method for dynamic analysis of network e ects and
individual behavior [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Such a simulation can be used to develop communication
strategies by anticipating potential reactions and their e ects throughout a social
network. However, these reactions can hardly be captured by simpli ed contagion
models. When attempting to a ect the content and ow of information,
individual motivations and behavioral dispositions that drive communication must be
considered. Depending on the composition of these individual behaviors,
simulated communication processes can vary drastically between negotiations of
di ering opinion as well as pure protest and resentment [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Consequently,
simulations for analyzing and addressing systemic risks in social media require
representations of communicative behavior to produce meaningful results. To that
end, the following section introduces behavior mining for extracting individual
communicative patterns from social media data as a foundation for simulation.
3
      </p>
    </sec>
    <sec id="sec-3">
      <title>Behavior Mining from Social Media Communication</title>
      <p>
        To generate realistic representations of communicative behavior, a method is
required to identify and derive this kind of behavior from social media data. Indeed,
there are various approaches readily available to mine such data for di erent
purposes. In particular, event mining methods are popular for risk assessment
applications in which, e.g., social unrest is predicted [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. These methods focus
on user groups, combinations of communicated contents, as well as
communication frequencies that indicate the targeted activities. Additionally, particular
user groups are identi ed according to their in uencing potential for customer
relationship management and marketing purposes [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. This can be achieved by
clustering social graphs in which these groups occur as densely interconnected
users with similar interests. For both applications, geo-spatial clustering is used
to narrow down a particular area of events or marketing activities [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>While event mining and geo-spatial clustering are highly relevant for risk
identi cation, the methods applied in that context are less useful for extracting
individual patterns of communication. A speci c event or location in uences the
Feature
Extraction</p>
      <p>Data
Preprocessing</p>
      <p>
        User Clustering Behavior Extraction
topic of certain conversations, but that topic can be discussed in di erent ways,
depending on the behavioral patterns of participating users [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Therefore,
another approach is necessary. Such an approach to behavior mining must identify
particular groups of users with similar behaviors and then extract these
behaviors as decision-making rules for actors in a simulation. However, in order to
achieve this, features to describe and discriminate behavioral patterns have to
be identi ed. This results in a behavior mining process consisting of the following
four consecutive steps and the associated methods shown in Table 1.
1. Feature Extraction: Identify properties of communication processes that
allow for distinguishing between di erent behavioral patterns.
2. Data Preprocessing: Prepare the available data for automated analysis of
user activities according to the identi ed features.
3. User Clustering: Group users according to similarities between their
communicative behaviors using the extracted features.
4. Behavior Extraction: Identify prototypical behaviors for each identi ed
user group in the form of condition-action rules.
      </p>
      <p>The following sections outline those tasks and discuss available methods for
each of these process steps in detail with respect to risk analysis in social media.
3.1</p>
      <sec id="sec-3-1">
        <title>Feature Extraction</title>
        <p>
          Features for characterizing user behavior can either be based on
communication content or on metadata about the interaction process. The former includes
discourse topics and sentiment expressed throughout a conversation [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ]. To
extract these features from raw data, computer linguistic methods are required.
The most simple way to model topics in social media is using hashtags with
which users provide keywords for describing their contributions. Since not all
messages contain hashtags, they can be complemented with other distinctive
words. Their occurrence frequencies in di erent messages form a topic model
for a conversation [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ]. On social media platforms like Twitter, more structured
arguments are rare [
          <xref ref-type="bibr" rid="ref5">5</xref>
          ]. Hence, subjects that attract an individual's attention
and their opinion toward it su ce as content-based features in most cases.
        </p>
        <p>
          While content-based features are important for analyzing di erent types of
discourses, a wide range of activity patterns can simply be observed in
metadatabased analyses. Social media metadata covers the activities of all observed users
in an abstracted form. It includes the time a message is sent or published, its
sender, potential receivers based on the underlying social network graph, any
explicitly mentioned addressees (e.g., so-called @-mentions), as well as the type of
message (i.e., an original contribution, a reply to another message, or a forwarded
message) [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. This data is readily available both through programming interfaces
of social media platforms and in existing data sets for social media analysis [
          <xref ref-type="bibr" rid="ref19 ref5">5,
19</xref>
          ]. From metadata, composite features like inter-activity times, activity type
frequencies, and activity type sequences can be derived. These specify patterns of
behavior which correspond to prototypical actor types and roles in social media.
3.2
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>Data Preprocessing</title>
        <p>Before user behaviors can be extracted, social media data must be preprocessed.
Gathering data or using existing data sets results in a collection of single
communication events or a graph of interconnected events and users. The
aforementioned features either describe the nature of individual events or they derive
statistics across several of them. Consequently, the data must be pro led to
bring the extracted features into a one line per user format. In that format, all
features are listed for the corresponding user who's behavior they characterize.
This is a prerequisite for identifying similarities and di erences between users
with respect to the extracted features of their communicative behavior.</p>
        <p>
          However, there can be a wide range of user behaviors out of which some
might be incomparable to others. These can disturb further analyses because
they will not t into any other group of behaviors. For instance, unusually small
inter-activity times are an indicator for either a corporate account or a social bot
[
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. While such accounts have the potential to crucially impact communication
in social media, it is impossible to sensibly t a single instance of them into any
other user group. Hence, it is necessary to detect such outliers and exclude them
from the clustering step [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ]. They can still be included again later as individual
single entity clusters to analyze their special impact.
3.3
        </p>
      </sec>
      <sec id="sec-3-3">
        <title>User Clustering</title>
        <p>
          User clustering groups social media users with common characteristics together
while distinguishing between groups that di er with respect to one or more
features. The resulting clusters re ect speci c communicative roles which users
adopt or particular topics they are interested in. These aspects drive the
communication process and have crucial impact on information di usion. For example,
a user adopting the role of a producer will primarily introduce original content
that can start communication or steer the process into new directions.
Contrastingly, communicators and networkers will add to the existing content and
primarily distribute information [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. Hence, these user groups exhibit
characteristic behavior patterns by which they can be identi ed and distinguished.
        </p>
        <p>
          To derive characteristic patterns from a data set, centroid-based clustering
is particularly suitable. This method groups data points around a
prototypical instance representing common and distinguishing features of the group [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ].
Consequently, it allows for directly identifying typical behavioral patterns of,
e.g., a producer or a networker among the potentially wide variations of those
behaviors. Even if users are similar in their activities and underlying
motivations, they still di er from each other. These variations produce noise which
density-based clustering as well as distribution-based clustering methods can
handle. Density-based algorithms distinguish between high and low density regions,
whereas distribution-based approaches attempt to match data points to
statistical distributions [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. However, sometimes several user groups can be
characterized by similar behaviors while di ering in particular aspects; i.e., they overlap
to a certain extent. For instance, communicators and networkers can di er in
their communication contents, but they both mainly distribute information [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ].
When overlapping user behaviors can be subsumed under more generic groups,
hierarchical clustering is useful. This method creates a taxonomy of groups by
starting with each data point as an individual cluster and then grouping similar
ones together [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ]. Nonetheless, its computational complexity makes it di cult to
apply that method to the large amounts of data present in social media analysis.
Thus, which clustering method is applied best highly depends on the analyzed
communication process and the user population participating in it.
3.4
        </p>
      </sec>
      <sec id="sec-3-4">
        <title>Behavior Extraction</title>
        <p>While user clustering identi es what behavioral patterns exist in social media, it
does not derive how these patterns are generated. Therefore, behavior extraction
has the task to nd decision rules which map speci c events to communicative
actions. These mappings then determine under which conditions, e.g., a message
is forwarded or replied to. Hence, they govern whether crucial information can
reach its target audience, whether misinformation can spread, whether a mass
protest can emerge, or whether nothing signi cant happens.</p>
        <p>
          To extract behaviors, speci c events must be identi ed that lead to the same
reactions within a user group. If a centroid-based clustering method was used
before, a prototypical user for each behavior pattern is already available. That
user's activities must be grouped by their types or the topics they refer to. Then,
they can be related to circumstances under which they occur. For instance,
messages from particular other users that are regularly forwarded or topics that
frequently provoke replies to observed contents. Rules for such behaviors can
be derived by inductive logic programming which hypothesizes on logical
inference rules based on background knowledge and a set of examples [
          <xref ref-type="bibr" rid="ref22">22</xref>
          ]. For social
media analysis, background knowledge covers the di erent possible events,
activities, and observations, whereas the examples are given by their respective
co-occurrences. However, since user behavior is not strictly deterministic, these
can be inconsistent which provides a challenge for logic-based methods.
        </p>
        <p>
          As an alternative, behavioral rules can be derived by means of decision-tree
learning [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ]. This method can classify events in social media according to the
activities they provoke in a group of users by ranking in uential factors for
distinguishing between these activities. The paths from a decision-tree's root to
each leaf form a set of rules for the users' activity selections analogous to the
inference rules provided by inductive logic programming. All users belonging to the
same cluster can act as a sample for this classi cation method. Thus,
decisiontree learning does not require a single prototypical user, but extracts activity
patterns for a whole group of similarly behaving individuals. These patterns
explain how communication takes place in social media which is a prerequisite for
developing simulations to aid crisis communication and risk management.
4
        </p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>Conclusions</title>
      <p>This paper has pointed out systemic risks of social media with respect to crisis
and reputation management. To handle these risks, it is necessary to analyze
communication processes which result from individual behaviors of
interconnected users. To that end, the paper has introduced behavior mining for
analyzing such communication. It has provided an overview of the corresponding
work ow and discussed methods for each process step according to their
suitability for social media. Hence, it has laid the foundation for establishing behavior
mining as an approach to systemic risk analysis in networked communication.</p>
      <p>
        Nevertheless, the process of behavior mining is still work in progress which
needs to be applied and evaluated with real-world data. While there are existing
studies on crisis and risk management in social media as well as cluster analyses
of network structures and communication ows [
        <xref ref-type="bibr" rid="ref15 ref5">15, 5</xref>
        ], applying the presented
integrated work ow to these and other examples is subject to future work.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Alexander</surname>
            ,
            <given-names>D.E.</given-names>
          </string-name>
          :
          <article-title>Social media in disaster risk reduction and crisis management</article-title>
          .
          <source>Sci. Eng. Ethics</source>
          <volume>20</volume>
          (
          <issue>3</issue>
          ),
          <volume>717</volume>
          {
          <fpage>733</fpage>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Allcott</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gentzkow</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Social media and fake news in the 2016 election</article-title>
          .
          <source>J. Econ. Perspectives</source>
          <volume>31</volume>
          (
          <issue>2</issue>
          ),
          <volume>211</volume>
          {
          <fpage>36</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Aula</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Social media, reputation risk and ambient publicity management</article-title>
          .
          <source>Strategy &amp; Leadership</source>
          <volume>38</volume>
          (
          <issue>6</issue>
          ),
          <volume>43</volume>
          {
          <fpage>49</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bao</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wilkie</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mokbel</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>Recommendations in location-based social networks: a survey</article-title>
          .
          <source>GeoInformatica</source>
          <volume>19</volume>
          (
          <issue>3</issue>
          ),
          <volume>525</volume>
          {
          <fpage>565</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Berndt</surname>
            ,
            <given-names>J.O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lorig</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Timm</surname>
            ,
            <given-names>I.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barth</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bucher</surname>
            ,
            <given-names>H.J.:</given-names>
          </string-name>
          <article-title>A systematic approach to agent-based dynamic analysis of social media communication</article-title>
          .
          <source>Intern. J. Advances in Internet Technology</source>
          <volume>10</volume>
          (
          <issue>1</issue>
          &amp;2) (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Blei</surname>
            ,
            <given-names>D.M.</given-names>
          </string-name>
          :
          <article-title>Probabilistic topic models</article-title>
          .
          <source>Commun. ACM</source>
          <volume>55</volume>
          (
          <issue>4</issue>
          ),
          <volume>77</volume>
          {
          <fpage>84</fpage>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>De Domenico</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lima</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mougel</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Musolesi</surname>
            ,
            <given-names>M.:</given-names>
          </string-name>
          <article-title>The anatomy of a scienti c rumor</article-title>
          .
          <source>Scienti c reports 3</source>
          ,
          <issue>2980</issue>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Dodds</surname>
            ,
            <given-names>P.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Watts</surname>
            ,
            <given-names>D.J.:</given-names>
          </string-name>
          <article-title>A generalized model of social and biological contagion</article-title>
          .
          <source>J. Theor. Biol</source>
          .
          <volume>232</volume>
          (
          <issue>4</issue>
          ),
          <volume>587</volume>
          {
          <fpage>604</fpage>
          (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Ferrara</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Varol</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Davis</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Menczer</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Flammini</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>The rise of social bots</article-title>
          .
          <source>Comm. ACM</source>
          <volume>59</volume>
          (
          <issue>7</issue>
          ),
          <volume>96</volume>
          {
          <fpage>104</fpage>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Freeman</surname>
            ,
            <given-names>L.C.</given-names>
          </string-name>
          :
          <article-title>Centrality in social networks conceptual clari cation</article-title>
          .
          <source>Soc. networks 1(3)</source>
          ,
          <volume>215</volume>
          {
          <fpage>239</fpage>
          (
          <year>1978</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Garee</surname>
            ,
            <given-names>M.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>W.K.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wan</surname>
          </string-name>
          , H.:
          <article-title>Regression-based social in uence networks and the linearity of aggregated belief</article-title>
          .
          <source>In: Proceedings of the 2018 Winter Simulation Conference</source>
          . pp.
          <volume>941</volume>
          {
          <fpage>952</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Gupta</surname>
            ,
            <given-names>D.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muthiahz</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Maresy</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ramakrish</surname>
          </string-name>
          , N.:
          <article-title>Forecasting civil strife: An emerging methodology</article-title>
          .
          <source>In: 3rd Intern. Conf. Human and Social Analytics (HUSO</source>
          <year>2017</year>
          ). pp.
          <volume>1</volume>
          {
          <issue>6</issue>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Haas</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trump</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gerhards</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Klingler</surname>
            ,
            <given-names>W.</given-names>
          </string-name>
          <source>: Web 2.0: Nutzung und Nutzertypen. Mediaperspektiven</source>
          <volume>4</volume>
          ,
          <issue>215</issue>
          {
          <fpage>222</fpage>
          (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Hodge</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Austin</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>A survey of outlier detection methodologies</article-title>
          .
          <source>Artif. Intell. Rev</source>
          .
          <volume>22</volume>
          (
          <issue>2</issue>
          ),
          <volume>85</volume>
          {
          <fpage>126</fpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Hoste</surname>
          </string-name>
          , V.,
          <string-name>
            <surname>Van Hee</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Poels</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Towards a framework for the automatic detection of crisis emotions on social media : a corpus analysis of the tweets posted after the crash of germanwings ight 9525</article-title>
          .
          <source>In: 2nd Intern. Conf. Human and Social Analytics (HUSO</source>
          <year>2016</year>
          ). pp.
          <volume>29</volume>
          {
          <issue>32</issue>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Huang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shen</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Meng</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chang</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>He</surname>
          </string-name>
          , H.:
          <article-title>Community-based in uence maximization for viral marketing</article-title>
          .
          <source>Appl. Intell. (online rst)</source>
          ,
          <volume>1</volume>
          {
          <fpage>14</fpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Hutto</surname>
            ,
            <given-names>C.J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gilbert</surname>
          </string-name>
          , E.:
          <article-title>Vader: A parsimonious rule-based model for sentiment analysis of social media text</article-title>
          .
          <source>In: 8th Intern. AAAI Conf. Weblogs and Social Media</source>
          . pp.
          <volume>216</volume>
          {
          <issue>255</issue>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <string-name>
            <surname>Jain</surname>
            ,
            <given-names>A.K.</given-names>
          </string-name>
          :
          <article-title>Data clustering: 50 years beyond k-means</article-title>
          .
          <source>Pattern Recogn. Lett</source>
          .
          <volume>31</volume>
          (
          <issue>8</issue>
          ),
          <volume>651</volume>
          {
          <fpage>666</fpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19.
          <string-name>
            <surname>Kunegis</surname>
          </string-name>
          , J.:
          <article-title>KONECT - The Koblenz Network Collection</article-title>
          .
          <source>In: Proc. Int. Web Observatory Workshop</source>
          . pp.
          <volume>1343</volume>
          {
          <issue>1350</issue>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20.
          <string-name>
            <surname>Levy</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nail</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Contagion: A theoretical and empirical review and reconceptualization</article-title>
          .
          <source>Genet. Soc. Gen. Psych</source>
          .
          <volume>119</volume>
          (
          <issue>2</issue>
          ),
          <volume>253</volume>
          {
          <fpage>283</fpage>
          (
          <year>1993</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21.
          <string-name>
            <surname>Lorig</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rodermund</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Berndt</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Timm</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          :
          <article-title>Modeling and simulation of complex agents for analyzing communication behavior in social media</article-title>
          .
          <source>Intern. J. Advances in Internet Technology</source>
          <volume>11</volume>
          (
          <issue>1</issue>
          &amp;2),
          <volume>11</volume>
          {
          <fpage>20</fpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <string-name>
            <surname>Muggleton</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>De Raedt</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Inductive logic programming: Theory and methods</article-title>
          .
          <source>J. Logic Program</source>
          .
          <volume>19</volume>
          ,
          <issue>629</issue>
          {
          <fpage>679</fpage>
          (
          <year>1994</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23.
          <string-name>
            <surname>Ott</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Theunissen</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Reputations at risk: Engagement during social media crises</article-title>
          .
          <source>Public Relat. Rev</source>
          .
          <volume>41</volume>
          (
          <issue>1</issue>
          ),
          <volume>97</volume>
          {
          <fpage>102</fpage>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Safavian</surname>
            ,
            <given-names>S.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Landgrebe</surname>
            ,
            <given-names>D.:</given-names>
          </string-name>
          <article-title>A survey of decision tree classi er methodology</article-title>
          .
          <source>IEEE T. Syst. Man Cyb</source>
          .
          <volume>21</volume>
          (
          <issue>3</issue>
          ),
          <volume>660</volume>
          {
          <fpage>674</fpage>
          (
          <year>1991</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Shirky</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>The political power of social media: Technology, the public sphere, and political change</article-title>
          .
          <source>Foreign A</source>
          . pp.
          <volume>28</volume>
          {
          <issue>41</issue>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Signorini</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Segre</surname>
            ,
            <given-names>A.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Polgreen</surname>
            ,
            <given-names>P.M.:</given-names>
          </string-name>
          <article-title>The use of Twitter to track levels of disease activity and public concern in the US during the in uenza A H1N1 pandemic</article-title>
          .
          <source>PloS one 6</source>
          (
          <issue>5</issue>
          ),
          <year>e19467</year>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Vega-Redondo</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>Complex Social Networks</article-title>
          . Cambridge University Press (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>Veil</surname>
            ,
            <given-names>S.R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buehner</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Palenchar</surname>
            ,
            <given-names>M.J.:</given-names>
          </string-name>
          <article-title>A work-in-process literature review: Incorporating social media in risk and crisis communication</article-title>
          .
          <source>J. Conting. Crisis Man</source>
          .
          <volume>19</volume>
          (
          <issue>2</issue>
          ),
          <volume>110</volume>
          {
          <fpage>122</fpage>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>X.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tang</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          , Liu, H.:
          <article-title>Discovering overlapping groups in social media</article-title>
          .
          <source>In: 10th Intern. Conf. Data Mining (ICDM)</source>
          . pp.
          <volume>569</volume>
          {
          <fpage>578</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Wendling</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Radisch</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jacobzone</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>The use of social media in risk and crisis communication</article-title>
          .
          <source>OECD Working Papers on Public Governance (24)</source>
          (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Yadav</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chan</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Xin</surname>
            <given-names>Jiang</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Xu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            ,
            <surname>Rice</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Tambe</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.:</surname>
          </string-name>
          <article-title>Using social networks to aid homeless shelters: Dynamic in uence maximization under uncertainty</article-title>
          .
          <source>In: AAMAS 2016</source>
          . pp.
          <volume>740</volume>
          {
          <issue>748</issue>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>