<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Understanding co-evolution of social and content networks on Twitter</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Philipp Singer</string-name>
          <email>philipp.singer@tugraz.at</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Claudia Wagner Markus Strohmaier</string-name>
          <email>claudia.wagner@joanneum.at</email>
          <email>claudia.wagner@joanneum.at markus.strohmaier@tugraz.at</email>
          <email>markus.strohmaier@tugraz.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>DIGITAL Intelligent Information Knowledge Management, Systems Institute and Know-Center, JOANNEUM RESEARCH Graz University of Technology</institution>
          ,
          <addr-line>Graz, Austria Graz</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Knowledge Management, Institute, Graz University of Technology</institution>
          ,
          <addr-line>Graz</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <fpage>57</fpage>
      <lpage>60</lpage>
      <abstract>
        <p>Social media has become an integral part of today's web and allows users to share content and socialize. Understanding the factors that influence how users evolve over time - for example how their social network and their contents co-evolve is an issue of both theoretical and practical relevance. This paper sets out to study the temporal co-evolution of content and social networks on Twitter and bi-directional influences between them by using multilevel time series regression models. Our findings suggest that on Twitter social networks have a strong influence on content networks over time, and that social network properties, such as users' number of followers, strongly influence how active and informative users are. While our investigations are limited to one small dataset obtained from Twitter, our analysis opens up a path towards more systematic studies of network coevolution on platforms such as Twitter or Facebook. Our results are relevant for researchers and social media hosts interested in understanding how content-related and social activities of social media users evolve over time and which factors impact their co-evolution.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Microblog</kwd>
        <kwd>Twitter</kwd>
        <kwd>Influence Patterns</kwd>
        <kwd>Semantic Analysis</kwd>
        <kwd>Time Series</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        ries modeling [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] based on the work by Wang and Groth [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]
who provide a framework to measure the bi-directional
influence between social and content network properties. In this
work we apply an autoregressive model in order to model
our time series data. An autoregressive model is a model
that goes back p time units in the regression and has the
ability to make predictions. This model can be defined as
AR(p), where the parameter p determines the order of the
model. An autoregressive model aims to estimate an
observation as a weighted sum of previous observations, which is
the number of the parameter p. In this work we apply a
simple model, which calculates each variable independently
and further only includes values from the last time unit.
The calculated coefficients of the model can determine the
influences between variables over time.
      </p>
      <p>
        In regression analysis variables often stem from different
levels. So called multilevel regression models are an appropriate
way to model such data. Hence, the measurement occasion
is the basic unit which is nested under an individual, the
cluster unit. In our dataset we have such a hierarchical
nested structure. For each day different properties are
measured repeatedly, but all of these values belong to different
individuals in our study. If we would apply a simple
autoregressive model to our data we would ignore the difference
between each user and would just calculate the so-called
fixed effects, because we can not assume that all
clusterspecific influences are included as covariates in the analysis
[
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. The advantage of such multilevel regression models is
now that they add random effects to the fixed effects to also
consider variations among our individuals. Since we
measure different properties repeatedly for different days and
different individuals in our study, our dataset has a
hierarchical nested structure. Therefore, we utilize a multilevel
autoregressive regression model which is defined as follows:
xi(,tp) = aiT x(pt−1) + i(t) + biT,px(pt−1) + i(,tp)
(1)
In this equation x(pt) = (xi(,tp), ..., x(mt),p)T represents a vector,
which contains the variables for an individual p at time t.
Furthermore, ai = (ai,1, ..., aim)T represents the fixed effect
coefficients and bi = (bi,1, ..., bim)T represents the random
effect coefficients. It is assumed that i(t) and i(,tp) is the noise
with Gaussian distribution for the fixed and random effects
respectively. It has zero mean and variance σ2. To compare
the fixed effects to each other, the variables in the random
effect regression equations need to be linearly transformed to
represent standardized values. How this is done and how the
model is finally applied to our data is described in section 4.
      </p>
    </sec>
    <sec id="sec-2">
      <title>3. DATASET</title>
      <p>We chose Twitter as a platform for studying the co-evolution
of communication content and social networks, since it is
a popular micro-blogging service. We explore one random
dataset in this work, which was crawled within a time period
of 30 days. This random dataset consists of random users
from the public timeline who do not have anything special
in common.</p>
      <p>To generate the random dataset, we randomly chose 1500
users from the public Twitter timeline who we used as seed
users. We used the public timeline method from the
Twitter API to sample users rather than using random user IDs
since the timeline method is biased towards active Twitter
users. To ensure that our random sample of seed users
consists of active, English-speaking Twitter users, we further
only kept users who mainly tweet in English, have at least
80 followers, 40 followees and 200 tweets. We also had to
remove users from our dataset who deleted or protected their
account during the 30 days of crawling. Hence, we ended up
having 1.188 seed users for whom we were able to crawl their
social network (i.e., their followers and followees) and their
tweets and retweets. To identify retweets we used the flag
provided by the official Twitter API and to extract URLs
we used a regular expression. During a 30 day time period
(from 15.03.2011 to 14.04.2011) we polled the data daily at
about the same time.</p>
    </sec>
    <sec id="sec-3">
      <title>4. EXPERIMENTAL SETUP</title>
      <p>The goal of our experiments is to study the co-evolution of
social and content networks of Twitter users and influence
patterns between them. In order to achieve this we firstly
created a social and content network for each specific time
point.</p>
      <p>Social network: The social network is a one-mode directed
network, where each vertex represents a user and the edges
between these vertices represent the directed follow-relations
between two users at a certain point in time. The
constructed social network of seed users only reflects a sub-part
of a greater network. Therefore it makes no sense to
calculate and analyze specific network properties such as
betweenness centrality or clustering coefficient, because these
properties depend on the whole network and we only have
data available for a certain sub-network.</p>
      <p>
        Content network: The content network at each point in
time is a two-mode network, which connects users and tweets
via authoring-relations. From these user-tweet networks one
can extract specific tweet features, such as hashtags, links or
retweet information, and build, for example, a user-hashtag
network. It would also be possible to create further types of
content networks, such as hashtag co-occurrence networks
(see [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] for further types), but we leave the investigation of
such network types open for future research.
      </p>
      <p>Overall, the social networks capture the social following
relations between users, whereas our content networks account
the tweets users publish. Finally, we can connect both
networks via their user vertexes, since we know which user in
the social network corresponds to which user in the content
network and vice versa.</p>
      <p>
        A further step towards our final results is the
normalization of our available data. This is done by subtracting the
time-overall mean and dividing the result by the time-overall
standard deviation. The fixed effects can now be analyzed
as the effect of one standard deviation of change in the
independent variable on the number of standard deviations
change in the dependent variable [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>Based on the prepared data, the final model described in
section 2 can be applied to identify potential influences
between social and content network properties over time.
Ta#MSM2012
Social Network
-0.23
ble 1 describes each social and content network property
used throughout our experiment. The properties are
calculated for a corresponding social or content network at each
time point t of the random Twitter dataset. The
dependent variable of the model is always a property at time t
and the independent variable are all properties at time t − 1
including the dependent variable at that time. Including
the dependent variable in that step allows us to detect if
a variable’s previous value influences it’s future value.
Finally, the resulting statistical significant coefficients show a
relationship between an independent variable at time t − 1
and a dependent variable at time t. Positive coefficients
indicate that a high value of a property leads to an increase
of another property, while negative coefficients indicate that
a high value of a property leads to an decrease of another
property. To reveal positive and negative influence relations
between properties within and across different networks, we
visualize them as graphical influence network.</p>
    </sec>
    <sec id="sec-4">
      <title>5. RESULTS</title>
      <p>Our results reveal interesting influence patterns between
social networks and content networks. The influence network
in figure 1 shows the correlations detected in the multilevel
regression analysis via arrows that point out influences
between a property at time t and another property at time
t + 1.</p>
      <p>The influence network reveals significant influences of
social properties on content network properties. The strongest
positive effects can be observed between the number of
followers of a user and the content network properties - i.e.,
users’ number of followers positively influences their link
ratio, their retweeted ratio and their number of tweets. This
indicates that users start providing more tweets and also
Social
Content
Content
Content
Content
more links in their tweets if their number of followers
increases. Not surprisingly, users’ tweets are also more likely
to get retweeted if their number of followers increases,
because more users are potentially reading their tweets.
Further, figure 1 shows that the number of followees of the
social network has positive and negative influences on the
content network in our random dataset. While the positive
effects point to the link and hashtag ratio, the negative
effects point to the number of tweets and the retweeted ratio.
This suggests that users who start following other users also
start using more hashtags and links. One possible
explanation for this is that users get influenced by the links and
#MSM2012
hashtags used by the users they follow and might therefore
use them more often in their own tweets. The negative
effect of the number of followees on the number of tweets and
the retweeted ratio suggests that users who start following
many other users start behaving more like passive readers
rather than active content providers.</p>
      <p>Another observation of our experiment is that all properties
influence themselves positively, which indicates that users
who are active one day, tend to be even more active the
next day. This indicates for example, that users who attract
new followers one day tend to attract more new followers
the day after.</p>
    </sec>
    <sec id="sec-5">
      <title>6. CONCLUSIONS AND FUTURE WORK</title>
      <p>The main contributions of this paper are the following: (i)
We applied multilevel time series regression models to one
selected Twitter dataset consisting of social and content
network data and (ii) we explored influence patterns between
social and content networks on Twitter. In our experiments
we studied how the properties of social and content networks
co-evolve over time. We showed that the adopted approach
allows answering interesting questions about how users’
behavior on Twitter evolves over time and the factors that
impact this evolution. While our results are limited to the
dataset used, our work illuminates a path towards
studying complex dynamics of network evolution on systems such
as Twitter. Our analyses may also facilitate social media
hosts to promote certain features of the platform and steer
users and their behavior. For example, one can see from
our analysis that usage of content features, such as hashtags
and links, is highly influenced by social network properties
such as the number of followers of a user. Therefore, social
media hosts could try to encourage users to use more
content features by introducing new measures such as a friend
recommender techniques which might impact the social
network of users. However, further work is warranted to study
these ideas.</p>
      <p>
        Overall, our findings on one small Twitter dataset suggest
that there are manifold sources of influence between social
and content network properties. Our results indicate that
users’ behavior and the co-evolution of content and social
networks on Twitter is driven by social factors rather than
content factors. Previous research by Anagnostopoulos et
al. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] showed that content on Flickr is not strongly
influenced by social factors. This may suggest that different
social media applications may be driven by different factors.
The experimental setup used in our work can be applied
to different datasets to study these questions in the future.
Nevertheless, further work is required to confirm or refute
this observations on other, larger datasets.
      </p>
      <p>Our experiments suggest that the number of followers
powerfully influences properties of the content network. One
interpreation for that is that the number of followers is a
very important motivation for Twitter users to add more
content and use more content features like hashtags, URLs
or retweets. However, the number of users a user is
following can also have a negative influence on content network
properties as one can see from figure 1. Our results suggests
that an increase of a user’s followees (i.e., the number of
users he/she follows) implies that the user starts tweeting
less and that his/her tweets get less frequently retweeted.
Further, our findings show that all properties influence
themselves positively. This does not mean that the values of all
properties always increase over time, but that they tend to
increase depending on how much they increased the day
before. For example, a Twitter user who started posting more
links at day t, is likely to post even more links at day t + 1
or a user who gain new followers at day t is likely to gain
even more new followers at day t + 1.</p>
      <p>
        To summarize, our work highlights the existence of
interesting influence relationships between content and social
networks on Twitter, and shows that multilevel time series
regression analysis can be used to reveal such relationships and
to study how they evolve over time. Based on the techniques
developed by Wang and Groth [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], our work investigated
influence patterns in a new domain, i.e. on microblogging
platforms like Twitter. Our results are relevant for researchers
interested in social network analysis, text mining and
behavioral user studies, as well as for community hosts who
need to understand the factors that influence the evolution
of their users in terms of their content-related and social
behavior.
      </p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work is in part funded by the FWF Austrian Science
Fund Grant I677 and the Know-Center Graz. Claudia
Wagner is a recipient of a DOC-fForte fellowship of the Austrian
Academy of Science.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Anagnostopoulos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Kumar</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M.</given-names>
            <surname>Mahdian</surname>
          </string-name>
          .
          <article-title>Influence and correlation in social networks</article-title>
          . In Y. Li,
          <string-name>
            <given-names>B.</given-names>
            <surname>Liu</surname>
          </string-name>
          , and S. Sarawagi, editors,
          <source>Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining</source>
          , Las Vegas, Nevada, USA,
          <year>August</year>
          24-
          <issue>27</issue>
          ,
          <year>2008</year>
          , pages
          <fpage>7</fpage>
          -
          <lpage>15</lpage>
          . ACM,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>G.</given-names>
            <surname>Kitagawa</surname>
          </string-name>
          . Introduction to Time Series Modeling (Chapman &amp; Hall/CRC Monographs on Statistics &amp; Applied Probability).
          <source>Chapman and Hall/CRC</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>C.</given-names>
            <surname>Ko</surname>
          </string-name>
          ¨rner,
          <string-name>
            <given-names>D.</given-names>
            <surname>Benz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Hotho</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Strohmaier</surname>
          </string-name>
          , and
          <string-name>
            <given-names>G.</given-names>
            <surname>Stumme</surname>
          </string-name>
          .
          <article-title>Stop thinking, start tagging: tag semantics emerge from collaborative verbosity</article-title>
          .
          <source>In Proceedings of the 19th international conference on World wide web, WWW '10</source>
          , pages
          <fpage>521</fpage>
          -
          <lpage>530</lpage>
          , New York, NY, USA,
          <year>2010</year>
          . ACM.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>A.</given-names>
            <surname>Skrondal</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Rabe-Hesketh</surname>
          </string-name>
          .
          <article-title>Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models</article-title>
          . Chapman and Hall/CRC,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>C.</given-names>
            <surname>Wagner</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Strohmaier</surname>
          </string-name>
          .
          <article-title>The wisdom in tweetonomies: Acquiring latent conceptual structures from social awareness streams</article-title>
          .
          <source>In Proc. of the Semantic Search 2010 Workshop (SemSearch2010)</source>
          , april
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>S.</given-names>
            <surname>Wang</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Groth</surname>
          </string-name>
          .
          <article-title>Measuring the dynamic bi-directional influence between content and social networks</article-title>
          . In P.
          <string-name>
            <surname>Patel-Schneider</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          <string-name>
            <surname>Pan</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Hitzler</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Mika</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Pan</surname>
            ,
            <given-names>I. Horrocks</given-names>
          </string-name>
          , and B. Glimm, editors,
          <source>The Semantic Web U˝ ISWC</source>
          <year>2010</year>
          , volume
          <volume>6496</volume>
          of Lecture Notes in Computer Science, pages
          <fpage>814</fpage>
          -
          <lpage>829</lpage>
          . Springer Berlin / Heidelberg,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>