<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Seven Years of Social Sensors</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Mario Cataldi</string-name>
          <email>m.cataldi@iut.univ-</email>
          <email>m.cataldi@iut.univparis8.fr</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Luigi Di Caro</string-name>
          <email>dicaro@di.unito.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Claudio Schifanella</string-name>
          <email>schi@di.unito.it</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Universite Paris 8</institution>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Turin</institution>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <abstract>
        <p>The aim of this paper is to review seven years of research on a speci c vision of social media which is that of social sensors, i.e., alternative information systems able to detect and characterize interesting and yet unreported information and events in real-time, crossing topics, locations and language barriers. In particular, we here present a computational exercise based on a Topic Modeling technique over a set of papers citing probably the rst contribution about the conceptualization and formalization of the social sensor keyword. By extracting topics from 367 (English) titles and correlating them with metadata such as the year of publication and the number of received citations, we tried to light up interesting aspects and research directions in the social media mining community.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Social Network Analysis</kwd>
        <kwd>Data Mining</kwd>
        <kwd>Social Media</kwd>
        <kwd>Social Networks</kwd>
        <kwd>Topic Detection</kwd>
        <kwd>Event Detection</kwd>
        <kwd>Social Sensors</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. INTRODUCTION</title>
      <p>Nowadays, social platforms have become the most popular
communication system all over the world. In fact, due to
the short format of messages and the accessibility of these
systems, users tend to shift from traditional
communication tools (such as blogs, web sites and mailing lists) to
social network for various purposes. Billions of messages are
appearing daily in these services such as Twitter, Tumblr,
Facebook, etc. The authors of these messages share content
about their private life, exchanging opinions on a variety of
topics and discussing a wide range of information news.
Microblogging services also exploit the immediateness of handy
smart devices.</p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], and later in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ], we conceptualize the vision of this
powerful communication channel as social sensor, which can
be used to detect and follow interesting and yet unreported
information and speci cally unknown / interesting /
anomalous events, facts, and topics in real time, crossing languages,
domains, locations and language barriers. Future
technologies on this connectivity may also provide applications with
automatic techniques for the generation of news ( ltered
over user pro les), o ering a sideways to the existing
authoritative information media.
      </p>
      <p>
        The quite high impact of such view in the literature
motivated the organization of a workshop on its related aspects.
The international workshop named SIDEWAYS, which
currently counts three editions, received interesting materials
ranging from socio-cultural contributions to computational
approaches. In detail, the past two editions [
        <xref ref-type="bibr" rid="ref4 ref7">7, 4</xref>
        ] focused
on the following subtopics:
detect emerging events, facts, topics [
        <xref ref-type="bibr" rid="ref20 ref21 ref25">21, 25, 20</xref>
        ]
track the evolution over time of events, facts and topics
[
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]
enrich them with contextual information like categories
and named entities [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]
identify communities and analyse large scale online/o ine
social networks[
        <xref ref-type="bibr" rid="ref22">22</xref>
        ]
unravel behaviours in social networks[
        <xref ref-type="bibr" rid="ref19">19</xref>
        ]
retrieve partecipatory decision making on civic social
networks [
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
understand key social and psychological factors and
problems [
        <xref ref-type="bibr" rid="ref10 ref11 ref23 ref9">23, 10, 9, 11</xref>
        ]
      </p>
      <p>
        nd relationships with other events and sources of
information[
        <xref ref-type="bibr" rid="ref26">26</xref>
        ]
analyze privacy issues [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]
However, Social Sensor analysis may involve other elds and
study such as visualization [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], collaboration networks [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ],
semantic annotation [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], in uence analysis [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ], Sentiment
Analysis [
        <xref ref-type="bibr" rid="ref15 ref24">15, 24</xref>
        ], irony detection [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], TV content
analysis [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], and others.
      </p>
      <p>
        The aim of this paper is to review those research works that
based their ideas, motivations and concepts on such social
sensor view. In the light of this, we carried out a classic
Topic Modeling exercise over the collection of papers that
have cited our original conceptualization [
        <xref ref-type="bibr" rid="ref14 ref6 ref8">8, 6, 14</xref>
        ]. We thus
collected around 368 publication titles with their relative
metadata information such as the type of publication
(journal or proceedings), the publication year and the number of
received citations. We then extracted topics from titles and
abstracts, correlating them along these dimensions,
highlighting some useful insights and historical perspectives for
future research.
      </p>
    </sec>
    <sec id="sec-2">
      <title>2. BACKGROUND ON TOPIC MODELING</title>
      <p>Topic models are fundamental tools for the extraction of
regularities and patterns providing automatic ways to
organize, search and give sense to large data collections. The
shared basic assumption is that documents have a latent
semantic structure that can be inferred from word-document
distributions.</p>
      <p>
        Latent Semantic Analysis (LSA) [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] is a linear
algebrabased method that reduces the a word-document co-occurrences
matrix into a reduced space such that words which are close
in the new space are similar. Its probabilistic and generative
version (pLSA) [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] adds a latent context variable to each
word occurrence which explicitly accounts for polysemy.
Latent Dirichlet Allocation (LDA) [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] is a fully Bayesian
probabilistic version of LSA. Given a corpus of documents,
the idea underlying LDA is that all documents share the
same set of topics, but each document exhibits those
topics in di erent proportions depending on words which are
present in that document. Topics, in turn, are de ned as
di erent probability distributions over the words of a xed
vocabulary, but they are interpreted by restricting attention
to words with the highest estimated frequency. Only
documents are observed, while the topics, per-document topic
distributions and the per-document per-word topic
assignments are latent structures inferred from the data.
      </p>
    </sec>
    <sec id="sec-3">
      <title>TOPICS FROM SOCIAL-SENSORS LIT</title>
    </sec>
    <sec id="sec-4">
      <title>ERATURE</title>
      <p>
        In this section, we show the results of a LDA topic modeling
exercise applied on the abstracts of the papers citing [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ].
As already mentioned, this paper represents one of the rst
work which recognized (and formalized) the role of social
sensor of social media.
      </p>
      <p>The results seem to show a quite clear map, where the main
scienti c e ort is divided on 1) the analysis of social media
(role, impact, contents, and user pro les), 2) the detection
of emerging topics or 3) events, and 4) network mining
approaches involving community detection techniques.</p>
    </sec>
    <sec id="sec-5">
      <title>4. SOCIAL-SENSOR TOPICS TRENDS</title>
      <p>In this section, we present some correlation study between
the extracted topics (see previous section) and metadata
such as the year of publication, the number of received
citations and the type of publication (journal or not). Figure 1
shows the whole result of the study.</p>
    </sec>
    <sec id="sec-6">
      <title>4.1 Social-Sensor Topics and Time</title>
      <p>As it can be noticed, the total amount of research in the
eld has been growing from 2011 to 2015, when it reached a
kind of convergence (year-2017 had few data records only).
However, the topic "Event Detection" is the only one that
kept growing also in 2016. It is possible to think that part
of the community working on topic detection then focused
on events at a certain point, since Social Media is known
to contain much more event-based information rather than
other sources of information. This is actually one of the key
motivation of the social sensor view.</p>
    </sec>
    <sec id="sec-7">
      <title>4.2 Social-Sensor Topics and Impact</title>
      <p>Another interesting aspect was to analyze the impact of the
extracted topics in terms of received citations from the
research community. Figure 1 (b) shows that social-sensor
papers with low citation numbers are more about topic
detection and social media with respect to the other two topics.
Instead, highly-cited papers are also about event detection,
while topic detection papers disappear on the right side of
the plot. This is quite interesting, since topic detection is
the top-2 topic. In a sense, it seems that most of the work
is on topic detection though it does not linearly impact on
future and contextual research.</p>
    </sec>
    <sec id="sec-8">
      <title>4.3 Social-Sensor Topics and Journals</title>
      <p>With this analysis, we tried to understand if social-sensor
topics have a similar distribution on conferences and
workshops rather than on journals. What we found, as shown
in 1 (c), is that the distribution on journals atten the
total number of papers on the di erent topics. This can be
probably interpreted as a quality-based natural ltering.
1We experimented with other number of topics, showing less
interpretable results.
(a)</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.</given-names>
            <surname>Antonini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Vignaroli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Schifanella</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. G.</given-names>
            <surname>Pensa</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. L.</given-names>
            <surname>Sapino</surname>
          </string-name>
          .
          <article-title>Mesoontv: a media and social-driven ontology-based tv knowledge management system</article-title>
          .
          <source>In Proceedings of the 24th ACM Conference on Hypertext and Social Media</source>
          , pages
          <volume>208</volume>
          {
          <fpage>213</fpage>
          . ACM,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D. M.</given-names>
            <surname>Blei</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. Y.</given-names>
            <surname>Ng</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. I.</given-names>
            <surname>Jordan</surname>
          </string-name>
          .
          <article-title>Latent dirichlet allocation</article-title>
          .
          <source>Journal of machine Learning research</source>
          ,
          <volume>3</volume>
          (Jan):
          <volume>993</volume>
          {
          <fpage>1022</fpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>G.</given-names>
            <surname>Boella</surname>
          </string-name>
          and
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Caro</surname>
          </string-name>
          .
          <article-title>Extracting de nitions and hypernym relations relying on syntactic dependencies and support vector machines</article-title>
          .
          <source>In ACL (2)</source>
          , pages
          <fpage>532</fpage>
          {
          <fpage>537</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>L. D.</given-names>
            <surname>Caro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          , and C. Schifanella, editors.
          <source>Proceedings of the 2nd International Workshop on Social Media World Sensors, SIDEWAYS</source>
          <year>2016</year>
          ,
          <article-title>co-located with 10th International Conference on Language Resources and Evaluation (LREC</article-title>
          <year>2016</year>
          ), Portoroz, Slovenia, May
          <volume>24</volume>
          ,
          <year>2016</year>
          , volume
          <volume>1696</volume>
          <source>of CEUR Workshop Proceedings. CEUR-WS.org</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.-A.</given-names>
            <surname>Aufaure</surname>
          </string-name>
          .
          <article-title>The 10 million follower fallacy: audience size does not prove domain-in uence on twitter</article-title>
          .
          <source>Knowledge and Information Systems</source>
          ,
          <volume>44</volume>
          (
          <issue>3</issue>
          ):
          <volume>559</volume>
          {
          <fpage>580</fpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. D.</given-names>
            <surname>Caro</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Schifanella</surname>
          </string-name>
          .
          <article-title>Personalized emerging topic detection based on a term aging model</article-title>
          .
          <source>ACM Transactions on Intelligent Systems and Technology (TIST)</source>
          ,
          <volume>5</volume>
          (
          <issue>1</issue>
          ):
          <fpage>7</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. D.</given-names>
            <surname>Caro</surname>
          </string-name>
          , and C. Schifanella, editors.
          <source>Proceedings of the 1st ACM Workshop on Social Media World Sensors, Guzelyurt, SIdEWayS@HT</source>
          <year>2015</year>
          , TRNC, Cyprus, September 1,
          <year>2015</year>
          . ACM,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Caro</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Schifanella</surname>
          </string-name>
          .
          <article-title>Emerging topic detection on twitter based on temporal and social terms evaluation</article-title>
          .
          <source>In Proceedings of the Tenth International Workshop on Multimedia Data Mining, page 4. ACM</source>
          ,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M. D.</given-names>
            <surname>Choudhury</surname>
          </string-name>
          .
          <article-title>Social media for mental illness risk assessment, prevention and support</article-title>
          .
          <source>In Cataldi et al. [7], page 1.</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>C.</given-names>
            <surname>Colella</surname>
          </string-name>
          .
          <article-title>Distrusting science on communication platforms: Socio-anthropological aspects of the science-society dialectic within a phytosanitary emergency</article-title>
          .
          <source>In Caro et al. [4]</source>
          , pages
          <fpage>19</fpage>
          {
          <fpage>24</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>L. H. M. S. S. K. Dane</surname>
            <given-names>Bell</given-names>
          </string-name>
          , Daniel Fried.
          <article-title>Challenges for using social media for early detection of t2dm</article-title>
          . In Caro et al. [
          <volume>4</volume>
          ].
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>S.</given-names>
            <surname>Deerwester</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. T.</given-names>
            <surname>Dumais</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. W.</given-names>
            <surname>Furnas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. K.</given-names>
            <surname>Landauer</surname>
          </string-name>
          , and
          <string-name>
            <given-names>R.</given-names>
            <surname>Harshman</surname>
          </string-name>
          .
          <article-title>Indexing by latent semantic analysis</article-title>
          .
          <source>Journal of the American society for information science</source>
          ,
          <volume>41</volume>
          (
          <issue>6</issue>
          ):
          <fpage>391</fpage>
          ,
          <year>1990</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>L.</given-names>
            <surname>Di Caro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K. S.</given-names>
            <surname>Candan</surname>
          </string-name>
          , and
          <string-name>
            <given-names>M. L.</given-names>
            <surname>Sapino</surname>
          </string-name>
          .
          <article-title>Navigating within news collections using tag- akes</article-title>
          .
          <source>Journal of Visual Languages &amp; Computing</source>
          ,
          <volume>22</volume>
          (
          <issue>2</issue>
          ):
          <volume>120</volume>
          {
          <fpage>139</fpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>L.</given-names>
            <surname>Di Caro</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cataldi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>C.</given-names>
            <surname>Schifanella. The</surname>
          </string-name>
          d-index:
          <article-title>Discovering dependences among scienti c collaborators from their bibliographic data records</article-title>
          .
          <source>Scientometrics</source>
          ,
          <volume>93</volume>
          (
          <issue>3</issue>
          ):
          <volume>583</volume>
          {
          <fpage>607</fpage>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Caro</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Grella</surname>
          </string-name>
          .
          <article-title>Sentiment analysis via dependency parsing</article-title>
          .
          <source>Computer Standards &amp; Interfaces</source>
          ,
          <volume>35</volume>
          (
          <issue>5</issue>
          ):
          <volume>442</volume>
          {
          <fpage>453</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>C.</given-names>
            <surname>Ellwein</surname>
          </string-name>
          and
          <string-name>
            <given-names>B.</given-names>
            <surname>Noller</surname>
          </string-name>
          .
          <article-title>Social media mining: Impact of the business model and privacy settings</article-title>
          .
          <source>In Cataldi et al. [7]</source>
          , pages
          <fpage>3</fpage>
          <lpage>{</lpage>
          8.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>A.</given-names>
            <surname>Gianti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Bosco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Patti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Bolioli</surname>
          </string-name>
          , and
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Caro</surname>
          </string-name>
          .
          <article-title>Annotating irony in a novel italian corpus for sentiment analysis</article-title>
          .
          <source>In Proceedings of the 4th Workshop on Corpora for Research on Emotion Sentiment and Social Signals</source>
          , pages
          <fpage>1</fpage>
          <issue>{7</issue>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>T.</given-names>
            <surname>Hofmann</surname>
          </string-name>
          .
          <article-title>Probabilistic latent semantic indexing</article-title>
          .
          <source>In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval</source>
          , pages
          <volume>50</volume>
          {
          <fpage>57</fpage>
          . ACM,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <given-names>R.</given-names>
            <surname>Kikas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Dumas</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Saabas</surname>
          </string-name>
          .
          <article-title>Explaining international migration in the skype network: The role of social network features</article-title>
          .
          <source>In Cataldi et al. [7]</source>
          , pages
          <fpage>17</fpage>
          {
          <fpage>22</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <given-names>T.</given-names>
            <surname>Kreutz</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Nissim</surname>
          </string-name>
          .
          <article-title>Catching events in the twitter stream: A showcase of student projects</article-title>
          .
          <source>In Caro et al. [4]</source>
          , pages
          <fpage>14</fpage>
          {
          <fpage>18</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>K. S. C. R. P. M. L. S. Luca</surname>
            <given-names>Vignaroli</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Claudio</given-names>
            <surname>Schifanella</surname>
          </string-name>
          .
          <article-title>Tracking and analyzing the "second life" of tv content: a media and social-driven framework</article-title>
          .
          <source>In Caro et al. [4].</source>
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>P. S.</given-names>
            <surname>Ludu</surname>
          </string-name>
          .
          <article-title>Inferring latent attributes of an indian twitter user using celebrities and class in uencers</article-title>
          .
          <source>In Cataldi et al. [7]</source>
          , pages
          <fpage>9</fpage>
          {
          <fpage>15</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <surname>C. F. U. K. Massimo Poesio</surname>
            ,
            <given-names>Ayman</given-names>
          </string-name>
          <string-name>
            <surname>Alhelbawy</surname>
          </string-name>
          .
          <article-title>Exploiting social media to address fundamental human rights</article-title>
          .
          <source>In Caro et al. [4].</source>
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>L.</given-names>
            <surname>Robaldo</surname>
          </string-name>
          and
          <string-name>
            <given-names>L. Di</given-names>
            <surname>Caro</surname>
          </string-name>
          .
          <article-title>Opinionmining-ml</article-title>
          .
          <source>Computer Standards &amp; Interfaces</source>
          ,
          <volume>35</volume>
          (
          <issue>5</issue>
          ):
          <volume>454</volume>
          {
          <fpage>469</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>E. D.</given-names>
            <surname>Rosa</surname>
          </string-name>
          and
          <string-name>
            <surname>A. Durante. App2check:</surname>
          </string-name>
          <article-title>a machine learning-based system for sentiment analysis of app reviews in italian language</article-title>
          .
          <source>In Caro et al. [4]</source>
          , pages
          <fpage>8</fpage>
          {
          <fpage>13</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>A.</given-names>
            <surname>Ruggeri</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Boella</surname>
          </string-name>
          .
          <article-title>Gibsonian modeling of users in social networks</article-title>
          .
          <source>In Caro et al. [4]</source>
          , pages
          <fpage>25</fpage>
          {
          <fpage>31</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <given-names>G.</given-names>
            <surname>Siragusa</surname>
          </string-name>
          .
          <article-title>Place as topics: Analysis of spatial and temporal evolution of topics from social networks data</article-title>
          .
          <source>In Caro et al. [4]</source>
          , pages
          <fpage>32</fpage>
          {
          <fpage>35</fpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>