<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Automatic Generation of Explanations to Prevent Privacy Violations</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Ruiz-Dolz RAMON</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alemany JOSE</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Heras STELLA</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Garcia-Fornes ANA</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Departament de Sistemes Inform a`tics i Computaci o ́, Universitat Polite`cnica de Vale`ncia</institution>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2019</year>
      </pub-date>
      <abstract>
        <p>With the massive use of online social environments and technologies, users' concern regarding the privacy of their own data has significantly increased. In this paper, we present a method to automatically generate explanations in a social network domain. This method uses the available data from the network to anticipate any potential privacy violation, automatically generates explanations, and shows them to the user with the purpose of avoiding the detected violation.</p>
      </abstract>
      <kwd-group>
        <kwd />
        <kwd>Argumentation</kwd>
        <kwd>Explainable AI</kwd>
        <kwd>Privacy</kwd>
        <kwd>Social Networks</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        With the continuous increase of the population of online social networks [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], users’
concern about the privacy of their data has significantly increased. Online social networks
provide users with a series of tools for interacting, sharing and publishing information
with other users. With these provided tools, to spread information and data is easier than
ever, thus it is imperative to make a responsible use of these technologies. When this does
not happen, several threats may appear. An important threat to users’ privacy may be
one’s own publications. Although this may not seem very logical, as described in [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ], it
is very common to find users regretting their own online publications. On the other hand,
when involving other users in a publication, since their privacy preferences may be
unknown for the author, multi party privacy conflicts [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ] are also a very common privacy
threat in social networks. Therefore, it is interesting to be able not only to warn users but
also to give them explanations of the main reasons of the potential privacy violations
detected to minimise their occurrence. Additionally, with the recent appearance of stricter
laws in the field of data privacy protection, these privacy violations may also have legal
consequences for the privacy violator, and social media users’ legal consciousness about
privacy is usually very low [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ].
      </p>
      <p>
        This increasing concern about privacy threats in social networks has attracted the
interest of researchers to find effective mechanisms to deal with privacy violations.
Several privacy management assistance tools have been identified in the literature. In
[
        <xref ref-type="bibr" rid="ref14 ref18 ref19 ref22">14,18,19,22</xref>
        ], we can observe different approaches to reduce the harm caused by privacy
violations. In [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], an underlying negotiation protocol to choose the optimal privacy
policy is presented. However, two important flaws can be identified in all these approaches.
First, all of them are focused on minimising conflicts when multiple parties are involved,
ignoring the potential self inflicted privacy violations. Second, none of them provide the
author with proper explanations of why a specific decision should be made.
      </p>
      <p>
        As pointed out in [
        <xref ref-type="bibr" rid="ref10 ref11">10, 11</xref>
        ], argumentation seems to be the most coherent approach
to tackle this kind of problems. In [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ], a negotiation protocol based on computational
argumentation techniques to decide the optimal privacy policy is proposed. However, the
decision is automatically taken by the system, and no explanation is given to the user.
      </p>
      <p>
        Computational argumentation has an extensive and successful history of
applications in law [
        <xref ref-type="bibr" rid="ref5 ref6">5, 6</xref>
        ], and it is a suitable a method for enforcing privacy and fairness.
However, it has not been until recently that the community has started to investigate the
potential applications of argumentation as a tool to provide AI systems with greater
explanatory power [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], also in the legal domain [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>Therefore, with this work we intend to pave the way for the automatic generation of
explanations in the privacy management domain. Thus, we propose an
argumentationbased approach to automatically generate such explanations and prevent privacy
violations in social networks. With our system, users can receive warnings and explanations
from the social network site that will improve their awareness on the potential
consequences of their publications. The paper is structured as follows, Section 2 contextualises
the framework of the research presented in this work. Section 3 presents the method
proposed to automatically generate explanations to prevent privacy violations in social
networks. In Section 4, a case study is set to illustrate how the proposed method works.
Finally, Section 5 summarises the main concepts presented in this work and proposes the
main lines of future work.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Background</title>
      <p>The research carried out in this work is based on two main pillars: PESEDIA, an
educational social network which is the application domain of the method proposed in this
work, and an argumentation framework for online social networks.</p>
      <p>
        PESEDIA is an online social network for educational and research purposes that
includes: (i) the design and development of new metrics to analyse and quantify privacy
risks [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], (ii) the application of methods to change users’ behaviour regarding their
privacy concerns, (iii) the implementation of new features to improve the management of
users’ content and (iv) the evaluation and testing of new proposals with real users. The
underlying implementation of PESEDIA uses Elgg [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], which is an open source engine
that is used to build social environments. The environment provided by this engine is
similar to other social networks (e.g., Facebook).
      </p>
      <p>
        In [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ], we formally defined an argumentation framework for online social networks
and proposed an architecture for an argumentation system capable of handling the whole
argumentation process. The proposed architecture is structured in four different modules:
(i) the feature extraction, (ii) the argument generation, (iii) the solver and (iv) the
dialogue modules. The feature extraction module is in charge of retrieving all the needed
data to both, prevent any potential privacy violation and to determine which
computational arguments (i.e., 3-element tuples) will be subsequently generated by the argument
generation module. This module must be able to generate four different types of
arguments: Privacy, Trust, Risk and Content arguments. Once all the computational
arguments are generated, the solver module must compute the set of acceptable arguments in
favour or against making a publication. When the set of acceptable arguments is against
making a publication (meaning that a potential privacy violation has been detected), the
dialogue module is in charge of trying to persuade the author to modify the publication
in order to satisfy the privacy preferences of all users affected. This whole process is the
automatic generation of explanations to prevent privacy violations that we will present
in this work.
      </p>
    </sec>
    <sec id="sec-3">
      <title>3. Method</title>
      <p>
        To properly generate explanations in our argumentation system, it is of the utmost
importance to process the features extracted in a coherent way considering the argumentation
framework. Computational arguments must be generated taking those features into
account and finally, the explanations must be built in such a way that they can be interpreted
by humans. It is important to emphasise that, since the implementation has been carried
out in PESEDIA [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], the method proposed is not only compliant with the argumentation
framework [
        <xref ref-type="bibr" rid="ref15">15</xref>
        ] requirements, but also with the social network functions and limitations.
      </p>
      <sec id="sec-3-1">
        <title>3.1. Features</title>
        <p>Four different features are considered by our proposed method to generate explanations:
Privacy Preferences, Trust, Privacy Risk Score (PRS) and Sensitive Content. All those
features are retrieved by the feature extraction module that works as an intermediary
between the social network and the argumentation system. Two main sources can be
identified when regarding the acquisition of the features: user preferences data and publication
data.</p>
      </sec>
      <sec id="sec-3-2">
        <title>3.1.1. Privacy Preferences</title>
        <p>When sharing content in an online social network, the author must choose the target
audience for each publication. For that purpose, privacy selectors such as the one depicted
in Figure 1 are available in our educational social network. The options provided to the
author as target audiences are the following: public, friends, collections and private.
Public is the adequate option to share content with the whole network. With friends option it
is possible to share the content only with the friends of the author. Collections are
subsets of friends created by each user. Finally, the private option allow authors to keep a
publication only visible to themselves.
3.1.2. Trust</p>
        <p>On the other hand, when creating a profile in the social network, each user must
define the default target audience for their publications. Thus, the feature extraction module
will retrieve both, users privacy preferences and the privacy configuration of the
publication going to be shared.</p>
        <p>When more users than the author are involved in a publication, it is important to respect
every user data privacy to prevent multi party privacy conflicts. In PESEDIA, users can
evaluate their friendship with a star based rating as depicted in Figure 2. This evaluation
is retrieved by the feature extraction module, allowing us to quantify the existing trust
between both users.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.1.3. Privacy Risk Score</title>
        <p>
          When sharing content in online social networks, it is hard to estimate the scope of a
publication. The Privacy Risk Score [
          <xref ref-type="bibr" rid="ref3">3</xref>
          ] is a metric that allows us to obtain a value
representing the risk of being read by unexpected users. Therefore, the feature extraction module
will retrieve the computed PRS value for every publication going to be shared.
        </p>
      </sec>
      <sec id="sec-3-4">
        <title>3.1.4. Sensitive Content</title>
        <p>
          The content of the own publication is also an important feature to be considered when
preventing privacy violations. Based in [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ] work, we considered the following six
categories of sensitive content: location, medical, drug, personal, relatives and offensive.
Before sharing any publication, a text content analyser developed in the PESEDIA
framework [
          <xref ref-type="bibr" rid="ref2">2</xref>
          ] is used to detect any of those categories of sensitive content. A six dimensional
vector is generated by the analyser indicating the detected categories in the text. The
feature extraction module retrieves the generated vector to feed the argumentation system
with the data related to the sensitive content detected.
        </p>
      </sec>
      <sec id="sec-3-5">
        <title>3.2. Argument Generation</title>
        <p>Once all the features have been retrieved, the computational arguments are generated.
Those arguments are defined by three parameters: the claim, the type and the support.
The claim of an argument in this domain can have two perspectives, positive arguments in
favour of sharing the publication or negative arguments against doing it. Secondly, each
argument can belong to four different classes depending on the source of the features
used to generate it: Privacy, Trust, Risk and Content arguments. Finally, the support is
a value computed from the extracted features that allow to both, quantify the individual
strength of an argument and determine the claim of it.</p>
        <p>Privacy arguments are generated from the privacy features. For this purpose, privacy
options are represented with the following values: public (0), friends (0.5), collections
(0.75) and private (1). Then, the support of the argument is computed as the difference
between the author’s default target audience and the publication privacy configuration.
If the resulting value is negative, a privacy argument against making the publication will
be generated, since the privacy configuration of the publication is less restrictive than the
author’s privacy preferences. Conversely, if the resulting value is not negative, a privacy
argument in favour of making the publication will be generated.</p>
        <p>Trust arguments are generated only when more than one user is tagged in a
publication. The evaluation provided by users when adding friends (i.e., a 0-1 ranged value
computed from the star based rating) is taken into account as the support for these
arguments. We fixed a threshold of 4/5 stars (i.e., 0.8 in the numerical value scale) to start
considering that trust may be enough to share some content without previously
consulting. Therefore, a positive trust argument will be generated for each tagged user that has
rated the author with 4/5 or 5/5 stars when evaluating the friendship. Conversely, if less
stars are given from the tagged users to the author, trust arguments against making the
publication will be generated.</p>
        <p>Risk arguments are generated with the Privacy Risk Score as their own support. A
threshold has been defined to discriminate between safe publications and publications
that may cause a privacy violation. Due to the nature of this metric, we defined that
threshold in the value 0.2, considering all publications with higher PRS dangerous for
the author. Therefore, an argument against doing the publication will be generated if the
threshold is surpassed. On the other side, an argument in favour of doing the publication
will be generated if the threshold is not surpassed.</p>
        <p>Content arguments are always generated against making the publication if any type
of sensitive content is detected. The preference value of the user towards the specific
type of content detected is used as the support of the generated argument. That value is
modelled as follows,</p>
        <p>where nt is the number of publications containing some specific type of content t and
N is the total amount of publications made by the user. This way, if any type of content
predominates in some user publications, we can give priority to other types of content
(e.g., a user whose account is medical content based will not be concerned about sharing
medical content, but it may be about sharing other types of content). Initially, every user
has the same value (1) towards each type of content. To smooth the initial decrements,
we use e to make sure the preference value is always higher than zero.</p>
        <p>
          Once all the arguments are generated, an aggregation of the scores of every argument
is done to compute the acceptable set as explained in [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. Using complete semantics,
only one of the extensions of arguments either in favour or against sharing the publication
can be accepted. In the case of accepting the extension of arguments positioned against
making the publication, automatically generated explanations will be shown to authors.
v(t) = max(1
nt ; e)
N
(1)
        </p>
      </sec>
      <sec id="sec-3-6">
        <title>3.3. Explanations</title>
        <p>In this method, we propose the use of templates to generate the explanations from the
set of acceptable arguments. Table 1 contains how each type of computational argument
is translated into natural language in order to be correctly interpreted by human users.
Therefore, as many explanations as there are computational arguments in the acceptable
set, will be generated and displayed to the author. In the next section, we provide an
example of the automatic generation of explanations in the PESEDIA network.</p>
        <p>Type of Argument</p>
        <p>Explanation Generated
Content(Location)</p>
        <p>You can be revealing information about where you are or where you’re going.</p>
        <p>Privacy
Trust</p>
        <p>Risk
Content(Medical)
Content(Drugs)
Content(Personal)
Content(Relatives)
Content(Offensive)</p>
        <p>The publication is going to be read by...
(no one., your friends., a collection of friends., all the users.)</p>
        <p>Some of the people you mention might get upset.</p>
        <p>Your publication may be read by unknown people.</p>
        <p>You may be publishing private medical information.</p>
        <p>People might think you’re on drugs/alcohol.</p>
        <p>You could be publishing sensitive personal data.</p>
        <p>You could be making public information related to family or friends.</p>
        <p>Your publication might offend the people who read it.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Case Study</title>
      <p>A brief example of the proposed method for automatically generating explanations is
depicted in both Figure 3 and Figure 5. For this example, we have considered a user
profile publicly sharing a message that contains several privacy violations (Figure 3).</p>
      <p>The author has his/her default target audience configured with the public option.
Additionally, his tagged friend Juan, has rated his relation with the author with only
three stars. From all the retrieved features (Table 2) in this scenario, a computational
argument in favour of making the publication (i.e., Privacy) and four different
computational arguments against sharing the content (i.e., Risk, Trust, Content(Location) and
Content(Personal)) will be generated by the argumentation system. The corresponding</p>
      <p>User Preferences Data</p>
      <p>Publication Data
argumentation graph generated by the argumentation system in this scenario is depicted
in Figure 4.</p>
      <p>With this example it is possible to observe the important difference between Privacy
and Risk arguments. Although the author has configured the publication with a privacy
policy coherent with his/her preferences, a Risk argument against doing the publication
is generated since it is hard to predict to which audience the publication is going to
reach. Once the inner procedure of the argumentation system has determined the set of
acceptable arguments (against doing the publication), in order to prevent the potential
privacy violation, explanations are automatically generated (Figure 5). The author can
respond to the generated explanations either accepting them and modifying the original
content, asking for more reasons, or else, ignoring them. Therefore, the final decision
still relies on the user, but at least it will be made with a clear view on its potential
consequences.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion</title>
      <p>In this work, we have proposed a method to automatically generate explanations to
prevent privacy violations. For this purpose, an educational social network and an
underlying argumentation framework for social networks have been used. The method proposed
uses all the available information from the social network and the mechanisms provided
by the argumentation framework to properly generate explanations for preventing a
potential privacy violation. A case study has also been presented to illustrate the proposed
method when facing a real situation.</p>
      <p>We foresee several improvements as future work. In the current method, except for
privacy arguments (where the audience is considered to generate the explanation), all the
explanations are the same without taking into account anything else than the type of the
argument. It would be interesting to explore the possibility of generating different
explanations for the same type of arguments depending on the strength of them. Another
interesting future work task would be to consider not only text, but also image data shared
in the network, since data protection rules are even stricter on videos and photos, and
many privacy violations are made by these means. Finally, to complement the
improvements presented above, we are also considering adding a new type of argument based
on the potential legal consequences of sharing some specific content. This new type of
argument and its subsequent explanation will be useful in trying to persuade the author
of a publication to modify it, warning of the possible legal consequences of sharing the
publication.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgements</title>
      <p>This work is partially supported by the Spanish Government project
TIN2017-89156R, the FPI grant BES-2015-074498, and the Valencian Government project
PROMETEO/2018/002.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>J</given-names>
            <surname>Alemany.</surname>
          </string-name>
          <article-title>Pesedia. red social para concienciar en privacidad</article-title>
          .
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>J</given-names>
            <surname>Alemany</surname>
          </string-name>
          ,
          <source>E del Val</source>
          , and Ana Garc´
          <fpage>ıa</fpage>
          -Fornes.
          <article-title>Empowering users regarding the sensitivity of their data in social networks through nudge mechanisms</article-title>
          .
          <source>In Proceedings of the 53rd Hawaii International Conference on System Sciences (in press)</source>
          ,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J</given-names>
            <surname>Alemany</surname>
          </string-name>
          ,
          <source>Elena del Val</source>
          ,
          <string-name>
            <given-names>J</given-names>
            <surname>Alberola</surname>
          </string-name>
          , and Ana Garc´
          <fpage>ıa</fpage>
          -Fornes.
          <article-title>Estimation of privacy risk through centrality metrics</article-title>
          .
          <source>Future Generation Computer Systems</source>
          ,
          <volume>82</volume>
          :
          <fpage>63</fpage>
          -
          <lpage>76</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Michał</surname>
            <given-names>ARASZKIEWICZ</given-names>
          </string-name>
          and
          <string-name>
            <surname>Grzegorz J NALEPA.</surname>
          </string-name>
          <article-title>Explainability of formal models of argumentation applied to legal domain.</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Trevor</given-names>
            <surname>Bench-Capon</surname>
          </string-name>
          .
          <article-title>Before and after dung: Argumentation in ai and law</article-title>
          .
          <source>Argument Computation</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          ,
          <year>11 2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Trevor</given-names>
            <surname>Bench-Capon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Henry</given-names>
            <surname>Prakken</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Giovanni</given-names>
            <surname>Sartor</surname>
          </string-name>
          .
          <article-title>Argumentation in legal reasoning</article-title>
          .
          <source>In Argumentation in artificial intelligence</source>
          , pages
          <fpage>363</fpage>
          -
          <lpage>382</lpage>
          . Springer,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Aylin</given-names>
            <surname>Caliskan</surname>
          </string-name>
          <string-name>
            <surname>Islam</surname>
          </string-name>
          , Jonathan Walsh, and
          <string-name>
            <given-names>Rachel</given-names>
            <surname>Greenstadt</surname>
          </string-name>
          .
          <article-title>Privacy detective: Detecting private information and collective privacy behavior in a large social network</article-title>
          .
          <source>In Proceedings of the 13th Workshop on Privacy in the Electronic Society</source>
          , pages
          <fpage>35</fpage>
          -
          <lpage>46</lpage>
          . ACM,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>Cash</given-names>
            <surname>Costello</surname>
          </string-name>
          .
          <article-title>Elgg 1.8 social networking</article-title>
          .
          <source>Packt Publishing Ltd</source>
          ,
          <year>2012</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <article-title>[9] eMarketer. Number of social network users worldwide from 2010 to 2021 (in billions) Statista</article-title>
          . https://www.statista.com/statistics/278414/number-of
          <article-title>-worldwide-social-network-users/</article-title>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Ricard</surname>
            <given-names>L Fogues</given-names>
          </string-name>
          ,
          <article-title>Pradeep</article-title>
          K Murukannaiah, Jose M Such,
          <string-name>
            <given-names>and Munindar P</given-names>
            <surname>Singh</surname>
          </string-name>
          .
          <article-title>Sharing policies in multiuser privacy scenarios: Incorporating context, preferences, and arguments in decision making</article-title>
          .
          <source>ACM Transactions on Computer-Human Interaction (TOCHI)</source>
          ,
          <volume>24</volume>
          (
          <issue>1</issue>
          ):
          <fpage>5</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Ricard</surname>
            <given-names>L Fogues</given-names>
          </string-name>
          , Pradeep Murukanniah, Jose M Such,
          <string-name>
            <given-names>Agustin</given-names>
            <surname>Espinosa</surname>
          </string-name>
          , Ana Garcia-Fornes, and
          <string-name>
            <given-names>Munindar</given-names>
            <surname>Singh</surname>
          </string-name>
          .
          <article-title>Argumentation for multi-party privacy management</article-title>
          .
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12] Nadin Ko¨kciyan, Nefise Yaglikci, and
          <string-name>
            <given-names>Pinar</given-names>
            <surname>Yolum</surname>
          </string-name>
          .
          <article-title>An argumentation approach for resolving privacy disputes in online social networks</article-title>
          .
          <source>ACM Transactions on Internet Technology (TOIT)</source>
          ,
          <volume>17</volume>
          (
          <issue>3</issue>
          ):
          <fpage>27</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Yavuz</surname>
            <given-names>Mester</given-names>
          </string-name>
          , Nadin Ko¨kciyan, and Pınar Yolum.
          <article-title>Negotiating privacy constraints in online social networks</article-title>
          .
          <source>In International Workshop on Multiagent Foundations of Social Computing</source>
          , pages
          <fpage>112</fpage>
          -
          <lpage>129</lpage>
          . Springer,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Primal</surname>
            <given-names>Pappachan</given-names>
          </string-name>
          , Roberto Yus,
          <string-name>
            <surname>Prajit Kumar Das</surname>
          </string-name>
          ,
          <string-name>
            <surname>Tim Finin</surname>
            , Eduardo Mena,
            <given-names>Anupam</given-names>
          </string-name>
          <string-name>
            <surname>Joshi</surname>
          </string-name>
          , et al.
          <article-title>A semantic context-aware privacy model for faceblock</article-title>
          . In Second International Workshop on Society,
          <article-title>Privacy and the Semantic Web-Policy and Technology</article-title>
          (PrivOn
          <year>2014</year>
          ),
          <source>Riva del Garda (Italy)</source>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>Ramon</given-names>
            <surname>Ruiz-Dolz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Stella</given-names>
            <surname>Heras</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J</given-names>
            <surname>Alemany</surname>
          </string-name>
          , and Ana Garc´
          <fpage>ıa</fpage>
          -Fornes.
          <article-title>Towards an argumentation system for assisting users with privacy management in online social networks</article-title>
          .
          <source>In Proceedings of the 19th Workshop on Computational Models of Natural Argument.</source>
          , pages
          <fpage>17</fpage>
          -
          <lpage>28</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>Katharine</given-names>
            <surname>Sarikakis</surname>
          </string-name>
          and
          <string-name>
            <given-names>Lisa</given-names>
            <surname>Winter</surname>
          </string-name>
          .
          <article-title>Social media users' legal consciousness about privacy</article-title>
          .
          <source>Social Media+ Society</source>
          ,
          <volume>3</volume>
          (
          <issue>1</issue>
          ):
          <fpage>2056305117695325</fpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <surname>Elizabeth</surname>
            <given-names>I Sklar</given-names>
          </string-name>
          and
          <article-title>Mohammad Q Azhar</article-title>
          .
          <article-title>Explanation through argumentation</article-title>
          .
          <source>In Proceedings of the 6th International Conference on Human-Agent Interaction</source>
          , pages
          <fpage>277</fpage>
          -
          <lpage>285</lpage>
          . ACM,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <surname>Anna</surname>
            <given-names>C Squicciarini</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Federica Paci</surname>
            , and
            <given-names>Smitha</given-names>
          </string-name>
          <string-name>
            <surname>Sundareswaran</surname>
          </string-name>
          .
          <article-title>Prima: a comprehensive approach to privacy protection in social network sites. annals of telecommunications-annales des te´le´communications,</article-title>
          <volume>69</volume>
          (
          <issue>1-2</issue>
          ):
          <fpage>21</fpage>
          -
          <lpage>36</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Anna</surname>
            <given-names>C Squicciarini</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Heng Xu</surname>
            ,
            <given-names>and Xiaolong</given-names>
          </string-name>
          <string-name>
            <surname>Zhang</surname>
          </string-name>
          . Cope:
          <article-title>Enabling collaborative privacy management in online social networks</article-title>
          .
          <source>Journal of the American Society for Information Science and Technology</source>
          ,
          <volume>62</volume>
          (
          <issue>3</issue>
          ):
          <fpage>521</fpage>
          -
          <lpage>534</lpage>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [20]
          <string-name>
            <surname>Kurt</surname>
            <given-names>Thomas</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Chris</given-names>
            <surname>Grier</surname>
          </string-name>
          , and David M Nicol.
          <article-title>unfriendly: Multi-party privacy risks in social networks</article-title>
          .
          <source>In International Symposium on Privacy Enhancing Technologies Symposium</source>
          , pages
          <fpage>236</fpage>
          -
          <lpage>252</lpage>
          . Springer,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <surname>Yang</surname>
            <given-names>Wang</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gregory Norcie</surname>
          </string-name>
          , Saranga Komanduri, Alessandro Acquisti,
          <article-title>Pedro Giovanni Leon, and Lorrie Faith Cranor. I regretted the minute i pressed share: A qualitative study of regrets on facebook</article-title>
          .
          <source>In Proceedings of the seventh symposium on usable privacy and security, page 10. ACM</source>
          ,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <surname>Ryan</surname>
            <given-names>Wishart</given-names>
          </string-name>
          , Domenico Corapi, Srdjan Marinovic, and
          <string-name>
            <given-names>Morris</given-names>
            <surname>Sloman</surname>
          </string-name>
          .
          <article-title>Collaborative privacy policy authoring in a social networking context</article-title>
          .
          <source>In 2010 IEEE International Symposium on Policies for Distributed Systems and Networks</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          . IEEE,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>