<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Socially Responsible Virtual Assistant for Privacy Protection: Implementing Trustworthy AI?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Socially Responsible Virtual Assistant...</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>FOCUS - Social Research and Marketing Agency</institution>
          ,
          <addr-line>Brno</addr-line>
          ,
          <country country="CZ">Czech Republic</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Faculty of Applied Sciences, University of West Bohemia</institution>
          ,
          <addr-line>Pilsen</addr-line>
          ,
          <country country="CZ">Czech Republic</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Faculty of Social Sciences, Charles University</institution>
          ,
          <addr-line>Prague</addr-line>
          ,
          <country country="CZ">Czech Republic</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Institute of State and Law, Czech Academy of Sciences</institution>
          ,
          <addr-line>Prague</addr-line>
          ,
          <country country="CZ">Czech Republic</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>The paper introduces an AI-based virtual assistant VILEM whose primary aim is to strengthen individual right to informational self-determination on the Internet. VILEM helps users to manage their privacy settings, protect themselves against potentially abusive websites, and saves time of users as it presents relevant information on personal data processing in a comprehensible manner. The paper also presents how VILEM ful lls requirements on Trustworthy AI.</p>
      </abstract>
      <kwd-group>
        <kwd>Socially responsible AI</kwd>
        <kwd>Trustworthy AI</kwd>
        <kwd>Accountability</kwd>
        <kwd>Responsibility</kwd>
        <kwd>Transparency</kwd>
        <kwd>Explainability</kwd>
        <kwd>Privacy</kwd>
        <kwd>Right to informational self-determination</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        E cient privacy protection is one of the crucial values that we need to
foster in our information based society. At the same time, preserving this value
should not hinder the development of society, science, technology, and provided
services. Unfortunately, processing personal data when accessing various online
services, such as social media, can pose various risks for Internet users { namely
undermining their ability to exercise control over own personal data [
        <xref ref-type="bibr" rid="ref20">20</xref>
        ].
      </p>
      <p>
        The necessity and importance of processing personal data, however, raises as
new services and applications are being developed. One of currently very popular
trends is personalization. Personalization can be understood \as a process that
changes the functionality, interface, information content, or distinctiveness of a
system to increase its personal relevance to an individual" [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ].
      </p>
      <p>
        Personalization is typically based on pro ling which can be technically done
namely with help of various kinds of cookies ( rst-party cookies, third-party
cookies, Flash cookies, etc.) or with help of other means, such as IP addresses,
web bugs, URL form data, etc. [
        <xref ref-type="bibr" rid="ref16">16</xref>
        ]. A wide range of information collected from
users, such as visited pages, dates and times of Internet usage or checked goods
can be processed with machine learning algorithms to create users' pro les or
pro les of groups of users with similar interests. Tracking Internet users across
di erent websites for providing them with personalized services is typically based
on browser cookies [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. The term cookie refers to \a text string that is placed
on a client browser when it accesses a given server" [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Research shows \that
some websites set over 300 cookies" into users devices [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ].
      </p>
      <p>
        This practice causes problems to Internet users who are often not aware
about placement of cookies or are perplexed with a large number of requests on
granting consent with cookies, with long and incomprehensible privacy policies,
multiplicity of actors, and overall information asymmetry they are facing. In
2016, Eurostat described how Internet users protected their privacy online.
Citizens of the Netherlands, Germany or Finland were very much aware of the fact
that they can be traced by cookies. Despite that Internet users were not very
active with regard to changing their cookie settings in a web browser. In
particular, in the Czech Republic less than 20 % of people changed their \browser
settings to prevent or limit cookies use" [
        <xref ref-type="bibr" rid="ref14">14</xref>
        ]. A recent study in the Czech
Republic showed that Czech citizens perceive themselves as powerless and react to
the complex situation of protecting their own online privacy by giving up on a
diligent approach and learning how to live with something that they perceive
as \an oppressive power of an algorithm" [
        <xref ref-type="bibr" rid="ref43">43</xref>
        ]. The approach described in the
Eurostat study and con rmed by the recent Czech study and suggests that
Internet users are renouncing their rights. In fact, Internet users stated that they
perceive exercising their privacy-related rights as impossible due to their limited
technical skills as well as limited legal knowledge.
      </p>
      <p>
        As individual autonomy is threatened in the online environment where there
are many \little brothers" and individual choices are predetermined based on
ubiquitous tracking and personalization [
        <xref ref-type="bibr" rid="ref17">17</xref>
        ], Internet users need to be provided
with tools that would strengthen their position and help them to exercise their
rights, namely their right to informational self-determination, i.e., the right of
an individual to decide whether and up to what degree information related to
their private life would be communicated to others. For this purpose we
propose designing a virtual assistant based on arti cial intelligence (AI) that would
strengthen individual autonomy by providing users with functionalities
allowing them to communicate their individual preferences in privacy protection to
providers of online content and services.
      </p>
      <p>
        This virtual assistant contributes to developing socially responsible AI.
Although socially responsible approach to AI has been mentioned by research in the
past [
        <xref ref-type="bibr" rid="ref36 ref9">36, 9</xref>
        ], the concept of socially responsible AI was de ned in early 2021 [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
The main objective of socially responsible AI is \addressing the social
expectations of generating shared value { enhancing both AI intelligence and its bene ts
to society" [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. At the same time the virtual assistant needs to comply with
ethical and legal requirements set out in EU documents and laws.
      </p>
      <p>Therefore, the aim of this paper is to introduce how we intend to implement
and operationalize a socially responsible AI system that would assist Internet
users with e cient protection of their online privacy and the right to their
informational self-determination by providing them with an easy and freely available
tool allowing them to administer their privacy preferences, reduce information
asymmetry, inform them in a comprehensible manner, and educate them in the
area of law and technology.
2</p>
    </sec>
    <sec id="sec-2">
      <title>EU Legislation, Personal Data Protection, and Cookies in Practice</title>
      <p>The tool we propose { our virtual assistant { will be initially available for users
from the Czech Republic. Therefore, its operation must be based on and
compliant with EU and Czech laws related to personal data protection and cookies.</p>
      <p>
        This legislation is quite robust and additional various explanatory documents
such as opinions of the European Data Protection Board or other bodies need
to be taken into account [19{23, 38]. Protection of personal data on the Internet
is regulated namely by the General Data Protection Regulation (hereinafter
GDPR [
        <xref ref-type="bibr" rid="ref39">39</xref>
        ]) and the ePrivacy directive [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. Internet users are typically provided
with various privacy policies that inform them how a particular data controller
processes their data. They can do so based on one of legal grounds set out in
the Art. 6 par. 1 of the GDPR. Typically, data controllers process personal data
based on consent. However, they can process personal data without users consent
for instance when they have a legitimate interest to do so. In this case users (data
subjects) can object against such processing according to Art. 21 par. 1 of the
GDPR. Data controllers can process personal data for various purposes. Each
purpose, however, must be based on one of the legal ground. Understanding the
situation can, thus, become very di cult and complex.
      </p>
      <p>
        The complexity of the situation increases also when cookies are used. Cookies
play an important role in securing proper functioning of providing online content
and online services. EU law recognizes them as legitimate tools, for instance, for
\analysing the e ectiveness of website design and advertising, and in verifying
the identity of users engaged in on-line transactions" [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ]. At the same time
use of cookies has implications for Internet users as cookies are stored on their
equipment and can, thus, interfere with the private sphere of users [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. However,
one needs to distinguish among di erent types of cookies [
        <xref ref-type="bibr" rid="ref31">31</xref>
        ].
      </p>
      <p>
        Originally, cookies were considered a privacy preserving mechanism [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ].
Unfortunately, the practice showed that cookies can be misused [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Legal
reguirements on cookies are often neglected [
        <xref ref-type="bibr" rid="ref33">33</xref>
        ], consent with placing cookies is not
acquired in a lawful manner (such as pre-ticking checkboxes [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ], or implying
consent [
        <xref ref-type="bibr" rid="ref37">37</xref>
        ]) or users face so called tracking walls as well as take-it-or-leave-it
choices [
        <xref ref-type="bibr" rid="ref45">45</xref>
        ]. Given the unfavourable environment, some public authorities
decided to audit cookie compliance [
        <xref ref-type="bibr" rid="ref35">35</xref>
        ]. Misuse of personal as well as non-personal
data from cookies can have serious impacts on Internet users and can result, for
instance, in online price discrimination [
        <xref ref-type="bibr" rid="ref41">41</xref>
        ] or exploiting biases [
        <xref ref-type="bibr" rid="ref44">44</xref>
        ].
      </p>
      <p>One of the solutions for achieving legal compliance regarding cookies is use of
consent management platforms. As preparatory work for designing an AI-based
virtual assistant, we needed to verify the level of use of consent management
platforms in the Czech Republic. In the preparatory phase, we crawled a number
of websites and tried to automatically identify how many of them are using
standard cookie consent managers (like CookieBot or OneTrust) because it is
much easier to automatically analyze consents on pages using such managers. As
the detection was done with help of a rule-based system (using de ned HTML
structure and keywords), the results are only approximate. It is possible that a
few pages were using consent managers contrary to the results or that on some
pages the managers were not identi ed correctly. However, based on manual
evaluation of some pages we can say it happened just in several cases. The
results of this experiment are shown in Table 1. The results indicate that 314
pages out of 3649 used one of the tested consent management platforms and 809
pages probably do not mention anything about cookies at all.
Description Number
OneTrust (CMP) 142
CookieBot (CMP) 16
Cookie Consent (CMP) 112
Funding Choices (CMP) 44
Cookies mentioned in Privacy Policy 2526
Probably no cookies used 809
Pages scanned in total 3649</p>
      <p>The experiment shows that use of cookies on the Internet in the Czech
Republic is quite inconsistent and, therefore, can be also confusing for Internet
users.
3
3.1</p>
    </sec>
    <sec id="sec-3">
      <title>VILEM: Virtual Assistant for Privacy Protection</title>
      <sec id="sec-3-1">
        <title>The Idea behind VILEM</title>
        <p>As suggested above, problems with online privacy protection and bad cookie
practice described above led us to the idea that Internet users need to be much
better equipped in order to face the growing information asymmetry, overload of
information related to personal data protection on the Internet, and a growing
number of requests on providing their consent with personal data processing and
placing cookies into their devices. As the principle of granting consent is in line
with the legal principle of personal autonomy and the right to information
selfdetermination, it needs to be maintained. At the same time, Internet users need
to be provided with tools on how to exercise their will and rights in practice not
to be paralyzed by practical e ects of this legal requirement.</p>
        <p>Therefore, we have designed an AI-based virtual assistant VILEM. Its name
refers to the principle of autonomy as the etymological meaning of this word is
\my will is my protection." Moreover, VILEM is an acronym that stands for
Volition Inspirited by Legal EMpowerment.</p>
        <p>
          The idea of using technology to empower Internet users with regard to privacy
protection online is not new. Apart from various plug-ins that help to block
tracking by third-party cookies, there is, for instance, a solution that utilizes deep
learning and helps Internet users to comprehend privacy policies { Polisis [
          <xref ref-type="bibr" rid="ref27">27</xref>
          ].
Another solution, a browser plug-in Robin, helps to monitor personalization
process and to understand \individual information cocoons" [
          <xref ref-type="bibr" rid="ref8">8</xref>
          ].
        </p>
        <p>The uniqueness of VILEM lies in its ability to return its users the
decisionmaking capacity that would not be hindered by the necessity to exploit limited
personal resources, such as time to search for relevant information, time to
manually set up privacy preferences for each visited website, and biologically limited
attention span. The following subchapter describes how VILEM shall function
in practice.
3.2</p>
      </sec>
      <sec id="sec-3-2">
        <title>VILEM's Functionalities</title>
        <p>Form and appearance VILEM is designed in the form of a sidebar that
appears when an Internet browser is opened. VILEM updates itself automatically
once a user enters a website on a new domain or when new cookies are detected. It
is accessible all the time and not only on demand. Currently, VILEM is designed
only in the Czech language and for Czech users. When completed, VILEM will
be available for free as a web plug-in.</p>
        <p>
          Personalized privacy protection We presume that upon installing VILEM,
users will ll in a survey regarding their privacy preferences. Our pilot empirical
study that we conducted in the Czech Republic in December 2020 shows that
some users trust certain websites more and are willing to share more
information with them than with others. Moreover, 56 % of respondents stated that
they prefer to assess each purpose of processing personal data individually [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ].
Therefore, VILEM will enable users to set up their speci c privacy preferences
with regard to grounds for personal data processing according to the Art. 6 par.
1 GDPR [
          <xref ref-type="bibr" rid="ref39">39</xref>
          ], purposes for personal data processing set out in privacy policies,
and individual types of cookies. The types of cookies have been preliminary
determined based on analysis of options provided by consent management
platforms and can be extended depending on continuous analysis. After completing
an initial survey, VILEM will automatically set up cookie preferences when asked
for consent by a website. Users will be able to change their privacy preferences
any time. Moreover, they will be able to change settings manually for individual
websites.
        </p>
        <p>Providing information to users VILEM informs users about the information
that the data controller needs to make available according to the GDPR. This
information contains the name and contact details of the controller, the purpose
of data processing, categories of processed personal data, and legal grounds for
the processing (consent, contractual obligation, legal obligation, protection of
vital interests, protection of a public interest, or a legitimate interest of the
controller). Additionally, VILEM informs users whether the controller makes
the data available to other parties, such as processors. In that case VILEM also
provides users with respective contact details. Users should understand from
the information provided that their consent is reversible, if already given, or
optional, if not. The same goes for the stated legitimate purposes.</p>
        <p>VILEM will also ful ll an educational role. It will inform users in simple
terms about what provided information means and what can be done in each
situation. For those interested in the topic and who will want to go into it in
more depth, we will provide links to our website with educational videos (in
preparation).</p>
        <p>Tool for managing cookies VILEM will enable users to forbid cookies
unnecessary for website's functioning and inform them that a website is inaccessible
without agreeing to certain types of cookies. In the future, VILEM should
provide additional functions, such as enabling users to forbid pop-up noti cations
and informing them if a website contains paid promotions.
3.3</p>
      </sec>
      <sec id="sec-3-3">
        <title>VILEM's Technical Background</title>
        <p>Various methods can implement mapping of user preferences with speci c rules
o ered by websites providers. With growing computational capabilities and more
powerful hardware, automatic but rigorous analysis of textual data becomes
more imaginable than before. VILEM can use any modern sequence classi cation
approach for checking matches in privacy preferences. Most probably, we will use
some BERT like models[bert] in cross attention fashion.</p>
        <p>
          The current trend in natural language processing is to use large neural
network models pre-trained on huge data sets. Such data do not have to be manually
labelled; we can use automatically generated datasets and design arti cial tasks {
so-called self-supervised learning { to extract knowledge about human language
and wisdom about the world. These models are mainly intended for the English
language. However, researchers released models trained on a couple of languages
simultaneously [
          <xref ref-type="bibr" rid="ref40">40</xref>
          ], which can help to increase the accuracy of such models by
enlarging the dataset. We can also utilise models for narrow language groups,
such as the Slavic language group [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ] or even monolingual models trained for the
Czech language [
          <xref ref-type="bibr" rid="ref42">42</xref>
          ].
        </p>
        <p>In exponentially growing data production and a rapidly changing legal
environment, modern society often searches for an easy and systematic way of
solving law issues. Complex but easy-to-use shelf-product solutions are often
the rst-choice tool for website operators who want to satisfy complicated law.
Projects like OneTrust aim to deal with the changing environment. However, a
non-negligible amount of web service providers still does not a systematic
solution or do not even implement law obligations. In this regard, VILEM will be
able to easily analyse and solve users matches on sites with mainstream
systematic solutions due to the known structure of forms and will be able to focus
only on textual content and its semantics. In non-systematic solutions, there
will be one extra step { to identify the form and parse the statements with their
controls. In the next step, VILEM will be able to analyse the texts, highlight
match or mismatch in each statement and pre ll the form for users. It will be
also able to recognise and send information about potential violation of law to
the respective public authority.</p>
        <p>
          As VILEM will use techniques of natural language processing, we need to
take extra care when preparing datasets for its learning. The preparation of the
data is done manually by people with knowledge of personal data processing
and its legal limits as well as the obligations imposed by the data protection
legislation [
          <xref ref-type="bibr" rid="ref1 ref39">39, 1</xref>
          ]. The annotation is made in an environment speci cally designed
just for this task.
        </p>
        <p>There are some speci cities related to annotating in the Czech language and
within the Czech legal culture. The rst speci city lies in the workings of the
language itself. The structure di ers signi cantly from English, German and other
languages used in areas where annotation of legal texts is more common than
in the Czech Republic. Therefore, existing conventions from other countries are
not usable for our work. The second speci city concerns the legal culture in the
Czech Republic, which scarcely uses standardized templates. The governmental
bodies, such as ministries and specialized public authorities (e.g., the O ce for
Personal Data Protection), do not provide them either. It is customary for the
administrative bodies to provide guidelines on the creation of necessary
documents instead. As a result, when annotating a Czech legal text one must expect
a high level of variability in its structure as well as in the terminology.</p>
        <p>
          The eld of annotating Czech legal texts is not explored thoroughly.
Nevertheless, more than one research project on this matter was completed in previous
years. For data extraction, we follow the best practice set by the team on the
Faculty of Law at Masaryk University [
          <xref ref-type="bibr" rid="ref24">24</xref>
          ] on the methodology for citation analysis
and annotation conventions. The most signi cant results so far were presented
in the research project Exact Assessment of the Relevance of Case-Law [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ]. In
the project, the focus however lied on the analysis of references present in the
case-law of Czech courts. The part relevant for work on VILEM was the
groundwork on manual annotation of data necessary for the automatic extraction of
data by the tool [
          <xref ref-type="bibr" rid="ref25">25</xref>
          ]. Of course, other works based on manual annotation of
legal texts exist, however they do not focus on the preparation of data for
automated extraction. For VILEM to work, it has to be capable to learn to nd
patterns in various texts containing personal data processing information. We
had to annotate with that in mind.
        </p>
        <p>
          The challenges of texts containing terms and conditions for personal data
processing are 1) variations in used legal terminology; 2) creativity in the phrasing
of information obligations towards the user; 3) inconsistent level of detail of
provided information; 4) purposeful omission of certain information. The obstacles
we are facing di er from the ones the team of Masaryk University had to solve.
For example, one of the problems they had was an unclear structure of case-law
decisions that required the addition of functionality to their tool, enabling
automated segmentation of the text [
          <xref ref-type="bibr" rid="ref26">26</xref>
          ]. In comparison, the most challenging part
of VILEM is that the terms and conditions on personal data processing require
a signi cant amount of di erent tags.
        </p>
        <p>To prevent mistakes in the manual annotation that would have a negative
in uence on the functionalities of VILEM, the annotation is done by professionals
in the area of personal data protection. This way, they are familiar with the
terminology and it will be quicker for them to search for relevant data in the
texts. Furthermore, their practical experience shall ensure that they can identify
possible hidden information in the text. Such as unlawful limitations of the data
subject's rights. These are written intentionally in a way that would confuse an
an unprepared reader without professional expertise. In the future, we would like
to enable the users of VILEM to send feedback in case they encounter an error
made by VILEM, such as the inability to nd all the information on personal
data processing in the terms and conditions. This way, VILEM can improve,
which is one of the upsides of using AI algorithms. That said, it is necessary
to supervise the learning of VILEM on the data feedback, since it might be
incorrect. It is bound to happen that the users will not be able to correctly
identify the relevant legal meaning behind the phrasing of the text. It can be
quite confusing for a consumer. Even so, the texts can be confusing to legal
professionals as well.</p>
        <p>
          Therefore, we have implemented the practice of multiple annotations of the
same text. To make the manual annotations as precise as possible, we also created
an annotation manual. The annotation manual is inspired by the one used for the
annotation of Czech judicial decisions [
          <xref ref-type="bibr" rid="ref4">4</xref>
          ]. It sets the general rules for annotation
so that all the annotators can adopt the same or at least similar approach. On
top of that all tags are accompanied by examples of how they can look like in
di erent texts.
3.4
        </p>
      </sec>
      <sec id="sec-3-4">
        <title>Involvement of VILEM's Users</title>
        <p>Any user experience feedback is precious and can improve functioning of a system
by adjusting the user interface or enlarging the training corpora. However, in
every application, collecting user feedback can be tricky. Active feedback can be
time-consuming and annoying for users. Moreover, recording users' behaviour
may not be well accepted in a project dealing with privacy issues. However,
VILEM can overcome these issues. We will let the users consider the bene t of
making the system better and let them decise whether they would accept or deny
sending anonymous automatic feedback upon installation of VILEM. meanwhile,
we will place feedback buttons in the applications for those who want to give
active feedback.</p>
        <p>We need to keep in mind that some serious problems can arise if users would
have the possibility to a ect the decision process of VILEM by sending feedback
on incorrect annotation of legal texts. In the rst place, a usual user is not
a lawyer, so that their reasoning can be simply wrong. Fortunately, modern
models can handle non-systematic noise brought by users well. However, if there
was some systematic misunderstanding of the law by the users, the model could
drift to this potentially wrong interpretation. We will avoid this unwanted state
by searching for a systematic deviation and investigating such singularities by
professionals.</p>
        <p>Nonetheless, the fact that the user would not be satis ed with the outcome
of VILEM will be essential for us. We can solve this issue in several ways: by
providing us with information why VILEM marked a statement as it had done
in the rst place and let the user share his own opinion on the subject for further
processing. If VILEM was wrong, we would add this "outlier" to the training
corpora. If VILEM was right, it could be a sign of an unclear understanding of
the setting of users preferences in VILEM after installation.
3.5</p>
      </sec>
      <sec id="sec-3-5">
        <title>Evaluation of VILEM by Czech Internet Users</title>
        <p>
          In November and December 2020, we tested the rst proof of concept and the
user interface of VILEM. In December 2020, we conducted the rst pilot
empirical study and presented a mock-up version of VILEM to 50 Czech Internet
users [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ]. The respondents could get acquainted with VILEM through an
introductory video. They were provided with description of VILEM's purpose and
functionalities. Our aim was to get preliminary feedback before further
development.
        </p>
        <p>
          The feedback from respondents was very positive. 92 % of respondents
considered such web plug-in as desirable. 94 % of respondents evaluated VILEM as
useful and 84 % considered it trustworthy. 56 % of respondents expressed that
VILEM would strengthen their control over information and would help them
to make the process of privacy protection more comprehensible to them.
Respondents expressed their expectations that VILEM would help them to protect
themselves from and block harmful websites as well as save their time. Only 4
respondents out of 50 were hesitant or negative about the use of VILEM. The main
reasons were a general concern that VILEM would slow down a computer and a
general distrust to any solution that needed to be installed into a computer [
          <xref ref-type="bibr" rid="ref32">32</xref>
          ].
        </p>
        <p>The pilot study showed us that Czech users would welcome a technical
solution that would strengthen their control over personal data, warned and
protected them against threats (namely when a websites requires more information
than users are willing to provide), and instructed them what to do in certain
situations.</p>
        <p>The main lesson we took from the study is to design VILEM in such a manner
that it shall provide a maximum level of information, choice and control to users
an a very comprehensible and easy-to-understand manner. In order to strengthen
trustworthiness of VILEM, we need to diligently implement and operationalize
requirements on Trustworthy and Responsible AI. The following chapter will
illustrate how we plan to do so.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4 Implementing Trustworthy AI</title>
      <p>
        The term of Trustworthy AI was introduced by the High-Level Expert Group on
Arti cial Intelligence [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. In order for AI systems to be well adopted by society,
these systems ideally need to comply with a number of requirements.
      </p>
      <sec id="sec-4-1">
        <title>Ethical Principles of Trustworthy AI AI systems will need to comply with</title>
        <p>four ethical principles on Trustworthy AI { respect for human autonomy,
prevention of harm, fairness, and explicability. VILEM ful lls the rationale of all
of the four principles. Its aim is to strengthen human autonomy by providing
Internet users with a free tool for better management of own choices and hereby
prevents harm that they could face by careless sharing of personal data. VILEM
will not discriminate any user as it will be freely available to all Czech citizens.
Moreover, functioning of VILEM will be explained to users in a comprehensible
and transparent manner.</p>
      </sec>
      <sec id="sec-4-2">
        <title>Key Requirements for Trustworthy AI AI systems will also need to comply</title>
        <p>with seven requirements. Compliance of VILEM is described below for each of
the requirements.</p>
        <p>Human agency and oversight As mentioned above, the main function of VILEM
is to strengthen personal autonomy. VILEM supports individual decision-making
related to protecting own online privacy.</p>
        <p>Technical robustness and safety The main risk to technical robustness and safety
would come from the side of users who could in uence functioning of VILEM.
However, all input and feedback from users on problems related to
malfunctioning will be checked manually.</p>
        <p>Privacy and data governance VILEM will not collect or process personal data
related to its users. All activity will be done only on the side of users. It will
be possible to share data with us if a particular user will wish to do so for the
purpose of improving the system.</p>
        <p>Transparency VILEM shall be completely transparent. We intend to share the
code as open source. Moreover, users or any other person will be provided with
information which training data was used.</p>
        <p>Diversity, non-discrimination, and fairness VILEM is designed as user-centric
and will be made available to anyone for free.
Societal and environmental well-being By protecting users VILEM will
contribute to overall societal well-being.</p>
        <p>Accountability With regard to securing safety and robustness, functioning of
VILEM will be continuously monitored and improved.
5</p>
      </sec>
    </sec>
    <sec id="sec-5">
      <title>Future Challenges</title>
      <p>
        Our virtual assistant VILEM is in the process of development. However, even
after it will be nished, we will need to continuously update it, expand the
training corpora and keep analyzing how law and privacy policies as well as
cookie legislation and practice evolves. One of the upcoming challenges we will
need to react to is a change in use of so called third-party cookies [
        <xref ref-type="bibr" rid="ref18">18</xref>
        ] use
of which has already been reduced in relationship with adopting the GDPR
(see [
        <xref ref-type="bibr" rid="ref34">34</xref>
        ]). Moreover, we need to monitor and update VILEM with regard to
potential new legal obligations.
      </p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Act</given-names>
            <surname>No</surname>
          </string-name>
          .
          <volume>110</volume>
          /2019 Coll.,
          <source>on Personal Data Processing (Czech Republic)</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Aguirre</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mahr</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Grewal</surname>
            , D., de Ruyter,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wetzels</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Unraveling the Personalization Paradox: The E ect of Information Collection and Trust-Building Strategies on Online Advertisement E ectiveness</article-title>
          .
          <source>Journal of Retailing</source>
          <volume>91</volume>
          (
          <issue>1</issue>
          ),
          <volume>34</volume>
          {
          <fpage>49</fpage>
          (
          <year>2015</year>
          ). https://doi.org/10.1016/j.jretai.
          <year>2014</year>
          .
          <volume>09</volume>
          .005
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Ahava</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Use (and Abuse) of Website Cookies under EU Privacy Law: Practical Tips for Better Compliance</article-title>
          , https://www.lexology.com/library/detail.aspx?g=
          <fpage>64772d95</fpage>
          -c4c7
          <string-name>
            <surname>-</surname>
          </string-name>
          4ad0
          <source>-8a5cab66 564e1e. Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <article-title>Annotation manual for the project Methodology for the Case-Law Citation Analysis, project no</article-title>
          . MUNI/A/0940/2015, http://citacnianalyza.law.muni.cz/content/cs/publikace/.
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Arzubov</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shakhovska</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lipinski</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          :
          <article-title>Analyzing ways of building user pro le based on web surf history</article-title>
          .
          <source>In: 12th International Scienti c and Technical Conference on Computer Sciences and Information Technologies (CSIT)</source>
          . IEEE Press (
          <year>2017</year>
          ). https://doi.org/10.1109/STC-CSIT.
          <year>2017</year>
          .8098809
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6. BERT in DeepPavlov, http://docs.deeppavlov.ai/en/master/features/models/bert.html.
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Blom</surname>
          </string-name>
          , J.:
          <article-title>Personalization: a taxonomy</article-title>
          .
          <source>In: CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems</source>
          , pp.
          <fpage>313</fpage>
          -
          <lpage>314</lpage>
          . ACM (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Bodo</surname>
            ,
            <given-names>B. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Helberger</surname>
            ,
            <given-names>N. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Irion</surname>
            ,
            <given-names>K. K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zuiderveen Borgesius</surname>
            ,
            <given-names>F. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moller</surname>
            , J. J., van de Velde,
            <given-names>B. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bol</surname>
            ,
            <given-names>N. N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>van Es</surname>
            ,
            <given-names>B. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>de Vreese</surname>
          </string-name>
          , C. C.
          <article-title>: Tackling the Algorithmic Control Crisis</article-title>
          .
          <source>The Technical, Legal</source>
          , and Ethical Challenges of Research into Algorithmic Agents.
          <source>Yale Journal of Law and Technology</source>
          <volume>19</volume>
          (
          <issue>1</issue>
          ),
          <volume>133</volume>
          {
          <fpage>181</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Brundage</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Avin</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Clark</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          et al.:
          <source>The Malicious Use of Arti cial Intelligence: Forecasting</source>
          , Prevention, and
          <string-name>
            <surname>Mitigation</surname>
          </string-name>
          . Report, Future of Humanity Institute (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Cahn</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alfeld</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Barford</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Muthukrishnan</surname>
            ,
            <given-names>S.:</given-names>
          </string-name>
          <article-title>An Empirical Study of Web Cookies</article-title>
          .
          <source>In: WWW '16: Proceedings of the 25th International Conference on World Wide Web</source>
          , pp.
          <fpage>891</fpage>
          -
          <lpage>901</lpage>
          . ACM (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11. Cheng, L.,
          <string-name>
            <surname>Varshney</surname>
            ,
            <given-names>K. R.</given-names>
          </string-name>
          , Liu, H.:
          <article-title>Socially Responsible AI Algorithms</article-title>
          : Issues, Purposes, and Challenges. 1-
          <fpage>49</fpage>
          (
          <year>2021</year>
          ). https://arxiv.org/abs/2101.02032
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <article-title>Directive 2002/58/EC of the European Parliament and of the Council of 12 July 2002 concerning the processing of personal data and the protection of privacy in the electronic communications sector (Directive on privacy and electronic communications)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <source>Directive</source>
          <year>2009</year>
          /136/EC of the
          <source>European Parliament and of the Council of 25 November 2009 amending Directive</source>
          <year>2002</year>
          /
          <article-title>22/EC on universal service and users' rights relating to electronic communications networks</article-title>
          and services,
          <source>Directive</source>
          <year>2002</year>
          /
          <article-title>58/EC concerning the processing of personal data and the protection of privacy in the electronic communications sector and Regulation (EC) No 2006/2004 on cooperation between national authorities responsible for the enforcement of consumer protection laws (Text with EEA relevance)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Eurostat</surname>
          </string-name>
          :
          <article-title>Digital economy</article-title>
          and society statistics { households and individuals, https://ec.europa.eu/eurostat/statistics-explained/index.php.
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <article-title>Exact assessment of the relevance of case-law</article-title>
          , https://starfos.tacr.cz/en/project/GA17-20645S.
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          16.
          <string-name>
            <surname>Farafonov</surname>
          </string-name>
          , G.:
          <article-title>Personal data and personalization issues</article-title>
          .
          <source>Diploma thesis</source>
          . University of Economics and Business, (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          17.
          <string-name>
            <surname>Grafanaki</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Autonomy Challenges in the Age of Big Data</article-title>
          .
          <source>Fordham Intellectual Property, Media &amp; Entertainment Law Journal</source>
          <volume>27</volume>
          (
          <issue>4</issue>
          ),
          <volume>803</volume>
          {
          <fpage>865</fpage>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          18.
          <article-title>Google ending third-party cookies in Chrome</article-title>
          , https://www.cookiebot.com/en/google-third
          <article-title>-party-cookies</article-title>
          .
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          19. Guidelines 05/2020 on consent under
          <source>Regulation</source>
          <year>2016</year>
          /976.
          <string-name>
            <surname>European Data Protection Board</surname>
          </string-name>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          20. Guidelines 8
          <article-title>/2020 on the targeting of social media users</article-title>
          .
          <source>European Data Protection Board</source>
          (
          <year>2021</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          21. Guidelines 09/2020 on relevant and
          <source>reasoned objection under Regulation</source>
          <year>2016</year>
          /679.
          <string-name>
            <surname>European Data Protection Board</surname>
          </string-name>
          (
          <year>2021</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          22.
          <article-title>Guidelines on Automated individual decision-making and Pro ling for the purposes of Regulation 2016/679</article-title>
          . Article 29
          <string-name>
            <given-names>Data</given-names>
            <surname>Protection Working Party</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          23. Guidelines on transparency under
          <source>Regulation</source>
          <year>2016</year>
          /679. Article 29
          <string-name>
            <given-names>Data</given-names>
            <surname>Protection Working Party</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          24.
          <string-name>
            <surname>Harasta</surname>
            ,
            <given-names>J.,</given-names>
          </string-name>
          <article-title>M sek</article-title>
          , J.,
          <string-name>
            <surname>Hanych</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loutocky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malan</surname>
            <given-names>k</given-names>
          </string-name>
          , M.,
          <string-name>
            <surname>Savelka</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , Stepan kova, M.,
          <string-name>
            <surname>Myska</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Rozmery citac v pravu a anotacn konvence</article-title>
          .
          <source>Revue pro pravo a technologie 8</source>
          (
          <issue>5</issue>
          ),
          <volume>51</volume>
          {
          <fpage>73</fpage>
          (
          <year>2017</year>
          ). https://doi.org/10.5817/RPT2017-1-4
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          25.
          <string-name>
            <surname>Harasta</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savelka</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kasl</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kotkova</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Loutocky</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          , M sek, J.,
          <string-name>
            <surname>Prochazkova</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pullmannova</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Semenis</surname>
            <given-names>n</given-names>
          </string-name>
          , P.,
          <string-name>
            <surname>Sejnova</surname>
            ,
            <given-names>T</given-names>
          </string-name>
          , Simkova,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Vosinek</surname>
          </string-name>
          ,
          <string-name>
            <surname>M</surname>
          </string-name>
          , Zavadilova,
          <string-name>
            <given-names>L.</given-names>
            ,
            <surname>Zibner</surname>
          </string-name>
          , J.:
          <article-title>Annotated Corpus of Czech Case Law for Reference Recognition Tasks</article-title>
          . In: Sojka,
          <string-name>
            <given-names>P.</given-names>
            ,
            <surname>Horak</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            ,
            <surname>Kopecek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            ,
            <surname>Pala</surname>
          </string-name>
          ,
          <string-name>
            <surname>K</surname>
          </string-name>
          . (eds.). Text, Speech, and Dialogue: 21st International Conference. Cham: Springer Nature Switzerland AG (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          26.
          <string-name>
            <surname>Harasta</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Savelka</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kasl</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , M sek, J.:
          <article-title>Automatic Segmentation of Czech Court Decisions into Multi-Paragraph Parts</article-title>
          .
          <source>Jusletter IT 4</source>
          ,
          <issue>1</issue>
          {
          <fpage>10</fpage>
          (
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          27.
          <string-name>
            <surname>Harkous</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fawaz</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lebret</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schaub</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shin</surname>
            ,
            <given-names>K. G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aberer</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          :
          <article-title>Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learning</article-title>
          .
          <source>In: USENIX Security</source>
          <year>2018</year>
          . (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          28.
          <string-name>
            <surname>High-Level Expert</surname>
          </string-name>
          Group on Arti cial Intelligence.
          <article-title>Ethics Guidelines for Trustworthy AI</article-title>
          . European
          <string-name>
            <surname>Commission</surname>
          </string-name>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          29.
          <string-name>
            <surname>Jablonowska</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Michalowicz</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Planet49: Pre-Ticked Checkboxes Are Not Su cient to Convey User's Consent to the Storage of Cookies (C-673/17 Planet49)</article-title>
          .
          <source>European Data Protection Law Review</source>
          <volume>6</volume>
          (
          <issue>1</issue>
          ),
          <volume>137</volume>
          {
          <fpage>142</fpage>
          (
          <year>2020</year>
          ). https://doi.org/10.21552/edpl/2020/1/19
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          30.
          <string-name>
            <surname>Jones</surname>
            ,
            <given-names>M. L.</given-names>
          </string-name>
          :
          <article-title>Cookies: a legacy of controversy</article-title>
          .
          <source>Internet Histories</source>
          <volume>4</volume>
          (
          <issue>1</issue>
          ),
          <volume>87</volume>
          {
          <fpage>104</fpage>
          (
          <year>2020</year>
          ). https://doi.org/10.1080/24701475.
          <year>2020</year>
          .1725852
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          31.
          <string-name>
            <surname>Koch</surname>
          </string-name>
          , R.:
          <article-title>Cookies, the GDPR, and the ePrivacy Directive</article-title>
          , https://gdpr.eu/cookies/.
          <source>Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref32">
        <mixed-citation>
          32.
          <string-name>
            <surname>Krausova</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Moravec</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Volek</surname>
          </string-name>
          , J.:
          <article-title>Osobn asistent pro praci s algoritmickou personalizac obsahu: Pilotn analyza uzivatelskych znalost a ocekavan</article-title>
          .
          <source>Research report, Focus { Marketing &amp; Social Research</source>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref33">
        <mixed-citation>
          33.
          <string-name>
            <surname>Leenes</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kosta</surname>
          </string-name>
          , E.:
          <article-title>Taming the cookie monster with Dutch law { A tale of regulatory failure</article-title>
          .
          <source>Computer Law &amp; Security Review</source>
          <volume>31</volume>
          (
          <issue>3</issue>
          ),
          <volume>317</volume>
          {
          <fpage>335</fpage>
          (
          <year>2015</year>
          ). https://doi.org/10.1016/j.clsr.
          <year>2015</year>
          .
          <volume>01</volume>
          .004
        </mixed-citation>
      </ref>
      <ref id="ref34">
        <mixed-citation>
          34.
          <string-name>
            <surname>Libert</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Graves</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kleis</surname>
            <given-names>Nielsen</given-names>
          </string-name>
          , R.:
          <article-title>Changes in Third-Party Content on European News Websites after GDPR</article-title>
          . Factsheet, Reuters Institute and University of Oxfors (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref35">
        <mixed-citation>
          35.
          <string-name>
            <surname>Long</surname>
            ,
            <given-names>W. R. M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rockwell</surname>
            ,
            <given-names>S. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cuyvers</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Developments in Cookie Regulation: French CNIL Declares Intent to Audit Websites for Cookie Compliance</article-title>
          , https://www.lexology.com/library/detail.aspx?g=
          <fpage>fea449a2</fpage>
          -b5a4
          <string-name>
            <surname>-</surname>
          </string-name>
          4c6d
          <source>-8d9e5 b79001790. Last accessed 18 May 2021</source>
        </mixed-citation>
      </ref>
      <ref id="ref36">
        <mixed-citation>
          36.
          <string-name>
            <surname>Mantelero</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>AI and Big Data: A blueprint for a human rights, social and ethical impact assessment</article-title>
          .
          <source>Computer Law &amp; Security Review</source>
          <volume>34</volume>
          (
          <issue>4</issue>
          ),
          <volume>754</volume>
          {
          <fpage>772</fpage>
          (
          <year>2018</year>
          ). https://doi.org/10.1016/j.clsr.
          <year>2018</year>
          .
          <volume>05</volume>
          .017
        </mixed-citation>
      </ref>
      <ref id="ref37">
        <mixed-citation>
          37.
          <string-name>
            <surname>Nouwens</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liccardi</surname>
            ,
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Veale</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Karger</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kagal</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Dark Patterns after the GDPR: Scraping Consent Pop-ups and Demonstrating their In uence</article-title>
          .
          <source>In: CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          . ACM (
          <year>2020</year>
          ). https://doi.org/10.1145/3313831.337632
        </mixed-citation>
      </ref>
      <ref id="ref38">
        <mixed-citation>
          38. Opinion 04/2012 on Cookie Consent Exemption.
          <source>Article 29 Data Protection Working Party</source>
          (
          <year>2012</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref39">
        <mixed-citation>
          39.
          <string-name>
            <surname>Regulation</surname>
          </string-name>
          (EU)
          <year>2016</year>
          /
          <article-title>679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data</article-title>
          ,
          <source>and repealing Directive</source>
          <volume>95</volume>
          /46/EC (
          <article-title>General Data Protection Regulation)</article-title>
        </mixed-citation>
      </ref>
      <ref id="ref40">
        <mixed-citation>
          40. Ronnquist,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Kanerva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            ,
            <surname>Salakosi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            ,
            <surname>Ginter</surname>
          </string-name>
          ,
          <string-name>
            <surname>F.</surname>
          </string-name>
          :
          <article-title>Is Multilingual BERT Fluent in Language Generation?</article-title>
          <source>In: Proceedings of the First NLPL Workshop on Deep Learning for Natural Language Processing</source>
          , pp.
          <fpage>29</fpage>
          -
          <lpage>36</lpage>
          . Linkoping University Electronic Press (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref41">
        <mixed-citation>
          41.
          <string-name>
            <surname>Sears</surname>
            ,
            <given-names>A. M.</given-names>
          </string-name>
          <article-title>The Limits of Online Price Discrimination in Europe</article-title>
          .
          <source>The Columbia Science &amp; Technology Law Review</source>
          <volume>21</volume>
          (
          <issue>1</issue>
          ),
          <volume>1</volume>
          {
          <fpage>42</fpage>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref42">
        <mixed-citation>
          42.
          <string-name>
            <surname>Sido</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Prazak</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Priban</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Pasek</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sejak</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Konop</surname>
            <given-names>k</given-names>
          </string-name>
          , M.:
          <article-title>Czert { Czech BERT-like Model for Language Representation</article-title>
          .
          <fpage>1</fpage>
          -
          <lpage>13</lpage>
          (
          <year>2021</year>
          ). https://arxiv.org/abs/2103.13031
        </mixed-citation>
      </ref>
      <ref id="ref43">
        <mixed-citation>
          43.
          <string-name>
            <surname>Volek</surname>
          </string-name>
          , J.:
          <article-title>Algoritmizovana personalizace obsahu: Pr nosy a ohrozen . Kvalitativn analyza uzivatelskych postoju a taktik</article-title>
          .
          <source>Research report, Focus { Marketing &amp; Social Research</source>
          (
          <year>2020</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref44">
        <mixed-citation>
          44.
          <string-name>
            <surname>Wagner</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , Eidenmuller, H.:
          <article-title>Down by Algorithms? Siphoning Rents, Exploiting Biases, and Shaping Preferences: Regulating the Dark Side of Personalized Transactions</article-title>
          . University of Chicago Law Review
          <volume>86</volume>
          (
          <issue>2</issue>
          ),
          <volume>581</volume>
          {
          <fpage>610</fpage>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref45">
        <mixed-citation>
          45.
          <string-name>
            <given-names>Zuiderveen</given-names>
            <surname>Borgesius</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J.</given-names>
            ,
            <surname>Kruikemeier</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            ,
            <surname>Boerman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. C.</given-names>
            ,
            <surname>Helberger</surname>
          </string-name>
          , N.:
          <article-title>Tracking Walls, Take-It-Or-Leave-It Choices, the GDPR, and the ePrivacy Regulation</article-title>
          .
          <source>European Data Protection Law Review</source>
          <volume>3</volume>
          (
          <issue>3</issue>
          ),
          <volume>353</volume>
          {
          <fpage>368</fpage>
          (
          <year>2017</year>
          ). https://doi.org/10.21552/edpl/2017/3/9
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>