<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <issn pub-type="ppub">1613-0073</issn>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>Challenges in Continuous Invisible AI for Self-Augmentation</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dinara Talypova</string-name>
          <email>dinara.talypova@fh-hagenberg.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Philipp Wintersberger</string-name>
          <email>philipp.wintersberger@fh-hagenberg.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="editor">
          <string-name>XAI, HCI, Continuous AI, Seamless Technology, Attention Management System</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TU Wien</institution>
          ,
          <addr-line>Vienna</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>University of Applied Sciences Upper Austria</institution>
          ,
          <addr-line>Hagenberg</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Despite the substantial progress in Machine Learning in recent years, its advanced models have often been considered opaque, ofering no insight into the precise mechanisms behind their predictions. Consequently, engineers today try to implement the explainability factors into the developed models, essential for trust and adoptancy of the system. Still, there are several blocks in Explainable Artificial Intelligence (XAI) research that cannot follow the standard design methods and guidelines for providing transparency and ensuring maintaining human objectives. In this position paper, we attempt to chart various AI blocks from the perspective of Human-Computer Interaction field and identify potential gaps requiring further exploration. We suggest three-level dimension classification: relations with humans (replacing vs augmenting), interaction complexity (discrete vs. continuous), and the object of application (external world or users themselves).</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>CEUR
ceur-ws.org</p>
    </sec>
    <sec id="sec-2">
      <title>1. Introduction</title>
      <p>
        Until these days, Artificial intelligence (AI) maintains a nuanced relationships with humans,
oscillating between a potential replacement of them to a technology that can augment and
expand human capabilities. As smart technologies become more prevalent in our daily routines,
the necessity for a smooth integration between humans and AI becomes evident ([
        <xref ref-type="bibr" rid="ref1 ref2 ref3 ref4 ref5 ref6">1, 2, 3, 4, 5, 6</xref>
        ]
just to name a few). This involves achieving a balanced incorporation of technology in our
day-to-day activities, recognizing its advantages while also being mindful of potential challenges
and unintended consequences.
      </p>
      <p>
        The common believe is that some of the issues could be uplifted by focusing on AI
explainability [
        <xref ref-type="bibr" rid="ref7 ref8 ref9">7, 8, 9</xref>
        ]. Explainable Artificial Intelligence (XAI), a field that is focused on interpreting
machine decisions, takes its roots with the advent of AI systems already half a century ago
[
        <xref ref-type="bibr" rid="ref10 ref11 ref12">10, 11, 12</xref>
        ]. The shift from rule-based systems to modern deep learning has increased the
dificulty of interpreting AI decisions, moving beyond the simpler applied rules scenarios. Current
eforts in XAI involve the attempts to open AI’s ”black box” by enhancing transparency and
providing clear explanations for AI predictions, like justifying flagged fraudulent transactions
or selection processes in recruitment.
Austria
      </p>
      <p>
        Moreover, the XAI challenge extends beyond revealing the internal inference processes of
AI algorithms — this is also important how the insights and explanations are communicated
to end-users. Human-Computer Interactions (HCI) researchers are concerned with ensuring
that the explanations are not only technically accurate but also usable, efective, and satisfying
for the people who interact with AI systems [
        <xref ref-type="bibr" rid="ref13 ref14 ref15 ref16">13, 14, 15, 16</xref>
        ]. This entails considering diferent
approaches based on user profiles, be they professionals utilizing the system (e.g., medical
practitioners), those afected by the system (e.g., patients), or developers themselves seeking
algorithm improvement. In summary, XAI’s role in HCI is twofold, aiming both to foster user
trust (that is, how well the insights could be delivered) and reinforce the reliability of AI systems
(that is, how reliable the conclusions are). As nicely formulated by Diefenbach et al., ”we must
be convinced that the other is capable of handling the task and that the other means well.” [17]
      </p>
      <p>In this position paper, we attempt to chart various AI blocks from the perspective of HCI
research in explainability and identify potential gaps requiring further exploration. We believe
that despite long XAI research history, the field is unbalanced: while some categories of AI got
more attention from XAI perspective, the others remain in shadow. Therefore, to highlight this
skew, there is a need to categorize AI systems along the dimensions afecting their utilization,
continuity, as well as the nature of interaction with the world and humans. We came up
with three-level dimensions: relations with humans (replacing vs augmenting), interaction
complexity (discrete vs. continuous), and the object of application (external world or users
themselves). The blocks with examples of AI technology implementation from the industry are
presented in Table 1.</p>
    </sec>
    <sec id="sec-3">
      <title>2. Replacing Humans vs. Augmenting Human Capabilities</title>
      <p>One perspective in the interaction debate revolves around whether smart technologies should
replace humans [18, 19], thereby freeing up time for more meaningful or enjoyable activities, or
whether AI technologies should operate in tandem with humans [20, 21, 22], ofering support
and enhancement. The former angle is exemplified by applications like automated customer
support (e.g., chatbots), industrial automation, and self-driving vehicles, all aimed at automating
tasks to potentially allow individuals to engage in more creative or self-developmental pursuits.
This still assumes a clear level of system transparency and interpretability of the outcome, so
humans monitoring the smart machines could trace back the solution process [23]. From the
XAI point of view, this approach may involve specific reports of what have been done and how
[24]. However, under this perspective, the XAI goal is not just explainability of the results but
rather reliability of the system, i.e., the trust that system can exhibit the same and expected
behavior over time [25].</p>
      <p>In contrast, proponents of the augmentation approach contend that machines should
collaborate with people to reinforce human capabilities. Thus, Autor et al. [26] argue that typical
job responsibilities are composed of task bundles; some of the tasks within these bundles are
more amenable to automation than others. This view inclines that AI will not displace humans
and their jobs entirely; instead, it will be used to enhance particular facets of tasks, promoting
efective collaboration between humans and AI (HAIC) [ 27].</p>
      <p>
        It has already been demonstrated that HAIC is more eficient in diverse types of tasks
compared to humans’ or AI performance in isolation [20, 21, 28, 29]. In such tandem, each
party is responsible for the task in the bundle that it does better. In response to the this belief,
some academic conversations are shifting towards enhancing human capacities through AI
integration, redefining job roles for efective partnership, and transforming business processes
to align with these new collaborative models [
        <xref ref-type="bibr" rid="ref6">30, 6, 31, 32</xref>
        ]. Moreover, this concept does not stop
in eficiency. We envision that AI systems should not only automate tasks in order to increase
productivity, but also support, amplify, and extend human skills, creativity, and potential. That
is, some tasks will not be fully passed to AI also because of their enjoyable nature for humans
and feeling of autonomy.
      </p>
      <p>Applications embodying skill augmentation approach include clinical diagnostic support,
writing assistance tools (e.g., Grammarly or ChatGPT), image recognition apps, and trafic
management systems. Advocates of this perspective believe that such cooperative relationships
will empower individuals, efectively elevating them to the status of ”superhumans.” As Dhiman
et al. reasonably claimed, “the assistants of the future will not only have to be trustworthy, respect
our privacy, be accountable and fair, but also help us flourish as human beings ” [33]. However,
this approach requires additional emphasis on transparency and explainability of human-AI
interaction. Since humans stay in the process loop, understandable and meaningful cooperation
should be the key to success.</p>
    </sec>
    <sec id="sec-4">
      <title>3. Discrete AI vs. Continuous AI</title>
      <p>Within an amplifying humans vision of AI, we can distinguish AI as a tool (that enhances human
natural capabilities) or as a collaborator (that interacts with human and create fruitful synergy).
AI as a tool assumes that human explicitly uses the system to get (most probably) immediate
output, for instance a decision or a product. Consequently, interaction involving user input and
AI output occurs coherently in distinct stages, as is the case with, for example, conversational
agents, image recognition apps, AI writing support tools, etc. In these instances, AI systems
follow a sequential pattern: users initiate the process by issuing a command, which is then
interpreted by the system to generate a response. We call this type of interaction - Discrete AI.</p>
      <p>
        While human-centered XAI has been extensively studied in the HCI field in the last decades
[
        <xref ref-type="bibr" rid="ref14 ref17 ref18 ref8 ref9">34, 8, 35, 14, 9</xref>
        ], the big scope of the research has concentrated in the context of discrete AI
[
        <xref ref-type="bibr" rid="ref16">16</xref>
        ], i.e., decision-making in situ. At the same time, contemporary research must adapt to
increasingly diverse and dynamic usage scenarios, where, for instance, user input and machine
output seamlessly unfold in parallel [
        <xref ref-type="bibr" rid="ref19">36</xref>
        ]. That is, AI as an agent that collaborates (explicitly or
implicitly) with the human being for their needs. These scenarios encompass applications like
Trafic Management Systems, smart homes, AI-driven Investment Portfolios, Self-Driving Cars,
and Industrial robots. They are ”intermittent, continuous, and proactive” [
        <xref ref-type="bibr" rid="ref19">36</xref>
        ]. We call this type
of interaction - Continuous AI.
      </p>
      <p>
        Continuous AI is defined as ’the extended and seamless synergy between intelligent systems and
human users over extended periods of time’ [
        <xref ref-type="bibr" rid="ref20">37</xref>
        ]. This category of AI underscores the potential
of smart technology to provide support, assistance, and enhancement across various real-life
contexts, provided that we can ensure user interactions remain non-disruptive and do not
overburden cognitive resources. However, due to its proactiveness and continuous nature,
very soon this technology becomes unnoticeable, or in the terminology of [
        <xref ref-type="bibr" rid="ref21">38</xref>
        ], invisible. That
is, critical decision points are challenging to pinpoint, as the consequences of AI decisions
accumulate gradually, making it dificult to identify a clear ’point of no return.’ Therefore, on the
one hand, seamless continuous technology ofers benefits by simplifying tasks and alleviating
the user from cognitive load. Yet, on the other hand, it introduces a degree of opaqueness,
potentially leading to feelings of uncertainty and diminished autonomy. In this context, the
importance of XAI becomes even more pronounced.
      </p>
      <p>
        An in-depth examination reveals that current methods and guidelines, initially designed to
facilitate interactions with AI systems, often prove inadequate and occasionally
counterproductive when applied to continuous usage scenarios [
        <xref ref-type="bibr" rid="ref20">37</xref>
        ]. For instance, conventional evaluation
methods often rely on assessing compliance and reliance rates to gauge user interactions with AI
or automated systems [
        <xref ref-type="bibr" rid="ref22 ref23 ref24">39, 40, 41</xref>
        ]. However, this approach is most efective when interactions
can be modeled as a series of isolated, subsequent trials, allowing users to retrace AI decisions
to specific events. It is less suitable for continuous and parallel interactions. Furthermore,
designed feedback mechanisms sometimes conflict with the seamless nature of continuous AI.
In continuous AI, the technology aims to operate on the background to achieve its objectives,
as in the example of Attention Management Systems (AMS) - technology that intelligently
postpones user’s notifications based on human’s cognitive load to cope with disruptions [
        <xref ref-type="bibr" rid="ref25 ref26">42, 43</xref>
        ].
If the AMS always reaches the user with information explaining delayed notification, there will
be no meaning in this system as it interrupts the user by trying to intelligently delay message.
As a result, there is a pressing need to develop fresh guidelines and evaluation methods tailored
to the description and assessment of Continuous AI scenarios.
      </p>
    </sec>
    <sec id="sec-5">
      <title>4. ”User as an agent” vs. ”User as an object”</title>
      <p>
        Guerrero et al. define the concept of augmented humanity as ”a human–computer integration
technology that proposes to improve capacity and productivity by changing or increasing the normal
ranges of human function through the restoration or extension of human physical, intellectual and
social capabilities” [
        <xref ref-type="bibr" rid="ref27">44</xref>
        ]. Unfortunately, in this definition, the grade of intrusion, i.e., whether
the restoration/extension of human capabilities realised within one’s body or through
humancomputer synergy, is not defined. Still, within the realm of our discussion, it is more relevant to
diferentiate the level of efect on human agency rather than embodied vs. extended nature in
the expression human-computer integration.
      </p>
      <p>
        Numerous discussions on human-machine interactions revolve around a balanced and explicit
partnership between an agent and a human. That is, technology serves a specific function to
assist in reaching the user’s goal, predominantly concentrated on data detached from the actor
(e.g., [
        <xref ref-type="bibr" rid="ref28">45</xref>
        ]). In other words, a human represents an actor, (in most cases) an equal contributor to
the interaction process, whether AI-system is a writing assistant that shapes the typed text for
the industry standard, or an industrial robot that partners with the human in the manufacture.
      </p>
      <p>
        When the user becomes the object of AI work in the context of self-augmentation, additional
challenges come to the fore. Notably, psychological nuances related to self-manipulation and
its acceptance factors become a central issue (see studies [
        <xref ref-type="bibr" rid="ref29 ref30">46, 47</xref>
        ]). For instance, the level
of intrusiveness is higher in using exoskeleton than cooperating with the robot in industrial
environment. When passing the decision about one’s own life to AI, concerns related to ensuring
AI’s transparency and alignment with desired needs and objectives rise up. Moreover, even if the
tasks of AI are aligned with our initial goals, are these goals still in place after our ”modification”?
We probably do not have that strong need to understand how or why the smart house changes
the temperature in rooms and starts self-cleaning at a specific time. As long as it works and
we do not freeze at home, it still makes our life easier, and that is what appears to matter most.
However, when it comes to manipulation of our own state, bigger questions arise. Within the
Discrete AI block, i.e., when the process of user input and AI output is sequential and each
request is initiated by human, individual has at least some control on technological influence
(that is, can trace one step back of where the result came from). While with Continuous AI, the
complexity of the technological integration make it dificult to assess the impact. According
to De Greef et al., the combination of increased complexity and undesirable machine behavior
should be considered a major risk [
        <xref ref-type="bibr" rid="ref31">48</xref>
        ]. If the AI wrongly concludes which support or when is
needed (or not needed), the potential benefits of adaptive automation turn into risks, elevated
by the hidden nature of this augmentation (see more on the topic of AI alignment [49]). The
examples here are a personalized news feed in social media that shows us specific news [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ],
an intelligent sleep app that sends us to bed at a particular time and adjusts our sleeping
environment [50], or a smart habit-tracker that strategically manipulates what and how we
have to do [51].
      </p>
      <p>Additionally, some scholars divide human augmentation by facets of human capabilities,
whether it is augmented senses (aka enhanced senses, extended senses), augmented action (e.g.,
motor augmentation, amplified force, and movement, speech input, etc.) or augmented cognition
(by detecting human cognitive state, using analytical tools to make a correct interpretation)
[52]. Within this division, the biggest shift in human agency is the last one — augmented
cognition. The principle of augmented cognition describes the symbolic human-AI integration
in a closed-loop system, where the system is designed to recognize the individual’s mental state
and the environmental context [53]. Thus, AI assistants could operate on behalf of humans,
based on their habits and preferences, proactively handling diferent types of tasks.</p>
      <p>An instance of this nuanced interaction is found in Attention Management Systems (AMS),
which seamlessly operate in the background, collecting data from diverse sensors and gradually
influencing user behavior and interactions over time. The question of human awareness of
constant intentional nudging is extremely relevant here. In this context, transparency involves
communicating the simple presence or activation of technology, questioning whether it has
already initiated a process or if we are still in an unaltered environment.</p>
      <p>It brings to the table the clear tension between smart and invisible versus transparent and
understandable technology. How can we find a balance between the seamless nature of the
continuous AI technology and keeping human in the loop of decision-making? How can
we control that the user still wants this technology and measure whether the system’s goals
continue to align with the user’s needs? What should be the explainability form of continuous
human-AI interaction for supporting trust and reliance in human augmentation? These are the
open questions that the modern research in XAI should aim to solve.</p>
    </sec>
    <sec id="sec-6">
      <title>5. Conclusion</title>
      <p>In this position paper, we made an attempt to chart AI systems through the lens of HCI
explainability research. By identifying three dimensions — relations with humans, interaction
complexity, and the object of application — we underscored the inadequacy of universal
explainability guidelines, particularly for seamless, continuous, and proactive AI systems oriented
towards self-augmentation. Consequently, we send out a call for the development of new
guidelines and evaluation methods specifically crafted to suit the characteristics of diferent AI
blocks.</p>
      <p>Based on our exploration and the statements above, we provide a list of the most pressing
research questions around Explainable AI research that must be addressed to advance the field
efectively:
• Addressing the Gap in Continuous AI for Self-Augmentation: Highlighting the
need for focused research on the specific challenges posed by Continuous AI technologies
designed for self-augmentation, such as ensuring transparency and user control in highly
integrated and proactive systems, to balance the benefits of seamless interaction with the
necessity of maintaining individuals’ autonomy.
• Development of XAI Techniques for Continuous AI Systems: Establishing new
methods group to enhance transparency and human control in continuous AI presence,
ensuring explanations are comprehensible without abusing limited users’ attention.
• Enhancing Human-AI Collaboration &amp; AI Alignment: Identifying ways to improve
human-AI collaboration to augment human capabilities efectively, focusing on
empowering individuals, preserving autonomy and ensuring the system still works in line with
human needs.
• Development of New Guidelines and Evaluation Methods: Creating flexible
guidelines and evaluation methods that can accurately assess the efectiveness as well as
potential biases in explainability across varied and evolving usage scenarios in
Continuous AI for self-augmentation.
• Ethical Implications of Human-Augmentation AI Systems: Addressing the ethical
considerations of AI systems that act as agents of human augmentation, with particular
attention to the questions of free will, autonomy and consent, ensuring these technologies,
at minimum, avoid misleading and are developed responsibly.
fusion 58 (2020) 82–115.
[17] S. Diefenbach, L. Christoforakos, D. Ullrich, A. Butz, Invisible but understandable: In
search of the sweet spot between technology invisibility and transparency in smart spaces
and beyond, Multimodal Technologies and Interaction 6 (2022) 95.
[18] T. B. Sheridan, W. L. Verplank, T. Brooks, Human/computer control of undersea
teleoperators, in: NASA. Ames Res. Center The 14th Ann. Conf. on Manual Control, 1978.
[19] M. R. Endsley, From here to autonomy: lessons learned from human–automation research,</p>
      <p>Human factors 59 (2017) 5–27.
[20] B. Shneiderman, Human-centered artificial intelligence: Reliable, safe &amp; trustworthy,</p>
      <p>International Journal of Human–Computer Interaction 36 (2020) 495–504.
[21] A. Fügener, J. Grahl, A. Gupta, W. Ketter, Cognitive challenges in human–artificial
intelligence collaboration: Investigating the path toward productive delegation, Information
Systems Research 33 (2022) 678–696.
[22] V. Trianni, A. G. Nuzzolese, J. Porciello, R. H. Kurvers, S. M. Herzog, G. Barabucci,
A. Berditchevskaia, F. Fung, Hybrid collective intelligence for decision support in complex
open-ended domains, in: HHAI 2023: Augmenting Human Intellect, IOS Press, 2023, pp.
124–137.
[23] N. Emaminejad, R. Akhavian, Trustworthy ai and robotics: Implications for the aec
industry, Automation in Construction 139 (2022) 104298.
[24] T. B. Sheridan, T. B. Sheridan, K. Maschinenbauingenieur, T. B. Sheridan, T. B. Sheridan,
Humans and automation: System design and research issues, volume 280, Human Factors
and Ergonomics Society Santa Monica, CA, 2002.
[25] K. A. Hof, M. Bashir, Trust in automation: Integrating empirical evidence on factors that
influence trust, Human factors 57 (2015) 407–434.
[26] D. H. Autor, F. Levy, R. J. Murnane, The skill content of recent technological change: An
empirical exploration, The Quarterly journal of economics 118 (2003) 1279–1333.
[27] E. Brynjolfsson, T. Mitchell, D. Rock, What can machines learn and what does it mean for
occupations and the economy?, in: AEA papers and proceedings, volume 108, American
Economic Association 2014 Broadway, Suite 305, Nashville, TN 37203, 2018, pp. 43–47.
[28] I. Roll, E. S. Wiese, Y. Long, V. Aleven, K. R. Koedinger, Tutoring self-and co-regulation
with intelligent tutoring systems to help students acquire better learning skills, Design
recommendations for intelligent tutoring systems 2 (2014) 169–182.
[29] D. Wang, A. Khosla, R. Gargeya, H. Irshad, A. H. Beck, Deep learning for identifying
metastatic breast cancer, arXiv preprint arXiv:1606.05718 (2016).
[30] A. Jaiswal, C. J. Arun, A. Varma, Rebooting employees: Upskilling for artificial intelligence
in multinational corporations, The International Journal of Human Resource Management
33 (2022) 1179–1208.
[31] M. Xia, Co-working with ai is a double-sword in technostress? an integrative review of
human-ai collaboration from a holistic process of technostress, in: SHS Web of Conferences,
volume 155, EDP Sciences, 2023, p. 03022.
[32] A. Zirar, Can artificial intelligence’s limitations drive innovative work behaviour?, Review
of Managerial Science (2023) 1–30.
[33] H. Dhiman, C. Wächter, M. Fellmann, C. Röcker, Intelligent assistants: Conceptual
dimensions, contextual model, and design trends, Business &amp; Information Systems Engineering
the symbiotic relation between man and machine, in: Foundations of Augmented
Cognition: Third International Conference, FAC 2007, Held as Part of HCI International 2007,
Beijing, China, July 22-27, 2007. Proceedings 3, Springer, 2007, pp. 439–448.
[49] I. Gabriel, Artificial intelligence, values, and alignment, Minds and machines 30 (2020)
411–437.
[50] N. F. Watson, C. R. Fernandez, Artificial intelligence and sleep: Advancing sleep medicine,</p>
      <p>Sleep medicine reviews 59 (2021) 101512.
[51] W. C. Xuan, P. Keikhosrokiani, Habitpad: A habit-change person-centric healthcare mobile
application with machine leaning and gamification features for obesity, in: Enabling
PersonCentric Healthcare Using Ambient Assistive Technology: Personalized and Patient-Centric
Healthcare Services in AAT, Springer, 2023, pp. 27–56.
[52] R. Raisamo, I. Rakkolainen, P. Majaranta, K. Salminen, J. Rantala, A. Farooq, Human
augmentation: Past, present and future, International Journal of Human-Computer Studies
131 (2019) 131–143.
[53] A. A. Kruse, D. D. Schmorrow, Session overview: Foundations of augmented cognition,
Foundations of augmented cognition (2005) 441–445.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>S.</given-names>
            <surname>Wei</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Huang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zou</surname>
          </string-name>
          ,
          <article-title>Exploring the application of artificial intelligence in sports training: a case study approach</article-title>
          ,
          <year>Complexity 2021</year>
          (
          <year>2021</year>
          )
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>B.</given-names>
            <surname>Stoel</surname>
          </string-name>
          ,
          <article-title>Use of artificial intelligence in imaging in rheumatology-current status and future perspectives</article-title>
          ,
          <source>RMD open 6</source>
          (
          <year>2020</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>R.</given-names>
            <surname>Rathi</surname>
          </string-name>
          ,
          <article-title>Efect of cambridge analytica's facebook ads on the 2016 us presidential election, Towards Data Science (</article-title>
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Q.</given-names>
            <surname>André</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Carmon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Wertenbroch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Crum</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Frank</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W.</given-names>
            <surname>Goldstein</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Huber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. Van</given-names>
            <surname>Boven</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Weber</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <article-title>Consumer choice and autonomy in the age of artiifcial intelligence and big data</article-title>
          ,
          <source>Customer needs and solutions 5</source>
          (
          <year>2018</year>
          )
          <fpage>28</fpage>
          -
          <lpage>37</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>E.</given-names>
            <surname>Stamboliev</surname>
          </string-name>
          ,
          <article-title>Proposing a postcritical ai literacy: Why we should worry less about algorithmic transparency and more about citizen empowerment</article-title>
          ,
          <source>Media Theory</source>
          <volume>7</volume>
          (
          <year>2023</year>
          )
          <fpage>202</fpage>
          -
          <lpage>232</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>I.</given-names>
            <surname>Rudko</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. Bashirpour</given-names>
            <surname>Bonab</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Bellini</surname>
          </string-name>
          ,
          <article-title>Organizational structure and artificial intelligence. modeling the intraorganizational response to the ai contingency</article-title>
          ,
          <source>Journal of Theoretical and Applied Electronic Commerce Research</source>
          <volume>16</volume>
          (
          <year>2021</year>
          )
          <fpage>2341</fpage>
          -
          <lpage>2364</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>G.</given-names>
            <surname>Vilone</surname>
          </string-name>
          , L. Longo,
          <article-title>Notions of explainability and evaluation approaches for explainable artificial intelligence</article-title>
          ,
          <source>Information Fusion</source>
          <volume>76</volume>
          (
          <year>2021</year>
          )
          <fpage>89</fpage>
          -
          <lpage>106</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>D.</given-names>
            <surname>Gunning</surname>
          </string-name>
          , D. Aha,
          <article-title>Darpa's explainable artificial intelligence (xai) program</article-title>
          ,
          <source>AI</source>
          magazine
          <volume>40</volume>
          (
          <year>2019</year>
          )
          <fpage>44</fpage>
          -
          <lpage>58</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>A.</given-names>
            <surname>Abdul</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Vermeulen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. Y.</given-names>
            <surname>Lim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kankanhalli</surname>
          </string-name>
          ,
          <article-title>Trends and trajectories for explainable, accountable and intelligible systems: An hci research agenda</article-title>
          ,
          <source>in: Proceedings of the 2018 CHI conference on human factors in computing systems</source>
          ,
          <year>2018</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>18</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>D. W.</given-names>
            <surname>Hasling</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. J.</given-names>
            <surname>Clancey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. D.</given-names>
            <surname>Rennels</surname>
          </string-name>
          ,
          <article-title>Strategic explanations for a diagnostic consultation system</article-title>
          ,
          <source>Int. J. Man Mach. Stud</source>
          .
          <volume>20</volume>
          (
          <year>1983</year>
          )
          <fpage>3</fpage>
          -
          <lpage>19</lpage>
          . URL: https://api.semanticscholar. org/CorpusID:15924245.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>W. R.</given-names>
            <surname>Swartout</surname>
          </string-name>
          ,
          <article-title>Explaining and justifying expert consulting programs</article-title>
          ,
          <source>in: Computerassisted medical decision making</source>
          , Springer,
          <year>1985</year>
          , pp.
          <fpage>254</fpage>
          -
          <lpage>271</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>A. C.</given-names>
            <surname>Scott</surname>
          </string-name>
          ,
          <string-name>
            <given-names>W. J.</given-names>
            <surname>Clancey</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Davis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. H.</given-names>
            <surname>Shortlife</surname>
          </string-name>
          ,
          <article-title>Explanation capabilities of productionbased consultation systems</article-title>
          ,
          <source>American Journal of Computational Linguistics</source>
          (
          <year>1977</year>
          )
          <fpage>1</fpage>
          -
          <lpage>50</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>U.</given-names>
            <surname>Ehsan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q. V.</given-names>
            <surname>Liao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Muller</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. O.</given-names>
            <surname>Riedl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. D.</given-names>
            <surname>Weisz</surname>
          </string-name>
          ,
          <article-title>Expanding explainability: Towards social transparency in ai systems</article-title>
          ,
          <source>in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>19</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>U.</given-names>
            <surname>Ehsan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Wintersberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Q. V.</given-names>
            <surname>Liao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Watkins</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Manger</surname>
          </string-name>
          , H.
          <string-name>
            <surname>Daumé</surname>
            <given-names>III</given-names>
          </string-name>
          ,
          <string-name>
            <surname>A. Riener</surname>
            ,
            <given-names>M. O.</given-names>
          </string-name>
          <string-name>
            <surname>Riedl</surname>
          </string-name>
          ,
          <article-title>Human-centered explainable ai (hcxai): beyond opening the black-box of ai, in: CHI conference on human factors in computing systems extended abstracts</article-title>
          ,
          <year>2022</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>7</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>D.</given-names>
            <surname>Long</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Magerko</surname>
          </string-name>
          ,
          <article-title>What is ai literacy? competencies and design considerations</article-title>
          ,
          <source>in: Proceedings of the 2020 CHI conference on human factors in computing systems</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>A. B. Arrieta</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          <string-name>
            <surname>Díaz-Rodríguez</surname>
            ,
            <given-names>J. Del</given-names>
          </string-name>
          <string-name>
            <surname>Ser</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Bennetot</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Tabik</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          <string-name>
            <surname>Barbado</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>García</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Gil-López</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          <string-name>
            <surname>Molina</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          <string-name>
            <surname>Benjamins</surname>
          </string-name>
          , et al.,
          <article-title>Explainable artificial intelligence (xai): Concepts, taxonomies, opportunities and challenges toward responsible ai</article-title>
          ,
          <source>Information</source>
          <volume>64</volume>
          (
          <year>2022</year>
          )
          <fpage>645</fpage>
          -
          <lpage>665</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [34]
          <string-name>
            <given-names>M.</given-names>
            <surname>Nazar</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. M. Alam</surname>
          </string-name>
          , E. Yafi,
          <string-name>
            <surname>M. M. Su</surname>
          </string-name>
          <article-title>'ud, A systematic review of human-computer interaction and explainable artificial intelligence in healthcare with artificial intelligence techniques</article-title>
          ,
          <source>IEEE Access 9</source>
          (
          <year>2021</year>
          )
          <fpage>153316</fpage>
          -
          <lpage>153348</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [35]
          <string-name>
            <given-names>S.</given-names>
            <surname>Brdnik</surname>
          </string-name>
          ,
          <article-title>Gui design patterns for improving the hci in explainable artificial intelligence</article-title>
          ,
          <source>in: Companion Proceedings of the 28th International Conference on Intelligent User Interfaces</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>240</fpage>
          -
          <lpage>242</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [36]
          <string-name>
            <given-names>N. Van</given-names>
            <surname>Berkel</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. B. Skov</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Kjeldskov</surname>
          </string-name>
          ,
          <article-title>Human-ai interaction: intermittent, continuous, and proactive</article-title>
          ,
          <source>Interactions</source>
          <volume>28</volume>
          (
          <year>2021</year>
          )
          <fpage>67</fpage>
          -
          <lpage>71</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          [37]
          <string-name>
            <given-names>P.</given-names>
            <surname>Wintersberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N. Van</given-names>
            <surname>Berkel</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Fereydooni</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Tag</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. L.</given-names>
            <surname>Glassman</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Buschek</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Blandford</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Michahelles</surname>
          </string-name>
          ,
          <article-title>Designing for continuous interaction with artificial intelligence systems</article-title>
          ,
          <source>in: CHI Conference on Human Factors in Computing Systems Extended Abstracts</source>
          ,
          <year>2022</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>4</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [38]
          <string-name>
            <given-names>C. O.</given-names>
            <surname>Alm</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Alvarez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Font</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Liapis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Pederson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Salo</surname>
          </string-name>
          ,
          <article-title>Invisible ai-driven hci systemswhen, why and how</article-title>
          ,
          <source>in: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>3</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [39]
          <string-name>
            <given-names>B. E.</given-names>
            <surname>Holthausen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Wintersberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B. N.</given-names>
            <surname>Walker</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Riener</surname>
          </string-name>
          ,
          <article-title>Situational trust scale for automated driving (sts-ad): Development and initial validation</article-title>
          ,
          <source>in: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications</source>
          ,
          <year>2020</year>
          , pp.
          <fpage>40</fpage>
          -
          <lpage>47</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [40]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Lu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Yin</surname>
          </string-name>
          ,
          <article-title>Human reliance on machine learning models when performance feedback is limited: Heuristics and risks</article-title>
          ,
          <source>in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2021</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [41]
          <string-name>
            <given-names>D.</given-names>
            <surname>Keller</surname>
          </string-name>
          , S. Rice,
          <article-title>System-wide versus component-specific trust using multiple aids</article-title>
          ,
          <source>The Journal of General Psychology: Experimental, Psychological, and Comparative Psychology</source>
          <volume>137</volume>
          (
          <year>2009</year>
          )
          <fpage>114</fpage>
          -
          <lpage>128</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [42]
          <string-name>
            <given-names>R.</given-names>
            <surname>Vertegaal</surname>
          </string-name>
          , et al.,
          <article-title>Attentive user interfaces</article-title>
          ,
          <source>Communications of the ACM</source>
          <volume>46</volume>
          (
          <year>2003</year>
          )
          <fpage>30</fpage>
          -
          <lpage>33</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [43]
          <string-name>
            <surname>C. Anderson</surname>
            ,
            <given-names>I. Hübener</given-names>
          </string-name>
          ,
          <string-name>
            <surname>A.-K. Seipp</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Ohly</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          <string-name>
            <surname>David</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          <string-name>
            <surname>Pejovic</surname>
          </string-name>
          ,
          <article-title>A survey of attention management systems in ubiquitous computing environments</article-title>
          ,
          <source>Proc. ACM Interact. Mob. Wearable Ubiquitous Technol</source>
          .
          <volume>2</volume>
          (
          <year>2018</year>
          ). URL: https://doi.org/10.1145/3214261. doi:
          <volume>10</volume>
          .1145/ 3214261.
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [44]
          <string-name>
            <given-names>G.</given-names>
            <surname>Guerrero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. J. M.</given-names>
            da
            <surname>Silva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fernández-Caballero</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Pereira</surname>
          </string-name>
          ,
          <article-title>Augmented humanity: a systematic mapping review</article-title>
          ,
          <source>Sensors</source>
          <volume>22</volume>
          (
          <year>2022</year>
          )
          <fpage>514</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [45]
          <string-name>
            <given-names>S. S.</given-names>
            <surname>Kim</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. A.</given-names>
            <surname>Watkins</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Russakovsky</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Fong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Monroy-Hernández</surname>
          </string-name>
          ,
          <article-title>” help me help the ai”: Understanding how explainability can support human-ai interaction</article-title>
          ,
          <source>in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [46]
          <string-name>
            <given-names>S.</given-names>
            <surname>Villa</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Niess</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Nakao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Lazar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schmidt</surname>
          </string-name>
          , T.
          <article-title>-K. Machulla, Understanding perception of human augmentation: A mixed-method study</article-title>
          ,
          <source>in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>16</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [47]
          <string-name>
            <given-names>D.</given-names>
            <surname>Talypova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Lingler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Wintersberger</surname>
          </string-name>
          ,
          <article-title>User-centered investigation of features for attention management systems in an online vignette study</article-title>
          ,
          <source>in: Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia</source>
          ,
          <year>2023</year>
          , pp.
          <fpage>108</fpage>
          -
          <lpage>121</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref31">
        <mixed-citation>
          [48]
          <string-name>
            <surname>T. De Greef</surname>
          </string-name>
          , K. van
          <string-name>
            <surname>Dongen</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          <string-name>
            <surname>Grootjen</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Lindenberg</surname>
          </string-name>
          , Augmenting cognition: reviewing
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>