<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>March</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>ExSS-ATEC: Explainable Smart Systems and Algorithmic Transparency in Emerging Technologies 2020</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Alison Smith-Renner</string-name>
          <email>alison.renner@dac.us</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tsvi Kuflik</string-name>
          <email>tsvikak@is.haifa.ac.il</email>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Advait Sarkar</string-name>
          <email>advait@microsoft.com</email>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Styliani Kleanthous</string-name>
          <email>styliani.kleanthous@gmail.com</email>
          <xref ref-type="aff" rid="aff6">6</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Simone Stumpf</string-name>
          <email>simone.stumpf.1@city.ac.uk</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Casey Dugan</string-name>
          <email>cadugan@us.ibm.com</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Brian Lim</string-name>
          <email>brianlim@com.nus.edu.sg</email>
          <xref ref-type="aff" rid="aff4">4</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jahna Oterbacher</string-name>
          <email>jahna.oetrbacher@me.com</email>
          <xref ref-type="aff" rid="aff5">5</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Avital Shulner</string-name>
          <email>avitalshulner@gmail.com</email>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>City, University of London</institution>
          ,
          <addr-line>London</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Decisive Analytics Corporation</institution>
          ,
          <addr-line>Arlington, VA</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>IBM Research</institution>
          ,
          <addr-line>Cambridge, MA</addr-line>
          ,
          <country country="US">US</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Microsoft Research</institution>
          ,
          <addr-line>Cambridge</addr-line>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>National University of Singapore</institution>
          ,
          <country country="SG">Singapore</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>OUC &amp; Rise Research Centre</institution>
          ,
          <addr-line>Nicosia</addr-line>
          ,
          <country country="CY">Cyprus</country>
        </aff>
        <aff id="aff6">
          <label>6</label>
          <institution>OUC &amp; Rise Research Centre</institution>
          ,
          <addr-line>Nicosia, Cyrpus</addr-line>
        </aff>
        <aff id="aff7">
          <label>7</label>
          <institution>University of Haifa</institution>
          ,
          <addr-line>Haifa</addr-line>
          ,
          <country country="IL">Israel</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <volume>17</volume>
      <issue>2020</issue>
      <abstract>
        <p>Smart systems that apply complex reasoning to make decisions and plan behavior, such as decision support systems and personalized recommendations, are difficult for users to understand. Algorithms allow the exploitation of rich and varied data sources, in order to support human decision-making and/or taking direct actions; however, there are increasing concerns surrounding their transparency and accountability, as these processes are typically opaque to the user. Transparency and accountability have attracted increasing interest to provide more effective system training, better reliability and improved usability. This workshop will provide a venue for exploring issues that arise in designing, developing and evaluating intelligent user interfaces that provide system transparency or explanations of their behavior. In addition, our goal is to focus on approaches to mitigate algorithmic biases that can be applied by researchers, even without access to a given system's inter-workings, such as awareness, data provenance, and validation.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Explanations</kwd>
        <kwd>visualizations</kwd>
        <kwd>machine learning</kwd>
        <kwd>intelligent systems</kwd>
        <kwd>intelligibility</kwd>
        <kwd>transparency</kwd>
        <kwd>fairness</kwd>
        <kwd>accountability</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>CCS CONCEPTS</title>
      <p>• Human-centered computing~Human computer
interaction (HCI)~Interactive systems and tools • Computing
methodologies~Machine learning • Computing
methodologies~Artificial intelligence</p>
    </sec>
    <sec id="sec-2">
      <title>1 Background</title>
      <p>
        Smart systems that apply complex reasoning to make decisions and
plan behavior, such as clinical decision support systems,
personalized recommendations, home automation, machine
learning classifiers, robots and autonomous vehicles, are difficult for
a user to understand [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. Fairness, accountability and transparency
are currently hotly discussed aspects of machine learning systems,
especially for deep learning systems that are seen to be very difficult
to explain to users. Textual explanations and graphical
visualizations are often provided by a system to give users insight
into what the systems is doing and why it is doing it [
        <xref ref-type="bibr" rid="ref3 ref4 ref5 ref6">3–6</xref>
        ] and work
is starting to investigate how to best engage in transparency design
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. However, there are still numerous issues and problems
regarding explanations and algorithm transparency that demand
further attention, such as how can we build (better) explanations or
transparent systems, what should be included in an explanation and
how should they be presented, when should explanations be
deployed, or when do they detract from the user experience, how
can transparency expose biases in data or algorithmic processes,
and how can we evaluate explanations or system transparency,
especially from a user perspective.
      </p>
      <p>The ExSS-ATEC 2020 workshop brings together academia
and industry together to address these issues. This workshop is a
follow-on from the ExSS 2018 and 2019 workshops in combination
with the ATEC 2019 workshop previously held at IUI. This
workshop includes a keynote, paper panels, and group activities,
with the goal of developing concrete approaches to handling
challenges related to the design and development of explanations
and system transparency. ExSS-ATEC 2020 is supported by the
Cyprus Center for Algorithm Transparency (CyCAT).
2</p>
    </sec>
    <sec id="sec-3">
      <title>Workshop Overview</title>
      <p>The workshop keynote is Dr. Carrie Cai, focusing on current
challenges for explainable smart systems. Nine accepted papers are
presented as three themed panel sessions. Accepted papers are:
• Jung et al. “Transparency of Data and Algorithms in a Persona</p>
      <p>System: Explaining Data-Driven Personas to End Users”
• Dodge and Burnett, “Position: We Can Measure XAI</p>
      <p>Explanations Better with ‘Templates’”
• Hepenstal et al., “What Are You Thinking? Explaining</p>
      <p>Conversational Agent Responses for Criminal Investigations”
• Stockdill et al., “Cross-Domain Correspondences for</p>
      <p>Explainable Recommendations”
• Lindvall and Molin, “Verification Staircase: A Design Strategy
for Actionable Explanations”
• Larasati et al., “The Effects of Explanation Styles on Users’</p>
      <p>Trust”
• Ferreira and Monteiro, “Do ML Experts Discuss Explainability
for AI Systems? A Discussion Case in the Industry for a
Domain-Specific Solution”
• Zürn et al., “What If? Interaction with Recommendations”
• Chromik and Schuessler, “A Taxonomy for Human Subject</p>
      <p>Evaluation of Black-Box Explanations in XAI”
The second part of the workshop is structured around hands-on
activity sessions in small subgroups of 3-5 participants.</p>
    </sec>
    <sec id="sec-4">
      <title>3 Key People 3.1</title>
    </sec>
    <sec id="sec-5">
      <title>Keynote Speaker</title>
      <p>Dr. Carrie Cai is a senior research scientist at Google Brain and
PAIR (Google’s People+AI Research Initiative). Her research aims
to make human-AI interactions more productive and enjoyable to
end-users, ranging from novel tools to help doctors steer AI
cancerdiagnostic systems in real-time, to frameworks for effectively
onboarding end-users to AI assistants. Her work has been published
in HCI venues such as CHI, IUI, CSCW, and VL/HCC, receiving 4
best paper / honorable mention awards and profiled on TechCrunch
and the Boston Globe. Before joining Google, Carrie completed her
PhD in computer science at MIT, where she created intelligent
waitlearning systems to help people accomplish long-term goals in short
chunks while waiting. Carrie first learned to program at age 24,
after having completed undergraduate degrees in human biology
and education at Stanford. She feels that it’s never too late to learn
machine learning, and that some of the world’s best AI innovations
come from the humanities powered by computing.
3.1</p>
    </sec>
    <sec id="sec-6">
      <title>Workshop Committee</title>
      <p>The workshop committee includes Gagan Bansal (UW), Veronika
Bogina (Haifa University), Robin Burke (UC Boulder), Jonathan
Dodge (OSU), Fan Du (Adobe), Malin Eiband (LMU), Michael
Ekstrand (Boise State), Melinda Gervasio (SRI), Fausto Giunchiglia
(U Toronto), Alan Hartman (Afeka), Judy Kay (U Sydney), Bran
Knowles (U Lancaster), Todd Kulesza (Google), Tak Lee (Adobe),
Loizos Michael (Cyprus), Shabnam Najafan (Delft), Alicja
Piotrkowicz (U Leeds), Forough Poursabzi-Sangdeh (Microsoft),
Gonazalo Ramos (MSR), Stephanie Rosenthal (CMU), Martin
Schuessler (TU Berlin), Ramya Srinivasan (Fujitsu), Mike Terry
(Google), Sarah Völkel (U Munich), and Jürgen Ziegler (U
Duisburg).
3.1</p>
    </sec>
    <sec id="sec-7">
      <title>Workshop Organizers</title>
      <p>The workshop organizing committee includes: Alison
SmithRenner, Director of the Machine Learning Visualization Lab for
Decisive Analytics Corporation and PhD Candidate at University of
Maryland, College Park; Dr. Styliani Kelanthous, senior
researcher in the Faculty of Pure and Applied Sciences at Open
University of Cyprus and RISE Research Centre, Cyprus; Dr. Brian
Lim, Assistant Professor in the Department of Computer Science at
the National University of Singapore, Prof. Tsvi Kuflik, professor
and former head of the Information Systems Department at the
University of Haifa, Israel; Dr. Simone Stumpf, Senior Lecturer
at City, University of London, Jahna Otterbacher, founder of the
Behavioral &amp; Language Traces research lab, which is housed in the
Faculty of Pure and Applied Sciences, Open University of Cyprus;
Dr. Advait Sarkar, senior researcher at Microsoft Research in
Cambridge (UK); Casey Dugan, manager of the AI Experience
Team at IBM Research Cambridge (MA, USA); and Avital
Shulner, PhD student in the Information Systems Department at
the University of Haifa, Israel.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Malin</given-names>
            <surname>Eiband</surname>
          </string-name>
          , Hanna Schneider,
          <string-name>
            <given-names>Mark</given-names>
            <surname>Bilandzic</surname>
          </string-name>
          , Julian Fazekas-Con,
          <string-name>
            <given-names>Mareike</given-names>
            <surname>Haug</surname>
          </string-name>
          , and
          <string-name>
            <given-names>Heinrich</given-names>
            <surname>Hussmann</surname>
          </string-name>
          .
          <year>2018</year>
          .
          <article-title>Bringing Transparency Design into Practice</article-title>
          .
          <source>In Proceedings of the 2018 Conference on Human InformationInteraction&amp;Retrieval</source>
          . https://doi.org/10.1145/3172944.3172961
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Alyssa</given-names>
            <surname>Glass</surname>
          </string-name>
          , Deborah L.
          <string-name>
            <surname>McGuinness</surname>
            ,
            <given-names>and Michael</given-names>
          </string-name>
          <string-name>
            <surname>Wolverton</surname>
          </string-name>
          .
          <year>2008</year>
          .
          <article-title>Toward establishing trust in adaptive agents</article-title>
          .
          <source>In Proceedings of the 13th international conference on Intelligent user interfaces - IUI '08</source>
          , 227. https://doi.org/10.1145/1378773.1378804
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Jonathan</surname>
            <given-names>L.</given-names>
          </string-name>
          <string-name>
            <surname>Herlocker</surname>
          </string-name>
          , Joseph A.
          <string-name>
            <surname>Konstan</surname>
            ,
            <given-names>and John</given-names>
          </string-name>
          <string-name>
            <surname>Riedl</surname>
          </string-name>
          .
          <year>2000</year>
          .
          <article-title>Explaining collaborative filtering recommendations</article-title>
          .
          <source>In ACM Conference on Computer Supported Cooperative Work (CSCW)</source>
          ,
          <fpage>241</fpage>
          -
          <lpage>250</lpage>
          . https://doi.org/10.1145/358916.358995
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Carmen</given-names>
            <surname>Lacave</surname>
          </string-name>
          and Francisco J. Díez.
          <year>2002</year>
          .
          <article-title>A review of explanation methods for Bayesian networks</article-title>
          .
          <source>Knowledge Engineering Review</source>
          <volume>17</volume>
          ,
          <fpage>107</fpage>
          -
          <lpage>127</lpage>
          . https://doi.org/10.1017/S026988890200019X
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Pearl</given-names>
            <surname>Pu</surname>
          </string-name>
          and
          <string-name>
            <given-names>Li</given-names>
            <surname>Chen</surname>
          </string-name>
          .
          <year>2006</year>
          .
          <article-title>Trust building with explanation interfaces</article-title>
          .
          <source>In International conference on Intelligent User Interfaces (IUI)</source>
          ,
          <volume>93</volume>
          . https://doi.org/10.1145/1111449.1111475
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>William</given-names>
            <surname>Swartout</surname>
          </string-name>
          , Cecile Paris, and Johanna Moore.
          <year>1991</year>
          .
          <article-title>Explanations in knowledge systems: Design for Explainable Expert Systems</article-title>
          .
          <source>IEEE Expert 6</source>
          ,
          <issue>3</issue>
          :
          <fpage>58</fpage>
          -
          <lpage>64</lpage>
          . https://doi.org/10.1109/64.87686
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>