<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Workshop on Human-Interpretable AI</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Francesco Giannini Scuola Normale Superiore Pisa</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Italy</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>CCS Concepts</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
          <xref ref-type="aff" rid="aff4">4</xref>
          <xref ref-type="aff" rid="aff5">5</xref>
          <xref ref-type="aff" rid="aff6">6</xref>
          <xref ref-type="aff" rid="aff7">7</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Damien Garreau Julius-Maximilians-Universität Würzburg Würzburg</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Gabriele Ciravegna Dipartimento di Automatica e Informatica</institution>
          ,
          <addr-line>Politecnico di Torino Torino</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Human-Interpretable AI</institution>
          ,
          <addr-line>Interpretability, Explainability, HI-AI, XAI</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Mateja Jamnik University of Cambridge Cambridge</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff4">
          <label>4</label>
          <institution>Mateo Espinoza Zarlenga University of Cambridge Cambridge</institution>
          ,
          <country country="UK">UK</country>
        </aff>
        <aff id="aff5">
          <label>5</label>
          <institution>Pietro Barbiero Università della Svizzera Italiana Lugano</institution>
          ,
          <country country="CH">Switzerland</country>
        </aff>
        <aff id="aff6">
          <label>6</label>
          <institution>Tania Cerquitelli Dipartimento di Automatica e Informatica</institution>
          ,
          <addr-line>Politecnico di Torino Torino</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
        <aff id="aff7">
          <label>7</label>
          <institution>Zoreh Shams University of Cambridge Cambridge</institution>
          ,
          <country country="UK">UK</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <abstract>
        <p>This workshop aims to spearhead research on Human-Interpretable Artificial Intelligence (HI-AI) by providing: (i) a general overview of the key aspects of HI-AI, in order to equip all researchers with the necessary background and set of definitions; (ii) novel and interesting ideas coming from both invited talks and top paper contributions; (iii) the chance to engage in dialogue with prominent scientists during poster presentations and cofee breaks. The workshop welcomes contributions covering novel interpretableby-design or post-hoc approaches, as well as theoretical analysis of existing works. Additionally, we accept visionary contributions speculating on the future potential of this field. Finally, we welcome contributions from related fields such as Ethical AI, Knowledgedriven Machine learning, Human-machine Interaction, applications in Medicine and Industry, and analyses from Regulatory experts. • Computing methodologies → Artificial intelligence .</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Human-interpretable AI models [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] are playing an increasingly
important role in Artificial Intelligence (AI). Today, a large part of
the technologies employed by AI and SIGKDD researchers is based
on Deep Neural Networks (DNNs). Yet, the lack of transparency of
DNNs prevents a safe deployment of these models in critical
contexts that significantly afect users. Consequently, decision-making
systems based on deep learning are facing constraints and
limitations from regulatory institutions [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], which increasingly demand
transparency in AI models [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Even though standard eXplainable
AI (XAI) emerged to address the need to interpret DNNs, several
works are arguing that it may not have achieved its goal [
        <xref ref-type="bibr" rid="ref4 ref5">4, 5</xref>
        ].
      </p>
      <p>
        To really explain DNN decision-making process, there is a
growing consensus that human-interpretable explanations are required.
Human-Interpretable AI (HI-AI) methods either provide post-hoc
explanations by extracting the symbols that have been
automatically learnt by the models (e.g., T-CAV [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]), or directly design
intrinsically interpretable architectures (e.g., CBM [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]). Among other
qualities, these explanations resemble better the way humans
reason and explain [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], help to detect model biases [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ], are more stable
to perturbations [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ], and can create more robust models [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Workshop Topics</title>
      <p>Topics of interest include, but are not limited to, the following:
• Explainable-by-design models, novel approaches to
creating machine learning and deep learning models that are
intrinsically explainable or interpretable.
• Post-hoc methods for Interpretable AI, novel approaches
on post-hoc interpretable AI. These include but are not
limited to approaches working on higher-level features such as
concepts.
• Theoretical analyses of existing methods, showing what
existing interpretable methods can achieve both from an
explanation and a generalization point of view.
• Knowledge integration &amp; Reasoning methods injecting
domain knowledge and reasoning methods into deep
learning models to enhance their interpretability and performance.
• AI Ethics papers analysing implications of interpretable AI
methods, discussing topics such as fairness, accountability,
transparency, and bias mitigation in AI systems.
• Human-machine Interaction studies on innovative
humanmachine interaction systems, successfully exploiting
interpretable AI models in their capability to provide both
standard and counter-factual explanations.
• Vision papers on XAI discussing the possible evolutions of
the XAI field or speculating potential interpretable system
and applications with their implications.
• Applications in Medicine and Healthcare applications
of interpretable AI methods in medical diagnosis, treatment
planning, and healthcare decision-making.
• AI in Industry practical applications of interpretable AI
methods in various safety-critical industrial sectors, such as
transportation, finance and retail.
• Legal and Regulatory dissertations discussing and
providing analysis of the legal challenges associated with
interpretable AI, including compliance with data protection laws
for transparent and accountable AI systems.</p>
      <p>Program Outline. Table 1 reports the workshop program. Firstly,
we will give an overview of the key aspects of HI-AI to ensure all
attendees have a solid understanding of the background concepts
and terminology. Secondly, the workshop features three invited
talks from experts in the field, who will share their insights and
latest research findings. These talks will provide valuable perspectives
and inspire new ideas. Thirdly, we will ofer participants the chance
to engage in dialogue with prominent scientists during a long cofee
break with poster presentations, encouraging collaborations and
knowledge-sharing. Also, the workshop program includes three
contributed talks from selected contributions. We will recognize the
most interesting contribution with a Best Workshop Paper Award.
We have allocated 40 minutes for each invited talk, allowing for a
30-minute presentation followed by a 10-minute Q&amp;A session. We
allotted the same time for the poster sessions.
4</p>
    </sec>
    <sec id="sec-3">
      <title>Paper Management</title>
      <p>Paper management. We published the Call For Papers (CFP) on
the workshop website1. The CFP focuses on short papers, which
can be research papers, theoretical analysis papers, or vision papers.</p>
      <p>In the case of research contributions, we asked paper authors to
make their code and data openly available to ensure reproducibility.
The review process has been double-blind. We have used
OpenReview to ensure the final decisions for each paper are made by the
organisers with no conflict of interest. All accepted papers will be
published on the workshop website, which will remain active and
accessible after the conference concludes. Additionally, we took
contact with an external editor (CEUR-WS) to create an archival
version of these papers for authors who wish to participate in a
subsequent publication.</p>
    </sec>
    <sec id="sec-4">
      <title>5 Program Commitee</title>
      <p>We are very grateful to each of our program committee members
for their hard reviewing work, namely Romain Giot, Eliana Pastor,
Roberto Pellungrini, Eleonora Poeta, Gianluigi Lopardo, and Gizem
Gezici, besides workshop chairs.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>Eleonora</given-names>
            <surname>Poeta</surname>
          </string-name>
          , Gabriele Ciravegna, Eliana Pastor, Tania Cerquitelli, and
          <string-name>
            <given-names>Elena</given-names>
            <surname>Baralis</surname>
          </string-name>
          .
          <article-title>Concept-based explainable artificial intelligence: A survey</article-title>
          .
          <source>arXiv preprint arXiv:2312.12936</source>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Bryce</given-names>
            <surname>Goodman</surname>
          </string-name>
          and
          <string-name>
            <given-names>Seth</given-names>
            <surname>Flaxman</surname>
          </string-name>
          .
          <article-title>European union regulations on algorithmic decision-making and a “right to explanation”</article-title>
          .
          <source>AI magazine</source>
          ,
          <volume>38</volume>
          (
          <issue>3</issue>
          ):
          <fpage>50</fpage>
          -
          <lpage>57</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>Johann</given-names>
            <surname>Laux</surname>
          </string-name>
          , Sandra Wachter, and
          <string-name>
            <given-names>Brent</given-names>
            <surname>Mittelstadt</surname>
          </string-name>
          .
          <article-title>Trustworthy artificial intelligence and the european union ai act: On the conflation of trustworthiness and acceptability of risk</article-title>
          .
          <source>Regulation &amp; Governance</source>
          ,
          <volume>18</volume>
          (
          <issue>1</issue>
          ):
          <fpage>3</fpage>
          -
          <lpage>32</lpage>
          ,
          <year>2024</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>Julius</given-names>
            <surname>Adebayo</surname>
          </string-name>
          , Justin Gilmer, Michael Muelly, Ian Goodfellow, Moritz Hardt, and
          <string-name>
            <given-names>Been</given-names>
            <surname>Kim</surname>
          </string-name>
          .
          <article-title>Sanity checks for saliency maps</article-title>
          .
          <source>Advances in neural information processing systems</source>
          ,
          <volume>31</volume>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>Cynthia</given-names>
            <surname>Rudin</surname>
          </string-name>
          .
          <article-title>Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead</article-title>
          .
          <source>Nature machine intelligence</source>
          ,
          <volume>1</volume>
          (
          <issue>5</issue>
          ):
          <fpage>206</fpage>
          -
          <lpage>215</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>Been</given-names>
            <surname>Kim</surname>
          </string-name>
          , Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler,
          <string-name>
            <given-names>Fernanda</given-names>
            <surname>Viegas</surname>
          </string-name>
          , et al.
          <article-title>Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (tcav)</article-title>
          .
          <source>In International conference on machine learning</source>
          , pages
          <fpage>2668</fpage>
          -
          <lpage>2677</lpage>
          . PMLR,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>Pang</given-names>
            <surname>Wei</surname>
          </string-name>
          <string-name>
            <surname>Koh</surname>
          </string-name>
          , Thao Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and
          <string-name>
            <given-names>Percy</given-names>
            <surname>Liang</surname>
          </string-name>
          .
          <article-title>Concept bottleneck models</article-title>
          .
          <source>In International conference on machine learning</source>
          , pages
          <fpage>5338</fpage>
          -
          <lpage>5348</lpage>
          . PMLR,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Sunnie</surname>
            <given-names>SY Kim</given-names>
          </string-name>
          , Elizabeth Anne Watkins, Olga Russakovsky, Ruth Fong, and
          <string-name>
            <surname>Andrés</surname>
          </string-name>
          Monroy-Hernández.
          <article-title>" help me help the ai": Understanding how explainability can support human-ai interaction</article-title>
          .
          <source>In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems</source>
          , pages
          <fpage>1</fpage>
          -
          <lpage>17</lpage>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>Rishabh</given-names>
            <surname>Jain</surname>
          </string-name>
          , Gabriele Ciravegna, Pietro Barbiero, Francesco Giannini, Davide Bufelli, and
          <string-name>
            <given-names>Pietro</given-names>
            <surname>Lio</surname>
          </string-name>
          .
          <article-title>Extending logic explained networks to text classification</article-title>
          .
          <source>In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing</source>
          , pages
          <fpage>8838</fpage>
          -
          <lpage>8857</lpage>
          . Association for Computational Linguistics,
          <year>2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>David</given-names>
            <surname>Alvarez</surname>
          </string-name>
          Melis and
          <string-name>
            <given-names>Tommi</given-names>
            <surname>Jaakkola</surname>
          </string-name>
          .
          <article-title>Towards robust interpretability with self-explaining neural networks</article-title>
          .
          <source>Advances in neural information processing systems</source>
          ,
          <volume>31</volume>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <surname>Gabriele</surname>
            <given-names>Ciravegna</given-names>
          </string-name>
          , Pietro Barbiero, Francesco Giannini, Marco Gori, Pietro Lió, Marco Maggini, and
          <string-name>
            <given-names>Stefano</given-names>
            <surname>Melacci</surname>
          </string-name>
          .
          <article-title>Logic explained networks</article-title>
          .
          <source>Artificial Intelligence</source>
          ,
          <volume>314</volume>
          :
          <fpage>103822</fpage>
          ,
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>