<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>making Machine Learning Systems Accountable?</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Iker Esnaola-Gonzalez</string-name>
          <email>iker.esnaola@tekniker.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>TEKNIKER, Basque Research and Technology Alliance (BRTA)</institution>
          ,
          <addr-line>Iñaki Goenaga 5, 20600 Eibar</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Even though the maturity of the Artificial Intelligence (AI) technologies is rather advanced nowadays, according to McKinsey1, its adoption, deployment and application is not as wide as it could be expected. This could be attributed to many barriers including cultural ones, but above all, the lack of trust of potential users in such AI systems. The diferent factors that afect the users' trustworthiness on AI systems were studied in [ according to [2] refers to the “techniques that enable human users to understand, appropriately trust, and efectively manage the emerging generation of artificially intelligent partners”. However, the explainability of AI systems is necessary but far from suficient for understanding them and holding them accountable [3]. Therefore, in order to develop trustworthy AI systems, not only should they be explainable, but also accountable.</p>
      </abstract>
      <kwd-group>
        <kwd>Some of these factors comprise the so-called Explainable Artificial Intelligence (XAI)</kwd>
        <kwd>which</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Extended Abstract</title>
      <p>CEUR
Workshop
Proceedings</p>
      <p>The first phase is related to the development of the predictive model and its deployment
in production where it will be executed. In the second phase both the procedure followed
to develop the deployed predictive model and the results produced by the predictive model
are annotated with the adequate ontology terms. As for the third phase, it is responsible for
managing the annotations of the previous phase and facilitating their exploitation by users via
SPARQL queries.</p>
      <p>The topics that can be identified in Machine Learning system and that may be of interest to
annotate with ontologies are: the forecast made by the predictive model, and the procedure
followed for making such a forecast. Likewise, the latter procedure-related information can be
divided in the information that addresses the training data and the information concerning the
predictive model itself. After considering and evaluating the suitability of diferent ontologies,
finally, three Ontology Design Patterns (the AfectedBy ODP 2, the Execution-Executor-Procedure
(EEP) ODP3 and the Result-Context (RC) ODP4) and the ML-Schema5 have been chosen for
representing this knowledge.</p>
      <p>The full potential of Semantic Technologies to fill existing gaps and unsolved challenges
towards trustworthy AI systems is yet to be unlocked. This article is aimed at paving the way
for future research in this direction.</p>
    </sec>
    <sec id="sec-2">
      <title>Acknowledgments</title>
      <p>This work is partly supported by the project 3KIA (KK-2020/00049), funded by the SPRI-Basque
Government through the ELKARTEK program and the AI-PROFICIENT project which has
received funding from the European Union’s Horizon 2020 research and innovation programme
under grant agreement no. 957391
2https://w3id.org/affectedBy
3https://w3id.org/eep
4https://w3id.org/rc
5http://www.w3.org/ns/mls</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>B.</given-names>
            <surname>Cahour</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.-F.</given-names>
            <surname>Forzy</surname>
          </string-name>
          ,
          <article-title>Does projection into use improve trust and exploration? an example with a cruise control system</article-title>
          ,
          <source>Safety science 47</source>
          (
          <year>2009</year>
          )
          <fpage>1260</fpage>
          -
          <lpage>1270</lpage>
          .
          <source>doi:1 0 . 1 0 1 6 / j . s s c i . 2 0 0 9 . 0 3 . 0 1 5 .</source>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>D.</given-names>
            <surname>Gunning</surname>
          </string-name>
          ,
          <source>Explainable artificial intelligence (xai)</source>
          ,
          <source>Defense Advanced Research Projects Agency (DARPA)</source>
          ,
          <source>nd Web 2</source>
          (
          <year>2017</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Kroll</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Barocas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. W.</given-names>
            <surname>Felten</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. R.</given-names>
            <surname>Reidenberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. G.</given-names>
            <surname>Robinson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Yu</surname>
          </string-name>
          , Accountable algorithms, U. Pa. L. Rev.
          <volume>165</volume>
          (
          <year>2016</year>
          )
          <fpage>633</fpage>
          -
          <lpage>705</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>D.</given-names>
            <surname>Oberle</surname>
          </string-name>
          ,
          <article-title>How ontologies benefit enterprise applications 5 (</article-title>
          <year>2014</year>
          )
          <fpage>473</fpage>
          -
          <lpage>491</lpage>
          .
          <source>doi: 1 0 . 3 2 3 3 / S W - 1</source>
          <volume>3 0 1 1 4 .</volume>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>I.</given-names>
            <surname>Tiddi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Lécué</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Hitzler</surname>
          </string-name>
          ,
          <source>Knowledge Graphs for Explainable Artificial Intelligence: Foundations, Applications and Challenges</source>
          , volume
          <volume>47</volume>
          , IOS Press,
          <year>2020</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>A.</given-names>
            <surname>Seeliger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Pfaf</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Krcmar</surname>
          </string-name>
          ,
          <article-title>Semantic web technologies for explainable machine learning models: A literature review</article-title>
          ,
          <source>in: Joint Proceedings of PROFILES 2019 and SEMEX</source>
          <year>2019</year>
          , 1st Workshop on Semantic Explainability (SemEx
          <year>2019</year>
          ),
          <article-title>co-located with the 18th</article-title>
          <source>International Semantic Web Conference (ISWC '19)</source>
          , volume
          <volume>2465</volume>
          <source>of PROFILES-SEMEX</source>
          <year>2019</year>
          ,
          <article-title>CEUR-</article-title>
          <string-name>
            <surname>WS</surname>
          </string-name>
          ,
          <year>2019</year>
          , pp.
          <fpage>30</fpage>
          -
          <lpage>45</lpage>
          . URL: http://ceur-ws.
          <source>org/</source>
          Vol-
          <volume>2465</volume>
          /semex_paper1.pdf.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>