<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>How to measure uncertainty in Uncertainty Sampling for Active Learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Eyke Hu¨llermeier</string-name>
          <email>eyke@uni-paderborn.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>University Potsdam</institution>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Abstract. Various strategies for active learning have been proposed in
the machine learning literature. In uncertainty sampling, which is among
the most popular approaches, the active learner sequentially queries the
label of those instances for which its current prediction is maximally
uncertain. The predictions as well as the measures used to quantify the
degree of uncertainty, such as entropy, are traditionally of a probabilistic
nature. Yet, alternative approaches to capturing uncertainty in machine
learning, alongside with corresponding uncertainty measures, have been
proposed in recent years. In particular, some of these measures seek to
distinguish different sources and to separate different types of
uncertainty, such as the reducible (epistemic) and the irreducible (aleatoric)
part of the total uncertainty in a prediction. This talk elaborates on
the usefulness of such measures for uncertainty sampling and compares
their performance in active learning. To this end, uncertainty sampling
is instantiated with different measures, the properties of the sampling
strategies thus obtained are analyzed and compared in an experimental
study.</p>
    </sec>
  </body>
  <back>
    <ref-list />
  </back>
</article>