<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Max-Sum Dispersion via Quantum Annealing</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Christian Bauckhage</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Rafet Sifa</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dirk Hecker</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Wobel</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>B-IT, University of Bonn</institution>
          ,
          <addr-line>Bonn</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Fraunhofer Center for Machine Learning</institution>
          ,
          <addr-line>Sankt Augustin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Fraunhofer IAIS</institution>
          ,
          <addr-line>Sankt Augustin</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We devise an Ising model for the max-sum dispersion problem which occurs in contexts such as Web search or text summarization. Given this Ising model, max-sum dispersion can be solved on adiabatic quantum computers; in proof of concept simulations, we solve the corresponding Schrodinger equations and observe our approach to work well. Quantum computing exploits quantum mechanical phenomena for information processing and is about to become a technical reality [7]. This will likely impact machine learning and data mining because quantum computing promises e cient solutions to certain optimization problems encountered there [2, 4, 12]. Here, we explore quantum computing for unsupervised learning and discuss how to solve the max-sum dispersion problem via adiabatic quantum computing (AQC). Adiabatic quantum computers determine minimum energy states of Ising models, that is they solve combinatorial optimization problems of the form argmin s|Q s + s|q: s2f 1;+1gn The 2n vectors s over which to minimize represent possible global states of a system of n entities each of which can be in one of two local states; Q 2 Rn n and q 2 Rn model internal and external dependencies, respectively. Ising models as in (1) occur in various data science settings [5, 6] which thus stand to bene t from quantum computing because it promises an e ciency unreachable by digital computers.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Introduction
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
The max-sum dispersion problem occurs in where data mining practitioners are
interested in identifying diverse or mutually far apart elements of a set of objects
or observations [1, 8, 10, 11]. Given a nite data set X = fx1; : : : ; xng and a
distance measure d( ; ), the problem is to determine a subset of size k &lt; n of
maximum dispersion. In other words, the max-sum dispersion problem consists
in solving the following constrained optimization problem
      </p>
      <p>S = argmax X X d xi; xj</p>
      <p>S X
xi2S xj2S
s:t: jSj = k:</p>
      <p>
        Introducing a distance matrix D 2 Rn n where Dij = d xi; xj and a binary
indicator vector z 2 f0; 1gn where zi = 1 if xi 2 S, (
        <xref ref-type="bibr" rid="ref2">2</xref>
        ) can be written as
z = argmax z|D z
z2f0;1gn
s:t: z|1 = k:
      </p>
      <p>
        Equation (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) reveals max-sum dispersion to be an integer programming
problem and thus to be NP-hard. State of the art solutions involve greedy
approximations which achieve O(nk) e ciency but lack optimality guarantees. More
sophisticated algorithms provide optimality guarantees of O(1 1=k) and
require O(nk2 log k) runtime or achieve O(1 1= ) at O(n= log k) runtime where
the constant 1. Interestingly, however, problem (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) resembles the Ising
energy minimization problem in (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). This suggests that it might be amenable to
quantum computing.
      </p>
      <p>
        Using the equivalence z|1 = k , z|1 k 2 = 0, the problem in (
        <xref ref-type="bibr" rid="ref3">3</xref>
        ) can
also be written as an unconstrained maximization problem
(
        <xref ref-type="bibr" rid="ref2">2</xref>
        )
(
        <xref ref-type="bibr" rid="ref3">3</xref>
        )
(
        <xref ref-type="bibr" rid="ref4">4</xref>
        )
(
        <xref ref-type="bibr" rid="ref5">5</xref>
        )
(
        <xref ref-type="bibr" rid="ref6">6</xref>
        )
z = argmin
z2f0;1gn
z| D
11| z
2 k z|1 + const
where we used that (
        <xref ref-type="bibr" rid="ref4">4</xref>
        ) is quadratic form in z so that the maximization problem
can equivalently be cast in terms of a minimization problem.
      </p>
      <p>
        Written like this, max-sum dispersion is recognizable as a problem similar to
the one in (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). However, while (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) minimizes over binary vectors z 2 f0; 1gn, Ising
models as in (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) involve bipolar vectors s 2 f 1; +1gn. Yet, since s = 2 z 1
is a bipolar vector so that we can write binary vectors as z = s + 1 =2. Hence,
using the substitutions Q = 41 (D 11|) and q = 12 (D 11|)1 k1,
the problem in (
        <xref ref-type="bibr" rid="ref5">5</xref>
        ) can also be written as
z = argmax z|D z
z2f0;1gn
z|1
k 2
where 2 R is a Lagrange multiplier. Treating this multiplier as a constant and
expanding the expression on the right hand side, we nd
s =
      </p>
      <p>argmin s|Q s + s|q
s2f 1;+1gn
which constitutes an appropriate Ising model for max-sum dispersion. Once the
solution s is available, entries si = +1 indicate which xi 2 X to select into S .</p>
      <p>2n 1
(t) = X ai(t)
i=0
i :
The key idea is to understand each basis state j ii as an indicator vector that
represents one of the 2n subsets of our data. The task is then to manipulate the
system such that, when measured afterwards, it will likely collapse to a state
which encodes the sought after solution.</p>
      <p>
        Manipulations that obey the laws of quantum mechanics are modeled in
terms of Hamiltonian operators, and, if a qubit system as in (
        <xref ref-type="bibr" rid="ref7">7</xref>
        ) evolves under
the in uence of a time-dependent Hamiltonian H(t), its behavior is governed by
the Schrodinger equation i ~ ddt (t) = H(t) (t) . To use this for computing,
one prepares a qubit register in the ground state of a problem independent
beginning Hamiltonian HB and evolves it towards a problem Hamiltonian HP
whose ground state represents a solution to the problem at hand.
      </p>
      <p>
        If the sought after solution is known to correspond to a minimum energy
con guration of an Ising model, a seminal paper by Farhi et al. [6] proposed a
simple recipe for how to set up appropriate problem Hamiltonians. To set up HP
for the Ising model in (
        <xref ref-type="bibr" rid="ref6">6</xref>
        ), we therefore follow standard suggestions and de ne
      </p>
      <p>Max-Sum dispersion via AQC
When using adiabatic quantum computing in order to identify k diverse elements
among a set of n elements, we consider a time dependent system of n qubits
where zi denotes the Pauli spin matrix z acting on the i-th qubit. Likewise
and again following standard suggestions, we choose</p>
      <p>n n
HP = X X Qij zi zj +
n</p>
      <p>X qi zi
can be used to let j (t)i evolve from the ground state j (0)i of HB to a nal
state j (T )i where j (0)i. Upon termination of this evolution, a measurement
of the qubit system causes it to collapse to one of its 2n basis states and the
probability for this state to be j ii is given by the amplitude jai(T )j2. However,
since the adiabatic evolution was steered towards the problem Hamiltonian HP ,
states j ii that correspond to ground states of HP are more likely to be found.</p>
      <p>
        The computational e ciency of adiabatic quantum computing will depend
on the choice of T in (
        <xref ref-type="bibr" rid="ref10">10</xref>
        ) which is known to depend on the minimum energy gap
(
        <xref ref-type="bibr" rid="ref7">7</xref>
        )
(
        <xref ref-type="bibr" rid="ref8">8</xref>
        )
(
        <xref ref-type="bibr" rid="ref9">9</xref>
        )
(
        <xref ref-type="bibr" rid="ref10">10</xref>
        )
between the ground state and the rst excited state of H(t). This gap is inversely
proportional to the square root of the number of basis states that have energies
close to global minimum [3]. For problems such as max-sum dispersion where
the number of potential solutions is typically small, T 2 O p2n is the smallest
possible runtime Hence, AQC can perform exhaustive searchers for max-sum
dispersion solutions quadratically faster than classically possible.
4
      </p>
      <p>Proof of Concept Simulations
Next, we present didactic simulation experiments to illustrate the feasibility of
AQC for max-sum dispersion. In each case, we numerically solve the governing
Schrodinger equations using the Python toolbox QuTip [9].</p>
      <p>Figure 1 shows n = 12 monthly weather
measurements in Hamburg. We normalize
them to unit variance so that far points are 30
nOe(i2th)earpoafrtt.hSeettetirnmgs in=(62) ntowdilolmthineantec.aWusee ◦ []reC2205 May Sep AuJguJlun
tscreoatntcsitnidgke,rw2Eeufw4col;ir5dk;e6wagnithddi1ivs2etraqsnuecbeeisltesmaynsedtnetmtsr.syIinntoaeaescuxh-- rtteeapum11055 FebApr MOJacartn Nov Dec
perposition of 212 = 4096 basis states. Using 0 40 50 60 70 80
Hamiltonians as discussed above, we evolve precipitation [mm]
them over T = 100 2 O p212 steps. Fig. 1: Data of monthly climatic</p>
      <p>The top row of Fig. 2 shows the results conditions in Hamburg.
for each setting. The middle row visualizes
how each qubit system evolves over time. At
t = 0, all basis states are equally likely but
over time their amplitudes begin to diverge; amplitudes of basis states that
correspond to low energy states of our Ising model increase while amplitudes of
basis states that could hardly be considered a solution to our problem decrease.
At t = T , certain basis states are therefore more likely to be measured and
the tables in the bottom row of Fig. 2 rank the 5 most likely ones. Looking
at these tables, the most likely nal states for the qubit systems to be found
in are j010010100001i, j010101010001i, and j110100110001i for k 2 f4; 5; 6g,
respectively. Understood as indicator vectors, these qubit con gurations
represent the sets fFebruary, May, July, Decemberg, fFebruary, April, June, August,
Decemberg, and fJanuary, February, April, July, August, Decemberg.</p>
      <p>Our experiments thus suggest that AQC can solve max-sum dispersion.
Classical algorithms typically resort to greedy heuristics. AQC, on the other hand,
(implicitly) performs exhaustive searches over all 2n subsets of the n given data
points. Our choice of T 2 O p2n suggests that it can accomplish this
quadratically faster than classically possible. Finally, in contrast to classical algorithms,
the runtime of the AQC approach does not depend on the size k of the subset
to be selected.
result for k = 6
40</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Abassi</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Mirrokni</surname>
            ,
            <given-names>V.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Thakur</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Diversity Maximization under Matroid Constraints</article-title>
          . In: KDD (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. Ameur, E.,
          <string-name>
            <surname>Brassard</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gambs</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Quantum Clustering Algorithms</article-title>
          . In: ICML (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Amin</surname>
            ,
            <given-names>M.H.S.:</given-names>
          </string-name>
          <article-title>E ect of Local Minima on Adiabatic Quantum Optimization</article-title>
          .
          <source>Physical Review Letters</source>
          <volume>100</volume>
          (
          <issue>13</issue>
          ),
          <volume>130503</volume>
          (
          <year>2008</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bauckhage</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brito</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cvejoski</surname>
            ,
            <given-names>K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ojeda</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sifa</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wrobel</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Ising Models for Binary Clustering via Adiabatic Quantum Computing</article-title>
          . In: EMMCVPR (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bauckhage</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ojeda</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sifa</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wrobel</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          :
          <article-title>Adiabatic Quantum Computing for Kernel k=2 Means Clustering</article-title>
          . In:
          <string-name>
            <surname>KDML-LWDA</surname>
          </string-name>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Farhi</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goldstone</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gutmann</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sipser</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Quantum Computation by Adiabatic Evolution</article-title>
          .
          <source>arXiv:quant-ph/0001106</source>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Gibney</surname>
          </string-name>
          , E.:
          <article-title>Quantum Computer Gets Design Upgrade</article-title>
          .
          <source>Nature</source>
          <volume>541</volume>
          (
          <issue>7638</issue>
          ) (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Gollapudi</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sharma</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>An Axiomatic Approach for Result Diversi cation</article-title>
          .
          <source>In: WWW</source>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Johansson</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nation</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Nori</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          :
          <article-title>QuTiP 2: A Python Framework for the Dynamics of Open Quantum Systems</article-title>
          .
          <source>Computer Physics Communications</source>
          <volume>184</volume>
          (
          <issue>4</issue>
          ) (
          <year>2013</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <given-names>Santos</given-names>
            <surname>Rodrygo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.T.</given-names>
            ,
            <surname>Macdonald</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Ounis</surname>
          </string-name>
          ,
          <string-name>
            <surname>I.</surname>
          </string-name>
          :
          <article-title>Intent-aware Result Diversi cation</article-title>
          .
          <source>In: SIGIR</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Sifa</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bauckhage</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Online k-Maxoids Clustering</article-title>
          . In: DSAA (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Wiebe</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kapoor</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Svore</surname>
            ,
            <given-names>K.M.</given-names>
          </string-name>
          :
          <article-title>Quantum Algorithms for Nearest-Neighbor Methods for Supervised and Unsupervised Learning</article-title>
          .
          <source>Quantum Information &amp; Computation</source>
          <volume>15</volume>
          (
          <issue>3</issue>
          {4) (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>