<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>University of Padua at MusiCLEF 2011: Music Identi cation Task</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Emanuele Di Buccio</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nicola Montecchio</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Nicola Orio</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of Information Engineering, University of Padua</institution>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This paper reports on the participation of the Information Management System Research Group of the University of Padua to the Music Identi cation task of the MusiCLEF Laboratory in CLEF 2011. The system under evaluation is FALCON, an open-source engine for content-based cover song identi cation written in Java that applies classic techniques derived from textual Information Retrieval to music identi cation. The obtained results show how such approach yields satisfying results using little computational resources.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>
        Automatic identi cation of music documents has become an essential component
of many popular web services. Audio ngerprinting techniques are widely used
in order to identify copies of a recording, which can di er from the original
because of data compression, A/D conversion or environmental noises [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In most
major video sharing websites, the background music of user generated videos is
automatically identi ed in order to either remove the video (for copyright issues)
or suggest where to purchase the original music (advertising)1.
      </p>
      <p>Audio ngerprint approaches aim at the identi cation of a particular
performance/recording rather than work : even alternate takes of a composition are
considered di erent items instead of being regarded as di erent instances of
the same piece. This assumption imposes signi cant restrictions to the range of
possible di erences between copies of the same recording, allowing audio
ngerprinting techniques to be particularly e cient.</p>
      <p>
        Aside from audio ngerprinting techniques, past research on music identi
cation has focused, for obvious commercial reasons, on popular music; the research
eld is commonly referred to as cover song identi cation, a more general name
for this research eld being version identi cation [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]. The problem however is
also of interest for other genres: in classical music there is especially a vast
number of interpretations of the same work and version identi cation technology can
be bene cial for many music libraries and archives that aim at the preservation
and dissemination of classical music. For a comprehensive review of previous
approaches to the version identi cation problem the reader can refer to [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], where
1 See, for instance, http://www.youtube.com/t/copyright_my_video
the author provides a review based on a functional block decomposition of
previously proposed systems.
      </p>
      <p>
        The experience gained in the development of text search engines shows that
in most cases simple and e cient techniques can be generally employed in various
retrieval tasks, with results that are often comparable with more complex and
less e cient approaches. Following this idea, we developed a music identi cation
engine named FALCON2. The fact that our software is implemented on top of
Apache Lucene3, an open source text search engine, substantiates the claim that
the problem of music identi cation can be modelled as a more general retrieval
task. In this paper we study its adaptability to classical music, making use of the
dataset prepared for the Music Identi cation task of the MusiCLEF 2011
benchmarking activity. The collection is constituted by circa 7 thousand recordings for
which the MusiCLEF Laboratory organizers provided precomputed descriptors.
Testing FALCON on this test collection has allowed us to investigate the
scalability of our proposed approach, thus extending previous investigations carried
out on popular music [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Methodology</title>
      <p>
        Our approach is based on a two-level bag-of-features hierarchy; the input
descriptors (chroma features) are transformed into hashes which are subsequently
grouped into a \set of hash sets" representation for each recording. The
cardinality of set intersection is adopted as a similarity measure. The methodology,
described in detail in [
        <xref ref-type="bibr" rid="ref3 ref4">3,4</xref>
        ], can be summarized as follows.
audio content analysis - this step consists in: (i) chroma feature extraction
from audio waveforms, (ii) key- nding | the most probable keys of a
recording are estimated in order to preserve transposition invariance | and (iii)
hashing of the transposed chroma features into a sequence of integer values
which form the output of this phase.
indexing - each sequence of hashes is segmented into a set of possible
overlapping segments. Hashes are interpreted as terms in a textual document
and segments as passages constituted by sets of terms. This representation
can be easily stored in an inverted index: the set of all the distinct hashes
appearing in the sequences obtained from the recordings in the collection
constitutes the index vocabulary; each item in the posting list is associated
to an hash and retains information about the frequency of occurrence of the
hash in a speci c segment.
querying - the similarity between a query Q and a recording D is computed
as
      </p>
      <p>v
S(Q; D) = jQutuj Y max n X min
q2Q d2D t2q\d
hf(t; d) hf(t; q) o</p>
      <p>;
jdj jqj
(1)
2 http://ims.dei.unipd.it/falcon
3 http://lucene.apache.org/
where q and d denote two segments of a query and a collection recording,
respectively of length (number of hashes) jqj; jdj; similarly, jQj; jDj denote
the number of distinct segments for Q; D and hf(t; d) denotes the frequency
of the hash t in the segment d. Formula 1 can be interpreted as follows: the
rst step (inner summation) computes local similarity between segments as
the (normalized) number of terms they have in common; the second step
aggregates the contributions of all the query segments, by computing the
geometric mean of the best local similarities.</p>
      <p>The procedure is repeated multiple times according to the most probable
keys detected in the audio analysis step; for each recording in the collection,
the highest similarity value is preserved.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Experiments</title>
      <p>3.1</p>
      <p>
        Test Collection and Setup
The test collection comprises 6679 recordings of classical music works, which add
up to more than 572 hours of music. Of these recordings, 2,671 are associated
to works that are represented at least twice in the data base, forming 945 cover
sets4. The audio descriptors were extracted using the MIRToolbox package [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
More details on the collection, and in general on the MusiClef campaign, are
available in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ].
      </p>
      <p>
        All experiments were repeated twice, one time using a key- nding algorithm
to preserve independency to transposition, and one time without such strategy.
The other parameters were set according to the values reported in [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], except
the segment overlap which was set to 50% the length of each segment (15s).
3.2
      </p>
      <p>Identi cation Accuracy and Computational Load
In FALCON, the trade-o between accuracy and speed of retrieval privileges
the latter, as the architecture was designed with large collections in mind. It
is therefore important to measure the computational resources required by the
software. All experiments were run on a machine with a 3.4 GHz dual-core
processor (4 logical cores), 24 GB of RAM and a 7200 RPM hard disk.</p>
      <p>Table 1 shows the results of our experimentation. As can be seen, the software
can index about 3.5 hours of music per second and is able to perform a typical
query in under 3 seconds. The average query time is di erent because the
keynding algorithm repeats a query multiple times (in this case 3) in parallel; each
thread is completely independent of the others.
4 The term \cover set" is commonly used to de ne a set of recordings of the same
piece of music.
no transposition
with transposition
total indexing time
average query time
MAP
MRR
163s
1.79s
0.6754
0.7617
166s</p>
    </sec>
    <sec id="sec-4">
      <title>Concluding Remarks</title>
      <p>This paper reports our contribution to the Music Identi cation task of the
MusiCLEF Laboratory in CLEF2011. Our experimental results show how a
simple approach based on text retrieval techniques can yield satisfying results using
little computational resources.</p>
      <p>These results suggest that the methodology implemented in FALCON can be
adopted as the rst of a two-step methodology. The identi cation performed by
FALCON would aim at providing candidate versions of the query recording at
the top k rank positions. Then identi cation could be re ned by means of more
sophisticated but also more resource consuming music alignment techniques,
that when exploited in isolation and on the entire collection are hardly scalable.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Cano</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Batlle</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kalker</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Haitsma</surname>
            ,
            <given-names>J.:</given-names>
          </string-name>
          <article-title>A review of audio ngerprinting</article-title>
          .
          <source>Journal of VLSI Signal Processing Systems 41 (November</source>
          <year>2005</year>
          )
          <volume>271</volume>
          {
          <fpage>284</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Serra</surname>
          </string-name>
          , J.:
          <article-title>Identi cation of versions of the same musical composition by processing audio descriptions</article-title>
          .
          <source>PhD thesis</source>
          , Universitat Pompeu Fabra,
          <string-name>
            <surname>Barcelona</surname>
          </string-name>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Di</given-names>
            <surname>Buccio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            ,
            <surname>Montecchio</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            ,
            <surname>Orio</surname>
          </string-name>
          , N.:
          <article-title>A scalable cover identi cation engine</article-title>
          .
          <source>In: Proceedings of the international conference on Multimedia. MM '10</source>
          , New York, NY, USA, ACM (
          <year>2010</year>
          )
          <volume>1143</volume>
          {
          <fpage>1146</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Miotto</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Orio</surname>
          </string-name>
          , N.:
          <article-title>A music identi cation system based on chroma indexing and statistical modeling</article-title>
          .
          <source>In: Proceedings of the 9th International Conference on Music Information Retrieval. ISMIR</source>
          (
          <year>2008</year>
          )
          <volume>301</volume>
          {
          <fpage>306</fpage>
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Lartillot</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Toiviainen</surname>
            ,
            <given-names>P.:</given-names>
          </string-name>
          <article-title>A matlab toolbox for musical feature extraction from audio</article-title>
          .
          <source>In: Proceedings of the 10th International Conference on Digital Audio E ects</source>
          , Bordeaux, France. (
          <year>2007</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Orio</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Rizo</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lartillot</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miotto</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Montecchio</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schedl</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          :
          <article-title>Musiclef: A benchmark activity in multimodal music information retrieval</article-title>
          .
          <source>In: Proceedings of the 12th International Conference on Music Information Retrieval</source>
          (to appear).
          <source>ISMIR</source>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>