<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Prior Art Retrieval Using Various Patent Document Fields Contents</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Metti Zakaria Wanagiri</string-name>
          <email>metti.zakaria@ui.edu</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mirna Adriani</string-name>
          <email>mirna@cs.ui.ac.id</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Fakultas Ilmu Komputer</institution>
          ,
          <addr-line>Universitas Indonesia Depok 16424</addr-line>
          ,
          <country country="ID">Indonesia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>In this paper, we report our approach to retrieve patent documents based on the prior art. We use the standard Information Retrieval (IR) techniques which contain indexing and retrieval processes. We use various combinations of document fields for the query formulation. Based on the evaluation summary, we achieve the best result for the combinations of invention-title, description and claims fields in terms of precision and recall.</p>
      </abstract>
      <kwd-group>
        <kwd>patent retrieval</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>There are a lot of inventions that have been invented in the industry and sciences. The
number of inventions is growing from time to time as there is a high demand and need
from human to have better and easier life, such as the living environment, working
environment and so on. For example, around April 2010, Apple Inc. developed a new
portable tablet computer called iPad which is one of the latest patented inventions.
One of the functions is it can enable humans to read any e-book documents anytime
and anywhere.</p>
      <p>An invention can be granted an exclusive right called patent by the national
government for a limited period of time in exchange for public disclosure of those
inventions. This exclusive right granted to an inventor is the right to prevent others
from making, using, selling or distributing the patented invention without permission.
So, with this exclusive right, an inventor can fully protect its patented invention from
any misuses in the given period of time.</p>
      <p>According to World Intellectual Property Organization (WIPO) of United Nations,
patent inventions/applications consist of patent specifications, official forms and
correspondence relating to the applications. A patent specification is a document that
describes the invention which generally contains the invention/application title,
section detailing the background and overview of the invention, a description of the
invention and embodiments of the invention and claims, which set out the scope of
the protection. It also includes an abstract which provides a summary of the invention.
The claims of a patent specification define the scope of protection of a patent granted
by the patent and describe the invention in a specific legal style.</p>
      <p>As the number of patent applications increases, the patent domain is considered
quite important. Since there are many new inventions that are being set out for patent
granting, then it should be a justification on those new inventions. A new invention
should be checked whether there are any existing patents which may invalidate them.
So a patent specification or patent document plays a vital role in differentiating any
inventions.</p>
      <p>
        In 2009, the Cross Language Evaluation Forum (CLEF) launches a track called
CLEF-IP which focuses on Intellectual Property domain. It investigates the use of
Information Retrieval techniques for patent document retrieval. The main task in this
track is to find any existing patent documents that may invalidate a new invention
who apply for its patent. Jarvelin and Preben [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ] use an automatic query generation
algorithm. They compare queries generated by human experts to those generated by
system and the automatic generated queries achieve the better performance. Lopez
and Romary [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] use multiple retrieval models for producing several sets of ranked
results. Then they apply Multiple SVM regression models to merge the results.
Toucedo and Losada [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] build queries by extracting terms from some textual patent
documents fields using inverse document frequency (idf) and give preference to the
title terms. BM25 retrieval model is used and the best result is achieved when the title
terms and the standard parameters of BM25 retrieval model are used.
      </p>
      <p>
        Mukherjea and Bamba [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] also develop a retrieval system for biomedical patents
called BioPatentMiner. It integrates information from the patents with knowledge
from biomedical ontologies to create a Semantic Web. Takaki et al. [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] propose the
invalidity patent search by applying an associative document retrieval method, in
which a document is used as a query to search for other similar documents. They use
subtopics or compositional elements extraction to extract subtopics which correspond
to an element constituting the claim section. Then content words which mainly nouns
are extracted from each compositional element as query terms. Evaluation results
show that the method used was effective in the patent search. Mase et al. [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] use two
retrieval stages which consists of query term extraction from claim text, query term
weighting without term frequency (tf) and using measurement terms (terms that
accompanied by numerical values) and text retrieval using claims as targets.
Evaluation results show that the effectiveness of the method varies depending on the
test sets used.
      </p>
      <p>In this paper, we report our participation in the 2nd CLEF-IP. We focused on the
Prior Art Candidate Search (PAC) task to find patent documents that are likely to
constitute prior art to a given patent application (patent topic).The remaining of this
paper is organized as follows: section 2 discusses our retrieval system for patent
documents, section 3 describes the experiments, section 4 describes the evaluation
summary and section 5 is the conclusion.</p>
    </sec>
    <sec id="sec-2">
      <title>2 Patent Documents Retrieval System</title>
      <p>In this section, we describe our retrieval system using standard Information Retrieval
(IR) techniques for indexing and retrieving patent documents.</p>
      <sec id="sec-2-1">
        <title>2.1 Extracting Patent Fields</title>
        <p>Before indexing process is carried out, we need to extract the patent fields in the
multilingual document collection. There are about 60 different fields in a patent
document, however their contents are not always informative and important. So we
need to figure out which fields that are considered important to a corresponding patent
application. First, we randomly take some patent documents from the CLEF-IP 2010
corpus. Then we extract all of the document fields by recognizing the associated tags.
Then we create a list of unique patent fields</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 Indexing Documents</title>
        <p>We choose a number of informative fields from the list of unique patent fields in
which the contents considered to be valuable and represent all the information about
the corresponding patent application. There are 30 chosen patent fields (see Table 1)
that are used in the indexing process.</p>
      </sec>
      <sec id="sec-2-3">
        <title>2.3 Query Formulation</title>
        <p>The CLEF-IP 2010 topic documents are categorized into two sets: the large topic set
and small topic set. Each topic document is a patent document in XML format which
has the same structured data as the patent documents in CLEF-IP 2010 corpus. Both
sets come in three different languages: English, French and German (see Table 2).</p>
      </sec>
      <sec id="sec-2-4">
        <title>Number of Docs</title>
        <p>2005
500
2505</p>
        <p>Our task in this track is to find all relevant patent documents in the collection that
invalidate a given topic documents. In this case, we build some appropriate and
effective queries from the topic documents.</p>
        <p>In this query formulation process, we use the standard term weighting algorithm of
TF-IDF [6[. Essentially, TF-IDF works by determining the relative proportion of
words in a specific document compared to the inverse proportion of that word over
the entire document corpus. This calculation determines how relevant a given word is
in a particular document.</p>
        <p>
          So, given a document collection D and a document d є D, the calculation of
TFIDF for a word w is
wd = fw,d * log (N/fw,D)
(1)
where fw,d is the number of times w appears in d, N is the number of documents in D
and fw,D is the number of documents in D in which w appears [
          <xref ref-type="bibr" rid="ref6">6</xref>
          ].
        </p>
        <p>For each of the topic documents from both sets, we apply these steps of query
formulation:
1. Extracting the contents from three patent fields: invention-title,
description and claims,
2. Extracting words from the extracted contents by applying the standard
weighting algorithm of TF-IDF,
3. Retrieving top 10 words with high TF-IDF, and
4. Forming the 10 words as one query.</p>
        <p>As there are three patent fields that we used for query formulation, we define three
possible combinations that will be used for our experiments. The combinations are:
1. claims
2. invention-title + description
3. invention-title + description + claims
So following the steps above, after we extract the contents from each patent field, we
combine the contents based on the combinations above and then extract the top 10
words as the query. Finally, there are three sets of query that we will use in the
retrieving process. Table 3 shows the details of the query sets.
For the experiments, we use CLEF-IP 2010 corpus which contains around 2 million
patent documents from European Patent Office (EPO). Each patent document is an
XML file containing structured data with different fields delimited by specified tags.</p>
        <p>
          We index the documents using Indri1 which is part of the Lemur2 Toolkit. Indri
retrieval model is based on a combination of language model and inference network
frameworks [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. We remove stopwords from the corpus but we don’t stem the words.
We don’t use any cross language technique in those runs therefore no language
specific methods are used.
        </p>
        <p>We run three experiments based on three sets of query and retrieve top 1000 patent
documents which are relevant to each query from sets. In the experiments, we
combined the title, description, and claims that occurred o the documents. These three
experiments or runs are the submitted runs for CLEF-IP 2010. For all of the runs, we
use both large and small topic sets. Table 4 shows the details of the submitted runs.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>4 Evaluation</title>
      <p>The results of our submitted runs using large and small topic set are shown on Table
5.
1 http://www.lemurproject.org/indri/
2 http://www.lemurproject.org/
all the topics sets show that the recall is much higher that the precision. The MAP of
the large topic set (0.0581) is higher than the small topic set (0.0537).</p>
      <p>Our results have motivated us to explore more on the patent fields’ contents that
are valuable for retrieval process. Furthermore the query formulation process needs to
be improved using different approach.</p>
    </sec>
    <sec id="sec-4">
      <title>5 Conclusion</title>
      <p>This year we participate in the Patent Retrieval track in CLEF-IP 2010. We use
standard IR techniques for retrieving patent documents. We identify several fields that
are used in the indexing process. For the retrieval process, we combine several fields
such as title, description, and claims. The evaluation shows that the precision is much
lower than the recall.</p>
      <p>There are still rooms for improvement such as adding more context to the query
using query expansion or relevance feedback and also using different term weighting
algorithm..</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Jarvelin</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Preben</surname>
          </string-name>
          , H.:
          <article-title>UTA and SICS at CLEF-IP</article-title>
          .
          <article-title>In: 1st CLEF-IP, Corfu</article-title>
          , Greece (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Lopez</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Romary</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          :
          <article-title>Multiple Retrieval Models and Regression Models for Prior Art Search</article-title>
          .
          <source>In: 1st CLEF-IP</source>
          , Corfu, Greece (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Mase</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matsubayashi</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ogawa</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          :
          <article-title>Proposal of Two Stage Patent Retrieval Method Considering the Claim Structure</article-title>
          .
          <source>ACM Transactions on Asian Language Information Processing</source>
          <volume>4</volume>
          (
          <issue>2</issue>
          ) (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Michel</surname>
          </string-name>
          , J.:
          <article-title>Considerations, challenges and methodologies for implementing best practices in patent office and like patent information departments</article-title>
          .
          <source>World Patent Information</source>
          <volume>28</volume>
          :
          <fpage>132</fpage>
          -
          <lpage>135</lpage>
          (
          <year>2006</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Mukherjea</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Bamba</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>BioPatentMiner: An Information Retrieval System for Biomedical Patents</article-title>
          .
          <source>In: VLDB '04: Proceedings of the Thirtieth International Conference on Very Large Data Bases</source>
          , pp.
          <fpage>1066</fpage>
          -
          <lpage>1077</lpage>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Salton</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Buckley</surname>
            ,
            <given-names>C.</given-names>
          </string-name>
          :
          <article-title>Term-weighting approaches in automatic text retrieval</article-title>
          .
          <source>In: Information Processing &amp; Management</source>
          ,
          <volume>24</volume>
          (
          <issue>5</issue>
          ), pp.
          <fpage>513</fpage>
          -
          <lpage>523</lpage>
          (
          <year>1988</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Strohman</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Metzler</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Turtle</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Croft</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          :
          <article-title>Indri: A language-model based search engine for complex queries (extended version)</article-title>
          .
          <source>Technical Report IR-407</source>
          , Department of Computer Science, University of Massachusetts (
          <year>2005</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Takaki</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fujii</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ishikawa</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Associative Document Retrieval by Query Subtopic Analysis and its Application to Invalidity Patent Search</article-title>
          .
          <source>In: Proceedings of CIKM</source>
          (
          <year>2004</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Toucedo</surname>
            ,
            <given-names>J.C.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Losada</surname>
          </string-name>
          , D.E.: University of Santiago de Compostela at CLEF-IP09.
          <article-title>In: 1st CLEF-IP, Corfu</article-title>
          , Greece (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>