<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Some Tools for Working with Bibliographic References</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>y Erm</string-name>
          <email>Ermakov@Keldysh.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Keldysh Institute of Applied Mathematics of RAS</institution>
          ,
          <addr-line>Miusskaya sq., 4 Moscow, 125047</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <fpage>301</fpage>
      <lpage>308</lpage>
      <abstract>
        <p>The rapid quantitative growth of scientific publications has pushed the development of various Internet tools for finding the necessary information. Statistics on its study and use (citation) are no less important than the search for the necessary information. This article explores the citation support tools provided by Google Academy, Crossref, and other developers. In the Russian Federation NEICON (a national consortium of Russian educational, scientific and cultural organizations) provides technical and methodological support for working with DOI and other Crossref services. The article shows how the considered tools are built into the user interfaces of the IPM electronic library. Additional features provided by these tools are considered.</p>
      </abstract>
      <kwd-group>
        <kwd>e-library</kwd>
        <kwd>bibliographic link</kwd>
        <kwd>back bibliographic link</kwd>
        <kwd>toolbox</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Introduction</title>
      <p>The rapid development of the Internet over the past 20 years has led to a significant
increase in the accumulated scientific and technical information, a sharp increase in the
number of electronic libraries and their volume.</p>
      <p>
        The rapid quantitative growth of scientific publications has pushed the development
of various Internet tools for finding the necessary information (for example, the Google
Academy [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]). It should be noted that Google Academy has partnered with publishers
to index peer-reviewed scientific articles and other academic materials, making them
searchable on Google.
      </p>
      <p>The Google Academy search base includes journals, conference proceedings,
abstracts, dissertations, scientific books, preprints, technical reports, and other scientific
literature from various fields of knowledge. In the Google Academy, you can find
publications from many scientific publishers, professional communities, as well as research
articles from various Internet sources.</p>
      <p>From the point of view of real citation rates for Russian-speaking authors,
GoogleAcademy is of possibly greater interest than Web of Science or Scopus, since it includes
the maximum number of scientific journals in Russian.</p>
      <p>Copyright © 2020 for this paper by its authors.</p>
      <p>Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</p>
      <p>No less important than the search for the necessary information is statistics on its
study and use (citation) by other readers. This data is certainly of interest both to the
author of the scientific publication and to network users who are interested in the article.</p>
      <p>
        One of the developers of specialized tools for supporting citation was the Crossref
association [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], which develops and maintains the world's high-tech infrastructure for
scientific communications.
      </p>
      <p>
        In the Russian Federation NEICON (a national consortium of Russian educational,
scientific and cultural organizations) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] provides technical and methodological support
for working with DOI and other Crossref services.
      </p>
      <p>The tools considered in the article are actively used by researchers and publishers
around the world.</p>
      <p>
        This article is devoted to the use of tools provided by Google-academy and Crossref
for the development of technological capabilities of the Keldysh Institute of Applied
Mathematics [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
2
      </p>
    </sec>
    <sec id="sec-2">
      <title>Crossref Association</title>
      <p>The development of digital libraries as a source of information is inextricably linked
with the history of the Internet. Scientific-technical and scientific-educational libraries
occupy a special place among electronic libraries. World experience shows that
educational and scientific electronic resources are formed, as a rule, by the scientific and
educational organizations themselves in which the authors of these publications work,
and they are focused primarily on readers who are also closely related to scientific and
educational activities (researchers, teachers, graduate students, students).</p>
      <p>The work of researchers within the framework of a certain scientific direction
involves the active study of publications of other authors in this topic and the legal use of
other people's materials (citation) when discussing within the framework of journal
articles, scientific reports, etc.</p>
      <p>The Crossref Association, of which the Keldysh Institute of Applied Mathematics
has been a member since 2016, maintains a joint worldwide mutual citation service that
functions as a kind of gateway between publishers' electronic platforms. This service
does not store the full texts of scientific publications, but it enters into its database
information about the relationship of publications using the Digital Object Identifier
(DOI) technology, as well as metadata of published scientific materials.</p>
      <p>The tools under development by Crossref (and some other organizations such as
Google Scholar, Scopus and Web of Science that use different sources for their citation
data) make it easier for both the author of the publication and the reader to find, cite,
evaluate, reuse research results.</p>
      <p>
        A dedicated team of Crossref developers (Crossref Labs [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]) creates and tests new
technologies and services that may be of interest to the scientific community. Some of
these experiments become new Crossref services. Others are being converted or
absorbed by existing services.
      </p>
    </sec>
    <sec id="sec-3">
      <title>Get references</title>
      <p>
        A bibliographic reference is a collection of bibliographic information about a cited,
considered or mentioned document in the text, necessary and sufficient for the general
characterization, identification and search of the document. The ability of a potential
reader to find this document and get acquainted with it depends on how accurately the
author of the publication indicated information about the cited document in the link [
        <xref ref-type="bibr" rid="ref10 ref6">6,
10</xref>
        ]. And the first Crossref tool that we would like to introduce readers to is "Get
persistent links": https://doi.crossref.org/simpleTextQuery
      </p>
      <p>It should be noted that we did not receive a link for the first position of this list
because we used transliteration (as is usually done for foreign publications). In the
Russian version of this list, Crossref easily finds a link to this publication. The third
bibliography is too old and has no DOI. Thus, by supplementing his list of references with
DOI references, the author of the article can, firstly, make sure of the correctness of
these links, and, secondly, help the reader find the cited article in one click, if it interests
him. Crossref has several more tools for getting permalinks. For example,
https://search.crossref.org/references.</p>
      <p>When implementing these tools, the Crossref working group (Crossref Labs)
developed and tested four approaches (algorithms) for DOI search, indexing a given
bibliographic reference:
• the traditional approach based on parsing links;
• SBM (Based Matching with Validation) algorithm with a simple threshold, which
searches for a reference string in a search engine and returns the first match for which
the relevance score exceeds a predetermined threshold;</p>
      <p>• Threshold normalized SBM algorithm, which searches for a reference string in a
search engine and returns the first match if its relevance score divided by string length
exceeds a predetermined threshold;</p>
      <p>• Search-Based Matching with Validation (SBMV) algorithm, which first applies the
normalized threshold SBM algorithm to select a set of candidate items, and a separate
validation procedure is used to select the final target item.</p>
      <p>In various Crossref tools (when loading content, when defining links, etc.),
depending on the requirements of simplicity-complexity and efficiency-accuracy, one or
another algorithm is used. But in any case, the author or an employee of the publishing
house is advised to independently check the correctness of the recognition result of
bibliographic records and the accuracy of the reference obtained.</p>
    </sec>
    <sec id="sec-4">
      <title>Reverse bibliographic reference (Cited-by)</title>
      <p>A reverse bibliography (Cited-by) is a bibliographic reference to a publication that links
to a given article. The tools for building a reverse bibliographic list are being developed
not only by Crossref, but others as well. For example, Google scholar. In the
corresponding Google tool, it is enough to specify the URL of the article you are interested
in as a query parameter and you can get a list of publications that link to it.
For example, the article by M.M. Gorbunov-Posadov "Internet activity as the duty of
scientist" (https://keldysh.ru/gorbunov/duty.htm) is referenced by 69 publications
(Fig. 2), a list of which can be obtained using a request
https://scholar.google.com/scholar?q=link:https://www.keldysh.ru/gorbunov/duty.htm</p>
      <p>
        KIAM employees, who support and develop the functional capabilities of the IPM
electronic library [
        <xref ref-type="bibr" rid="ref7 ref8 ref9">7–9</xref>
        ], this feature – obtaining a reverse bibliographic list using
Google Scholar – is built into the electronic bibliographic publication card (Fig. 3).
      </p>
      <p>One of the Crossref tools that allows you to build a reverse bibliographic list
(Citedby) is called getForwardLinks and has the format:
https://doi.crossref.org/servlet/getForwardLinks?usr=[username]&amp;pwd=[password]&amp;doi=[DOI],
where the publisher's login and password (login and password in the Crossref database),
as well as the DOI of the publication of interest are indicated. For example:
https://doi.crossref.org/servlet/getForwardLinks?usr=kiam&amp;pwd=ХХХ&amp;doi=10.20948/prepr-2016-124</p>
      <p>The query result is returned in XML format. For the above example:</p>
      <p>Another Crossref tool allows you to get information about publications linking to a
specified article in JSON format (Fig 5).
In our opinion, one of the interesting possibilities associated with building a reverse
bibliographic list is the setting of a time range. This may be of interest to authors and
readers of "live publications" or publications that have undergone significant revisions.
Those. authors (and readers) can find out whether the interest in the publication is
growing, whether the changes made (or some events in the scientific world) influenced the
citation of the article.
https://doi.crossref.org/servlet/getForwardLinks?usr=[username]&amp;pwd=[password]&amp;doi=[prefix]&amp;startDate=[YYYY-MM-DD]&amp;endDate=[YYYY-MM-DD]</p>
    </sec>
    <sec id="sec-5">
      <title>Conclusions and Outlook</title>
      <p>Various tools related to scientific publications and their bibliography have been
developed and used for quite some time. For example, the Index of Citation of Scientific
Articles, the total volume of citations, the Hirsch index, the impact factor, etc. But in
our opinion, for authors and readers of scientific publications, it is important not only
the quantitative (how many?), but also the qualitative (who?). Element of the list
citations; and the ease of access to a specific article in a bibliography or reverse
bibliography.</p>
      <p>The citation support tools considered in this work are used to develop the
technological capabilities of the IPM electronic library, and are partially embedded in the
interface for working with the library.</p>
      <p>This work was supported by the Russian Foundation for Basic Research, projects
19-01-00069, 20-07-00528, 18-07-01292, 18-07-00841.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Google</given-names>
            <surname>Scholar</surname>
          </string-name>
          . https://scholar.google.ru/schhp?hl=ru
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>2. Crossref association. https://www.crossref.org/about/</mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <article-title>3. NEIKON is a national consortium of Russian educational, scientific and cultural organizations</article-title>
          . https://neicon.ru/
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <article-title>4. KIAM digital library</article-title>
          . https://library.keldysh.ru/prep_qf.asp
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Crossref</given-names>
            <surname>Labs</surname>
          </string-name>
          . https://www.crossref.org/labs/
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Gorbunov-Possadov</surname>
            ,
            <given-names>M.M.:</given-names>
          </string-name>
          <article-title>Online bibliographic reference</article-title>
          .
          <source>KIAM Preprint No</source>
          <volume>11</volume>
          ,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          ,
          <year>2020</year>
          . https://library.keldysh.ru/preprint.asp?id=
          <fpage>2020</fpage>
          -
          <lpage>11</lpage>
          ; https://doi.org/10.20948/prepr-2020
          <source>-11</source>
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Slepenkov</surname>
            ,
            <given-names>M.I.</given-names>
          </string-name>
          :
          <article-title>Conference proceedings in the on-line library of Keldysh Institute</article-title>
          . KIAM Preprint No 18,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          ,
          <year>2020</year>
          . http://doi.org/10.20948/prepr-2020-18; http://library.keldysh.ru/preprint.asp?id=
          <fpage>2020</fpage>
          -
          <lpage>18</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Ivanov</surname>
            ,
            <given-names>D.S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ivlev</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Ivanova</surname>
            ,
            <given-names>T.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Roldugin</surname>
            ,
            <given-names>D.S.</given-names>
          </string-name>
          :
          <article-title>Microsatellite Mock-Up Automatic Balancing on the Air-Bearing Laboratory Facility</article-title>
          .
          <source>KIAM Preprint No</source>
          <volume>16</volume>
          ,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          ,
          <year>2020</year>
          . http://doi.org/10.20948/prepr-2020-16; http://library.keldysh.ru/preprint.asp?id=
          <fpage>2020</fpage>
          -
          <lpage>16</lpage>
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Revyakin</surname>
            ,
            <given-names>Y.G.</given-names>
          </string-name>
          :
          <article-title>The opportunities of web-analysis to estimate the effectiveness of scientific publications</article-title>
          .
          <source>KIAM Preprint No</source>
          <volume>50</volume>
          ,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          ,
          <year>2020</year>
          . http://doi.org/10.20948/prepr-2020-50; https://keldysh.ru/papers/2020/prep2020_
          <fpage>50</fpage>
          .pdf
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Polilova</surname>
            ,
            <given-names>T.A.</given-names>
          </string-name>
          :
          <article-title>Infrastructure of scientific publications</article-title>
          .
          <source>KIAM Preprint No</source>
          <volume>15</volume>
          ,
          <string-name>
            <surname>Moscow</surname>
          </string-name>
          ,
          <year>2009</year>
          . http://library.keldysh.ru/preprint.asp?id=
          <fpage>2009</fpage>
          -
          <lpage>15</lpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>