<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Unsupervised Co-Authorship Based Algorithm for Clustering of R&amp;D Trends at Science and Technology Centers in Oil and Gas Industry</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Fedor Krasnov</string-name>
          <email>krasnov.fv@gazprom-neft.ru</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Mars Khasanov</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Gazprom Neft PJSC</institution>
          ,
          <addr-line>Pochtamtskaya ul. d. 3-5, St Petersburg 190000</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Science &amp; Technology Centre GazpromNeft</institution>
          ,
          <addr-line>75-79 liter D, Moika River emb., St Petersburg, 190000</addr-line>
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Planning of research and development trends in science and technology centers should be in line with the actual state of things. Such phenomena as organizational frigidity, research diversi cation and propensity for developing IT products are able to signi cantly impair any strategies and development trends. However, feasibility of plans is an important attribute of development able to which signi cantly raise personnels motivation for achieving best results. This is why setting achievable goals is of such importance. There are never enough quantitative tools for appraisal of research and development activities. Formal paperwork reporting on R&amp;D is not suitable for evaluation of researchers involvement and dedication. Instead, small formats of research works such as presentations at scienti c and technical conferences or scienti c articles in peer-reviewed scienti c publications require much more informal approach from researchers. Analysis of a science and technology centers performance based on its publication activity is a common practice. Many studies analyze text corpus of scienti c articles and make conclusions on development trends. Text data noise levels are quite high; even most advanced analysis methods based on word embedding are able to produce accurate predictions only if analyzed are huge text volumes which are seldom available in case of small organizations. Small research organizations su er the most from inaccurate planning of research activities. Authors of this research propose to take advantages of articles (presentations) analysis based on co-authorship bipartite graph to extract research trends with the purpose of their further evaluation and planning.</p>
      </abstract>
      <kwd-group>
        <kwd>clustering</kwd>
        <kwd>co-authorship graph</kwd>
        <kwd>research activitys attributes</kwd>
        <kwd>scientometrics</kwd>
        <kwd>organizational hypotheses</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>Todays focus on scienti c approaches to managerial decisions becomes ever more
vital. As data volumes grow analytic tools used by organizations management
become less e cient. On the other hand often there is no su cient data volume
for sustainable work of advanced algorithms. On the forefront of this trend there
is a problem of adaptation and developing new heuristics for solving such classic
problems as clustering which are to be used for organizational purposes.</p>
      <p>
        Data clustering based on a static model gained momentum as such
algorithms when PAM [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], CLARANS [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], DBSCAN [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], CURE [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] and ROCK [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]
had been discovered. However, lately a special focus is on the clustering
algorithms based on dynamic model such as CHAMELEON [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. The basic idea of the
CHAMELEON [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] algorithm is in applying proximity metrics to a graph built on
a set of clusterable data through the k nearest neighbor (KNN) method. Graph
metrics prove more e cient for top-down data breaking in case of complex
objects (Figure 1).
      </p>
      <p>Algorithms diversity does not make less important the task of their e ciency
evaluation. However, given a limited number of data and in order to improve
managerial decisions the quality of clustering must to have not only
mathematically substantiated but also reliable image components. In other words, it should
be comprehensible at a glance and not requiring going deep into formulas. Such
are the todays businesses needs.</p>
    </sec>
    <sec id="sec-2">
      <title>Methodology of the research</title>
      <p>From a formal point of view we have to solve the problem of unsupervised
machine learning for co-authorship graph, attribute clusters to particular subjects
and detect variations in clusters over the time.</p>
      <p>Clustering of co-authorship graph can be achieved based on various nodes
metrics:
{ Degree centrality
{ Betweenness centrality
{ Closeness centrality
{ Harmonic centrality
{ Clustering
Let us examine the conceptual meaning of the Betweenness centrality metrics
applied to the problem of clustering of co-authorship graph in an R&amp;D
organization. The Betweenness centrality metrics shows how important is a particular
node for the graphs connectivity. Connections in a co-authorship graph re ect
research collaboration. Co-authorship graphs are not always connected; usually
they consist of several connected components of various sizes.</p>
      <p>Connected components are natural clusters. Small connected components
re ect primary initiatives researchers rst articles. However the main connected
component may contain up to 90% of a co authorship graphs nodes and call for
a special approach to clustering.</p>
      <p>To extract clusters from a main connected component of a co-authorship
graph one may use the method of arti cial removal of the nodes with the
topvalue Betweenness centrality metrics. As each of such nodes is removed a graph
may break down into several disconnected components. The Figure 2 shows such
separation model.</p>
      <p>Each of the components resulting from such separation can be analyzed for
subjects homogeneity based on articles texts of which each component is formed.
Several iterations would result in a set of clusters.</p>
      <p>The method proposed by the authors is a heuristic one and requires
examination by a particular formal criterion. Conventional criteria for the purposes of
clustering are proximity metrics for a cluster components and distances between
components in separate clusters.</p>
      <p>Convergence of the authors method is ensured through searching a minimum
of functional errors in determining k clusters with 1.</p>
      <p>Where WSSci within-cluster variation for cluster Ci, mi - centroid of Ci and
i 2 [1::k] (2). The total WSS measures the compactness of the clustering and
we want it to be as small as possible.</p>
      <p>And BSS - weighted inter-cluster separation, measured by the between
cluster sum of squares (3).</p>
      <p>k
W SS = X X x
mi
jCij mj
mi
2
(2)
(3)
Where jCij - is a cluster size.</p>
      <p>Interdisciplinary researches lead to the situation where articles may fall into
several subject categories, thus the resulting clusters would be intersecting and
non-exclusive.
3</p>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>The Gazpromneft R&amp;D Center`s publication activity has been chosen as a
research subject. The data has been obtained from the OnePetro open online
library of the international Society of Petroleum Engineers (SPE). Upon cleansing
172 articles have been singled out.</p>
      <p>
        Let us base our prediction on a co-authorship graph. For this purpose we
build a co-authorship bipartite graph [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ] with the nodes: author (479) and article
(171). Authors have technical competences while articles have such attributes as
title, year of publication and key words.
      </p>
      <p>The resulting co-authorship graph has 26 connected components of which
the strongest one has 556 nodes while the others have maximum eight nodes.
Connected components with up to eight nodes represent the researchers rst
articles.</p>
      <p>Let us examine the strongest connected component (556 nodes). We extract
a subgraph from the main co-authorship graph based on the nodes contained
in the strongest connected component. The resulting subgraph is shown on the
Figure 3 .</p>
      <p>Let us compute the Betweenness centrality metrics for the resulting subgraph.
The obtained Betweenness centrality values are shown on the Figure 4. Zero
values for the Betweenness centrality are not shown.</p>
      <p>As we can see on the Figure 4 the values of the Betweenness centrality metrics
in the third quartile belong to only 23 nodes which represent less than 5% of the
total number of nodes.</p>
      <p>Let us apply the algorithm of arti cial removal of the nodes with the highest
value of the Betweenness centrality metrics. The Figure 5 shows correlation
between the connected components number and the number of arti cially removed
nodes.</p>
      <p>As the nodes get removed the graph can behave in two following modes:
1. Connectivity constraint (Mode I)
2. Exponential decay (Mode II)</p>
      <p>Mode I is characterized by the graphs retaining its connectivity as the nodes
with high values of the Betweenness centrality metrics get removed. It means
that the removed nodes are not the only connections between clusters.</p>
      <p>Mode II is characterized by following the exponential model of a graphs
decay when each removed node causes exponential growth in emergence of new
connected components.</p>
      <p>Let us have a closer look at the second half of the Mode I of the algorithm
when the graph has broken down into six connected components. These
components sizes are 511, 34, 1, 1, 1, 1. Among them the component with 34 nodes
shown on the Figure 6 represents the most pronounced direction of research into
Subject 1.</p>
      <p>We have examined extraction of one cluster in detail. The complete algorithm
of clusters extraction would consist of the following steps:
1. Building a co-authorship bipartite graph: G
2. Finding the Betweenness centrality metrics for the G graph
3. Finding a node with BCmax metrics (Betweenness centrality)
4. Removing the BCmax node (Betweenness centrality) from the G graph
5. Deriving a list of connected components of the G graph
6. Computing a quality metrics W SS and BSS of the retrieved clusters
7. Further the algorithm is iterated for each connected component
8. Algorithm is completed when all connected components represent clusters
of acceptable quality.</p>
      <p>
        For the selected co-authorship graph 16 clusters have been extracted. To
compute values and W based on the articles texts we have applied the Vector Space
Model (VSM). Each article is represented as a vector with the BM25 [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] metrics
values for each word. Articles are considered as BOW ("bag of words"). For
measuring distances between the articles VSM we have applied cosine measure.
The Figure 7 shows the clusters separability matrix.
      </p>
      <p>For the purposes of comparison of the resulting articles clustering we have
performed clustering with the KMeans algorithm which yielded similar results
(Figure 8 ).</p>
      <p>The articles corpus has been broken down into clusters using the KMeans
algorithm. The resulting clusters allowed arranging authors into groups.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>The authors have proposed a method of extraction of research trends based
on the co-authorship graph. Concept-wise the method belongs to the top-down
clustering algorithms. The Betweenness centrality metrics has been chosen as a
criterion for extracting clusters.</p>
      <p>The metrics of cluster components proximity and the metrics of distances
between separate clusters based on the subjects of articles in the co-authorship
graph have been applied as a clusters quality criterion. This method resulted in
an aggregate vision of organizations research trend based on the open data on
its researchers publication activities.</p>
      <p>The authors method of extraction of research trends based on the co-authorship
graph has been tested at the Gazpromneft R&amp;D Center. As a result 16 clusters
indicative of the organization activity have been extracted. The following
attributes of the authors method of extraction of research trends based on the co
authorship graph are signi cant:
{ Recursive algorithm allows working with graphs of various orders.
{ Greedy algorithm for clusters quality evaluation allows correcting
optimization at any step.
{ Applying a co-authorship bipartite graph allows analyzing various
projections.
{ Working with the data in public domain gives ample opportunities for
application in business intelligence.</p>
      <p>The novelty of the method of extraction of research trends based on the
coauthorship graph proposed by the authors is in applying the co-authorship
bipartite graph and in the dynamic model of clustering using structural metrics
for the co-authorship graph and proximity metrics for research articles texts.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <given-names>Leonard</given-names>
            <surname>Kaufman and Peter J Rousseeuw</surname>
          </string-name>
          .
          <article-title>Finding groups in data: an introduction to cluster analysis</article-title>
          , volume
          <volume>344</volume>
          . John Wiley &amp; Sons,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Raymond</surname>
            <given-names>T.</given-names>
          </string-name>
          <string-name>
            <surname>Ng</surname>
          </string-name>
          and Jiawei Han.
          <article-title>Clarans: A method for clustering objects for spatial data mining</article-title>
          .
          <source>IEEE transactions on knowledge and data engineering</source>
          ,
          <volume>14</volume>
          (
          <issue>5</issue>
          ):
          <volume>1003</volume>
          {
          <fpage>1016</fpage>
          ,
          <year>2002</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <given-names>Martin</given-names>
            <surname>Ester</surname>
          </string-name>
          ,
          <string-name>
            <surname>Hans-Peter Kriegel</surname>
          </string-name>
          , Jorg Sander, Xiaowei
          <string-name>
            <surname>Xu</surname>
          </string-name>
          , et al.
          <article-title>A density-based algorithm for discovering clusters in large spatial databases with noise</article-title>
          .
          <source>In Kdd</source>
          , volume
          <volume>96</volume>
          , pages
          <fpage>226</fpage>
          {
          <fpage>231</fpage>
          ,
          <year>1996</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <given-names>Sudipto</given-names>
            <surname>Guha</surname>
          </string-name>
          , Rajeev Rastogi, and
          <string-name>
            <given-names>Kyuseok</given-names>
            <surname>Shim</surname>
          </string-name>
          .
          <article-title>Cure: an e cient clustering algorithm for large databases</article-title>
          .
          <source>In ACM Sigmod Record</source>
          , volume
          <volume>27</volume>
          , pages
          <fpage>73</fpage>
          {
          <fpage>84</fpage>
          . ACM,
          <year>1998</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <given-names>Sudipto</given-names>
            <surname>Guha</surname>
          </string-name>
          , Rajeev Rastogi, and
          <string-name>
            <given-names>Kyuseok</given-names>
            <surname>Shim</surname>
          </string-name>
          .
          <article-title>Rock: A robust clustering algorithm for categorical attributes</article-title>
          .
          <source>Information systems</source>
          ,
          <volume>25</volume>
          (
          <issue>5</issue>
          ):
          <volume>345</volume>
          {
          <fpage>366</fpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <given-names>George</given-names>
            <surname>Karypis</surname>
          </string-name>
          ,
          <string-name>
            <surname>Eui-Hong Han</surname>
            , and
            <given-names>Vipin</given-names>
          </string-name>
          <string-name>
            <surname>Kumar</surname>
          </string-name>
          . Chameleon:
          <article-title>Hierarchical clustering using dynamic modeling</article-title>
          .
          <source>Computer</source>
          ,
          <volume>32</volume>
          (
          <issue>8</issue>
          ):
          <volume>68</volume>
          {
          <fpage>75</fpage>
          ,
          <year>1999</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <given-names>Fedor</given-names>
            <surname>Krasnov</surname>
          </string-name>
          .
          <article-title>Analysis of methods of construction of the graph of co-authorship: an approach based on bipartite graph</article-title>
          .
          <source>International Journal of Open Information Technologies</source>
          ,
          <volume>6</volume>
          (
          <issue>2</issue>
          ):
          <volume>31</volume>
          {
          <fpage>37</fpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <given-names>Yuanhua</given-names>
            <surname>Lv</surname>
          </string-name>
          and
          <article-title>ChengXiang Zhai. Adaptive term frequency normalization for bm25</article-title>
          .
          <source>In Proceedings of the 20th ACM international conference on Information and knowledge management</source>
          , pages
          <year>1985</year>
          {
          <year>1988</year>
          . ACM,
          <year>2011</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>