<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>The using of machine learning and neural networks in the processing of computer simulation results for medical diagnostics</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Maxim Polyakov</string-name>
          <email>m.v.polyakov@volsu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander Khoperskov</string-name>
          <email>khoperskov@volsu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Egor Borisovskii</string-name>
          <email>infomod@volsu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Egor Emelyanov</string-name>
          <email>infomod@volsu.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Department of information systems and computer modeling, Volgograd State University</institution>
          ,
          <addr-line>Volgograd</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>189</fpage>
      <lpage>192</lpage>
      <abstract>
        <p>-We use machine learning technologies and neural networks to improve the efficiency of medical diagnostics based on the microwave radiometry. Originality of our approach is that we use the results of computer modeling temperature fields in multicomponent biological tissues to build training and test data sets. We investigate limits of applicability of the method for diagnosing breast cancer using microwave radiometry data. Task of determining diagnostic quality for different sizes of tumors seems promising to us.</p>
      </abstract>
      <kwd-group>
        <kwd>computer modeling</kwd>
        <kwd>machine learning</kwd>
        <kwd>neural networks</kwd>
        <kwd>diagnosis of cancer</kwd>
        <kwd>microwave radiometry</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>I. INTRODUCTION</p>
      <p>
        Early diagnosis of breast cancer is an important issue in
modern medicine. Incidence of breast cancer is increasing
worldwide and is one of the most common types of cancer.
At the moment, there is no effective means to prevent breast
cancer. Probability of successful treatment and full recovery of
the patient depends entirely on early detection and diagnosis.
Breast cancer is a curable disease with a probability of
97% with early detection [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ]. Microwave radiometry is a
non-invasive method for measuring internal temperature in
biological tissues. This method is based on measuring the
selfradiation of the biological tissues in the radio to microwave
range. Possibility of using microwave radiometry to diagnose
breast cancer was shown in the article [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] for the first time. We
can assume that the theoretical basis of microwave radiometry
in mammology is based on the research of the French scientist
M. Gautherie [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ] to some extent. He convincingly showed that
the heat release of the tumor is directly proportional to the
rate of its growth. His research was based on clinical data
from more than 85,000 patients. Microwave radiometry has
a unique ability to detect fast-growing tumors in the first
place. Microwave radiometry is also used in other fields of
Copyright © 2020 for this paper by its authors.
      </p>
      <p>
        Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)
medicine [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. The paper [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ] states that the minimum
size of a cancerous tumor detected by mammography is 1.68
cm in diameter. The task of microwave radiometry is to
detect smaller tumors. Microwave radiometry can also detect
cancerous tumors or early structural changes that are not
detected and can be skipped when using mammography.
      </p>
    </sec>
    <sec id="sec-2">
      <title>II. PROBLEM STATEMENT</title>
      <p>
        Mathematical models and numerical methods that we use
to construct a sample of temperature data are described in [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
We have verified models and it has shown the effectiveness
of building models of the mammary glands healthy patients
(without cancer pathologies) [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. The main task of this study
is to determine threshold value size of the tumor, which can
be detected by microwave radiometry.
      </p>
      <p>Fig. 1. Distribution of thermodynamic temperature at a depth 4 cm obtained
by computer simulation. On the left is a model with a tumor of radius R =
0.5 cm.</p>
      <p>To do this, we need to build samples data from computer
modeling of breast temperatures, volume which will allow for
machine learning, as well as binary classification of test data
(healthy-sick). When building a large volume of models, it
is necessary to take into account the fact that most often
malignant tumors appear in the upper outer quadrant. We
present results of numerical simulation thermal dynamics in
the biological tissues of the mammary gland (Fig. 1.).</p>
      <p>III. MACHINE LEARNING METHODS AND TOOLS
The following methods are used for binary classification
of computer modeling data: support vector machines (SVM),
k-nearest neighbors, (KNN) and the naive Bayesian classifier
(NBC). These methods are implemented in the Scikit-learn
Python library. In addition to the classification task, this library
allows you to build regressions, perform clusterization, and so
on.</p>
      <p>
        The training set is a temperature data set at points of the
breast (according to the survey method [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ]) in the microwave
range (depth temperature) and in the infrared range (skin
temperature). Each model has the “1” – sick or “0” – healthy flag.
Equal data samples containing 80 models were constructed:
without a tumor, with a tumor of radii R=0.5 cm, R=0.75 cm
and R=1 cm (Fig. 2.). A cross section was made with skin and
depth temperatures of points 0,..., 8 and we have a combined
data set
      </p>
      <p>2 T01 T11 : : : T118 3 2 y1 3
X = 664: T::2: : : : : : : : : : : : : : : : T::12:8:775 ; Y = 664: y:2: :775 ;</p>
      <p>0 T12 : : :
where T0i; : : : ; T8i are internal temperature at the points
0; : : : ; 8, T9i; : : : ; T1i8 are temperature of the skin at points
0; : : : ; 8 and yi 2 fHealth, R=0.5, R=0.75, R=1.0g is label i
model.</p>
      <p>Ratio of cancer and healthy models in the training and
test sets is assumed to be equal, in order to preserve data
uniformity. We conducted a statistical analysis of the data at
the first stage. It showed general differences between the data
sets.</p>
      <p>Qualitative analysis of large amounts of data is particularly
difficult. Statistical analysis confirms reliable differences in
temperature data at certain points of the breast (Fig. 3.).</p>
    </sec>
    <sec id="sec-3">
      <title>IV. THE USING OF NEURAL NETWORKS Neural networks are another way to perform binary classification. It is necessary that the input data lie in a single range for successful training of the neural network. We used</title>
      <p>1
0
1
0
0
where Mj is the average value of the samples, and Sj is
the standard deviation of the samples.</p>
      <p>a
b
100
200
300
400
500
100
200</p>
      <p>300
epoch
400
500</p>
      <p>We solve binary classification problem, so number of
neurons in the output layer is two. The softmax function is
selected as the activation function for last layer. This function
converts the network output vector to another vector. The
coordinate of this vector is located in range [0; 1]. The sum
of the coordinates is 1. We define patient class by the largest
coordinate in output vector. Parameters of the layers and their
number were selected empirically. We were based on the
results of testing.</p>
      <p>To train a neural network, the original sample consisting
of 160 numerical simulation results was randomly mixed and
divided into two parts, the first p art c ontaining 1 20 survey
results, the second part containing 40. Gradient optimization
methods were used to train neural networks.</p>
      <p>In order for the model not to be retrained, the number of
epochs was set to 500. The Fig.4. shows the accuracy of model
and model loss in learning process.</p>
      <p>G = pL S ;
(3)</p>
      <p>To determine dependence of the effectiveness diagnostics
on size of the tumor, we used binary classification “Healthy”
and “Cancer”. This is due to the fact that most important, in
our opinion, is correct detection of malignant neoplasms.</p>
      <p>A measure of the effectiveness of medical diagnostics
is considered to be the geometric mean of sensitivity and
specificity</p>
      <p>MP thanks RFBR (project number 19-37-90142) for the
financial support. AK acknowledges the Ministry of Science
and Higher Education of the Russian Federation (government
task, project No.0633-2020-0003) for the financial support of
the development of the software. EE is grateful to RFBR and
the government of Volgograd region according to the research
project No. 19-47-343008 for the financial support.</p>
      <p>The support vector method gave the best result in relation
to other machine learning methods (Table 1), which indicates
that this method is better applicable to this type of tasks and to
this structure of training data set. The SVM method’s gain in
relation to the NBC is 10% for a data set with a tumor R=0.5
cm. Which is significant for the task of medical diagnostics.
Ratio of correctly classified models to volume of test sample
was used as a measure of efficiency for comparing methods.
E = F! , where ! is number of correctly recognized models,
and F is volume of test data set.</p>
      <p>0.8
0.75
0.7
0.65
E
0.6
0.55
0.5
0.45
0.5
0.6
0.7
0.8
0.9</p>
      <p>1</p>
      <p>R, cm</p>
      <p>The calculated sensitivity and specificity indicators (Table 2)
are quite high. At the same time, we should note characteristic
space limited only by temperatures and rather small training
data set.</p>
      <p>Neural network testing results show comparable results
with machine learning methods (Table 3). Structure of
neural network significantly affects the accuracy of diagnostics.
Effectiveness of diagnostics increases with increase in radius
of tumor (Fig. 5.). Even for small tumors of radius R=0.5
cm with a probability of 57.5%, it is possible to correctly
determine the class. We can expect a successful application
of microwave radiometry method for smaller tumors, with an
expansion of feature space, an increase in sample size, and the
use of heuristics.</p>
    </sec>
    <sec id="sec-4">
      <title>ACKNOWLEDGMENT</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>A.G.</given-names>
            <surname>Gudkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Yu</surname>
          </string-name>
          . Leushin,
          <string-name>
            <given-names>I.A.</given-names>
            <surname>Sidorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.G.</given-names>
            <surname>Vesnin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.O.</given-names>
            <surname>Porokhov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.K.</given-names>
            <surname>Sedankin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.V.</given-names>
            <surname>Agasieva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.V.</given-names>
            <surname>Chizhikov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.N.</given-names>
            <surname>Gorlacheva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.I.</given-names>
            <surname>Lazarenko</surname>
          </string-name>
          and
          <string-name>
            <given-names>V.D.</given-names>
            <surname>Shashurin</surname>
          </string-name>
          ,
          <article-title>"The use of multichannel microwave radiometry for the functional diagnosis of the brain,"</article-title>
          <source>Medical Technology</source>
          , vol.
          <volume>2</volume>
          , no.
          <issue>314</issue>
          , pp.
          <fpage>22</fpage>
          -
          <lpage>25</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>A.G.</given-names>
            <surname>Losev</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.A.</given-names>
            <surname>Mazepa</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.V.</given-names>
            <surname>Zamechnik</surname>
          </string-name>
          ,
          <article-title>"About several typical traits in the diagnosis of mammary glands pathologyaccrding to the date of microwave radiometry," Modern problems of science and education</article-title>
          , vol.
          <volume>6</volume>
          , pp.
          <fpage>254</fpage>
          -
          <lpage>261</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>A.H.</given-names>
            <surname>Barrett</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.C.</given-names>
            <surname>Myers</surname>
          </string-name>
          ,
          <article-title>"Subcutaneous Temperature: A method of Noninvasive Sensing,"</article-title>
          <source>Science</source>
          , vol.
          <volume>190</volume>
          , pp.
          <fpage>669</fpage>
          -
          <lpage>671</lpage>
          ,
          <year>1975</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>E.Y.K.</given-names>
            <surname>Ng</surname>
          </string-name>
          ,
          <article-title>"A review of thermography as promising non-invasive detection modality for breast tumor,"</article-title>
          <source>Int J Therm Sci</source>
          , vol.
          <volume>48</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>849</fpage>
          -
          <lpage>859</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>J.R.</given-names>
            <surname>Keyserlingk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.D.</given-names>
            <surname>Ahlgren</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Belliveau</surname>
          </string-name>
          and
          <string-name>
            <given-names>M.</given-names>
            <surname>Yassa</surname>
          </string-name>
          ,
          <article-title>"Functional infrared imaging of the breast, "</article-title>
          <source>IEEE Eng Med Biol Mag</source>
          , vol.
          <volume>19</volume>
          , no.
          <issue>3</issue>
          , pp.
          <fpage>30</fpage>
          -
          <lpage>41</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>M.</given-names>
            <surname>Gautherie</surname>
          </string-name>
          ,
          <article-title>"Temperature and Blood Flow Patterns in Breast Cancer During Natural Evolution and Following Radiotherapy,"</article-title>
          <source>Biomedical Thermology</source>
          , pp.
          <fpage>21</fpage>
          -
          <lpage>64</lpage>
          ,
          <year>1982</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>M.K.</given-names>
            <surname>Sedankin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Yu</surname>
          </string-name>
          . Leushin.,
          <string-name>
            <given-names>A.G.</given-names>
            <surname>Gudkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.G.</given-names>
            <surname>Vesnin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.A.</given-names>
            <surname>Khromov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.O.</given-names>
            <surname>Porokhov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.A.</given-names>
            <surname>Sidorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.V.</given-names>
            <surname>Agasieva</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.N.</given-names>
            <surname>Gorlacheva</surname>
          </string-name>
          ,
          <article-title>"Modeling the intrinsic thermal radiation of the kidney in the microwave range,"</article-title>
          <source>Medical Technology</source>
          , vol.
          <volume>1</volume>
          , no.
          <issue>313</issue>
          , pp.
          <fpage>44</fpage>
          -
          <lpage>47</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>M.K.</given-names>
            <surname>Sedankin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Yu. Leushin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.G.</given-names>
            <surname>Gudkov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.G.</given-names>
            <surname>Vesnin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.A.</given-names>
            <surname>Sidorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. V.</given-names>
            <surname>Agasieva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.M.</given-names>
            <surname>Ovchinnikov</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.A.</given-names>
            <surname>Vetrova</surname>
          </string-name>
          ,
          <article-title>"Applicator antennas for medical microwave radiothermographs,"</article-title>
          <source>Medical Technology</source>
          , vol.
          <volume>4</volume>
          , no.
          <issue>310</issue>
          , pp.
          <fpage>13</fpage>
          -
          <lpage>15</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>M.V.</given-names>
            <surname>Polyakov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.V.</given-names>
            <surname>Khoperskov</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.V.</given-names>
            <surname>Zamechnic</surname>
          </string-name>
          ,
          <article-title>"Numerical Modeling of the Internal Temperature in the Mammary Gland,"</article-title>
          <source>Lecture Notes in Computer Science</source>
          , vol.
          <volume>10594</volume>
          , pp.
          <fpage>128</fpage>
          -
          <lpage>135</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>V.</given-names>
            <surname>Levshinskii</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Polyakov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Losev</surname>
          </string-name>
          and
          <string-name>
            <given-names>A.</given-names>
            <surname>Khoperskov</surname>
          </string-name>
          ,
          <article-title>"Verification and Validation of Computer Models for Diagnosing Breast Cancer Based on Machine Learning for Medical Data Analysis,"</article-title>
          <source>Communications in Computer and Information Science</source>
          , vol.
          <volume>1084</volume>
          , pp.
          <fpage>447</fpage>
          -
          <lpage>460</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>