<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Iris segmentation in an image using U-Net convolutional neural network architecture</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Yulia Ganeeva</string-name>
          <email>jganeeva99@mail.ru</email>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Geoinformatics and Information Security department Samara National Research University Samara</institution>
          ,
          <country country="RU">Russia</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Geoinformatics and Information Security department Samara National Research University; Image Processing Systems Institute of RAS - Branch of the FSRC "Crystallography and Photonics" RAS Samara</institution>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2020</year>
      </pub-date>
      <fpage>10</fpage>
      <lpage>13</lpage>
      <abstract>
        <p>-The accuracy of segmentation plays an important role in the methods for personal identification by iris images. In this paper, we study the iris segmentation method based on the convolutional neural network of the UNet architecture. As part of the research, manual segmentation of the images of the used dataset was performed, the optimal network training parameters were determined, and the segmentation quality was evaluated. All studies in the paper were conducted using the open MMU Iris Image Database. The results showed that the studied approach provides high precision segmentation of the iris images.</p>
      </abstract>
      <kwd-group>
        <kwd>accuracy</kwd>
        <kwd>convolutional neural network</kwd>
        <kwd>iris</kwd>
        <kwd>segmentation</kwd>
        <kwd>U-Net</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>INTRODUCTION</p>
      <p>
        Recently, the most widespread methods of identifying a
person use biometric data (face images [
        <xref ref-type="bibr" rid="ref1 ref2">1, 2</xref>
        ], hand geometry
[
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ], fingerprints [5, 6], iris, etc.). Iris identification is one
of the most accurate and reliable methods of biometric
identification since the texture of the iris is remarkably stable
over time. The accuracy of segmentation plays an important
role in achieving high-quality indicators of identification by
the iris image. Since the iris is an annular area between the
pupil and the sclera in the image, the solution to the
segmentation problem is often reduced to approximating the
inner and outer borders of the iris with circles. For this
purpose, most works use the Daugman method [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ], and the
Hough transform for the detection of circles [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], as well as
other methods, for example, based on the analysis of the
distribution of boundary points [9].
      </p>
      <p>Unfortunately, the segmentation of the iris performed by
these methods is often not accurate enough due to the partial
overlap of the iris with the eyelids and eyelashes, as well as
the appearance of glare from the light source. Also, the shape
of the iris itself is not always well approximated by circles.
Thus, a relevant task is to improve the quality of iris
segmentation.</p>
      <p>
        With the success of deep neural network models,
researchers are increasingly turning their attention to
convolutional neural networks to further improve the
accuracy of existing iris segmentation methods. To solve the
problem of iris segmentation, we propose to use an approach
based on training the convolutional neural network (CNN) of
the U-Net architecture [
        <xref ref-type="bibr" rid="ref11 ref12">11,12</xref>
        ].
      </p>
      <p>U-Net is considered one of the standard CNN
architectures for image segmentation tasks when you need
not only to define the entire image class but also to segment
regions, i.e. create a mask that will divide the image into
several classes. One of the main advantages of the network,
Evgeny Myasnikov
which is essential in the context of this work, is the ability to
train it on a small amount of data.</p>
      <p>The paper has the following structure. Section 2 is
devoted to the description of the studied approach to iris
image segmentation, a description of the network
architecture, the features of data preparation, and training.
Section 3 describes the dataset used in the paper and
provides the results of experimental studies. The paper ends
up with the conclusion and reference list.</p>
      <p>II.</p>
    </sec>
    <sec id="sec-2">
      <title>METHOD</title>
      <sec id="sec-2-1">
        <title>A. The U-Net Architecture</title>
        <p>U-Net is a famous CNN architecture for solving
biomedical problems (segmentation of various types of cells,
determining the boundaries between dense cell structures,
etc.) and other image segmentation tasks. The main
advantage of this model is the ability to learn on small
datasets and, at the same time, show high accuracy, which is
a common problem for computer vision problems.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>The network architecture is shown in Fig. 1.</title>
      <p>
        Fig. 1. The U-Net architecture [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>As you can see in the figure, the architecture consists of a
contracting path (left) to capture the context and an
expanding path (right) to allow precise localization. There
are two classes in the paper: iris and non-iris.</p>
      <p>The contracting path corresponds to the typical structure
of a convolutional neural network. It consists of re-applying
two convolutions (kernel size 3x3), followed by a layer of
ReLU and max-pooling (kernel size 2x2) with step 2.</p>
      <p>Each step of the expanding path contains an expanding
feature map layer (up-conv), the reverse of the max-pooling,
followed by a convolution (kernel size 2x2) that reduces the
number of feature channels. This is followed by
concatenation with the appropriate cropped feature map
(copy and crop) from the contracting path and two
convolutional layers (kernel size 3x3), each of which is
followed by a ReLU layer.</p>
      <p>B.</p>
      <sec id="sec-3-1">
        <title>Model training and preparatory stages</title>
        <p>
          At the stage of preparation for training, a pre-trained
model was taken [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. The dataset was divided into training
and validation sets. The color source images were converted
to grayscale, and reduced to a size of 320 x 320 pixels. Pixel
values were scaled to the range [0;1]
        </p>
        <p>
          Binary cross-entropy was used as a loss function, which
determines how the network quality is estimated on training
data. Adam was chosen as the optimizer determining the
mechanism for updating the weights [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ].
        </p>
        <p>III.</p>
        <p>EXPERIMENTS AND RESULTS</p>
        <p>For experimental research, implementation in Python was
performed using the Keras, Numpy, OpenCV, and Matplotlib
libraries.</p>
        <p>
          The MMU Iris Database [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] was used as a dataset of iris
images. The base contained 5 images for the left and right
eyes of 45 people, which gave a total of 450 images. To train
and evaluate the quality of segmentation, manual
segmentation of all images from the set was performed.
        </p>
        <p>
          Nine experiments were conducted to determine the best
parameters. The neural network was trained using the found
parameters for 50 epochs. At the stage of searching for the
best parameters during training, the pre-trained neural
network [
          <xref ref-type="bibr" rid="ref13 ref16">13, 16</xref>
          ] was configured on the above data with the
following parameters: the learning rate for the first, second
and third experiments was equal to 10-3, for the fourth, fifth
and sixth - 10-4, for the seventh, eighth and ninth - 10-5, the
number of training epochs (epochs) was 10, the size of the
random subsample (batch size) used to estimate the gradient
for the first, fourth, and seventh experiments was 10, the
second, fifth, and eighth - 20, and the third, sixth, and
ninth - 40.
        </p>
        <p>To monitor the training process, the value of
crossentropy and segmentation accuracy was evaluated using the
validation set at the end of each epoch of training.</p>
        <p>Segmentation accuracy was estimated as the proportion
of correctly classified pixels in the images of the validation
set.</p>
        <p>The values of the loss function and the accuracy of the
trained model on the training and validation data for various
values of the batch size and learning rate hyperparameters
are shown in Table 1.</p>
        <p>The plot of changes in the accuracy values and loss
function in the first 10 epochs of neural network training for
the two best models can be seen below in figures 2 and 3.</p>
        <p>As a result of experiments, the following values of
training parameters were selected: learning rate was equal to
10-4, the size of a random sub-sample (batch size) was 40.
Training a neural network with the specified parameters for
50 epochs allowed us to achieve accuracy and loss function
values equal to 99.53 and 0.0071, respectively, on the
validation sample.</p>
        <p>The results of the studied approach for the resulting
model are shown below in figure 4.</p>
        <p>
          Besides, in this paper, we provide an example of iris
segmentation using the previously developed technique [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ].
        </p>
        <p>A brief description of the previously proposed technique
is given below:</p>
        <p>1. Determination of the centers and radii of two circles
approximated the pupil and the iris using the Hough
transform.</p>
        <p>2. Crop the image.</p>
        <p>3. The resulting image is blurred to eliminate minor noise
and smooth the iris.</p>
        <p>4. Conversion to a monochrome image.
5. Contour detection.
6. Morphological transformation (closing gaps).</p>
        <p>7. Construction of the mask of the open area of the iris
(each pixel has a value of 1 if this pixel belongs to the iris,
and 0 otherwise).</p>
        <p>The use of the aforementioned technique allowed
obtaining 90.67% of segment accuracy.</p>
        <p>The accuracy of the method considered in this paper is
99.53%, which is 8.86% higher, the use of a CNN
significantly compared to the previously proposed
technique.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>CONCLUSION</title>
      <p>In this paper, we study the iris segmentation method
based on the convolutional neural network of the U-Net
architecture. To configure and evaluate the method, manual
segmentation of images from the open MMU Iris Image
Database was performed.</p>
      <p>Using the specified dataset, the best values of the
training parameters were determined, and segmentation
quality was estimated. Studies have shown that the approach
under study allows us to achieve 99.53% segmentation on
the validation dataset.</p>
    </sec>
    <sec id="sec-5">
      <title>ACKNOWLEDGMENT</title>
      <p>The work was partly funded by RFBR according to the
research project 18-01-00748 in parts of «II. Method» - «III.
Experiments and Results» and by the Russian Federation
Ministry of Science and Higher Education within a state
contract with the «Crystallography and Photonics» Research
Center of the RAS in parts «I. Introduction» and «IV.
Conclusion».</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>V.B.</given-names>
            <surname>Nemirovskiy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.K.</given-names>
            <surname>Stoyanov</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.S.</given-names>
            <surname>Goremykina</surname>
          </string-name>
          , “
          <article-title>Face recognition based on the proximity measure clustering</article-title>
          ,”
          <source>Computer Optics</source>
          , vol.
          <volume>40</volume>
          , no.
          <issue>5</issue>
          , pp.
          <fpage>740</fpage>
          -
          <lpage>745</lpage>
          ,
          <year>2016</year>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>2412</fpage>
          -6179- 2016-40-5-
          <fpage>740</fpage>
          -745.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>Yu.V.</given-names>
            <surname>Vizilter</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.S.</given-names>
            <surname>Gorbatsevich</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.V.</given-names>
            <surname>Vorotnikov</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.A.</given-names>
            <surname>Kostromov</surname>
          </string-name>
          , “
          <article-title>Real-time face identification via CNN and boosted hashing forest</article-title>
          ,”
          <source>Computer Optics</source>
          , vol.
          <volume>41</volume>
          , no.
          <issue>2</issue>
          , pp.
          <fpage>254</fpage>
          -
          <lpage>265</lpage>
          ,
          <year>2017</year>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>2412</fpage>
          -6179-2017-41-2-
          <fpage>254</fpage>
          -265.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hashemi</surname>
          </string-name>
          and E. Fatemizadeh, “
          <article-title>Biometric identification through hand geometry,” EUROCON - Int</article-title>
          . Conf. '
          <article-title>Computer as a Tool'</article-title>
          , vol.
          <volume>2</volume>
          , pp.
          <fpage>1011</fpage>
          -
          <lpage>1014</lpage>
          ,
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>S.M.</given-names>
            <surname>Prasad</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.K.</given-names>
            <surname>Govindan</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.S.</given-names>
            <surname>Sathidevi</surname>
          </string-name>
          , “
          <article-title>Bimodal personal recognition using hand images</article-title>
          ,
          <source>” Proc. Int. Conf. Advances in Computing Communication and Control (ICAC3)</source>
          , pp.
          <fpage>403</fpage>
          -
          <lpage>409</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>W.</given-names>
            <surname>Yuan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Lixiu</surname>
          </string-name>
          and Zh. Fuqiang, “
          <article-title>A real time fingerprint recognition system based on novel fingerprint matching strategy</article-title>
          ,
          <source>” 8th International Conference on Electronic Measurement and Instruments</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>81</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>M.</given-names>
            <surname>Kaur</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Singh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Girdhar</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Parvinder</surname>
          </string-name>
          , “
          <article-title>Fingerprint verification system using minutiae extraction technique</article-title>
          ,”
          <source>World Academy of Science Engineering and Technology</source>
          , vol.
          <volume>46</volume>
          , pp.
          <fpage>497</fpage>
          -
          <lpage>502</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>J.G.</given-names>
            <surname>Daugman</surname>
          </string-name>
          , “
          <article-title>How iris recognition works</article-title>
          ,
          <source>” Proc. IEEE Trans. Circ. Syst. Video Technol.</source>
          , vol.
          <volume>14</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>21</fpage>
          -
          <lpage>30</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>R.</given-names>
            <surname>Gonzalez</surname>
          </string-name>
          and
          <string-name>
            <given-names>R.</given-names>
            <surname>Woods</surname>
          </string-name>
          , “Digital Image Processing,” M: Technosphere,
          <year>2005</year>
          , 1072 p.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>M.S.</given-names>
            <surname>Semenov</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.V.</given-names>
            <surname>Myasnikov</surname>
          </string-name>
          , “
          <article-title>A comparison of iris image segmentation techniques</article-title>
          ,
          <source>” CEUR Workshop Proceedings</source>
          , vol.
          <volume>2210</volume>
          , pp.
          <fpage>163</fpage>
          -
          <lpage>169</lpage>
          ,
          <year>2018</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>Y.K.</given-names>
            <surname>Ganeeva</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.A.</given-names>
            <surname>Beketova</surname>
          </string-name>
          and
          <string-name>
            <given-names>E.V.</given-names>
            <surname>Myasnikov</surname>
          </string-name>
          , “
          <article-title>Development and software implementation of the method of segmentation of the iris in the image,” International Youth Scientific Conference "XV Korolev Readings", dedicated to the 100th anniversary of the birth of D.I. Kozlova</article-title>
          , vol.
          <volume>1</volume>
          , pp.
          <fpage>482</fpage>
          -
          <lpage>483</lpage>
          ,
          <year>2019</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>O.</given-names>
            <surname>Ronneberger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Fischer</surname>
          </string-name>
          and
          <string-name>
            <given-names>T.</given-names>
            <surname>Brox</surname>
          </string-name>
          , “
          <article-title>U-net: Convolutional networks for biomedical image segmentation</article-title>
          ,
          <source>” MICCAI</source>
          , p.
          <fpage>234</fpage>
          -
          <lpage>241</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>A. V.</given-names>
            <surname>Nikonorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. V.</given-names>
            <surname>Petrov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. A.</given-names>
            <surname>Bibikov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V. V.</given-names>
            <surname>Kutikova</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. A.</given-names>
            <surname>Morozov</surname>
          </string-name>
          and
          <string-name>
            <given-names>N. L.</given-names>
            <surname>Kazanskiy</surname>
          </string-name>
          , “
          <article-title>Image restoration in diffractive optical systems using deep learning and deconvolution</article-title>
          ,”
          <source>Computer Optics</source>
          , vol.
          <volume>41</volume>
          , no.
          <issue>6</issue>
          , pp.
          <fpage>875</fpage>
          -
          <lpage>887</lpage>
          ,
          <year>2017</year>
          . DOI:
          <volume>10</volume>
          .18287/
          <fpage>2412</fpage>
          - 6179-2017-41-6-
          <fpage>875</fpage>
          -887.
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <surname>Pre-trained U-Net</surname>
            <given-names>model</given-names>
          </string-name>
          [Online]. URL: https://github.com/ jus390/U-net-Iris-segmentation (
          <volume>12</volume>
          /23/
          <year>2019</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <given-names>D.</given-names>
            <surname>Kingma</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Ba</surname>
          </string-name>
          , “Adam: A Optimization,” arXiv:
          <fpage>1412</fpage>
          .6980v8,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <given-names>MMU</given-names>
            <surname>Iris Image</surname>
          </string-name>
          <string-name>
            <surname>Database</surname>
          </string-name>
          : Multimedia University [Online]. URL: http://pesonna.mmu.edu.my/ccteo/.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <given-names>J.</given-names>
            <surname>Lozej</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Meden</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Struc</surname>
          </string-name>
          and
          <string-name>
            <given-names>P.</given-names>
            <surname>Peer</surname>
          </string-name>
          , “
          <article-title>End-to-End Iris Segmentation Using U-Net,”</article-title>
          <source>IEEE International Work Conference on Bioinspired Intelligence (IWOBI)</source>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          ,
          <fpage>2018</fpage>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>