<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Optimizing extrusion processing of Al-Mg-Si alloys by machine learning</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Wolfram Walenta</string-name>
          <email>Wolfram.Walenta@profactor.at</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Johannes A. Österreicher</string-name>
          <email>Johannes.Oesterreicher@ait.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dragan Živanović</string-name>
          <email>dragan.zivanovic@elfak.ni.ac.rs</email>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Stefan Maimone</string-name>
          <email>Stefan.Maimone@profactor.at</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Florian Ehmeier</string-name>
          <email>fehmeier@mesa-international.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Milomir Mikulovic</string-name>
          <email>mmikulovic@mesa-</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Georg Kunschert</string-name>
          <email>Georg.Kunschert@ait.ac.at</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Daniela Kirchberger</string-name>
          <email>Daniela.Kirchberger@profactor.at</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>LKR Light Metals Technologies, Austrian Institute of Technology</institution>
          ,
          <addr-line>Ranshofen 5282</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>MESA Electronic GmbH</institution>
          ,
          <addr-line>Bad Feilnbach 83075</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>PROFACTOR GmbH</institution>
          ,
          <addr-line>Steyr 4407</addr-line>
          ,
          <country country="AT">Austria</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>University of Niš, Faculty of Electronic Engineering</institution>
          ,
          <addr-line>Niš 18000</addr-line>
          ,
          <country country="RS">Serbia</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>This work explores an approach to optimize microstructural development in thermomechanical aluminum processing using neural networks. The intricate industrial process involves continuous casting, homogenization heat treatment, reheating, forming (extrusion), and artificial aging. For a given geometry and chemical composition, the microstructural evolution of the material during this process chain defines the end-product properties. Our primary focus is on integrating a neural network combined with an optimization algorithm to precisely regulate thermomechanical processing parameters, enhancing processability and end-product quality while minimizing scrap generation in pursuit of Zero Defect Manufacturing. A neural network architecture predicts grain size distribution based on extrusion process parameters and in-situ conductivity measurements. The dataset is derived from in-situ measurements of conductivity of six different aluminum alloys during homogenization, implicitly carrying microstructural information, and from finite element simulations of the extrusion process coupled with physically based microstructure simulation. The optimization algorithm, using Gradient Decent, dynamically adjusts key parameters for the extrusion process, such as ram speed, billet temperature, and tool temperature. The algorithm converges consistently across different initializations to optimized parameters that match the parameters in the simulation, which shows that the optimization works and the model is robust to local minima.</p>
      </abstract>
      <kwd-group>
        <kwd>1 Zero Defect manufacturing (ZDM)</kwd>
        <kwd>Quality management</kwd>
        <kwd>Process Optimization</kwd>
        <kwd>Metal extrusion</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>In the realm of aluminum production, a robust correlation has been established between the
conditions of heat treatment and the processability (e.g., extrusion, rolling, forging) as well as the
final properties of the resulting product [1], [2]. In particular, the extrusion process is important for
the material’s performance and quality, which also depends on the microstructure [3]. Information
about the material's microstructure can be extracted via ex-situ measurements like microscopy [4].</p>
      <p>Many approaches to finding optimized process parameters use statistical methods, as
demonstrated in [5], which employs 27 experiments to determine the optimized parameters. These
"trial and error"-methods result in scrap generation, as destructively tested sample parts need to be
manufactured for process verification. Other approaches, such as those described in [6],utilize finite
simulation models for predicting the quality of the metal.</p>
      <p>Besides that, data availability increases in general in the industry with the emerging trend of the
Internet of Things (IoT) and the advancement of artificial intelligence methods, the data-driven
approach has become a more easily available and important tool to use [6]. Building on this trend,
this paper shows a proof of concept of the integration of an optimization process for microstructural
development in Al-Mg-Si alloys with machine learning, particularly neural networks, to finely control
the extrusion process. A similar approach for optimized rolling schedule for desired mechanical
properties with in-situ measurements was shown by [7]. Another similar data driven approach shows
the process parameter optimization for the aluminum alloy casting in [8].</p>
      <p>Such process optimization holds the potential to steer the process towards an optimal window,
ensuring both enhanced processability and improved end-product properties while minimizing scrap
generation. By adjusting parameters in the extrusion process such as temperature and ram speed, the
neural network optimization seeks to bring about a substantial increase in productivity within an
industrial setting.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Material and Methods</title>
    </sec>
    <sec id="sec-3">
      <title>2.1.Data and Machine Learning</title>
      <p>A neural network was developed with the goal of predicting the grain size distribution within an
alloy profile. To facilitate the training of the algorithm, a comprehensive dataset was curated
encompassing extrusion process parameters. These parameters were derived from a finite element
simulation of the extrusion process, as detailed in [9], [10]. The dataset includes crucial factors such
as grain size, grain element position, ram speed, billet temperature, and tool temperature. The
simulations were conducted for six different materials, and for each material, 245 simulations were
performed with different parameter combinations [10], providing an extensive range of data for the
machine learning. The extrusion process was simulated for identical Al-Mg-Si profiles, specifically
targeting 6060, 6005A, and 6082, as well as non-standard variations of these alloys with higher Fe
content [11].</p>
      <p>In addition, in-situ conductometry measurements were incorporated, involving both real and
imaginary parts of impedance, along with the sensor temperature. These in-situ measurements were
systematically carried out during the homogenization process of six Al-Mg-Si wrought alloys and
implicitly carry information about the microstructural evolution during the heat treatment [11].</p>
      <p>Each measurement curve within the dataset comprised a substantial 800 datapoints. To optimize
computational efficiency, accelerating convergence and avoid overfitting, a one-dimensional
convolutional autoencoder (1d-CAE) was employed for dimensionality reduction [12], [13]. This
technique allowed condensing the measurement curves down to just 12 essential features. All of the
ensembled data can be seen in the following Table 1:</p>
      <p>The neural network architecture, as illustrated in Figure 1, consisted of an input layer with 17
inputs, three hidden layers, each containing 64 neurons, and an output layer for grain size prediction.
Linear layers and leaky rectified linear [14] unit activation functions were employed in the network
structure. This comprehensive approach facilitated the efficient prediction of grain size distribution
based on the provided features seen in table one (except the grain size, which is the prediction target).</p>
    </sec>
    <sec id="sec-4">
      <title>2.2.Optimization Algorithm</title>
      <p>To determine the optimal parameters for the model and minimize the objective function (also
called cost function or loss), the Gradient Descent optimization algorithm was employed in
conjunction with the Adam Optimizer [15], [16]. This combination leverages adaptive learning rates
and momentum for enhanced convergence efficiency. The entire process chain, from input variables
through the Neural Network (NN) to the objective or loss function (see Figure 2), comprises
differentiable functions. This continuity enables the application of the Backpropagation method.
The general workflow of the gradient descent optimization is shown in Figure 2.</p>
      <p>The first step of the algorithm involves initializing the variables that should be optimized. The
objectives for optimization are the process parameters, including ram speed, billet temperature, and
tool temperature of the extrusion process. These parameters are the input for the neural network
model, which, alongside known material properties obtained from the measurements (see 2.1),
predicts the grain size distribution of the alloy profile. The grain size distribution forms a component
of the objective function, the target for minimization.</p>
      <p>The second component consists of constraints for the process parameters. The goal is to predict
the smallest possible grain size distribution with a process parameter combination within an
extrusion ram speed of 4–8 mm/s. Additionally, the model should not extrapolate on the data but find
the best set of parameters within its known range. Therefore, in addition to the ram speed constraint,
the temperatures are also constrained between 460–520°C.</p>
      <p>For the constraints, the following regularization function is implemented, used to regulate the
three process variables (ram speed, billet temperature, and tool temperature) in the desired range:
()
=ℎ ℎ 2
∗  + 2
 − ℎ + є
є
8 ∗  +ℎ ℎ ;
− + є − (ℎ − 1)
є
=
(1)</p>
      <p>Here in equation (1), width is a constant parameter affecting the position and width of the area to
regulate, while ε is used to smooth the function, and c scales the output of it. Combining the
regularization functions for the process parameters and the model for the grain size distribution that
should be minimized, the objective or loss function looks as follows:
 = (, !, ") + () + (!) + (")
(2)</p>
      <p>Here, r, t1 and t2 are respectively the ram speed, tool temperature, and billet temperature, while
NN stands for the Neural Network, and Loss represents the objective function in equation (2). After
evaluating the objective function, the optimization algorithm evaluates the gradients and optimizes
the process parameters through backpropagation.</p>
    </sec>
    <sec id="sec-5">
      <title>3. Results and Discussion</title>
      <p>To test the optimization algorithm in conjunction with the neural network for predicting grain
size distribution, eight different optimization runs were conducted using various initial values for the
process parameters. After that, the optimized parameter get compared to the simulation data. The
results, including the optimized parameters and the corresponding final grain size distribution, are
presented in Table 2:</p>
      <p>The results indicate that, irrespective of the initialized parameters, the optimized parameters
consistently converge to approximately 4 mm/s, 461°C, and 461°C. The consistent convergence of the
neural network towards the same optimized process parameters across various initial conditions
suggests that the model possesses a robust and reliable capability for parameter optimization. The
resilience to different initializations indicates that the network model is less susceptible to local
minima.</p>
      <p>In Table 3, simulation values are listed, showing the temperatures for achieving the smallest Grain
Size Distribution in the simulation from [9] for each simulated ram speed.</p>
      <p>The relevant ram speeds of the simulations are 4 mm/s and 8 mm/s, as that is the regulated area
of the optimization algorithm. The values of the optimized parameters, calculated using the
optimization procedure, with 4 mm/s, 461°C, and 461°C, align with the simulation parameters from
[9] of 4 mm/s, 460°C, and 460°C. Additionally, the prediction of the average grain size between the
neural network with 51.15 µm and the simulation from [9] with 52.33 µm aligns.</p>
      <p>In summary, the algorithm converges consistently across different initializations to optimized
parameters that match the parameters in the simulation, which shows that the optimization works
and the model is robust to local minima.</p>
    </sec>
    <sec id="sec-6">
      <title>4. Conclusion</title>
      <p>This study introduces a proof of concept for a data-driven approach, utilizing neural networks and
an optimization algorithm, to optimize the extrusion process of Al-Mg-Si alloys. Other approaches
for process optimization use statistical methods with trial and error experiments or attempt to
simulate the quality of the extruded alloy [5], [6]. Our optimization approach with machine learning
advocates the possibility to eliminate these ‘trial and error’ methods without the need for simulations
by leveraging microstructural information contained in in-situ conductivity curves alongside process
parameters such as time/temperature curves and extrusion parameters. Using this data, the neural
network predicts the microstructure of the alloy. Furthermore, this model serves as the objective
function for the optimization algorithm, dynamically adjusting key parameters. The optimized
process parameters consistently converge to values aligned with simulations, which serve as ground
truth data, indicating successful optimization.</p>
      <p>Despite the challenges posed by limited real-world data availability and the reliance on
simulationdriven training, our approach demonstrates robustness in converging towards optimized parameters
closely aligned with simulated results. This suggests the potential applicability of our optimization
framework in industrial settings.</p>
      <p>Future research will focus on accumulating larger datasets of real process data, which could aid in
predicting additional product properties beyond grain structure. Furthermore, with these real-world
data, the optimization model should be again tested and verified.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgment</title>
      <p>Funding: This work was supported by the Austrian Research Promotion Agency (FFG) [project
”ZDM – Zero Defect Manufacturing”, grant number 883864].</p>
    </sec>
    <sec id="sec-8">
      <title>Declaration on Generative AI</title>
      <p>The author(s) have not employed any Generative AI tools.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <given-names>J.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schiffl</surname>
          </string-name>
          , G. Falkinger and
          <string-name>
            <given-names>G.</given-names>
            <surname>Bourret</surname>
          </string-name>
          ,
          <article-title>"Microstructure and mechanical properties of high strength Al-Mg-Si-Cu profiles for safety parts</article-title>
          ,"
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>J.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kumar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schiffl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schwarz</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Bourret</surname>
          </string-name>
          ,
          <article-title>"Secondary precipitation during homogenization of Al-Mg-Si alloys: Influence on high temperature flow stress," Materials Science</article-title>
          and Engineering: A, vol.
          <volume>687</volume>
          ,
          <year>January 2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <given-names>P.</given-names>
            <surname>Goik</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schiffl</surname>
          </string-name>
          and
          <string-name>
            <given-names>H.</given-names>
            <surname>Höppel</surname>
          </string-name>
          ,
          <article-title>"Formation of Peripheral Coarse Grain in Thin-Walled Al-Mg-Si Extrusion Profiles," Metallurgical and Materials Transactions A</article-title>
          , vol.
          <volume>54</volume>
          ,
          <year>August 2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Kumar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Schiffl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schwarz</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Hillebrand</surname>
          </string-name>
          and
          <string-name>
            <given-names>G. R.</given-names>
            <surname>Bourret</surname>
          </string-name>
          ,
          <article-title>"Sample preparation methods for scanning electron microscopy of homogenized Al-Mg-Si billets: A comparative study,"</article-title>
          <source>Materials Characterization</source>
          , vol.
          <volume>122</volume>
          , pp.
          <fpage>63</fpage>
          -
          <lpage>69</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Chahare</surname>
          </string-name>
          and
          <string-name>
            <given-names>K. H.</given-names>
            <surname>Inamdar</surname>
          </string-name>
          ,
          <article-title>"Optimization of Aluminium extrusion process using Taguchi method,"</article-title>
          <source>IOSR J Mech Civ Eng</source>
          , vol.
          <volume>17</volume>
          , p.
          <fpage>61</fpage>
          -
          <lpage>5</lpage>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <given-names>D.</given-names>
            <surname>Mourtzis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E.</given-names>
            <surname>Vlachou</surname>
          </string-name>
          and
          <string-name>
            <given-names>N.</given-names>
            <surname>Milas</surname>
          </string-name>
          ,
          <article-title>"Industrial Big Data as a Result of IoT Adoption in Manufacturing,"</article-title>
          <source>Procedia CIRP</source>
          , vol.
          <volume>55</volume>
          , pp.
          <fpage>290</fpage>
          -
          <lpage>295</lpage>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>K.</given-names>
            <surname>Hartl</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Sorger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Weiß</surname>
          </string-name>
          and
          <string-name>
            <surname>M. Stockinger,</surname>
          </string-name>
          <article-title>"Machine learning driven prediction of mechanical properties of rolled aluminum and development of an in-situ quality control method based on electrical resistivity measurement,"</article-title>
          <source>Journal of manufacturing processes</source>
          , vol.
          <volume>106</volume>
          .
          <year>2023</year>
          , p.
          <fpage>158</fpage>
          -
          <issue>177</issue>
          , 5
          <string-name>
            <surname>October</surname>
          </string-name>
          <year>2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>S.</given-names>
            <surname>Li</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Yan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Cao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Liu</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>Chen</surname>
          </string-name>
          ,
          <article-title>"Data-Driven Optimization Method for Aluminum Alloy Casting Process Parameters and Alloy Composition," in 2021 33rd Chinese Control and Decision Conference (CCDC</article-title>
          ),
          <year>2021</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>S.</given-names>
            <surname>Hovden</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kronsteiner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Arnoldt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Horwatitsch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Kunschert</surname>
          </string-name>
          and
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <article-title>"Parameter study of extrusion simulation and grain structure prediction for 6xxx alloys with varied Fe content," Materials Today Communications</article-title>
          , vol.
          <volume>38</volume>
          , p.
          <fpage>108128</fpage>
          ,
          <year>2024</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>J.</given-names>
            <surname>Kronsteiner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Hovden</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Arnoldt</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <article-title>"Simulation of Coarse Grain Evolution during Hot Extrusion of Al-Mg-Si Alloy," Key Engineering Materials</article-title>
          , vol.
          <volume>926</volume>
          , pp.
          <fpage>426</fpage>
          -
          <lpage>435</lpage>
          ,
          <year>July 2022</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Österreicher</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Arnoldt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gneiger</surname>
          </string-name>
          and
          <string-name>
            <given-names>G.</given-names>
            <surname>Kunschert</surname>
          </string-name>
          ,
          <article-title>"Tolerance of Al-Mg-Si Wrought Alloys for High Fe Contents: The Role of Effective Si," Metallurgical and Materials Transactions A</article-title>
          , vol.
          <volume>54</volume>
          , p.
          <fpage>4472</fpage>
          -
          <lpage>4480</lpage>
          ,
          <year>September 2023</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          <string-name>
            <given-names>M.</given-names>
            <surname>Verleysen</surname>
          </string-name>
          and
          <string-name>
            <given-names>D.</given-names>
            <surname>François</surname>
          </string-name>
          ,
          <article-title>"The Curse of Dimensionality in Data Mining</article-title>
          and Time Series Prediction,"
          <year>2005</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          <string-name>
            <given-names>Y.</given-names>
            <surname>Wang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Yao</surname>
          </string-name>
          and
          <string-name>
            <given-names>S.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <article-title>"</article-title>
          <source>Auto-Encoder Based Dimensionality Reduction," Neurocomputing</source>
          , vol.
          <volume>184</volume>
          ,
          <year>November 2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          <string-name>
            <given-names>A. L.</given-names>
            <surname>Maas</surname>
          </string-name>
          ,
          <article-title>"Rectifier Nonlinearities Improve Neural Network Acoustic Models,"</article-title>
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          <string-name>
            <given-names>D. P.</given-names>
            <surname>Kingma</surname>
          </string-name>
          and
          <string-name>
            <given-names>J.</given-names>
            <surname>Ba</surname>
          </string-name>
          ,
          <article-title>Adam: A Method for Stochastic Optimization</article-title>
          ,
          <year>2017</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          <string-name>
            <given-names>S.</given-names>
            <surname>Ruder</surname>
          </string-name>
          ,
          <article-title>"An overview of gradient descent optimization algorithms,"</article-title>
          <source>CoRR</source>
          , vol.
          <source>abs/1609.04747</source>
          ,
          <year>2016</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>