<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Analysis of Multilayer Methods of Building Approximate Solutions of Differential Equations in the Context of Solving a Homogeneous Duffing Equation*</article-title>
      </title-group>
      <contrib-group>
        <aff id="aff0">
          <label>0</label>
          <institution>Peter the Great St. Petersburg Polytechnic University</institution>
        </aff>
      </contrib-group>
      <fpage>28</fpage>
      <lpage>37</lpage>
      <abstract>
        <p>Multilayer methods are an alternative approach to building the approximate analytical solution of differential equations. This paper presents the study of the results obtained by the implementation of our modifications of acknowledged implicit and explicit numerical methods. The homogeneous Duffing equation is of practical interest for modeling nonlinear oscillations and considered as a model equation. The accuracy of the obtained solutions is compared. It is shown that moving an initial point can significantly increase the accuracy of the solutions.</p>
      </abstract>
      <kwd-group>
        <kwd>differential equations</kwd>
        <kwd>numerical methods</kwd>
        <kwd>analytical methods</kwd>
        <kwd>multilayer models</kwd>
        <kwd>Duffing equation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Modeling the behavior of many real objects often reduces to initial or boundary value
problems for differential equations. In practice, the analytical solution of differential
equations usually cannot be built, therefore, a numerical approximate solution is often
sought. But such solutions are not clear enough. It is complicated to use it for studying
the effect of changing the parameters of the original problem or adjust it to the behavior
of the simulated object using the results of observation. Another well-known approach
is building the approximate analytical solution. A lot of different approaches to finding
it has been developed. There are various asymptotic methods, series expansion
methods, etc. [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. Classic perturbation methods [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ] are quite versatile but, like other
nonlinear analytical methods, they have significant limitations and restrictions. The quality
of the solution may directly depend on the choice of the parameter by the researcher.
In recent decades, new methods have appeared and old ones have been improved [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ].
*
      </p>
      <p>Copyright 2021 for this paper by its authors. Use permitted under Creative Commons License
Attribution 4.0 International (CC BY 4.0).</p>
      <p>
        But often the higher-order analytical approximations require analytical solving of
systems of complex nonlinear algebraic equations or additional restrictions on the
parameters or the function [
        <xref ref-type="bibr" rid="ref4 ref5 ref6 ref7">4-7</xref>
        ]. Other approaches imply building a functional approximation
in the form of broken lines or splines based on points of the numerical solution. In this
article, we consider methods for building multilayer models that allow us to obtain an
approximate analytical solution based on classical numerical methods. We compare the
solutions built according to recurrence formulas of various numerical methods and
investigate the possibility of increasing the accuracy of the obtained solutions on the base
of the initial point moving.
2
      </p>
      <p>
        General Description of Multilayer Methods
The essence of our approach is to apply the well-known recurrence formulas for the
numerical integration of differential equations to an interval with a variable right
endpoint. [
        <xref ref-type="bibr" rid="ref10 ref11 ref12 ref8 ref9">8-12</xref>
        ]. The result is an approximate analytical solution in the form of a function
of this endpoint.
      </p>
      <p>Consider the Cauchy problem for a system of ordinary differential equations
(1)
(2)
(3)</p>
      <p>The search for a solution is carried out on the interval [ 0,  0 +  ]. According to the
main idea of our approach, we use well-known methods for the numerical solution of
the problem (1) to an interval with a variable right endpoint  ∈ [ 0,  0 +  ]. We
choose a partition   ( ) of the interval [ 0,  ] into n subintervals  0 &lt;  1 &lt; ⋯ &lt;   &lt;
⋯ &lt;   =  , ℎ =   +1 −   . By applying the formula
  +1 =   +  ( , ℎ ,   ,   +1,   ,   −1, … ,  0)
 ′ =  ( ,  )
{
 ( 0) =  0</p>
      <p>∈  ,  ∈  
n times, we obtain an approximate solution   ( ). The operator  defines a specific
method we modify as described above. The result is a function defined on the interval
[ 0,  0 +  ]. We can replace an interval [ 0,  0 +  ] with [ 0 −  ,  0 +  ].
3</p>
      <p>Multilayer Methods in the Context of Solving the</p>
      <p>
        Duffing Equation
As the model task, we consider the homogeneous Duffing equation with constant
coefficients [
        <xref ref-type="bibr" rid="ref13 ref14 ref15 ref4 ref5">4-5, 13-16</xref>
        ].
      </p>
      <p>′′ +  +   3 = 0
 (0) =  0,  ′(0) =  1</p>
      <p>Higher-order differential equations can always be reduced to the form (1) by
increasing the dimension of the system. In our case, it is easy to make a replacement  =
 ,  ′ =  :
the formula
is used.</p>
      <p>3
2
1
1
2
3
y</p>
      <p>′ = 
 ′ = −</p>
      <p>
        −   3
 (0) =  0,  (0) =  1
(4)
The search for a solution is carried out on the interval [
        <xref ref-type="bibr" rid="ref3">0,3</xref>
        ], the initial conditions and
parameters of the equation are as follows
      </p>
      <p>= 1,  = 1,  0 = 1,  1 = 1</p>
      <p>For simplicity, the partition   ( ) is considered uniform for each method, namely
ℎ</p>
      <p>= ( −  0)⁄ .
3.1</p>
    </sec>
    <sec id="sec-2">
      <title>Explicit Methods</title>
      <p>Euler's method. The simplest numerical method for which the operator F has the form
 ( , ℎ ,   ,   ) = ℎ  (  ,   )

Refined Euler's method. Another well-known numerical method in which we used
In this case, to start the algorithm, the expression
 ( , ℎ ,   ,   ,   −1) = 2ℎ  (  ,   ) +   −1 −   .</p>
      <p>1 =  0 + ℎ  (  0 +
1
,  0 +</p>
      <p>( 0,  0))
ℎ
1
2
ℎ
y x
0.5 1.0 1.5 2.0 2.5 3.0
x
 ( , ℎ ,   ,   ) = ℎ [ (  ,   ) +</p>
      <p>(  ′(  ,   ) +   ′(  ,   ) (  ,   ))].</p>
      <p>Second-order Runge-Kutta method:
 ( , ℎ ,   ,   ) = ℎ  (   ,   +</p>
      <p>(  ,   )) .
ℎ

2
y x
y x
0.5
x
x
3
2
1
1
2
3
y
3
2
1
1
2
3
y
3
2
1
1
2
3
y
3
2
1
1
2
3
y
Störmer Method. Since initially, the Duffing equation is a second-order differential
equation, we can apply the Störmer method. In this case
2
  +1 = 2  −   −1 + ℎ  (  ,   ).</p>
      <p>This method requires  1. We calculated it approximately by the Taylor formula
 1 =  0 +
 ′( 0)
1!
ℎ1 +
 ′′( 0)
2!
ℎ12 +
 ′′′( 0)
3!
ℎ13,
where  ′′( 0) and  ′′′( 0) are easily obtained from differential equation (3).
y5 x
y x
lem (3) and the approximate solution built by
our modification of the Störmer Method in the
Fig. 6. The plot of the exact solution of
problem (3) and the approximate solution built by
our modification of the Störmer Method in the
case of n=5
case of n=10</p>
    </sec>
    <sec id="sec-3">
      <title>3.2 Implicit Methods</title>
      <p>Implicit methods are applicable if the equation   +1 =   +
 ( , ℎ ,   ,   +1,   ,   −1, … ,  0) is solvable for   +1. About our problem, this means
solving the cubic equation at each step. In some cases, it is advisable not to look for the
exact solution of this cubic equation but to use the approximate solving methods. We
use one step of the Newton method. The justification of this approach is demonstrated
below.</p>
      <p>The implicit Euler method. The operator F for an implicit method is as follows
 ( , ℎ ,   ,   +1) = ℎ  (  +1,   +1).</p>
      <p>Substituting this expression in (2) we obtain the system
{   +1 =   + ℎ   +1
  +1 =   + ℎ (−  +1 −   3+1).
(5)
This system allows the exact expression   +1,   +1 in terms of   ,   , ℎ :
Then we can use formula
to perform computations. The result of such solving is presented below. On the other
hand, the solution of system (5) can be obtained by using one step of the Newton
method. In this case, we obtain another expression,
y5 x
y x
0.5 1.0 1.5 2.0 2.5 3.0
x
0.5 1.0 1.5 2.0 2.5 3.0
x
3 3
Fig. 7. The plot of the exact solution of prob- Fig. 8. The plot of the exact solution of
problem (3) and the approximate solution built by lem (3) and the approximate solution built by
our modification of the implicit Euler method our modification of the implicit Euler method
in the case of the exact solution of (5) and n=5 in the case of the approximate solution of (5)
(one step of the Newton method) and n=5
The maximum error in the first case is equal to 0.89163, in the second case it is
0.96993. As we can see, there is no significant change in the plot behavior. But when
using the Newton method an expression is easier and therefore the complexity and time
of calculations are lower than if we solve system (5) analytically. The solutions below
are obtained using the Newton method.</p>
      <p>
        One-step Adams method. Another implicit method, the equation has the form
  +1 =   + ℎ2 ( (  ,   ) +  (  +1,   +1)).
y5 x
y x
y x
[0, 1.5]
0.14765
0.022633
0.026272
0.032397
0.0058227
0.16892
0.19285
[
        <xref ref-type="bibr" rid="ref3">0, 3</xref>
        ]
1.19331
0.19536
0.13579
0.19168
0.034254
0.62051
0.67787
The maximum error in the case of the exact solution according to the cubic equation is
equal to 1.11217 and in the case of the approximate solution, it is 1.14777.
The computational results of all methods are presented in Table1. Each method
corresponds to its maximum error in the specified interval. We compare the error on the
intervals [0,1.5] and [
        <xref ref-type="bibr" rid="ref3">0,3</xref>
        ].
      </p>
      <p>Initial Point Moving
To improve the accuracy of the model, we investigated the following approach. Using
the methods described above, we build a solution to the Cauchy problem (1) starting
from the point  1 ∈ [ 0,  0 +  ], other than  0. The unknown initial condition  ( 1) =
 1 in this case is the parameter of the resulting solution   ( ,  |1). This parameter can
be determined from the equation   ( 0,  |1) =  0. From the computational results
below, it follows that by moving an initial point in this way, it is possible to improve the
solution on the interval.</p>
      <p>As an example, we consider the Störmer method, as the most accurate method of the
previously considered. The table below shows the maximum error of the solution
obtained by this method on the interval [0,1.5] in the case of moving the initial point from
zero in increments of 110. The number of layers n we took equal to 2 and 5.
Implicit methods have no advantages over explicit methods for this task. Of the explicit
methods we examined, the most accurate is the Störmer method.
 1
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7</p>
      <p>y
2.0
1.5
1.0
0.5
0.5
1.0
As we can see, solutions with moving the initial point have significantly better accuracy
on the interval than a conventional solution built starting from zero.
y x
0.2 0.4 0.6 0.8 1.0 1.2 1.4
0.2 0.4 0.6 0.8 1.0 1.2 1.4
x
x
Fig. 11. The plot of the exact solution of
problem (3) and the approximate solution built by
our modification of the Störmer Method in the
case of n=2 and initial point  1 = 0.8
Fig. 32. The plot of the exact solution of
problem (3) and the approximate solution built by
our modification of the Störmer Method in the
case of n=2 and initial point  1 = 0</p>
      <p>y
2.0
1.5
1.0
0.5
0.5
1.0
Next, we select new starting points from the gap between the previous best results in
increments of 1 . 1/100. From this list of models, the most accurate model can be
cho100
sen.
Thus, the approach with moving an initial point allowed us to significantly reduce the
deviation of the solution on the interval. The plots below illustrate the difference
between models with a selected initial point and models built starting from zero.
y x
0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4</p>
      <p>y
0.025
0.020
0.015
0.010
0.005
1. The methods we have proposed allow us to construct an approximate solution of the</p>
      <p>
        Duffing equation in the form of a function with the required accuracy.
2. For model equations with parameters considered, implicit methods do not have
significant advantages over explicit methods. Implicit methods make sense for those
parameters when the task becomes stiff.
3. Moving an initial point lets us obtain an approximate analytical solution of the model
task which is several times more accurate than a solution obtained without moving
an initial point. Wherein an accuracy increases with the number of layers.
4. Our methods, without requiring additional assumptions, allow us to build parametric
approximate analytical solutions [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ] concerning the parameters of the original task.
      </p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgment</title>
      <p>This paper is based on research carried out with the financial support of the grant of the
Russian Scientific Foundation (project №18-19-00474).</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Hairer</surname>
            <given-names>E.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Norsett</surname>
            <given-names>S. P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wanner</surname>
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Solving Ordinary Differential Equations I: Nonstiff</surname>
            <given-names>Problem</given-names>
          </string-name>
          , Springer-Verlag, Berlin, 480 p.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Nayfeh</surname>
            ,
            <given-names>A. H.</given-names>
          </string-name>
          <article-title>Problems in perturbation</article-title>
          , John Wiley &amp; Sons, 556 p.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>He J.-H. Α</surname>
          </string-name>
          <article-title>Review on Some New Recently Developed Nonlinear Analytical Techniques</article-title>
          .
          <source>International Journal of Nonlinear Sciences and Numerical Simulation</source>
          <volume>1</volume>
          ,
          <fpage>51</fpage>
          -
          <lpage>70</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Wu</surname>
            <given-names>B.S.</given-names>
          </string-name>
          et al.
          <article-title>An analytical approximate technique for a class of strongly non-linear oscillators</article-title>
          .
          <source>International Journal of Non-Linear Mechanics</source>
          <volume>41</volume>
          ,
          <fpage>766</fpage>
          -
          <lpage>774</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Farzaneh</surname>
            <given-names>Y.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tootoonchi</surname>
            <given-names>A. A.</given-names>
          </string-name>
          <string-name>
            <surname>Global Error</surname>
          </string-name>
          <article-title>Minimization method for solving strongly nonlinear oscillator differential equations</article-title>
          ,
          <source>Computers and Mathematics with Applications</source>
          ,
          <volume>59</volume>
          ,
          <fpage>2887</fpage>
          -
          <lpage>2895</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Ismail</surname>
            <given-names>G. M.</given-names>
          </string-name>
          <article-title>An analytical coupled homotopy-variational approach for solving strongly nonlinear differential equation</article-title>
          <source>Journal of the Egyptian Mathematical Society</source>
          Volume
          <volume>25</volume>
          ,
          <string-name>
            <surname>Issue</surname>
            <given-names>4</given-names>
          </string-name>
          ,
          <fpage>434</fpage>
          -
          <lpage>437</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Rahman</surname>
            <given-names>M. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Hasan</surname>
            <given-names>A. S. M. Z.</given-names>
          </string-name>
          <article-title>Modified harmonic balance method for the solution of nonlinear jerk equations Results in Physics</article-title>
          , Volume
          <volume>8</volume>
          ,
          <fpage>893</fpage>
          -
          <lpage>897</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Lazovskaya</surname>
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Tarkhov</surname>
            <given-names>D.</given-names>
          </string-name>
          <article-title>Multilayer neural network models based on grid methods //</article-title>
          <source>Journal of Physics Conference Series: Materials Science and Engineering</source>
          , Volume
          <volume>158</volume>
          , Number 1.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Tarkhov</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasilyev</surname>
            <given-names>А</given-names>
          </string-name>
          .
          <article-title>Semi-empirical Neural Network Modeling and</article-title>
          Digital Twins Development Academic Press, Elsevier,
          <volume>288</volume>
          p.
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kaverzneva</surname>
            <given-names>T. T.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Malykhina</surname>
            <given-names>G. F.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tarkhov D. A. From</surname>
          </string-name>
          <article-title>Differential Equations to Multilayer Neural Network Models</article-title>
          ,
          <source>International Symposium on Neural Networks ISNN 2019: Advances in Neural Networks - ISNN 2019 Lecture Notes in Computer Science book series (LNCS</source>
          , volume
          <volume>11554</volume>
          )
          <fpage>19</fpage>
          -
          <lpage>27</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Kuznetsov</surname>
            <given-names>E. B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Leonov</surname>
            <given-names>S. S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tarkhov</surname>
            <given-names>D. A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Vasilyev</surname>
            <given-names>A. N.</given-names>
          </string-name>
          <article-title>Multilayer method for solving a problem of metals rupture under creep conditions</article-title>
          , Thermal Science: vol.
          <volume>23</volume>
          ,
          <issue>suppl</issue>
          .
          <volume>2</volume>
          ,
          <fpage>S575</fpage>
          -
          <lpage>S582</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Shemyakina T. Tarkhov</surname>
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vasilyev</surname>
            <given-names>A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Velichko</surname>
            <given-names>Y.</given-names>
          </string-name>
          <article-title>Comparison of two neural network approaches to modeling processes in a chemical reactor</article-title>
          , Thermal Science: vol.
          <volume>23</volume>
          ,
          <issue>suppl</issue>
          .
          <volume>2</volume>
          ,
          <fpage>S583</fpage>
          -
          <lpage>S589</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Moon F. C. Chaotic Vibrations</surname>
          </string-name>
          :
          <article-title>An Introduction for Applied Scientists</article-title>
          and Engineers, John Wiley &amp; Sons, 316 p.
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          14.
          <string-name>
            <surname>Astrakhov</surname>
            <given-names>V.V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Koblyanskiy</surname>
            <given-names>S.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shabunin</surname>
            <given-names>A.V.</given-names>
          </string-name>
          <string-name>
            <surname>Ostsilyator</surname>
          </string-name>
          <article-title>Duffinga: Uchebnoye posobiye dlya studentov vuzov</article-title>
          (in
          <source>Russian)</source>
          ,
          <volume>52</volume>
          p.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          15.
          <string-name>
            <surname>Lakshmanan</surname>
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Murali</surname>
            <given-names>K.</given-names>
          </string-name>
          <article-title>Chaos in Nonlinear Oscillators: Controlling and Synchronization</article-title>
          ,
          <source>World Scientific (World Scientific Series on Nonlinear Science Series A).</source>
          , Vol.
          <volume>13</volume>
          .
          <fpage>35</fpage>
          -
          <lpage>90</lpage>
          (
          <year>1996</year>
          )
          <fpage>16</fpage>
          .
          <string-name>
            <surname>Kovacic</surname>
            <given-names>I.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Brennan</surname>
            <given-names>M. J.</given-names>
          </string-name>
          <article-title>The Duffing Equation: Nonlinear Oscillators and their</article-title>
          <string-name>
            <surname>Behaviour</surname>
          </string-name>
          , John Wiley &amp; Sons, 386 p.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>