<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>method of augmented regularized normal equations for systems with sparse matrices</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>S.Y. Gogoleva</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Samara National Research University</institution>
          ,
          <addr-line>34 Moskovskoe Shosse, 443086, Samara</addr-line>
          ,
          <country country="RU">Russia</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2017</year>
      </pub-date>
      <fpage>64</fpage>
      <lpage>66</lpage>
      <abstract>
        <p>A new approach for solving ill-posed problems is proposed. The approach makes it possible to effectively calculate normal pseudosolutions for ill-conditioned systems of linear algebraic equations and to find an acceptable solution with a minimum filling of sparse matrices. Many practical problems of finding solutions based on available data are typical representatives of ill-posed problems. It should be noted that such problems have a number of unpleasant properties of manipulating, and for their solution standard methods are inapplicable. Thanks to the works of academician A.N. Tikhonov developed a general strategy for constructing stable methods for solving ill-posed (unstable problems) in operator form [1]. It is based on the notion of a regularizing operator or a regularizing algorithm. Realizing this algorithm, it is necessary to solve the normal regularized systems of linear algebraic equations. This system is often ill-conditioned. It is necessary to choose the regularization parameter correctly in order to reduce the condition number. It is also important to choose a solution method that is numerically stable. Often ill-posed problems lead to systems with large and sparse coefficient matrices, in which most of the elements are zero.</p>
      </abstract>
      <kwd-group>
        <kwd>regularization method</kwd>
        <kwd>augmented system</kwd>
        <kwd>sparse matrices</kwd>
        <kwd>filling</kwd>
        <kwd>pivoting</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
    </sec>
    <sec id="sec-2">
      <title>2. Statement of the Problem</title>
      <p>
        Consider the system linear algebraic equations
where  ∈   × ,  ∈   .
the regularized normal system
The regularized solution of the system (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) is found as  = Argmin ∈  {‖
−  ‖22 +  2‖ ‖22}, which is equivalent to solving
where  2 is a regularization parameter.
      </p>
      <p>The condition number of the system (3) is found as
=  ,
(   +  2 ) =    ,
2(   +  2 ) =
 12+ 2
 2 + 2</p>
    </sec>
    <sec id="sec-3">
      <title>3. The Method of Augmented Regularized Normal Equations with Pivoting</title>
      <p>Instead of system (3), it is proposed to consider the equivalent system of algebraic equations [2]:
where  =  −</p>
      <p>is the residual vector.</p>
      <p>The condition number of the system matrix (3) is slightly less than the condition number of the normal system equations
matrix (2). Therefore, in order to reduce the condition number, the parameter  &gt; 0 is introduced into the system (3):

( 
− 2
) (
) = (</p>
      <p>)
 2 ) ( ) = (</p>
      <p>) ↔ С( ) =  .
the matrix (4) is attained for  ∗ = √ 2</p>
      <p>+  2, where   is the minimal singular number of the matrix A.</p>
      <p>
        When choosing  ∗∗ = √ 2the spectral condition number of the system matrix (4) will be √ 12 +2 2. Thus, this approach
make it possible to increase the numerical stability of the problem and to reduce errors in solving of the equations system (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ).
      </p>
      <p>The augmented system of equations modification leads to an increase in the dimension of the original problem. Using
known methods to solve it leads to computational difficulties. Therefore, it is proposed to consider the modification of the
direct projection method [4, 6] with the pivoting, which allows to reduce the number of arithmetic operations to obtain the
augmented system of equations solution.</p>
      <p>Due to the special structure of the linear algebraic equations augmented system matrix and direct projection method
vectors in the augmented system, from  =  +</p>
      <p>equations n are solved analytically. This means that it is possible to calculate
in advance the values of the first n vectors and indicate the vectors structure in the next steps of the algorithm.</p>
      <p>For sparse systems, in order to reduce the fill-in, it is proposed to apply the Markowitz strategy in the direct projection
method.[3]
Markowitz count of an entry с</p>
      <p>( )is a value</p>
      <p>Let the k-th step of the direct projection method be performed. The number  ( ,  ) denotes the number of non-zero
entries in the i-th row of the active submatrix С and  ( ,  ) is the number of non-zero elements in the j-th column of С .The</p>
      <p>= ( ( ,  ) − 1)( ( ,  ) − 1), ( ,  = 1 …  ).</p>
      <p>is equal to the number of elements that change the value at the transition to the next elimination step, if
the entry с
( ) is chosen as the pivot one, it is the upper border for the fill-in that occurs when с
( ) is selected.
  = min{ 
|  ,  =  …  }.
count is much easier than calculating the value of the fill for each entry С .
condition</p>
      <p>The Markowitz strategy is that at each step k, the entry with the Markowitz count   is taken as the pivot.
This does not necessarily mean that the fill-in minimum at the k-th step will be obtained; however, finding Markowitz
To ensure numerical stability, we will choose the elements of the active submatrix for the role of the pivot, satisfying the
|с

( )| ≥</p>
      <p>max
 ≤ ≤ , ≤ ≤
|с
( )|,
(4)</p>
      <p>
        We give the system of equations solution (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ) using the ill-conditioned matrix photogrammetry. The results of the
From Table 2 we see that the direct projection method for the augmented system with pivoting and the use of the
Markowitz strategy yields exactly the same results as the QR method, but requires less execution time.
Matrix
ash958
flower_8_1
ch7-8-b1
mk11-b1
well1033
photogrammetry
ash608
numerical experiment are shown in Table 2.
      </p>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion References</title>
      <p>A new approach to solving ill-posed problems is considered. This approach makes it possible to effectively calculate
normal pseudosolutions of ill-conditioned linear equations systems and to find an acceptable solution in accuracy. Its
modification for this problem, taking into account the sparseness of the augmented system, allows to significantly reduce the
number of steps of the algorithm, as well as to reduce the amount of random-access memory and arithmetic operations. The
Markowitz strategy in this modification allows to reduce the fill-in of a sparse matrix. This fact significantly simplifies the
problem solving and reduces the time for calculation, which is a rather significant advantage.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <source>[1] [2] [3] [4] [5]</source>
          [6]
          <string-name>
            <surname>Tikhonov</surname>
            <given-names>AN</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Goncharsky</surname>
            <given-names>AV</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stepanov</surname>
            <given-names>VV</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yagola</surname>
            <given-names>AG</given-names>
          </string-name>
          .
          <article-title>Numerical methods for solving ill-posed problems</article-title>
          . Moscow: Nauka,
          <year>1990</year>
          ; 229 p.
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <given-names>Zhdanov</given-names>
            <surname>AI</surname>
          </string-name>
          .
          <article-title>The method of solving regularized normal equations</article-title>
          .
          <source>Journal of Computational Mathematics and Mathematical Physics</source>
          <year>2012</year>
          ;
          <volume>52</volume>
          (
          <issue>2</issue>
          ):
          <fpage>205</fpage>
          -
          <lpage>208</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          <string-name>
            <surname>Zlatev</surname>
            <given-names>Z</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Esterby</surname>
            <given-names>O</given-names>
          </string-name>
          .
          <article-title>Direct methods for sparse matrices</article-title>
          . M.:
          <string-name>
            <surname>Mir</surname>
          </string-name>
          ,
          <year>1987</year>
          ; 120 p.
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          <string-name>
            <given-names>Zhdanov</given-names>
            <surname>AI</surname>
          </string-name>
          .
          <article-title>A direct sequential method for solving systems of linear algebraic equations</article-title>
          .
          <source>Russian Academy of Science Report</source>
          <year>1997</year>
          ;
          <volume>356</volume>
          (
          <issue>4</issue>
          ):
          <fpage>442</fpage>
          -
          <lpage>444</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>Harwell-BoeingCollection. MatrixMarket</surname>
          </string-name>
          . URL: http://math.nist.gov/MatrixMarket/data/Harwell-Boeing/ (
          <volume>5</volume>
          .
          <fpage>02</fpage>
          .
          <year>2016</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          <string-name>
            <surname>Vestnik</surname>
            <given-names>SSAU</given-names>
          </string-name>
          <year>2008</year>
          ;
          <volume>2</volume>
          :
          <fpage>175</fpage>
          -
          <lpage>178</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>