<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Modeling of Dictionary Learning in Compressive Sensing for Medical Images</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Kowsalya A.</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Hepzibah Christinal</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>D. Abraham Chandy</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>T. Shekinah</string-name>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Chandrajit L.</string-name>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Institute for Computational Engineering and Sciences, University of Texas</institution>
          ,
          <addr-line>Austin</addr-line>
          ,
          <country country="US">USA</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Karunya Institute of Technology and Sciences</institution>
          ,
          <addr-line>Coimbatore</addr-line>
          ,
          <country country="IN">India</country>
        </aff>
      </contrib-group>
      <fpage>7</fpage>
      <lpage>12</lpage>
      <abstract>
        <p>Compressive sensing of images encompasses the following stage processes: Representation of sparse signal, constructing the linear measurement and reconstructing of the image. This paper, presents the novelty of representing the sparse signal based on dictionary learning method. The choice of designing the dictionary model based on deep learning methodology, which delivers a simple and expressive structure for designing well-organized and efficient dictionaries. The norm- difference of the image is used of evaluating the performance of dictionary learning based algorithms. Experimental result shows that the matching pursuit (OMP) performance has better output when compared to Least Angle Regression (LAR) algorithm. The result indicates that the sparse modelling using dictionary learning with Orthogonal Matching Pursuit is proficient in CS of MRI images. Compressive sensing, sparse representation, dictionary learning, medical images.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        Compressive sensing (CS) is plays on vital role in signal processing community. The signals can
be restored as a compressed form is called the new signal acquisition in a compressive sensing. The
signals are basic tools of processing the video clips, medical scans and natural images [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ].In sampling
theory of CS states that“Images are using significantly fewer measurements than number of unknowns”
which is known as Nyquist Sampling. Naturally the image/signal is sparse in original domain or in some
transform domain, the acquisition is incoherent, in an appropriate sense, with the transform and to get
the better enhancement reconstruction procedure is endured which is nonlinear.CS theory has been
applied to MRI images to achieve the high quality reconstructions with lesser measurements. Recently,
sparse representation with dictionary learning is applied in MRI images to get the accurate CS recovery.
In sparsity based modelling the linear combination of signals are known as atoms,supports in simple
and compact models is known us dictionary. Sparsity is the essential prominent tool for dictionary,
while modelling the dictionary the one must be cautious about the predictive power of signal classes
and efficient compression ability. Earlier the dictionaries were modelled using mathematical functions
using harmonic analysis of the signal classes. The analysis of sparse modelling was done using the
sparse representation of mathematical dictionaries.
      </p>
      <p>
        Dictionary Learning (DL) transforms data into sparse representation. The well-known DL method
is KSVD [
        <xref ref-type="bibr" rid="ref1 ref2">1,2</xref>
        ]. It has its role in image denoising [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ], compression, sersm data denoising, etc. In image
processing, comparing to predefined transformation KSVD reaches high quality accuracy in denoising
complicated structures [
        <xref ref-type="bibr" rid="ref3 ref4">3, 4</xref>
        ]. Since it has high market value it becomes hard to handle practically for
      </p>
      <p>
        2022 Copyright for this paper by its authors.
large scale data. Data-driven tight frame (DDTF)is a recently developed method to gain efficient output.
By the term tight frame, we that the frame has a sound reconstruction property i.e., signal
representation by means of linear combination of atoms can be specified with products in the signal
and dictionary [
        <xref ref-type="bibr" rid="ref5 ref6">5,6</xref>
        ]. DDTF is used as a catalyst in the property of tight frame of dictionary to enhance
the updating step and it takes just one SVD decomposition [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Also, it is applied in denoising of data
and interpolation of missed trace [
        <xref ref-type="bibr" rid="ref6 ref7">6, 7</xref>
        ]. For processing signal data of large scale, a rapid version of
DDTF is used. A vital is defined to model spare. Originally it was introduced by [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ] which help
learning through trained data. This sort of representation is called as synthesis sparse modelling. It
enables in capturing structures underlying the natural images and it has a good adapting quality for
large scale. This process paved wayfor designing algorithms in image processing area such as [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] and
to solve inverse problems [
        <xref ref-type="bibr" rid="ref10 ref9">9, 10</xref>
        ]. In the field of image processing, the application lies exactly in the
signals with compact representation. In this chapter, both theoretical and practical approaches are
specified to model sparse signal for compressed images.
      </p>
      <p>The objective of this work is to modelling the sparse matrix using dictionary learning method with
a help of deep learning architectures for compressive sensing process of medical images. This requires
the comparability of the reconstruction algorithms orthogonal matching pursuit (OMP) and least angle
regression (LAR).This paper is organized as follows: in Section 2 we give the overview of the
dictionary learning. In Section 3 sparse modelling using dictionary learning discussed. Interpretations
of the results of the experimentation are shown in section 4 and conclusion is drawn in section 5.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Overview of the Dictionary Learning Method</title>
      <p>
        In CS the sparse representation process is the essential for modelling the dictionary. As expected,
the signals are sparse and can be restored form the linear projection of space or time measurements
[
        <xref ref-type="bibr" rid="ref3">3</xref>
        ]. Dictionary can model in the following manner, given signal of small elements x with linear
combination of dimension m. Here the unit norm functions are atoms and atoms are dictionary. Let us
represent D as dictionary and the atoms represent   m = 1, 2……M, where M represents dictionary
size. The dictionary is over complete dictionary when there is span in a signal space with the linearly
dependent atoms (M &gt; m).
      </p>
      <sec id="sec-2-1">
        <title>Dictionary is a signal with the linear combination of atoms,</title>
        <p>x =
= ∑  =1  
(1)
b is not unique when the dictionary is over complete. This is the point where a sparsity constraint
has avital role. Decrease of requirements of the sparse, higher the efficiency of sparse representation.
With approximation error  for bounded energy the sparse linear expansion is obtained. Our main aim
is to find sparse vector b containing minimal significant coefficients, and the remaining coefficients
lesser than are equal to zero. In other words, our objective is to have limited no of resources (atoms)
for representing the signal.</p>
      </sec>
      <sec id="sec-2-2">
        <title>The following problem is optimized and formulated as given below:</title>
        <p>Min|| ||0 subject to x = 
+ 
and || |2|2&lt;
(2)</p>
        <p>
          Where ||. || represents the l norm and the problem is non-deterministic polynomial-time (NP)
hard. In order to obtain the suboptimal solution for vector b, the method of approximation
algorithms for polynomials with respect to time are used [
          <xref ref-type="bibr" rid="ref7">7</xref>
          ]. These approximation algorithms can be
divided in to twotypes of classes: the first group uses the pursuit algorithms namely, matching pursuit
and the orthogonalMatching pursuit, the basis vectors can selected as iterative optimal vector. The
methods of convex relaxation such as, pursuit denoising and least absolute shrinkage and selection
operator, are secondgroup of pursuit algorithms and benefits solves the following problem:
        </p>
        <p>
          The convex  1 norm is replaced by non-convex  0 norm through convex relaxation, where  0 has
nonzero elements and the term norm is used when p approaches zero. Apart from pursuit algorithms
other algorithms are also used such as focal underdetermined system solver [
          <xref ref-type="bibr" rid="ref10">10</xref>
          ] and sparse
Bayesian learning. The evaluation of these techniques on the basis of the quality approximation and
the sparsity of the coefficient vector b depend signal alone but also depends on the over complete
dictionary D. When the techniques are used for particular class of signal x, it is understood that not all
the dictionariesyield the similar estimation performance [
          <xref ref-type="bibr" rid="ref9">9</xref>
          ]. There are several dictionaries that have
more similar in leading the sparse solution comparing to others. In these dictionaries the atoms
providing the best causesof the target dataset are included. To seek optimized dictionaries is the main
target of the methods ofdictionaries.
        </p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Sparse Modelling Using Over-Complete Dictionaries</title>
      <p>In research, three main streams with three algorithm groups are used for dictionary learning. They
include 1. probabilistic learning; 2. The learning methods clustering or vector quantization-based
learning; 3. particular construction learning with dictionaries. The construction comprises of data
structure or focus on managing dictionaries. This section provides three important principles of
algorithm representation with three dictionary Learning categories. The over complete dictionary must
be well examined than complete dictionary [14]. In order to define over complete dictionaries there,
exist two representations namely analysis path and synthesis path. In the area of signal processing,
learning is a topic whereas dictionary is referred to represent spare or signal approximation. The
dictionary consists of atom collection where atoms refer to real column vectors with length. For
example a dictionary with finite number k can be represented as a matrix D with size. Similarly, a
sparserepresentation can be represented as a linear combo of dictionary atoms [12].</p>
      <p>The size of the normal image is too large, it can be partition into N×  image blocks and sparse
modelling can be done using image blocks X = [x1, x2, x3, xL], each of size √ × √ pixels,
where</p>
      <p>
        √ is an integer value. Learning of dictionaries determines the vector approximation with sparse
criteria on coefficients i.e., it allows minimal nonzero coefficients. The dictionary is fit in LHS for the
reconstruction to happen on RHS. It is noticed that a better output is retrieved from an undistorted
image but here we start with a contradiction [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]. Observing the original image and reconstructed
image becomes helped in evaluating the results. If a perfect image is obtained it resembles a Gaussian
noise.
      </p>
      <p>Since the real world image is larger we segregate it into smaller blocks and modelling is done in
that particular set.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Interpretation of results and experimentation</title>
      <p>Here it deals with the medical image Cardiac [16] considered for experimentation as shown in
Fig.2.Theexecution of software for this method is implemented with the language Python with help of
Intel Core (R) 64-bit processor with 8.00 GB RAM, 2.60GHz clock speed on the
Windows11operatingsystem. The Dictionary learning domain is applied in sparse Representation
using deep learning methodology. Using dictionary model the linear measurement is also achieved to
obtain the linear measurement and image reconstruction using the orthogonal matchingpursuit method
and least angle regression (LAR) method is executed for the reconstruction of the enhanced image.
The CAD cardiac MRI images undergo training with limited time and reconstruction achieved by
norm value. The following metrices PSNR, norm value and time are measured to validate the results
of CS.</p>
      <p>The regional practice of gaining results in denoising image is obtained by comparing the original
and reconstructed images. If the reconstructed image becomes perfect then it resembles the Gaussian
noise.It can be notified from the plotting that the output from imp with 2 nonzero coefficients is less
biased whereas with one non-zero coefficient it becomes a controversy [13].</p>
      <p>
        The cardiac MRI images are initially learning from dictionaries and classified into 7076 patches
with total training time of (3.0sec.). By training the dataset in deep learning method the cardiac MRI
dataset with the single atom dictionary of orthogonal matching pursuit algorithm has obtained the
maximum norm value (5.00) with minimum computation time(0.4sec.). Secondly, the dictionary of
two atom OMP method is yielded the (4.18) with time consumption (0.8sec.). For the same, sparse
dictionary learning and least angle recursion method has shown least performance in terms of norm
(6.18), needs more computation time (5.7 sec). Threshold value is obtained the higher norm (6.85)
value with minimal time (0.1) but it doesn’t provide the desired image. The Measurement metrics
PSNR are observed that orthogonal matching pursuit algorithm with single dictionary atom are
achieved the desired results (33.02dB) orthogonal matching pursuit algorithm with two dictionary
atom performs secondly, threshold performs poor denoising in the PSNR value (25.01 dB). On the
whole, Dictionary learning with OMP method is able to accomplish near to the extreme one in terms
of all the metrics. It is obvious that, least angle recursion algorithm is the second in performance [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ].
      </p>
      <p>In addition, it is closer to F norm and LAR is strongly biased with differing intensity value of
original image. Though thresholding gives efficient output and is used in other tasks such as object
clarificationwith relating visuals, it is less helpful in denoising.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusion</title>
      <p>In this paper, the novelty of developing the sparse modelling with dictionary learning method
using deep learning performs well on MRI images. The performance of the sparse modelling using
dictionary learning with least angle regression method and Orthogonal matching pursuit are calculated
based on the experimentation using Cardiac MRI image. Generally, to find better output performance
the image of reconstructed image or difference norm image and original images are consider.MRI
dataset with the single atom dictionary of orthogonal matching pursuit algorithm obtained the highest
norm value with minimum time for computation. Sparse dictionary learning and least angle recursion
method exhibits low performance concerning norm, which needs more computation time. Threshold
value is obtained the higher norm value with minimal time but it doesn’t provide the desired image.
OM achieves most suitable results compared with performance of LAR. Further work can be done by
testing the methods of compressive sensing using the dictionary learning model which can be extended
to medical images.</p>
    </sec>
    <sec id="sec-6">
      <title>6. References</title>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <surname>Aharon</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Elad</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Bruckstein</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2006</year>
          ).
          <article-title>K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation</article-title>
          .
          <source>IEEE Transactions on signal processing</source>
          ,
          <volume>54</volume>
          (
          <issue>11</issue>
          ),
          <fpage>4311</fpage>
          -
          <lpage>4322</lpage>
          .[2]
          <string-name>
            <surname>Ahmad</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Amin</surname>
            ,
            <given-names>M. G.</given-names>
          </string-name>
          (
          <year>2012</year>
          ).
          <article-title>Through-the-wall human motion indication using sparsity-driven change detection</article-title>
          .
          <source>IEEE Transactions on Geoscience and Remote Sensing</source>
          ,
          <volume>51</volume>
          (
          <issue>2</issue>
          ),
          <fpage>881</fpage>
          -
          <lpage>890</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <surname>Beckouche</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ma</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2014</year>
          ).
          <article-title>Simultaneous dictionary learning and denoising for seismicdata</article-title>
          .
          <source>Geophysics</source>
          ,
          <volume>79</volume>
          (
          <issue>3</issue>
          ),
          <fpage>A27</fpage>
          -
          <lpage>A31</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Boßmann</surname>
            ,
            <given-names>F.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Ma</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2015</year>
          ).
          <article-title>Asymmetric chirplet transform for sparse representation of seismicdata</article-title>
          .
          <source>Geophysics</source>
          ,
          <volume>80</volume>
          (
          <issue>6</issue>
          ),
          <fpage>WD89</fpage>
          -
          <lpage>WD100</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Wang</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shu</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zhang</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Liu</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Gan</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          (
          <year>2008</year>
          , May).
          <article-title>Iterative image coding with overcomplete curvelet transform</article-title>
          .
          <source>In 2008 Congress on Image and Signal Processing</source>
          (Vol.
          <volume>1</volume>
          , pp.
          <fpage>666</fpage>
          -
          <lpage>670</lpage>
          ). IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Pant</surname>
            ,
            <given-names>J. K.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Krishnan</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2013</year>
          ).
          <article-title>Compressive sensing of electrocardiogram signals by promoting sparsity on the second-order difference and by using dictionary learning</article-title>
          .
          <source>IEEE transactions on biomedical circuits and systems</source>
          ,
          <volume>8</volume>
          (
          <issue>2</issue>
          ),
          <fpage>293</fpage>
          -
          <lpage>302</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Ma</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Yu</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          (
          <year>2017</year>
          ).
          <article-title>Sparsity in compressive sensing</article-title>
          .
          <source>The Leading Edge</source>
          ,
          <volume>36</volume>
          (
          <issue>8</issue>
          ),
          <fpage>646</fpage>
          -
          <lpage>652</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Meher</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Agrawal</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Panda</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dora</surname>
            ,
            <given-names>L.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Abraham</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          (
          <year>2020</year>
          ).
          <article-title>A novel region‐based multimodal image fusion technique using improved dictionary learning</article-title>
          .
          <source>International Journal of Imaging Systems and Technology</source>
          ,
          <volume>30</volume>
          (
          <issue>3</issue>
          ),
          <fpage>558</fpage>
          -
          <lpage>576</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Akbari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Trocan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          (
          <year>2015</year>
          ,
          <article-title>October)</article-title>
          .
          <article-title>Sparse recovery-based error concealment for multiview images</article-title>
          .
          <source>In 2015 International Workshop on Computational Intelligence for Multimedia Understanding (IWCIM)</source>
          (pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          ). IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <surname>Akbari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trocan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Granado</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2017</year>
          , June).
          <article-title>Synthesis sparse modeling: Application to image compression and image error concealment</article-title>
          .
          <source>In Proceedings of Signal Processing with Adaptive Sparse Structured Representations Workshop (SPARS).</source>
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <surname>Akbari</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Trocan</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          , &amp;
          <string-name>
            <surname>Granado</surname>
            ,
            <given-names>B.</given-names>
          </string-name>
          (
          <year>2017</year>
          ,
          <article-title>August)</article-title>
          .
          <article-title>Joint-domain dictionary learning-based error concealment using common space mapping</article-title>
          .
          <source>In 2017 22nd International Conference on Digital Signal Processing (DSP)</source>
          (pp.
          <fpage>1</fpage>
          -
          <lpage>5</lpage>
          ). IEEE.
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11] [danialsharifrazi], (
          <year>2021</year>
          , October).
          <article-title>[cad-cardiac-mri-dataset]</article-title>
          ,
          <source>[Version</source>
          <volume>2</volume>
          ]. From [https://www.kaggle.com/danialsharifrazi/cad-cardiac
          <string-name>
            <surname>-</surname>
          </string-name>
          mri-dataset].
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>