<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Real-Time Tracking of Aortic Valve Landmarks Based on 2D-2D Fluoroscopic Image Registration</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>M. E. Karar</string-name>
          <email>mohamed.karar@medizin.uni-leipzig.de</email>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>T. Noack</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>J. Kempfert</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>V. Falk</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>O. Burgert</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Division of Heart and Vascular Surgery, University Hospital Zurich</institution>
          ,
          <addr-line>8091 Zurich</addr-line>
          ,
          <country country="CH">Switzerland</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Heart Center Leipzig</institution>
          ,
          <addr-line>04289 Leipzig</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Innovation Center Computer Assisted Surgery (ICCAS), Universität Leipzig</institution>
          ,
          <addr-line>04103 Leipzig</addr-line>
          ,
          <country country="DE">Germany</country>
        </aff>
      </contrib-group>
      <fpage>57</fpage>
      <lpage>60</lpage>
      <abstract>
        <p>Transcatheter aortic valve implantation (TAVI) is routinely performed under 2D fluoroscopic guidance. The target position for placement of the stented aortic valve prosthesis is defined by aortic valve landmarks, e.g. coronary ostia. This paper presents a real-time tracking method of these landmarks in 2D fluoroscopic image sequences to improve the positioning of the implant during TAVI. The proposed tracking method is based on the Insight Toolkit (ITK) registration framework. Minimal user-interaction is required to define 2D landmarks in a reference image. The reference image is automatically detected to present all image features, when the aortic root is filled with a contrast agent. Preliminary results showed a good tracking of the landmarks even without the contrast agent in 14 fluoroscopic image sequences.</p>
      </abstract>
      <kwd-group>
        <kwd>Transcatheter aortic valve implantation</kwd>
        <kwd>Fluoroscopy</kwd>
        <kwd>Real-time tracking</kwd>
        <kwd>Image registration</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>Problem</title>
    </sec>
    <sec id="sec-2">
      <title>Methods</title>
      <p>
        The Insight Toolkit (ITK) [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ] has been used for intensity-based 2D-2D rigid fluoroscopic image registration. The basic
components of the ITK registration framework are two input images, an image transformation, a metric, an interpolator
and an optimizer. The two input images are a fixed image and a moving image. A translation transformation maps the
fixed image space into the moving image space by resolving the translational misalignment between images, in order to
overlap the same objects in both images. An optimizer is required to explore the parameter space of the transform in
search of optimal values of the metric. Mutual information registration by Mattes et al. [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] has been used as a metric to
compare how well the two images match each other. An interpolator will finally evaluate the intensities of the moving
image as non-rigid positions.
      </p>
      <p>
        Fig. 1 shows the flowchart of the proposed tracking method of aortic valve landmarks in 2D fluoroscopic image
sequences. For the TAVI, the automatic landmark detection is a difficult task, because the aortic root is not visible in the
fluoroscopic image unless the contrast agent is injected. Therefore, detection of a reference image that includes the
required features of aortic root is needed. The proposed tracking algorithm automatically detects the reference image in
which the aortic root including the stenotic valve is filled with a contrast agent based on histogram analysis of the
fluoroscopic images [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Once the reference image is detected, the image sequence is frozen to provide a manual
initialization of the valve landmark locations.
      </p>
      <p>Afterwards, tracking of aortic valve landmarks is automatically started as follows: The input fluoroscopic image and the
reference image are preprocessed using the median filter, in order to reduce the image noise. Each image of the
sequence is presented as a fixed image and the reference image including the landmarks is presented as a moving image
for the ITK registration framework. The registered reference image determines a new translation of the current features
in each image of sequence, defining the new displacement of valve landmarks. Finally, these landmarks are overlaid on
the current image of the sequence to visualize the target area of implantation.</p>
      <p>
        The evaluation of the registration-based tracking procedure is a difficult task, especially for the registered images with
no injected contrast agent. Also, a ground-truth image data is not available. All image sequences were therefore visually
and qualitatively inspected to verify the registration quality for landmarks tracking. The quality of registration was
classified as defined in [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]:
• Excellent: the best quality with no visible discrepancy between both images.
• Good: small misalignment between the images in the range of 1 to 9 pixels.
• Moderate: high misalignment between the images in the range of 10 to 20 pixels.
      </p>
      <p>• Poor: registration with significant misalignment.</p>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>The proposed tracking method has been tested on 14 fluoroscopic image sequences of the TAVI. The tested images are
1024×1024 pixels in size. All image sequences were acquired using an angiographic C-arm system (Axiom Artis,
Siemens AG, Healthcare Sector, Forchheim, Germany) at the Heart Center Leipzig, Germany.</p>
      <p>
        The proposed method has been implemented using C++ and open source libraries which are the ITK and the
Visualization Toolkit (VTK) [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Total processing time of the registration-based tracking algorithm is 100 ms per frame.
Fig. 2 shows a sample of landmarks tracking in two sets of fluoroscopic images using 2D-2D intensity-based
registration. The reference fluoroscopic images are automatically detected to manually define the aortic valve landmarks
as depicted in Fig. 2(a, b). The features from the reference image (moving image) are matched to the most intense
features of the input images of the sequence (fixed image) in the presence of a contrast agent (see Fig. 2(c, d)) and
without a contrast agent as shown in Fig. 2(e, f). The evaluation results of registration are summarized in Table. 1.
      </p>
      <p>Fig: 2: (a, b) the reference images of two different fluoroscopic image sequences including the manual
definition of aortic valve landmarks, i.e. coronary ostia and two lower points of aortic valve cusps, the figures
(c and e, d and f) show that the landmarks are successfully tracked in a sample of two images for each
fluoroscopic sequence, the figures also depict checkerboard registration results as alternating blocks from the
reference image and the input image of sequence with a contrast agent (c, d), and without a contrast agent (e, f).
An intra-operative tracking method of aortic valve landmarks has been presented based on 2D-2D fluoroscopic image
registration. A qualitative evaluation of the registration performance showed that the quality of registration-based
tracking of landmarks algorithm is good with 1 to 9 pixels errors in most tested images of each fluoroscopic sequence as
illustrated in Table 1. The misalignment of registered images detected in 7 of 14 fluoroscopic image sequences in the
range of 1 to 10 images per sequence, because the input fluoroscopic images without a contrast agent and large motion
of the aortic root may affect significantly the accuracy of 2D-2D intensity-based registration procedure. However, the
alignment of fluoroscopic images is still valid and optimized by using the capabilities of the ITK registration framework.
The proposed registration-based tracking method of aortic valve landmarks may provide a helpful tool for assisting the
TAVI under 2D fluoroscopic guidance. To minimize the user-interaction and increase the accuracy of initialization, we
plan to extract 3D landmarks from CT or Dyna-CT images and register them to a 2D fluoroscopic reference image.
Tracking of native annular calcification may be also another promising method for image registration in the future.</p>
    </sec>
    <sec id="sec-4">
      <title>Acknowledgment</title>
      <p>This work is supported by German Academic Exchange Service (DAAD) under scholarship no. A0690520. The
Innovation Center Computer Assisted Surgery (ICCAS) at Faculty of Medicine, Universität Leipzig, is funded by
German Federal Ministry of Education and Research (BMBF) and Saxon Ministry of Science and Fine Arts (SMWK) in
the scope of the initiative “Unternehmen Region” with grant numbers 03 ZIK 031 and 03 ZIK 032. This work is
partially funded by Siemens AG, Healthcare Sector, Forchheim, Germany.
5</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>T.</given-names>
            <surname>Walther</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Dewy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M. A.</given-names>
            <surname>Borger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Kempfert</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Linke</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Becht</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Falk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Schuler</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. W.</given-names>
            <surname>Mohr</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Mack</surname>
          </string-name>
          ,
          <article-title>Transapical aortic valve implantation: step by step</article-title>
          ,
          <source>Ann. Thorac. Surg.</source>
          , vol.
          <volume>87</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>276</fpage>
          -
          <lpage>283</lpage>
          ,
          <year>2009</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>M. E.</given-names>
            <surname>Karar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Gessat</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Walther</surname>
          </string-name>
          ,
          <string-name>
            <given-names>V.</given-names>
            <surname>Falk</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O.</given-names>
            <surname>Burgert</surname>
          </string-name>
          ,
          <article-title>Towards a new image guidance system for assisting transapical minimally invasive aortic valve implantation</article-title>
          ,
          <source>Conf Proc IEEE Eng Med Biol Soc</source>
          .
          <year>2009</year>
          , pp.
          <fpage>3645</fpage>
          -
          <lpage>3648</lpage>
          . doi:
          <volume>10</volume>
          .1109/IEMBS.
          <year>2009</year>
          .5332516
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>The</given-names>
            <surname>Insight Segmentation and Registration Toolkit</surname>
          </string-name>
          , Kitware, www.itk.org,
          <volume>05</volume>
          -
          <fpage>07</fpage>
          -
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <given-names>D.</given-names>
            <surname>Mattes</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. R.</given-names>
            <surname>Haynor</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Vesselle</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T. K.</given-names>
            <surname>Lewellen</surname>
          </string-name>
          , W. Eubank,
          <article-title>PET-CT image registration in the chest using free-form deformations</article-title>
          ,
          <source>IEEE Trans. on Medical Imaging</source>
          , vol.
          <volume>22</volume>
          , no.
          <issue>1</issue>
          , pp.
          <fpage>120</fpage>
          -
          <lpage>128</lpage>
          ,
          <year>2003</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>A.</given-names>
            <surname>Condurache</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Aach</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            <surname>Eck</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bredno</surname>
          </string-name>
          ,
          <article-title>Fast detection and processing of arbitrary contrast agent injections in coronary angiography and fluoroscopy</article-title>
          ,
          <source>Bildverarbeitung für die Medizin</source>
          , Berlin: Springer, pp.
          <fpage>5</fpage>
          -
          <lpage>9</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>R.</given-names>
            <surname>Kolar</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L.</given-names>
            <surname>Kubecka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Jan</surname>
          </string-name>
          ,
          <article-title>Registration and fusion of the autofluorescent and infrared retinal images</article-title>
          ,
          <source>Int. J. Biomedical Imaging</source>
          , vol.
          <year>2008</year>
          ,
          <string-name>
            <surname>Article</surname>
            <given-names>ID</given-names>
          </string-name>
          513478, 11 pages,
          <year>2008</year>
          . doi:
          <volume>10</volume>
          .1155/
          <year>2008</year>
          /513478
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          [7]
          <string-name>
            <given-names>The</given-names>
            <surname>Visualization</surname>
          </string-name>
          <string-name>
            <surname>Toolkit</surname>
          </string-name>
          , Kitware, www.vtk.org,
          <volume>05</volume>
          -
          <fpage>07</fpage>
          -
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>