<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Reducing false discovery rates for on-line model checking based detection of respiratory motion artifacts</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Sven-Thomas Antoni</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Xintao Ma</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Sibylle Schupp</string-name>
          <email>schuppg@tuhh.de</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alexander Schlaefer</string-name>
          <email>schlaeferg@tuhh.de</email>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Hamburg University of Technology, Institute for Software Systems</institution>
          ,
          <addr-line>Am-Schwarzenberg-Campus 3E, 21073 Hamburg</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Hamburg University of Technology, Institute of Medical Technology</institution>
          ,
          <addr-line>Am-Schwarzenberg-Campus 3E, 21073 Hamburg</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2016</year>
      </pub-date>
      <fpage>182</fpage>
      <lpage>186</lpage>
      <abstract>
        <p>Compensating respiratory motion in radiosurgery is an important problem and can lead to a more focused dose delivered to the patient. We previously showed the negative effect of respiratory artifacts on the error of the correlation model, connecting external and internal motion, for meaningful episodes from treatments with the Accuray CyberKnifer. We applied on-line model checking, an iterative fail safety method, to respiratory motion. In this paper we vary its prediction parameter and decrease the previously rather high false discovery rate by 30.3%. In addition, we were able to increase the number of detected meaningful episodes through adaptive parameter choice by 452%.</p>
      </abstract>
      <kwd-group>
        <kwd>On-line model checking</kwd>
        <kwd>respiratory motion compensation</kwd>
        <kwd>prediction</kwd>
        <kwd>fail safety</kwd>
        <kwd>event detection</kwd>
        <kwd>radiosurgery</kwd>
        <kwd>stereotactic body radiation therapy</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>artifacts may lead to distinct deviations between tumor and beams that lead to recreation
of the CM or may not be detected by the system [SGB+00, SSA04, SBN+07, ARSS15b].
To overcome latencies in the system, prediction of external motion is used. New methods
are able to predict even irregular data with little error [EDSS13]. While this reduces the
prediction error our research indicates that the CM may become invalid [ARSS15b].
On-line model checking (OMC) is a new iterative fail safety method. At discrete time
intervals OMC validates the input data against a previously defined model which parameters
are derived from the data history. Recently, OMC was introduced as a validation method
for respiratory motion. While in principle OMC for artifact detection is feasible, a rather
high false discovery rate (FDR) was observed [RSG14a, RSG14b, ARSS15a, ARSS15b].
For this work we advance the detection of meaningful episodes showing high correlation
errors in the data. In addition, we focus on reducing the FDR of OMC, which we achieve
without sacrificing the overall accuracy. Due to the improved episode detection, we are
able to work on a significantly smaller dataset than previous works.
2
2.1</p>
    </sec>
    <sec id="sec-2">
      <title>Materials and methods</title>
      <sec id="sec-2-1">
        <title>CyberKnife treatment data</title>
        <p>Our data contains time series of the surrogate and fiducial marker positions si and fi, as
well as the expected fiducial marker positions gi. The error ei = k fi gik and the mean
error e with respect to the fiducial position are used to select interesting episodes.
Particularly, we consider episodes with three subsequent small errors followed by one large error.
Let di = jei ej and sd be the absolute and standard deviation from the average error,
respectively. Using the 90% quantile q = Q0:9(d) we define thresholds tl = dijdi &lt; q and
tu = tl + sd , where errors below tl are considered small and errors above tu are considered
large.</p>
        <p>We use the two thresholds to derive physiologically meaningful episodes [i 3; i] that
exhibit an amplitude of at least 2mm and 6mm in the first principal component (PC) of
external and internal motion, respectively, and fulfill fi : ei 3; ei 2; ei 1 tl ^ ei &gt; tug .
2.2</p>
      </sec>
      <sec id="sec-2-2">
        <title>On-line Model Checking</title>
        <p>During OMC the breathing motion is predicted and the respiratory model is periodically
evaluated.</p>
        <p>The prediction model of the chest movement is generated based on a limited history of
data which we assume to indicate the movement in the future. The prediction combines
discrete Fourier series and linear regression
Here, b is a deviation factor that allows adopting the prediction to different breathing
patterns. To increase the possibility of correctly predicting the respiration, multiple
possible movement trajectories are generated. For smaller values of an accuracy parameter
a 2 [0; 100] more trajectories are simulated. The influence of the deviation parameter
b is varied in two ways: by varying the actual value of b and by varying the interval
tlb = f[lb; 1000] : lb 2 Zg at which a deviation is applied. Previous implementations of
OMC did not allow changing lb, which was always set to 1 (Fig. 1a). For this work we
focus on varying the parameter lb. For small lb, deviations are added earlier during
prediction. For episodes of regular breathing, however, the frequency of irregularities in motion
is small. Hence, a larger value of lb is appropriate as it increases the probability to
correctly predict regular motion. On the other hand, the value of lb should not be too large.
Otherwise, too few trajectories are generated, making it harder to account for natural small
irregularities in respiratory motion.</p>
        <p>For validation we estimate how likely we can predict the actual value x0 at time t0 with the
probability</p>
        <p>Pr[t0
tI
tp
t0 + tI ^ x(tp)
xI
x(tp)
x(tp) + xI ];
(2)
where x(tp) is the predicted value at time tp and xI and tI define a rectangular region around
the actual value and the measured time. The probability is estimated for the three PCs of
the marker coordinates placed on the patient’s chest. In a second step, we capture how
often in a row the probability is lower than a threshold q . The validation result is positive
if the probability falls below the safety threshold for three times in a row, indicating there
is an artifact of the patient. Otherwise, the result is negative, indicating normal breathing.
3</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>Results</title>
      <p>For the modified selection of episodes we used data of 194 sessions that showed 23
episodes before [ARSS15b]. With the improved episode selection we are now able to
identify 104 episodes; an increment of about 452%.</p>
      <p>For the OMC parameter variation we investigated treatment sessions of 6 patients of a total
mean duration of 35 minutes. Values of tl ranged from 0.83mm to 3.86mm, tu from 1.41
(a)
(c)
to 7.75. OMC parameters were set to a = 70, q = 30%, tI = 0:5ms and xI = 0:5mm. We
varied the time interval in four steps tlb; lb = 1; 250; 500; 1000.</p>
      <p>We identified 6 episodes fulfilling all criteria. Every episode showed a clear artifact prior to
the high CM error that is detected by the OMC for every tlb, see Fig. 2a-b at approximately
21930s and 2c-d at approximately 33540s and 33600s for examples. The mean FDR of
OMC validation of those 6 episodes ranged from 50.91% with t1 to 35.29% with t750. The
false positives were reduced by 51.14% in mean.
4</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>Compared to the setting t1 used in previous work, we reduced the number of false positives
significantly by about 31% using t750 without sacrificing overall accuracy.
Even with our modifications, the patient of Fig 2a-b) showed a very high number of false
positive OMC validations although we were able to reduce them from 17 with t1 to 11
with t750. Previous results of the same session did not show this behavior. We assume this
is due to timing issues and it will need to be addressed in the future. Leaving this patient
out, the mean FDR of the remaining 5 episodes ranged from 35.49% with t1 to 6.25% with
t750 with a mean 89% reduction in false positives.</p>
      <p>Overall, we were able to reduce the number of false positives distinctly, making OMC now
better suited for artifact detection in respiratory motion.</p>
      <p>For future improvements we suggest to include the correlation model directly into the
OMC. This would allow to immediately check for errors in the correlation model.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          <string-name>
            <surname>[ARSS15a] S.-T. Antoni</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Rinast</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Schupp</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Schlaefer</surname>
          </string-name>
          .
          <article-title>Comparing model-free motion prediction and on-line model checking for respiratory motion management</article-title>
          .
          <source>In Gemeinsamer Tagungsband der Workshops der Tagung Software Engineering</source>
          <year>2015</year>
          , Dresden, Germany,
          <volume>17</volume>
          .-
          <fpage>18</fpage>
          . Ma¨rz
          <year>2015</year>
          ., pages
          <fpage>15</fpage>
          -
          <lpage>18</lpage>
          ,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          <string-name>
            <surname>[ARSS15b] S.-T. Antoni</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Rinast</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          <string-name>
            <surname>Schupp</surname>
          </string-name>
          ,
          <article-title>and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Schlaefer</surname>
          </string-name>
          .
          <article-title>Evaluation des Einflusses von Artefakten auf den Korrelationsfehler in der bewegungskompensierten Radiochirurgie</article-title>
          .
          <source>In Tagungsband der 14</source>
          . Jahrestagung der Deutschen Gesellschaft fu¨r Computer- und
          <source>Roboterassistierte Chirurgie</source>
          , pages
          <fpage>133</fpage>
          -
          <lpage>138</lpage>
          , Bremen, Germany,
          <year>2015</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [DHV+10]
          <string-name>
            <given-names>T.</given-names>
            <surname>Depuydt</surname>
          </string-name>
          ,
          <string-name>
            <given-names>O. C.</given-names>
            <surname>Haas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            <surname>Verellen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Erbel</surname>
          </string-name>
          ,
          <string-name>
            <surname>M. De Ridder</surname>
            , and
            <given-names>G.</given-names>
          </string-name>
          <string-name>
            <surname>Storme</surname>
          </string-name>
          .
          <article-title>Geometric accuracy evaluation of the new VERO stereotactic body radiation therapy system</article-title>
          .
          <source>In UKACC International Conference on Control</source>
          <year>2010</year>
          , pages
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . IET,
          <year>2010</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [EDSS13]
          <string-name>
            <given-names>F.</given-names>
            <surname>Ernst</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R.</given-names>
            <surname>Du</surname>
          </string-name>
          <article-title>¨richen, A. Schlaefer, and</article-title>
          <string-name>
            <given-names>A.</given-names>
            <surname>Schweikard</surname>
          </string-name>
          .
          <article-title>Evaluating and comparing algorithms for respiratory motion prediction</article-title>
          .
          <source>Phys Med Biol</source>
          ,
          <volume>58</volume>
          (
          <issue>11</issue>
          ):
          <fpage>3911</fpage>
          ,
          <year>2013</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          <string-name>
            <surname>[HNLH08] M. Hoogeman</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          <string-name>
            <surname>Nuyttens</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Levendag</surname>
            , and
            <given-names>B.</given-names>
          </string-name>
          <string-name>
            <surname>Heijmen</surname>
          </string-name>
          .
          <article-title>Time dependence of intrafraction patient motion assessed by repeat stereoscopic imaging</article-title>
          .
          <source>Int J Radiat Oncol Biol Phys</source>
          ,
          <volume>70</volume>
          (
          <issue>2</issue>
          ):
          <fpage>609</fpage>
          -
          <lpage>618</lpage>
          ,
          <year>2008</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [RSG14a] [RSG14b] [SBN+07] [SGB+00] [SSA04]
          <string-name>
            <given-names>J.</given-names>
            <surname>Rinast</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schupp</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Gollmann</surname>
          </string-name>
          .
          <article-title>A graph-based transformation reduction to reach uppaal states faster</article-title>
          .
          <source>In FM 2014: Formal Methods</source>
          , pages
          <fpage>547</fpage>
          -
          <lpage>562</lpage>
          . Springer,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <string-name>
            <given-names>J.</given-names>
            <surname>Rinast</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Schupp</surname>
          </string-name>
          , and
          <string-name>
            <given-names>D.</given-names>
            <surname>Gollmann</surname>
          </string-name>
          .
          <article-title>State space reconstruction in Uppaal: An algorithm and its proof</article-title>
          .
          <source>International Journal On Advances in Systems and Measurements</source>
          ,
          <volume>7</volume>
          (
          <issue>1</issue>
          and 2):
          <fpage>91</fpage>
          -
          <lpage>102</lpage>
          ,
          <year>2014</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          <string-name>
            <given-names>Y.</given-names>
            <surname>Seppenwoolde</surname>
          </string-name>
          ,
          <string-name>
            <given-names>R. I.</given-names>
            <surname>Berbeco</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Nishioka</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Shirato</surname>
          </string-name>
          , and
          <string-name>
            <given-names>B.</given-names>
            <surname>Heijmen</surname>
          </string-name>
          .
          <article-title>Accuracy of tumor motion compensation algorithm from a robotic respiratory tracking system: a simulation study</article-title>
          .
          <source>Med Phys</source>
          ,
          <volume>34</volume>
          (
          <issue>7</issue>
          ):
          <fpage>2774</fpage>
          -
          <lpage>2784</lpage>
          ,
          <year>2007</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          <string-name>
            <given-names>A.</given-names>
            <surname>Schweikard</surname>
          </string-name>
          , G. Glosser,
          <string-name>
            <given-names>M.</given-names>
            <surname>Bodduluri</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Murphy</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Adler</surname>
          </string-name>
          .
          <article-title>Robotic motion compensation for respiratory movement during radiosurgery</article-title>
          .
          <source>Comput Aided Surg</source>
          ,
          <volume>5</volume>
          (
          <issue>4</issue>
          ):
          <fpage>263</fpage>
          -
          <lpage>277</lpage>
          ,
          <year>2000</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          <string-name>
            <given-names>A.</given-names>
            <surname>Schweikard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Shiomi</surname>
          </string-name>
          , and
          <string-name>
            <given-names>J.</given-names>
            <surname>Adler</surname>
          </string-name>
          .
          <article-title>Respiration tracking in radiosurgery</article-title>
          .
          <source>Med Phys</source>
          ,
          <volume>31</volume>
          (
          <issue>10</issue>
          ):
          <fpage>2738</fpage>
          -
          <lpage>2741</lpage>
          ,
          <year>2004</year>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>