<?xml version="1.0" encoding="UTF-8"?>
<TEI xml:space="preserve" xmlns="http://www.tei-c.org/ns/1.0" 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
xsi:schemaLocation="http://www.tei-c.org/ns/1.0 https://raw.githubusercontent.com/kermitt2/grobid/master/grobid-home/schemas/xsd/Grobid.xsd"
 xmlns:xlink="http://www.w3.org/1999/xlink">
	<teiHeader xml:lang="en">
		<fileDesc>
			<titleStmt>
				<title level="a" type="main">Focused Registration of Tracked 2D US to 3D CT Data of the Liver</title>
			</titleStmt>
			<publicationStmt>
				<publisher/>
				<availability status="unknown"><licence/></availability>
			</publicationStmt>
			<sourceDesc>
				<biblStruct>
					<analytic>
						<author role="corresp">
							<persName><forename type="first">Janine</forename><surname>Olesch</surname></persName>
							<email>olesch@mic.uni-luebeck.de</email>
							<affiliation key="aff0">
								<orgName type="department">Institute of Mathematics and Image Computing</orgName>
								<orgName type="institution">University of Lübeck</orgName>
								<address>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
							<affiliation key="aff1">
								<orgName type="department" key="dep1">Fraunhofer MEVIS</orgName>
								<orgName type="department" key="dep2">Project Group Image Registration</orgName>
								<address>
									<settlement>Lübeck</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
							<affiliation key="aff2">
								<orgName type="department">Graduate School for Computing in Medicine and Life Sciences</orgName>
								<orgName type="institution">Univ. Lübeck</orgName>
								<address>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<author>
							<persName><forename type="first">Bernd</forename><surname>Fischer</surname></persName>
							<affiliation key="aff0">
								<orgName type="department">Institute of Mathematics and Image Computing</orgName>
								<orgName type="institution">University of Lübeck</orgName>
								<address>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
							<affiliation key="aff1">
								<orgName type="department" key="dep1">Fraunhofer MEVIS</orgName>
								<orgName type="department" key="dep2">Project Group Image Registration</orgName>
								<address>
									<settlement>Lübeck</settlement>
									<country key="DE">Germany</country>
								</address>
							</affiliation>
						</author>
						<title level="a" type="main">Focused Registration of Tracked 2D US to 3D CT Data of the Liver</title>
					</analytic>
					<monogr>
						<imprint>
							<date/>
						</imprint>
					</monogr>
					<idno type="MD5">914DCA4993F4E8A326DF5AF3D0690D5E</idno>
				</biblStruct>
			</sourceDesc>
		</fileDesc>
		<encodingDesc>
			<appInfo>
				<application version="0.7.2" ident="GROBID" when="2023-03-25T04:30+0000">
					<desc>GROBID - A machine learning software for extracting information from scholarly documents</desc>
					<ref target="https://github.com/kermitt2/grobid"/>
				</application>
			</appInfo>
		</encodingDesc>
		<profileDesc>
			<abstract>
<div xmlns="http://www.tei-c.org/ns/1.0"><p>The paper deals with the registration of pre-operative 3D-CT-data to tracked intra-operative 2D-US-slices in the context of liver surgery. To bring such a method to clinical practice, it has to be fast and robust. In order to meet these demanding criteria, we propose two strategies. Instead of applying a time-consuming compounding process to obtain a 3D-US image, we use the 2D-slices directly and thereby drastically reduce the complexity and enhance the robustness of the scheme. Naturally, the surgeon does not need the same high resolution for the whole liver. We make use of this fact by applying a focusing technique to regions of special interest. With this, we reduce the overall amount of data to register significantly without sacrificing the accuracy in the ROIs. In contrast to other attempts, the high resolution result in the ROI is combined in a natural way with a global deformation field to obtain a smooth registration of the whole liver. Overall we arrive at a method with a favorable timing. The proposed algorithm was applied to four different patient data-sets and evaluated with respect to the reached vessel-overlap on validation slices. The obtained results are very convincing and will help to bring non-linear registration techniques to the operation theater.</p></div>
			</abstract>
		</profileDesc>
	</teiHeader>
	<text xml:lang="en">
		<body>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Introduction</head><p>The best treatment for tumors in the liver is still their resection. This is a tricky intervention, as one would like to remove all tumorous tissue and to preserve as much healthy liver as possible. To this end planning-data is acquired and processed, which ideally provides an optimal resection plan. As the liver is deformed during the intervention, intra-operative navigation is needed to guide the surgeon with respect to the planning-data. To enable the navigation during the intervention, ultrasound (US) is often the method of choice. It is the purpose of this paper to come up with a reliable and fast scheme which aligns the pre-processed 3D planning-data (CT) to the intra-operative situation, given the information by the tracked 2D-US-slices. Instead of determining a non-linear transformation for the whole liver, we propose a different strategy: In the first step we perform a fast rigid pre-alignment based on the full CT-volume. The second step is then used to improve this result non-linearly in a region of interest (ROI). As the non-linear step is computationally more expensive as opposed to the rigid one and the surgeon is not interested in the same resolution throughout the whole liver, it makes very much sense to focus on a ROI. To achieve nevertheless a transformation for the full volume, we apply a technique developed in <ref type="bibr" target="#b0">[1]</ref>, where the authors introduce the idea of focused registration. Figure <ref type="figure" target="#fig_0">1</ref> (a) visualizes pre-processed 3D planning-data superimposed by the proposed resection plane, the ROI (b), (c), and some of the US-slices (d). It should be noted, that the ROI is automatically derived from the location of the resection plane and the associated US-slices.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">Materials and Methods</head><p>We start by briefly describing the different steps of our proposed method. First we select j rigid slices from the US-data based on an entropy measure. Next, the rigid registration process with respect to these slices and the CT-data takes place. Then, based on the resection plane, we identify a region of interest Ω ROI in the CT-volume. Subsequently, the US-slices within the ROI are determined. For the non-linear step, a subset of j nl slices is selected. Naturally, the non-linear step makes use of the rigid result on T ROI and is performed solely based on the selected US-slices. Finally, the result y opt of the non-linear step is combined with the result of the rigid step to gain the deformation for the full CT-volume.</p><p>The registration-steps described above are based on the idea of volume-toslice registration, which was introduced for rigid registration by Penney et al. <ref type="bibr" target="#b1">[2]</ref> and for non-linear registration by Heldmann and Papenberg <ref type="bibr" target="#b2">[3]</ref>. In the following we describe the specialized non-linear registration problem that will be solved using the discretize-then-optimize approach in our proposed algorithm. In the first step we apply the rigid volume-to-slice registration, as described in <ref type="bibr" target="#b3">[4]</ref>. The general version of the non-linear registration problem reads as follows: given a template T and a reference R, where T , R : Ω ⊂ R 3 → R, find a transformation y : R 3 → R 3 such that where D denotes a distance measure, S a regularizer, and α ∈ R + a regularization parameter.</p><formula xml:id="formula_0">J (y) = D(R, T ; y) + αS(y) = min! (a) (b) (c) (d)</formula><p>The present registration problem is originally a multi-modal registration problem (US-CT). To circumvent this, we make use of the fact that the vessel systems are of foremost interest for the surgeon. More precisely, we only register the segmented vessel systems T V and R V . Note, that the CT-data is already segmented in the planning step. Consequently, we are able to treat the former multi-modal data by the cheap sum of squared differences (SSD) distance measure. The distance measure, which is evaluated only on the known j nl slices M nl j , j = 1, ..., j nl reads</p><formula xml:id="formula_1">D slice (y) = j nl ∑ j=1 ∫ M nl j (T V (y(x)) − R V (x)) 2 ds(x)</formula><p>where ds(x) denotes the two-dimensional surface measure.</p><p>To arrive at smooth deformations and to regularize the ill-posed problem for the non-linear step, a regularization term S is needed. For the special case of volume-to-slice registration we need a high order regularizer in order to assure a smooth deformation field y in between the US-slices <ref type="bibr" target="#b2">[3]</ref>. To this end, S is chosen as the second order curvature regularizer [5]</p><formula xml:id="formula_2">S curv (y) = 3 ∑ ℓ=1 ∫ ΩROI |∆y ℓ | 2 dx</formula><p>In contrast to the distance measure, the regularizer works on the full deformation field (Ω ROI instead of M nl j ). The discretize-then-optimize framework makes it quite straightforward to apply the idea of focused registration to our scheme. To calculate a result, which covers the full CT-volume, we apply Dirichlet zero boundary conditions to the regularizer in the focused non-linear step. With this we are able to combine the rigid and the non-linear result in an interpolation-step to an overall deformationfield.  In the beginning of this section, we mentioned two steps, where we are obliged to select slices from the US-data. Those slices, in conjunction with the regularizer, are supposed to be sufficient to guide the registration. It is obviously important that the selected slices are distributed throughout the volume to be registered and that they contain meaningful information. We therefore apply a strategy proposed by Wein et.al <ref type="bibr" target="#b5">[6]</ref>, that is, we partition the original slices into several groups and choose slices based on their entropy with these groups. Only the selected slices are then used to calculate the deformation. We tested different numbers of slices and evaluated the outcome of the methods based on these numbers. To further speed up the computation and to avoid local minima we apply a multi-level strategy in the rigid as well as in the non-linear registration step. We start on a broad resolution of the chosen slices and refine it, until a user prescribed finest resolution. Simultaneously we apply a multi-scale approach to the CT-volume that starts with the main vessels and includes stepwise finer vessels using morphological operations <ref type="bibr" target="#b6">[7]</ref>. To solve the final registration problem we apply the discretize-then-optimize strategy <ref type="bibr" target="#b7">[8]</ref> by evoking the Gauss-Newton method.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Results</head><p>We tested the proposed algorithm on four different cases. Note that all runtime results were obtained using MATLAB 2010b code, on a 2 × 2.8 GHz Quad-Core Intel Xeon Mac Pro, which was not optimized for run-time. To evaluate the algorithm, different configurations of the parameters were chosen.</p><p>For the multi-level setup-up we chose two rigid steps and two non-linear steps in all tests. First we evaluated the influence of the number of slices used in the rigid registration step. The validation subset of slices is fixed throughout all our validation steps to make the results comparable. The left part of Figure <ref type="figure" target="#fig_1">2</ref> visualizes the factors of improvement in relation to the vessel-overlap before rigid registration. This together with the run-time table suggests that a choice of 15 slices seems to be a reasonable compromise between favorable run-time and accuracy for the rigid step. The non-linear steps are performed in the region of interest solely and started from the rigid results based on 15 slices. We tested the non-linear step also on different numbers of slices. Knowing that the number of slices will have direct impact on the run-times we chose (M nl j , j = 5, 10, 15, 30). For non-linear registration the choice of α is always a crucial step, we tested different possibilities. In our tests α = 0.5 turned out to be the best choice in terms of improvement of the results with respect to run-times and regularity of the resulting grid. Figure <ref type="figure">3</ref> indicates for the non-linear step in the regions of interest, choices of M nl j , j = 5, 10 seem to be equally reasonable, resulting in an improvement up to factor of two.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">Discussion</head><p>For the first time, the focused registration methodology is combined with rigid and non-linear volume to slice registration techniques. We tested the method on four clinical data-sets and observe very promising results both in terms of timing and accuracy. Future plans include the evaluation on more clinical data-sets and the porting of the code to a run-time optimized environment.</p></div><figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_0"><head>Fig. 1 .</head><label>1</label><figDesc>Fig. 1. CT planning-data including the vessel-system (a), the lesions and a proposed resection plane; bounding box covering the ROI (b); stripped version of ROI (c); liver and some of the tracked 2D-US-slices (d).</figDesc><graphic coords="2,376.08,545.80,102.16,62.16" type="bitmap" /></figure>
<figure xmlns="http://www.tei-c.org/ns/1.0" xml:id="fig_1"><head>Fig. 2 .</head><label>2</label><figDesc>Fig. 2. Factors of improvement of the rigid registration step in relation to the vesseloverlap before rigid registration (left) and run-times (right), for all four different cases.</figDesc></figure>
			<note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0">Olesch &amp; Fischer</note>
		</body>
		<back>
			<div type="references">

				<listBibl>

<biblStruct xml:id="b0">
	<analytic>
		<title level="a" type="main">Registrierung im Fokus</title>
		<author>
			<persName><forename type="first">N</forename><surname>Papenberg</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Modersitzki</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Fischer</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proc BVM</title>
				<meeting>BVM</meeting>
		<imprint>
			<date type="published" when="2008">2008</date>
			<biblScope unit="page" from="138" to="142" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b1">
	<analytic>
		<title level="a" type="main">Registration of freehand 3D ultrasound and magnetic resonance liver images</title>
		<author>
			<persName><forename type="first">G</forename><forename type="middle">P</forename><surname>Penney</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><forename type="middle">M</forename><surname>Blackall</surname></persName>
		</author>
		<author>
			<persName><forename type="first">M</forename><forename type="middle">S</forename><surname>Hamady</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Med Image Anal</title>
		<imprint>
			<biblScope unit="volume">8</biblScope>
			<biblScope unit="issue">1</biblScope>
			<biblScope unit="page" from="81" to="91" />
			<date type="published" when="2004">2004</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b2">
	<analytic>
		<title level="a" type="main">A variational approach for volume-to-slice registration</title>
		<author>
			<persName><forename type="first">S</forename><surname>Heldmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Papenberg</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Lect Notes Computer Sci</title>
		<imprint>
			<biblScope unit="volume">4485</biblScope>
			<biblScope unit="page" from="624" to="635" />
			<date type="published" when="2009">2009</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b3">
	<analytic>
		<title level="a" type="main">Improved minimal-invasive laproscopic liver surgery by regstration of 3D CT and 2D ultrasound slices</title>
		<author>
			<persName><forename type="first">S</forename><surname>Heldmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">B</forename><surname>Beuthien</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Olesch</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Proc BMT</title>
		<imprint>
			<date type="published" when="2010">2010</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b4">
	<analytic>
		<title level="a" type="main">Fast curvature-based registration of MR mammography images</title>
		<author>
			<persName><forename type="first">B</forename><surname>Fischer</surname></persName>
		</author>
		<author>
			<persName><forename type="first">J</forename><surname>Modersitzki</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="m">Proc BVM</title>
				<meeting>BVM</meeting>
		<imprint>
			<date type="published" when="2002">2002</date>
			<biblScope unit="page" from="139" to="142" />
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b5">
	<analytic>
		<title level="a" type="main">Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention</title>
		<author>
			<persName><forename type="first">W</forename><surname>Wein</surname></persName>
		</author>
		<author>
			<persName><forename type="first">S</forename><surname>Brunke</surname></persName>
		</author>
		<author>
			<persName><forename type="first">A</forename><surname>Khamene</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Med Image Anal</title>
		<imprint>
			<biblScope unit="volume">12</biblScope>
			<biblScope unit="page" from="577" to="585" />
			<date type="published" when="2008">2008</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b6">
	<analytic>
		<title level="a" type="main">A scale-space approach for image registration of vessel structures</title>
		<author>
			<persName><forename type="first">S</forename><surname>Heldmann</surname></persName>
		</author>
		<author>
			<persName><forename type="first">N</forename><surname>Papenberg</surname></persName>
		</author>
	</analytic>
	<monogr>
		<title level="j">Proc BVM</title>
		<imprint>
			<biblScope unit="page" from="137" to="141" />
			<date type="published" when="2009">2009</date>
		</imprint>
	</monogr>
</biblStruct>

<biblStruct xml:id="b7">
	<monogr>
		<title level="m" type="main">Flexible Algorithms for Image Registration</title>
		<author>
			<persName><forename type="first">J</forename><surname>Modersitzki</surname></persName>
		</author>
		<author>
			<persName><surname>Fair</surname></persName>
		</author>
		<imprint>
			<date type="published" when="2009">2009</date>
			<publisher>SIAM</publisher>
			<pubPlace>Philadelphia</pubPlace>
		</imprint>
	</monogr>
</biblStruct>

				</listBibl>
			</div>
		</back>
	</text>
</TEI>
