<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>Workshop for Computing &amp; Advanced Localization at the Fifteenth International Conference on Indoor
Positioning and Indoor Navigation, September</journal-title>
      </journal-title-group>
    </journal-meta>
    <article-meta>
      <title-group>
        <article-title>ABeL: A Customizable Open-Source Framework for Evaluating 3D Terrestrial Positioning Algorithms</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Simon Huh</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Tristan Itschner</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Niclas Zeller</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Karlsruhe University of Applied Sciences</institution>
          ,
          <addr-line>Moltkestraße 30, 76131 Karlsruhe</addr-line>
          ,
          <country country="DE">Federal Republic of Germany</country>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2025</year>
      </pub-date>
      <volume>1</volume>
      <fpage>5</fpage>
      <lpage>18</lpage>
      <abstract>
        <p>The increase of readily available compute power of portable devices allows them to use more complex algorithms for positioning. As these algorithms are based on the propagation of a signal through the environment, an evaluation tool that allows for an evaluation of positioning algorithms based on the scenario is needed. With ABeL (Terrestrial Positioning Algorithm Benchmarking Library), an open-source Python framework for an endto-end evaluation and benchmarking of indoor and outdoor positioning algorithms, we created a framework satisfying this need. The approach of using Python as a programming language and a modularized structure allows for maximum flexibility in regard to algorithm implementation and evaluation while still maintaining a relatively low barrier of entry. As an initial benchmark, we create a baseline by evaluating two positioning algorithms, thereby demonstrating that the framework can be used for simulating multipath afected environments. The framework is available as OSS (Open-Source Software) at https://github.com/RobotVisionHKA/ABeL.git.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;Indoor Positioning</kwd>
        <kwd>Simulation Framework</kwd>
        <kwd>Positioning Benchmark</kwd>
        <kwd>Nvidia Sionna</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        In many terrestrial indoor as well as urban outdoor positioning scenarios, a direct LoS (Line-of-Sight)
connection between transmitter and receiver cannot be guaranteed. Instead, electromagnetic waves are
often reflected at least once to reach the receiver, creating an NLoS (Non-Line-of-Sight) environment
where the ToA (Time of Arrival) is delayed. Furthermore, DMCs (Difuse Multipath Components) are
introduced through the interaction of electromagnetic waves with difuse or rough surfaces as well as
edges. As both NLoS and DMC have been shown to have a major impact on the accuracy of positioning
algorithms and are highly dependent on the propagation environment, a benchmarking framework is
needed allowing for a holistic and comparable testing of positioning and multipath mitigation strategies
[
        <xref ref-type="bibr" rid="ref1">1</xref>
        ], [
        <xref ref-type="bibr" rid="ref2">2</xref>
        ].
      </p>
      <p>
        To the best of our knowledge, as of today, there exists no such E2E (End-to-End) solution, neither
commercially nor as OSS (Open-Source Software), for terrestrial positioning that is providing a 1. scenario
definition, 2. signal generation and data preparation and 3. algorithm evaluation metric in a standardized
manner. Instead, datasets, either open-source or self-generated, or simplified channel models are used
by researchers in conjunction with custom benchmarking tools. The first drawback arising from this
approach is a limited comparability between multiple positioning algorithms, as the data source used
for benchmarking the algorithms and the data preprocessing have a major impact on the reported
accuracy of the algorithm [
        <xref ref-type="bibr" rid="ref3">3</xref>
        ], [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ], [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ]. Besides, there is a need for a standardized evaluation, either
visually or numerically, which cannot be provided by custom benchmarking solutions, leading to only
vaguely comparable performance results [
        <xref ref-type="bibr" rid="ref6">6</xref>
        ]. Another point to mention is the time needed to create
an environment, where positioning algorithms can be realistically tested and benchmarked. At the
moment researchers need to either create their own custom environment or augment existing ones to
ift their needs, while the primary focus still lies on the research of terrestrial positioning algorithms.
      </p>
      <p>With ABeL we would like to overcome the aforementioned limitations and create an easy-to-use
framework for rapid prototyping and benchmarking of terrestrial positioning algorithms. Despite
having a low barrier of entry, the flexibility, adaptability and expandability of the framework are still
maintained.</p>
      <p>The remainder of this paper is structured as follows: in section 2 current solutions for simulating
signal propagation are compared, section 3 explains the modularized structure of ABeL and how a
scenario can be defined and customized, section 4 shows the capabilities of ABeL on the example of
a ToA (Time of Arrival) and TDoA (Time Diference of Arrival) positioning algorithm, section 5 will
give an outlook on work-in-progress and planned features and section 6 will summarize the current
progress and capabilities of ABeL.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Related Work</title>
      <p>
        The propagation of a signal can generally be simulated by either using stochastic or deterministic channel
models. While the former is advantageous when temporal change is the main focus, deterministic RT
(Ray Tracing) and RL (Ray Launching) channel models have been shown to be more accurate if the
receiver position is (quasi-)static [
        <xref ref-type="bibr" rid="ref7">7</xref>
        ]. Furthermore, it was proved that 2-dimensional channel models
perform worse than their 3D counterpart with regard to channel capacity, gain and delay spread [
        <xref ref-type="bibr" rid="ref8">8</xref>
        ], [
        <xref ref-type="bibr" rid="ref9">9</xref>
        ].
      </p>
      <p>
        Commercially, there are multiple RT- or RL-based simulators available. MathWorks Matlab can be used
in conjunction with the Communication Toolbox to evaluate the propagation efects based on longitude
and latitude. The Wireless InSite® software from remcom instead follows a more holistic and easy-to-use
approach, allowing the user to carry out exhaustive link- and system-level analyses of antennas as well
as transmitter and receiver setups in a GUI (Graphical User Interface). Besides the aforementioned closed
source solutions, there are also many OSS options available. The simulator WiThRay [
        <xref ref-type="bibr" rid="ref10">10</xref>
        ] implements its
own custom ray tracing algorithm and is more inclined towards link-level simulation. Another solution
is Unity-based simulator presented in [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ]. While its unique approach allows simulating time-based
scenarios, the drawbacks arise from the use of closed-source tools (Unity) and the amount of external
dependencies needed for the simulation. While Opal [
        <xref ref-type="bibr" rid="ref12">12</xref>
        ] is not directly dependent on Unity, Veneris
uses it to create dynamic scenarios. Another double-edged sword is Opal’s use of pure C++ code: a
pure C++ implementation will be faster than comparable Python code, while the ease-of-use is greatly
reduced. With Sionna [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ] a CUDA-based Python simulator is readily available. In comparison to the
aforementioned solutions, Sionna is actively developed, has exhaustive documentation and is highly
customizable. Furthermore, it ofers system- and link-level simulation capabilities, which can be used
in conjunction with the generated signal propagation data.
      </p>
      <p>The aforementioned simulators have in common that the provided tools are limited to simulating and
evaluating signal propagation data. Neither the open- nor closed-source simulators allow 1. to define
and create scenarios as well as 2. to implement and benchmark positioning algorithms in a comparable
environment. With ABeL we target to fill this gap.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Framework Architecture</title>
      <p>For ABeL’s structure, a modularized approach shown in figure 1 with fixed interfaces between modules
was taken. This ensures that future changes can be implemented easily and allows the stages of
the framework to be run independently. Having independent stages is especially important, as data
generation is the main contributor to the total compute time. The framework itself is separated into
three modules, which will be explained in the following chapters.</p>
      <p>• Scenario Definition and Parametrization: Create a scenario with Blender, place transmitters as well
as receivers and define the signal and simulation properties.
• Signal Generation and Data Preprocessing: Simulate the signal propagation for the scenario defined
in the preceding module and prepare the data for saving and later use.</p>
      <p>• Algorithm Implementation and Benchmarking: Use the data generated in the previous module and
supply it via a fixed interface. Also provide standardized performance metrics for positioning
algorithms, guaranteeing inter-comparability.</p>
      <sec id="sec-3-1">
        <title>3.1. Scenario Definition and Parametrization</title>
        <p>
          The definition of the scenario can generally be divided into the parts 1. scene creation and 2. signal
and simulation parametrization. For the former, Blender [
          <xref ref-type="bibr" rid="ref14">14</xref>
          ], a 3D rendering OSS, is used to create
a rendering of the environment in a multistage process. First, OSM (Open Street Map) data is used
in conjunction with Blosm [
          <xref ref-type="bibr" rid="ref15">15</xref>
          ] to create a 3D rendering of the terrain. The objects of the scene, like
buildings or streets, are then given a material identifier, which will be used for signal generation with
Nvidia’s Sionna framework; an aerial view of the scene after the OSM data import and the preprocessing
is shown in figure 2. In the last step, the rendering is exported by Mitsuba-Blender [
          <xref ref-type="bibr" rid="ref16">16</xref>
          ]. The level of
detail of the exported scenario is only limited by the available system resources used for generating the
signal propagation describes in the following simulation step.
        </p>
        <p>
          The second part of the scene definition consists of parametrizing the transmitters, receivers, material
and simulation parameters. For transmitter and receiver, the orientation in space and the antenna
pattern can be defined, while for receivers there is also an option to configure a speed-dependent
trajectory. Furthermore, the electromagnetic properties of the materials need to be set for an accurate
simulation of the signal propagation; see [
          <xref ref-type="bibr" rid="ref17">17</xref>
          ], [
          <xref ref-type="bibr" rid="ref18">18</xref>
          ] for an in-depth description of the propagation
models used. Finally, the simulation parameters containing, among other things, the option to set the
total amount of bounces or signal frequency, also need to be specified.
        </p>
      </sec>
      <sec id="sec-3-2">
        <title>3.2. Signal Generation and Data Preprocessing</title>
        <p>The generation of the signal propagation data can be generally divided into step 1. setting up the
environment, 2. generating signal propagation data and 3. saving and visualizing the data. For the
ifrst step, we need to calculate the trajectories of the receivers, which are defined by anchor points
containing position and orientation in 3D space. With the knowledge of the simulation step size and
the receiver’s velocity, we can determine the position and orientation of all receivers for every time step
through linear interpolation. Following, a Nvidia Sionna scene will be set up with the defined signal
and simulation properties, the environment created in Blender and the defined trajectory.</p>
        <p>
          The generation of the signal propagation data is implemented through Nvidia Sionna [
          <xref ref-type="bibr" rid="ref19">19</xref>
          ], a Python
toolbox for researching communication systems. In comparison to other available solutions, it is
open-source, still actively developed, has mature ray tracing capabilities and also allows a link- and
(a) 3D aerial side view of the campus.
        </p>
        <p>
          (b) Orthographic top down view of the campus.
system-level channel simulation for the defined scenarios. While there are no plans to directly support
the latter in ABeL, users may still use the generated signal propagation data in conjunction with Sionna;
for this we refer to the documentation [
          <xref ref-type="bibr" rid="ref20">20</xref>
          ]. Instead, we use the diferential ray tracer in conjunction with
the scenario defined in the preceding module to get high resolution signal propagation data containing,
among others, the complex amplitude of the signal, the azimuth  and zenith  angle of arrival and
departure and the time of arrival. Sionna itself considers reflection, refraction, (edge) difraction and
scattering in respect to the material and simulation properties [
          <xref ref-type="bibr" rid="ref13">13</xref>
          ]. The latter include, but are not
limited to, the carrier frequency, bandwith and polarisation of the signal as well as customizable receiver
and transmitter antenna arrays.
        </p>
        <p>Following, the data can either be preprocessed and saved for benchmarking or be used directly
for visualization and further processing, e.g., for use with Sionna’s link- and system-level channel
simulation. Currently, a visualization of the CIR (Channel Impulse Response), the AoA (Angle of Arrival)
and AoD (Angle of Departure) as well as the generation of coverage plots are supported; for the CIR and
AOA / ADO plot, see also figure 4.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.3. Algorithm Implementation and Benchmarking</title>
        <p>The comparability between positioning algorithms can be established by using standardized interfaces,
namely a joint data preparation and shared performance evaluation. Therefore, the measured
performance is only dependent on the positioning algorithms. In code this is realized by the two classes
“DataPreperation” and “LocalizationPrecisionMetrics”, where the latter currently supports the automatic
creation of plots showing the absolute error over time and as a boxplot; for examples, see section 4.</p>
        <p>For the implementation of positioning algorithms, we recommend the use of the provided template,
whose call structure is shown in figure 3. This is a further step towards standardization, as the compliance
between the class and interfaces of the algorithm is guaranteed, while an easy implementation of new
algorithms can be ensured. The latter can be traced to the decorator “iterateMethod”, which allows
iterating over a decorated method depending on an instance variable. The result is a dimensionality
reduction, in other words, if we iterate over all simulation steps, we only need to implement an algorithm
for a system of one or multiple transmitters and receivers. One may take this even a step further and
use the decorator in conjunction with the “__algorithm” method to iterate over all receivers, hence
creating a constellation of multiple transmitters and one receiver.</p>
        <p>After creating and populating the positioning algorithm class, the performance metrics can easily be
called by dot-notation, accessing the inherited evaluation metrics from “LocalizationPrecisionMetrics”.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Reference Benchmark Implementation</title>
      <p>
        As we would like to keep the barrier of entry low, we have chosen to show ABeL’s benchmarking
capabilities for a ToA [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ] and TDoA [
        <xref ref-type="bibr" rid="ref22">22</xref>
        ] based positioning algorithm in a 5G environment with a carrier
frequency of 5 GHz and bandwidth of 10 MHz. Both will be used in conjunction with a minimal ToF
(Time of Flight) selector, picking the received signal with the shortest ToF, for a rudimentary mitigation
of multipath efects. Furthermore, a minimal set of four transmitters and two receivers were selected for
the scenario. This decision was made to create a minimal working benchmark in 3D space. The receivers
themselves will follow trajectories with 1. direct LoS and 2. no or only partial LoS to all transmitters
with a speed of 1 m/s, mimicking a human’s normal walking speed [
        <xref ref-type="bibr" rid="ref23">23</xref>
        ]. A visualization of the setup and
configuration is also shown in figure 2. Finally, the main simulation parameters were chosen as follows:
a step size of 1 s, minimizing the total compute time while still ensuring a high positioning fidelity, the
use of electromagnetic reflection and difraction as well as scattering and a maximum amount of 20
bounces, guaranteeing a high resolution even in dense and complex environments.
      </p>
      <p>ABeL supports evaluating 1. the signal propagation itself and 2. the performance of positioning
algorithms. The former is solely dependent on the signals’ propagation through the environment and
thus needs to be carried out only once per data generation. While not directly contributing to the
performance evaluation, the plots collected in 1. allow researchers to make sense of results of the
positioning algorithms and choose an appropriate algorithm depending on the environment. As the
propagation data changes over time, we decided to create an animation made by linking together the CIR
(Channel Impulse Response) as well as AoA (Angle of Arrival) and AoD (Angle of Departure) plots created
for a single simulation time step. Figure 4a visualizes the change of the AoA and AoD by plotting the
relative frequency of azimuth  and zenith  angle. If high spreading occurs or multiple points of high
density are shown, the transmitter-receiver connection must be NLoS and an angle-based positioning
algorithm might be infeasible. With the CIRs shown in figure 4b, we can get an even clearer view of
the situation: “receiver_02” must have moved into a (partial) NLoS environment, as the signal power
is either very low, resulting from a loss of power due to multiple material interactions, or the signal
is arriving delayed, a consequence of the additional distance traveled due to reflection. Furthermore,
there is also an option to generate a coverage map of the scenario.</p>
      <p>After the simulation of the signal propagation and the implementation of the algorithms as shown
i#n« fig∈urRe33,dtehsecreibrrinorg btehtewreeecneiavcetrupaolsaintidonca,lccaunlaeteitdherercbeeiveevrapluoasitteidonvisu#«al=ly #o«racttauablu− lar#«yc.alTcuhlaetefdo,rwmitehr
is shown in figure 5 and gives a statistical overview of the error in two difering ways. In figure 5b
the ℒ2-norm of the error #« is shown as a boxplot with an inter-quantile range lying between the
25 %- and 75 %-quantile and whiskers of size 1.5 times the inter-quantile range. This allows for a quick
assessment of the algorithm used, e.g., the plot shown lets us know that the positioning accuracy is
(a) AoA and AoD plots, showing
azimuth  and zenith  angle.</p>
      <p>
        (b) CIR plot, showing the signal power and delay.
(a) Boxplot showing the ℒ2-norm of (b) Plot showing the change of the absolute errors of the spatial axes.
the errors between actual and
localized receiver positions.
acceptable, while “receiver_01” has a significant outlier. For a more in-depth view, we can consult
ifgure 5b, visualizing the absolute error for each spatial axis and simulation time step. In the case of the
ToA-based positioning algorithm, the z-axis can be determined as the main contributor to the mean error,
indicating an imprecision of the model described in [
        <xref ref-type="bibr" rid="ref21">21</xref>
        ]. Furthermore, the outlier afects all spatial axes,
pointing to a loss of an LoS connection between the receiver and one or multiple of the transmitters; a
possible solution has been described in [
        <xref ref-type="bibr" rid="ref24">24</xref>
        ]. Finally, with a median positioning resolution of ≈ 40 µm ∝
13 fs for “receiver_01” and ≈ 100 µm ∝ 33 fs for “receiver_02”, the error introduced by ABeL is multiple
orders of magnitude below the accuracy of any practical implementation of positioning algorithms [
        <xref ref-type="bibr" rid="ref25">25</xref>
        ],
[
        <xref ref-type="bibr" rid="ref26">26</xref>
        ].
      </p>
      <p>For a direct comparison between multiple positioning algorithms, the metrics shown in table 1 can be
returned by ABeL. The shown column arrangement allows for either a general or per-axis performance
analysis, guaranteeing that both an easy and fast as well as in-depth evaluation can be conducted. As for
the metrics, the RMSE (Root Mean Square Error) measures the standard deviation of the residuals, i.e., the
error #«. The mean in conjunction with the median allows us instead to estimate the scale of the average
error without outliers as well as measure the influence of the outliers themselves. Furthermore, we also
calculate the absolute value of both metrics, as the error is a signed value. While the sign introduces
directionality, it also distorts the mean and median, in the sense that the positioning error is moved
closer to zero, thus causing an additional error; e.g., see the x-axis of “receiver_01” for the ToA algorithm.
Finally, the values shown in table 1 for positioning algorithms shall also serve as a reference for future
works and while we only considered the positioning precision, ABeL can easily be extended by custom
performance metrics, e.g., for measuring the availability or eficiency of a positioning algorithm.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Discussion and Outlook</title>
      <p>While ABeL can already be used for benchmarking positioning algorithms, improvements can still be
carried out in regard to the integration of Blender. Currently, the creation of the environment is done in
Blender, while the transmitter and receiver properties are defined independently by hand. This results
in 1. unnecessary labor and 2. may also lead to transfer errors of the properties from Blender to the
config file, which could introduce positioning or simulation errors.</p>
      <p>
        Another important area needing further improvement, is the dependence on material and
electromagnetic properties for high-frequency systems defined in [
        <xref ref-type="bibr" rid="ref27">27</xref>
        ]. Especially for dense and complex
environments, i.e., when applying indoor positioning, the provided materials may not be suficient to
accurately model the scenario. A possible solution is discussed by the creators of Sionna themselves:
calibrating the material properties in such a way that the simulated signal matches the real signal
closely [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ], [
        <xref ref-type="bibr" rid="ref28">28</xref>
        ]. Closing the topic on Sionna’s implementation into ABeL, we strive to provide further
tools and metrics for evaluating the data generated by our framework.
      </p>
      <p>
        In addition, modeling indoor environments is 1. time-consuming and 2. imprecise when done manually,
causing a distortion between the simulated and actual signal propagation. We want to remedy this error
by creating a Blender interface, which allows us to import point clouds captured by LiDAR sensors, e.g.,
generated by automatic mapping algorithms like [
        <xref ref-type="bibr" rid="ref29">29</xref>
        ]. Thus, we will be able to recreate the environment
by a point cloud to mesh conversion, allowing an easy and accurate representation of the real-world
environment [
        <xref ref-type="bibr" rid="ref30">30</xref>
        ]. Based on this approach and the aforementioned material calibration, we want to
validate ABeL with actual terrestrial data.
      </p>
    </sec>
    <sec id="sec-6">
      <title>6. Conclusion</title>
      <p>In this paper we have introduced ABeL, a novel benchmarking framework for 3D terrestrial positioning
algorithms. We discussed the framework’s structure as well as modules in necessary detail such that the
readers can efectively use ABeL and its features as well as being able to create their own scenarios and
evaluation metrics. Furthermore, we have explained the latter by example of a ToA- and TDoA-based
positioning algorithm, showcasing how ABeL can help researchers in developing positioning algorithms
and create a baseline for future works.</p>
      <p>With ABeL, we hope to support the ongoing research for accurate indoor positioning. Furthermore,
we hope that the provided framework will guarantee reproductivity and comparability for the evaluation
of (indoor) positioning algorithms.</p>
    </sec>
    <sec id="sec-7">
      <title>Acknowledgments</title>
      <p>This work was funded by the German Federal Ministry of the Interior represented by the Federal Agency
for Public Safety Digital Radio (BDBOS) in the KoPa_45 program.</p>
      <p>We want to thank Janis Bernauer for supporting the technical realization of this paper as part of his
work as student assistant.</p>
    </sec>
    <sec id="sec-8">
      <title>Declaration on Generative AI</title>
      <p>The authors have not employed any Generative AI tools.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>D.</given-names>
            <surname>Weng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Z.</given-names>
            <surname>Hou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Meng</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Cai</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Chan</surname>
          </string-name>
          ,
          <article-title>Characterization and mitigation of urban GNSS multipath efects on smartphones</article-title>
          ,
          <source>Measurement</source>
          <volume>223</volume>
          (
          <year>2023</year>
          )
          <article-title>113766</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.measurement.
          <year>2023</year>
          .
          <volume>113766</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [2]
          <string-name>
            <given-names>L.</given-names>
            <surname>Xie</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Y.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Zhao</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Zhang</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Yang</surname>
          </string-name>
          ,
          <article-title>Positioning Under Multipath Environments in Wireless Network: Survey, Design, and Opportunities</article-title>
          ,
          <source>IEEE Network 38</source>
          (
          <year>2024</year>
          )
          <fpage>476</fpage>
          -
          <lpage>484</lpage>
          . doi:
          <volume>10</volume>
          .1109/MNET.
          <year>2024</year>
          .
          <volume>3435087</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [3]
          <string-name>
            <given-names>J.</given-names>
            <surname>Medbo</surname>
          </string-name>
          ,
          <string-name>
            <surname>I. Siomina</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Kangas</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Furuskog</surname>
          </string-name>
          ,
          <article-title>Propagation channel impact on LTE positioning accuracy: A study based on real measurements of observed time diference of arrival</article-title>
          ,
          <source>in: 2009 IEEE 20th International Symposium on Personal, Indoor and Mobile Radio Communications</source>
          ,
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          , Toyko, Japan,
          <year>2009</year>
          , pp.
          <fpage>2213</fpage>
          -
          <lpage>2217</lpage>
          . doi:
          <volume>10</volume>
          .1109/PIMRC.
          <year>2009</year>
          .
          <volume>5450144</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [4]
          <string-name>
            <surname>I. Sharp</surname>
          </string-name>
          ,
          <string-name>
            <given-names>Kegen</given-names>
            <surname>Yu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Sathyan</surname>
          </string-name>
          ,
          <article-title>Positional Accuracy Measurement and Error Modeling for Mobile Tracking</article-title>
          ,
          <source>IEEE Transactions on Mobile Computing</source>
          <volume>11</volume>
          (
          <year>2012</year>
          )
          <fpage>1021</fpage>
          -
          <lpage>1032</lpage>
          . doi:
          <volume>10</volume>
          .1109/TMC.
          <year>2011</year>
          .
          <volume>119</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [5]
          <string-name>
            <given-names>I.</given-names>
            <surname>Lapin</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Seco-Granados</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Samson</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. A.</given-names>
            <surname>Garcia-Molina</surname>
          </string-name>
          ,
          <source>Base Station Clock Ofset of Cellular Measurements and Its Impact on Positioning, IEEE Transactions on Vehicular Technology</source>
          <volume>73</volume>
          (
          <year>2024</year>
          )
          <fpage>15553</fpage>
          -
          <lpage>15566</lpage>
          . doi:
          <volume>10</volume>
          .1109/TVT.
          <year>2024</year>
          .
          <volume>3409088</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [6]
          <string-name>
            <given-names>H.</given-names>
            <surname>Liu</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Darabi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Banerjee</surname>
          </string-name>
          , J. Liu,
          <source>Survey of Wireless Indoor Positioning Techniques and Systems, IEEE Transactions on Systems, Man and Cybernetics</source>
          , Part C (
          <article-title>Applications</article-title>
          and Reviews)
          <volume>37</volume>
          (
          <year>2007</year>
          )
          <fpage>1067</fpage>
          -
          <lpage>1080</lpage>
          . doi:
          <volume>10</volume>
          .1109/TSMCC.
          <year>2007</year>
          .
          <volume>905750</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          <article-title>[7] Stochastic versus Ray Tracing Wireless Channel Modeling for 5G and V2X Applications: Opportunities and Challenges</article-title>
          , IntechOpen,
          <year>2022</year>
          . doi:
          <volume>10</volume>
          .5772/intechopen.101625.
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          [8]
          <string-name>
            <given-names>N.-r.</given-names>
            <surname>Jeon</surname>
          </string-name>
          , C.
          <article-title>-h.</article-title>
          <string-name>
            <surname>Lee</surname>
          </string-name>
          , N.-g. Kang, S.-c. Kim,
          <article-title>Performance of Channel Prediction Using 3D Raytracing Scheme Compared to Conventional 2D Scheme</article-title>
          , in: 2006 Asia-Pacific Conference on Communications, IEEE, Busan,
          <year>2006</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          . doi:
          <volume>10</volume>
          .1109/apcc.
          <year>2006</year>
          .
          <volume>255882</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          [9]
          <string-name>
            <given-names>R.</given-names>
            <surname>Almesaeed</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. S.</given-names>
            <surname>Ameen</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Doufexi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Dahnoun</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A. R.</given-names>
            <surname>Nix</surname>
          </string-name>
          ,
          <article-title>A comparison study of 2D and 3D ITU channel model</article-title>
          , in: 2013
          <string-name>
            <given-names>IFIP</given-names>
            <surname>Wireless</surname>
          </string-name>
          <article-title>Days (WD), IEEE</article-title>
          , Valencia, Spain,
          <year>2013</year>
          . doi:
          <volume>10</volume>
          .1109/wd.
          <year>2013</year>
          .
          <volume>6686494</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          [10]
          <string-name>
            <given-names>H.</given-names>
            <surname>Choi</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Oh</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Chung</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. C.</given-names>
            <surname>Alexandropoulos</surname>
          </string-name>
          , J. Choi,
          <article-title>WiThRay: A Versatile Ray-Tracing Simulator for Smart Wireless Environments</article-title>
          , IEEE Access
          <volume>11</volume>
          (
          <year>2023</year>
          )
          <fpage>56822</fpage>
          -
          <lpage>56845</lpage>
          . doi:
          <volume>10</volume>
          .1109/ access.
          <year>2023</year>
          .
          <volume>3283610</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          [11]
          <string-name>
            <given-names>W.</given-names>
            <surname>Tärneberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Fedorov</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Callebaut</surname>
          </string-name>
          ,
          <string-name>
            <given-names>L. V.</given-names>
            <surname>der Perre</surname>
          </string-name>
          , E. Fitzgerald,
          <article-title>Towards Practical Cell-Free 6G Network Deployments: An Open-Source End-to-</article-title>
          <string-name>
            <surname>End Ray Tracing Simulator</surname>
          </string-name>
          ,
          <year>2023</year>
          . doi:
          <volume>10</volume>
          . 48550/arXiv.2401.08624. arXiv:
          <volume>2401</volume>
          .
          <fpage>08624</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          [12]
          <string-name>
            <given-names>E.</given-names>
            <surname>Egea-Lopez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J. M.</given-names>
            <surname>Molina-Garcia-Pardo</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Lienard</surname>
          </string-name>
          ,
          <string-name>
            <given-names>P.</given-names>
            <surname>Degauque</surname>
          </string-name>
          ,
          <string-name>
            <surname>Opal:</surname>
          </string-name>
          <article-title>An open source raytracing propagation simulator for electromagnetic characterization</article-title>
          ,
          <source>PLOS ONE 16</source>
          (
          <year>2021</year>
          )
          <article-title>e0260060</article-title>
          . doi:
          <volume>10</volume>
          .1371/journal.pone.
          <volume>0260060</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          [13]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hoydis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. A.</given-names>
            <surname>Aoudia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cammerer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nimier-David</surname>
          </string-name>
          ,
          <string-name>
            <given-names>N.</given-names>
            <surname>Binder</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Marcus</surname>
          </string-name>
          , A. Keller,
          <string-name>
            <surname>Sionna</surname>
            <given-names>RT</given-names>
          </string-name>
          :
          <article-title>Diferentiable Ray Tracing for Radio Propagation Modeling, in: 2023 IEEE Globecom Workshops (GC Wkshps)</article-title>
          , IEEE,
          <string-name>
            <surname>Kuala</surname>
            <given-names>Lumpur</given-names>
          </string-name>
          , Malaysia,
          <year>2023</year>
          , pp.
          <fpage>317</fpage>
          -
          <lpage>321</lpage>
          . doi:
          <volume>10</volume>
          .1109/GCWkshps58843.
          <year>2023</year>
          .
          <volume>10465179</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref14">
        <mixed-citation>
          [14]
          <string-name>
            <surname>Blender</surname>
            ,
            <given-names>Blender</given-names>
          </string-name>
          <string-name>
            <surname>Foundation</surname>
          </string-name>
          ,
          <year>2025</year>
          . URL: https://www.blender.org/.
        </mixed-citation>
      </ref>
      <ref id="ref15">
        <mixed-citation>
          [15]
          <string-name>
            <surname>Blosm</surname>
          </string-name>
          , prochitecture,
          <year>2025</year>
          . URL: https://github.com/vvoovv/blosm.
        </mixed-citation>
      </ref>
      <ref id="ref16">
        <mixed-citation>
          [16]
          <string-name>
            <surname>Mitsuba-Blender</surname>
          </string-name>
          , Realistic Graphics Lab,
          <year>2025</year>
          . URL: https://github.com/mitsuba-renderer/ mitsuba-blender.
        </mixed-citation>
      </ref>
      <ref id="ref17">
        <mixed-citation>
          [17]
          <string-name>
            <given-names>V.</given-names>
            <surname>Degli-Esposti</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Fuschini</surname>
          </string-name>
          ,
          <string-name>
            <given-names>E. M.</given-names>
            <surname>Vitucci</surname>
          </string-name>
          , G. Falciasecca,
          <article-title>Measurement and Modelling of Scattering From Buildings</article-title>
          ,
          <source>IEEE Transactions on Antennas and Propagation</source>
          <volume>55</volume>
          (
          <year>2007</year>
          )
          <fpage>143</fpage>
          -
          <lpage>153</lpage>
          . doi:
          <volume>10</volume>
          .1109/ TAP.
          <year>2006</year>
          .
          <volume>888422</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref18">
        <mixed-citation>
          [18]
          <string-name>
            <given-names>V.</given-names>
            <surname>Degli-Esposti</surname>
          </string-name>
          , V.
          <string-name>
            <surname>-M. Kolmonen</surname>
            ,
            <given-names>E. M.</given-names>
          </string-name>
          <string-name>
            <surname>Vitucci</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          <string-name>
            <surname>Vainikainen</surname>
          </string-name>
          ,
          <article-title>Analysis and Modeling on co-</article-title>
          and
          <string-name>
            <surname>Cross-Polarized Urban</surname>
          </string-name>
          <article-title>Radio Propagation for Dual-Polarized MIMO Wireless Systems</article-title>
          ,
          <source>IEEE Transactions on Antennas and Propagation</source>
          <volume>59</volume>
          (
          <year>2011</year>
          )
          <fpage>4247</fpage>
          -
          <lpage>4256</lpage>
          . doi:
          <volume>10</volume>
          .1109/TAP.
          <year>2011</year>
          .
          <volume>2164226</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref19">
        <mixed-citation>
          [19]
          <string-name>
            <surname>Nvidia</surname>
            <given-names>Sionna</given-names>
          </string-name>
          , Nvidia Corporation,
          <year>2025</year>
          . URL: https://github.com/NVlabs/sionna.
        </mixed-citation>
      </ref>
      <ref id="ref20">
        <mixed-citation>
          <source>[20] Sionna - Sionna 1.1.0 documentation</source>
          ,
          <year>2025</year>
          . URL: https://nvlabs.github.io/sionna/.
        </mixed-citation>
      </ref>
      <ref id="ref21">
        <mixed-citation>
          [21]
          <string-name>
            <given-names>W.</given-names>
            <surname>Xiong</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Bordoy</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Gabbrielli</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Fischer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D. J.</given-names>
            <surname>Schott</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Hoflinger</surname>
          </string-name>
          ,
          <string-name>
            <given-names>J.</given-names>
            <surname>Wendeberg</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            <surname>Schindelhauer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. J.</given-names>
            <surname>Rupitsch</surname>
          </string-name>
          , Two Eficient and
          <article-title>Easy-to-Use NLOS Mitigation Solutions to Indoor 3-D AOABased Localization</article-title>
          , in: 2021
          <source>International Conference on Indoor Positioning and Indoor Navigation (IPIN)</source>
          , IEEE, Lloret de Mar, Spain,
          <year>2021</year>
          , pp.
          <fpage>1</fpage>
          -
          <lpage>8</lpage>
          . doi:
          <volume>10</volume>
          .1109/IPIN51156.
          <year>2021</year>
          .
          <volume>9662529</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref22">
        <mixed-citation>
          [22]
          <string-name>
            <given-names>N. K.</given-names>
            <surname>Inamdar</surname>
          </string-name>
          ,
          <source>Time Diference of Arrival Source Localization: Exact Linear Solutions for the General 3D Problem</source>
          ,
          <year>2025</year>
          . doi:
          <volume>10</volume>
          .48550/arXiv.2501.01076. arXiv:
          <volume>2501</volume>
          .
          <fpage>01076</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref23">
        <mixed-citation>
          [23]
          <string-name>
            <given-names>R. W.</given-names>
            <surname>Bohannon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>A.</given-names>
            <surname>Williams</surname>
          </string-name>
          <string-name>
            <surname>Andrews</surname>
          </string-name>
          ,
          <article-title>Normal walking speed: A descriptive meta-analysis</article-title>
          ,
          <source>Physiotherapy</source>
          <volume>97</volume>
          (
          <year>2011</year>
          )
          <fpage>182</fpage>
          -
          <lpage>189</lpage>
          . doi:
          <volume>10</volume>
          .1016/j.physio.
          <year>2010</year>
          .
          <volume>12</volume>
          .004.
        </mixed-citation>
      </ref>
      <ref id="ref24">
        <mixed-citation>
          [24]
          <string-name>
            <given-names>E.</given-names>
            <surname>Navon</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Bobrovsky</surname>
          </string-name>
          ,
          <article-title>An eficient outlier rejection technique for Kalman filters</article-title>
          ,
          <source>Signal Processing 188</source>
          (
          <year>2021</year>
          )
          <article-title>108164</article-title>
          . doi:
          <volume>10</volume>
          .1016/j.sigpro.
          <year>2021</year>
          .
          <volume>108164</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref25">
        <mixed-citation>
          [25]
          <string-name>
            <given-names>Z.</given-names>
            <surname>Abu-Shaban</surname>
          </string-name>
          ,
          <string-name>
            <given-names>X.</given-names>
            <surname>Zhou</surname>
          </string-name>
          ,
          <string-name>
            <given-names>T.</given-names>
            <surname>Abhayapala</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G.</given-names>
            <surname>Seco-Granados</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Wymeersch</surname>
          </string-name>
          ,
          <article-title>Error Bounds for Uplink and Downlink 3D Localization in 5G Millimeter Wave Systems</article-title>
          ,
          <source>IEEE Transactions on Wireless Communications</source>
          <volume>17</volume>
          (
          <year>2018</year>
          )
          <fpage>4939</fpage>
          -
          <lpage>4954</lpage>
          . doi:
          <volume>10</volume>
          .1109/TWC.
          <year>2018</year>
          .
          <volume>2832134</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref26">
        <mixed-citation>
          [26]
          <string-name>
            <given-names>A.</given-names>
            <surname>Shahmansoori</surname>
          </string-name>
          ,
          <string-name>
            <given-names>G. E.</given-names>
            <surname>Garcia</surname>
          </string-name>
          , G. Destino,
          <string-name>
            <given-names>G.</given-names>
            <surname>Seco-Granados</surname>
          </string-name>
          ,
          <string-name>
            <given-names>H.</given-names>
            <surname>Wymeersch</surname>
          </string-name>
          , Position and
          <string-name>
            <given-names>Orientation</given-names>
            <surname>Estimation Through Millimeter-Wave</surname>
          </string-name>
          <string-name>
            <surname>MIMO</surname>
          </string-name>
          <source>in 5G Systems, IEEE Transactions on Wireless Communications</source>
          <volume>17</volume>
          (
          <year>2018</year>
          )
          <fpage>1822</fpage>
          -
          <lpage>1835</lpage>
          . doi:
          <volume>10</volume>
          .1109/TWC.
          <year>2017</year>
          .
          <volume>2785788</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref27">
        <mixed-citation>
          [27]
          <string-name>
            <surname>Recommendation</surname>
            <given-names>ITU-R P.</given-names>
          </string-name>
          <year>2040</year>
          -
          <volume>3</volume>
          (
          <issue>08</issue>
          /
          <year>2023</year>
          )
          <article-title>- Efects of building materials and structures on radiowave propagation above about 100 MHz (</article-title>
          <year>2023</year>
          ).
        </mixed-citation>
      </ref>
      <ref id="ref28">
        <mixed-citation>
          [28]
          <string-name>
            <given-names>J.</given-names>
            <surname>Hoydis</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F. A.</given-names>
            <surname>Aoudia</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Cammerer</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            <surname>Euchner</surname>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            <surname>Nimier-David</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S. T.</given-names>
            <surname>Brink</surname>
          </string-name>
          , A. Keller, Learning Radio Environments by Diferentiable Ray Tracing,
          <source>IEEE Transactions on Machine Learning in Communications and Networking</source>
          <volume>2</volume>
          (
          <year>2024</year>
          )
          <fpage>1527</fpage>
          -
          <lpage>1539</lpage>
          . doi:
          <volume>10</volume>
          .1109/TMLCN.
          <year>2024</year>
          .
          <volume>3474639</volume>
          .
        </mixed-citation>
      </ref>
      <ref id="ref29">
        <mixed-citation>
          [29]
          <string-name>
            <given-names>T.</given-names>
            <surname>Guadagnino</surname>
          </string-name>
          ,
          <string-name>
            <given-names>B.</given-names>
            <surname>Mersch</surname>
          </string-name>
          ,
          <string-name>
            <given-names>S.</given-names>
            <surname>Gupta</surname>
          </string-name>
          , I. Vizzo, G. Grisetti,
          <string-name>
            <surname>C.</surname>
          </string-name>
          <article-title>Stachniss, KISS-SLAM: A Simple, Robust, and Accurate 3D LiDAR SLAM System With Enhanced Generalization Capabilities</article-title>
          ,
          <year>2025</year>
          . doi:
          <volume>10</volume>
          .48550/arXiv.2503.12660. arXiv:
          <volume>2503</volume>
          .
          <fpage>12660</fpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref30">
        <mixed-citation>
          [30]
          <string-name>
            <surname>H.-W. Lin</surname>
            ,
            <given-names>C.-L.</given-names>
          </string-name>
          <string-name>
            <surname>Tai</surname>
            ,
            <given-names>G.-J.</given-names>
          </string-name>
          <string-name>
            <surname>Wang</surname>
          </string-name>
          ,
          <article-title>A mesh reconstruction algorithm driven by an intrinsic property of a point cloud</article-title>
          ,
          <source>Computer-Aided Design</source>
          <volume>36</volume>
          (
          <year>2004</year>
          )
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          . doi:
          <volume>10</volume>
          .1016/S0010-
          <volume>4485</volume>
          (
          <issue>03</issue>
          )
          <fpage>00064</fpage>
          -
          <lpage>2</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>