<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Coordinate alignment of the Lidar mapping system for tightly coupled distance measurements based on graph optimization ⋆</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Pengcheng Zheng</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Zhitian Li</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Wenhao Lei</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Xudong Zou</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
          <xref ref-type="aff" rid="aff1">1</xref>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Qilu Aerospace Information Research Institute, Chinese Academy of Sciences</institution>
          ,
          <addr-line>Jinan, Shandong 250000</addr-line>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences</institution>
          ,
          <addr-line>Beijing 100049</addr-line>
          ,
          <country country="CN">China</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences</institution>
          ,
          <addr-line>Beijing 100190</addr-line>
        </aff>
      </contrib-group>
      <pub-date>
        <year>2024</year>
      </pub-date>
      <volume>2</volume>
      <fpage>14</fpage>
      <lpage>17</lpage>
      <abstract>
        <p>In this paper, a tightly coupled UWB and LIDAR localization and map building framework is designed. This framework adopts the initialization of IMU and UWB fusion, so that the local coordinates are aligned with the global coordinates. This framework achieves consistent localization and mapping with higher accuracy and modeling of larger scenes. Accurate localization of robots in both indoor and outdoor environments is crucial for their automation and intelligence. In many scenarios, GNSS signals can be obstructed, making localization and mapping technologies in GNSS-denied environments significantly valuable. Simultaneous Localization and Mapping (SLAM) is one of the key technologies for addressing localization in environments where GNSS signals are limited, yet it has constraints in global observability. Particularly, when initiated at different positions, SLAM can result in inconsistencies in localization. Furthermore, Ultra-Wideband (UWB) technology, especially systems based on UWB stations, provides consistent observational coordinates and is a vital radio technology for localization[1]. Against this backdrop, this paper proposes a tightly coupled localization and mapping system integrating UWB and LIDAR technologies, leveraging their strengths to achieve more accurate and reliable localization[2][3]. Under conditions of sufficient computational power, the LIDAR SLAM system demonstrates high stability. Compared to camera-based SLAM systems, LIDAR systems are unaffected by lighting conditions and can extract more robust three-dimensional geometric features. LIDAR SLAM systems typically utilize Iterative Closest Point (ICP) or Normal Distribution Transform (NDT) algorithms to solve for position and orientation. To accelerate the solution speed and enhance the system's robustness to LIDAR point cloud noise, geometric features are commonly extracted based on planes and edges. Moreover, LIDAR SLAM systems typically employ graph optimization or Extended Kalman Filter (EKF) for pose estimation. Under conditions of sufficient computational power, graph optimization can utilize more comprehensive measurement data at various moments, thereby theoretically providing more reliable pose estimates. Accordingly, this paper adopts the graph optimization approach for pose estimation.</p>
      </abstract>
      <kwd-group>
        <kwd>eol&gt;UWB</kwd>
        <kwd>LIDAR</kwd>
        <kwd>Tightly Coupled</kwd>
        <kwd>Localization 1</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>
        UWB or other global observational data can effectively overcome the global unobservability
issues inherent in SLAM systems[
        <xref ref-type="bibr" rid="ref2">4</xref>
        ]. TOA-based UWB ranging and localization systems have been
extensively researched and applied, and the integration of UWB with other measurement data is
widely applicable[
        <xref ref-type="bibr" rid="ref3">5</xref>
        ][
        <xref ref-type="bibr" rid="ref4">6</xref>
        ]. Specifically, nonlinear optimization of UWB fused with Inertial
Measurement Units (IMUs) can utilize IMU measurements to circumvent UWB's Non-Line-of-Sight
(NLOS) errors. Therefore, this paper adopts a fusion approach of UWB with IMU to avoid the NLOS
issues associated with UWB. Additionally, the tight coupling of LIDAR with UWB can compensate
for NLOS issues at the level of feature measurement, thus enabling globally consistent localization
and mapping.
      </p>
      <p>The main work of this paper is the development of a tightly coupled localization system
integrating UWB ranging data and LIDAR point clouds. The key contributions are as follows:
• First, a coordinate alignment method based on the fusion of LO (Laser Inertial Navigation) and</p>
      <p>UIO (Ultrawideband Inertial Navigation) measurements is proposed.
• Second, an external parameter alignment combining DOP (Dilution of Precision) and LIDAR
features is utilized to maximize the effectiveness of range space measurements.
• Finally, a tightly coupled strategy using multiple UWB tags with LIDAR point clouds leverages
spatiotemporal information for global optimization and explores the effectiveness of
deploying multiple UWB tags.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Methods</title>
      <p>UWB
IMU</p>
      <sec id="sec-2-1">
        <title>UWB Optimization</title>
      </sec>
      <sec id="sec-2-2">
        <title>IMU Integration</title>
      </sec>
      <sec id="sec-2-3">
        <title>NLOS</title>
      </sec>
      <sec id="sec-2-4">
        <title>Process</title>
      </sec>
      <sec id="sec-2-5">
        <title>Coordinate</title>
      </sec>
      <sec id="sec-2-6">
        <title>Alignment</title>
      </sec>
      <sec id="sec-2-7">
        <title>Initialization</title>
        <p>This paper presents a tightly coupled localization and mapping framework integrating UWB
ranging information with LIDAR point cloud data, as shown in Fig.1. The system employs a soft
synchronization method for temporal filtering of UWB and LIDAR data. The proposed system mainly
consists of an initialization positioning module combining UWB and IMU, a synchronous front-end
processing for UWB and LIDAR, and a fusion positioning and mapping backend that integrates
Range with Submap. Additionally, the system has been extended to incorporate a scan-to-map
mapping approach.</p>
        <p>At time t, a specific point in the point cloud frame collected by the LIDAR SLAM system is
represented in the LIDAR coordinate system{L} , with the origin at the start point of the LIDAR
SLAM. The UWB measurements are conducted in a point-to-point manner between fixed UWB
stations and a mobile UWB tag, requiring at least three pairs of UWB measurements for positional
solution. Let's denote the position of UWB tag j in the coordinate system {U} formed by UWB</p>
        <p>U U p
stations as ri, j , and the relative position of UWB tag j in the same coordinate system as j . The
UWB ranging between these points can be calculated. The transformation relationship between {L}
and {U} is represented by the rotation matrix ULR , and the translation vector ULt , known as the
external parameters, describing the transformation from coordinate system {L} to {U} . The
problem studied in this paper can be represented by equation eq (1).</p>
        <p>  
Z1:t  =)RX,UL(UL)t P  (UL U ri, j i=1:3, j=1:4 PUt /L </p>
        <p>   
=(UL)t P  (UL )R, U ri, j i=1:3, j=1:4  • P  (UL )R, (UL)t PUt /L 
 XUL   XUL 
(1)</p>
        <sec id="sec-2-7-1">
          <title>2.1. Initialization</title>
          <p>The initialization of coordinate alignment is conducted through UIO (UWB+IMU combination),
solving for the initial position of the robot's body coordinate system within the UWB Anchor
coordinate system. The purpose is to unify the spatial representation of LIDAR measurement data
with UWB measurement data. The factor graph involved in this initialization process is illustrated
in the Fig. 2.</p>
          <p>IMU</p>
          <p>The initialization process and the localization and mapping system are loosely coupled. The
initialization procedure primarily involves using the Time of Arrival (TOA) from UWB
measurements at multiple moments for initialization, along with the use of IMU pre-integration to
obtain the measurement model. The handling of NLOS errors primarily involves statistical
consistency checks. The initial pose transformations provided by the IMU between two UWB
measurements are trustworthy over short periods, and so are the results of their integrations, as
shown in Fig.3.</p>
          <p>eR =Log(∆Ri−+11，i RUiI RUjI )
ev</p>
          <p>=RiIU ( vUi+I1 − vUiI − g∆ti+1,i ) − ∆vij
e p</p>
          <p>1 
=RiIU  pUi+I1 − pUiI − vUiI ∆ti+1,i − 2 gΔti2+1,i  − ∆pi+1,i
UWB Anchors</p>
          <p>Anchors00</p>
          <p>Anchors01</p>
          <p>Anchors02</p>
          <p>Anchors03</p>
          <p>UWB
Measurement</p>
          <p>IMU
Integration</p>
          <p>Tag00
Tag01
Tag02
UWB
Tags</p>
          <p>UWB
Tags</p>
          <p>Therefore, erroneous UWB data are filtered out based on consistency checks, and these incorrect
data are not used in the initialization or subsequent front-end and back-end processes.
dik, j − PUiA − (tUkI + RUkI * ∆tUkI+1,k + RUkI ∆RUkI+1,k * PBjT ) &lt; 3σ
(3)</p>
          <p>The constraints used for initialization mainly include: the IMU pre-integration factor and the
UWB ranging constraints, and the optimization function is as follows:</p>
          <p>Ek+1,k =</p>
          <p>∑
i:=1:4, j=1:3</p>
          <p>UWBeki, j +</p>
          <p>∑
i:=1:4, j=1:3</p>
          <p>UWBeki,+j1 + IMU ek+1,k</p>
        </sec>
        <sec id="sec-2-7-2">
          <title>2.2. The Front-end</title>
          <p>
            Based on the results of the coordinate alignment obtained from the initialization, the front-end
carries out the measurement fusion of the UWB data with the LIDAR point cloud, and the LIDAR
point cloud information is feature-associated by the two frames of the point cloud at two adjacent
moments. The handsome selection and association of edge features and planar features are
(2)
(4)
 eplane =(RUkL pliidar,k + tUkL − RUkL+1 plijdar,k+1 − tUkL+1)
 •nplane • nplane
 i lidar,k+1 − tUkL+1)
eedge =(RUkLelidar,k + tUkL − RUkL+1e j

•nplane • nplane − (RUkLeliidar,k + tUkL − RUkL+1e j
lidar,k+1 − tUkL+1)
performed according to the LOAM[
            <xref ref-type="bibr" rid="ref5">7</xref>
            ] selection method, as shown in Fig. 4. The LIDAR measurement
factors are as follows:
(6)
(7)
          </p>
        </sec>
        <sec id="sec-2-7-3">
          <title>2.3. The Back-end</title>
          <p>The initial values of the odometry processed by the front-end process are used by the back -end
process to optimize the final results of the odometry and the coherent map building, as shown in Fig.
4. In addition, the measurement information involved in consistent localization and mapping still
includes the corresponding UWB measurement information. Therefore, the factors involved in the
back-end optimization mainly include the single-frame LiDAR point cloud and the LiDAR factor for
matching the map point cloud, as well as the UWB ranging factor:</p>
          <p>UWB Tag0
UWB Tag1
UWB Tag2
UWB Tag0
UWB Tag1
UWB Tag2</p>
          <p>LUpIDWoAsBiRtiTopanogse PErxaitonrirdnFsLaiIccDtUoAWrRB MMeeaasULsuIWuDrerABemRmeenntt
Plane Feature</p>
          <p>Edge Feature
UWB+IMU Prior
initial pose</p>
          <p>LUpIDWoAsBiRtiTopanogse PErxaitonrirdnFsLaiIccDtUoAWrRB MMeeaasULsuIWuDrerABemRmeenntt
Plane Feature</p>
          <p>Edge Feature</p>
          <p>LIDAR Tk+1</p>
          <p>LIDAR Tk
UWB+IMU Prior
initial pose
Frontinitial pose
 epilane =(RUkL pliidar,k + tUkL − pUj ) • nplane • ni plane
eedge =(RUkLelidar,k + tUkL − eUj ) • nplane • nplane − (RUkLelidar,k + tUkL − eUj )</p>
          <p>When an a priori factor for the initial value of the front -end odometry is added, the back-end
optimized function is as follows:
i:=1:4, j=1:3</p>
          <p>UWBeki, j + ∑ eplane + ∑ eedge
(8)</p>
        </sec>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3. Experiments</title>
      <p>The experimental validation part of this paper mainly includes numerical analysis and validation
for the validity of UWB ranging information, simulation and comparison validation of datasets, and
real-time localization and map building test for real scenarios.</p>
      <sec id="sec-3-1">
        <title>3.1. Numerical analysis validation</title>
      </sec>
      <sec id="sec-3-2">
        <title>3.1.1. UWB Anchor DOP analysis</title>
        <p>UWBs, as typical gauges for spatial ranging, need to be analyzed for their spatial measurement
validity and sources of error. Based on DOP (Dilution of precision), we analyze the sources of
uncertainty in UWB 3D localization, aiming at describing the shortcomings of UWBs as localization
information, and thus elucidating the implications of fusion.</p>
        <p>(a) DOP of Anchor Scene
(c) DOP of Anchor Scene
(b) DOP of Anchor Scene</p>
        <p>The ranging site for the UWB here is a square row with a length of 40 
at a horizontal height of
as shown in Fig.6. In Fig.7, the distribution of DOPs based on such settings is shown in Fig.7(a).
The error in ranging in this analysis is, and the numerical results show that the main error comes
from the horizontal error approximating the height of the UWB. In Fig7(b)(c), the results show that
the main source of error comes from the horizontal dissipation of localization information.</p>
      </sec>
      <sec id="sec-3-3">
        <title>3.1.2. UWB Tag number FIM analysis</title>
        <p>This part mainly verifies the effect of the number of UWB tags on the positioning accuracy.
Without loss of generality, the simulation trajectory adopts the uniform circular motion and the base
station arrangement as above. In Fig.8, the number of UWB tags are 2, 3 and 4, the spacing of tags is
1 meter, and the relative measurement accuracy of the odometers used to connect the two moments
is 0.1m and 1°.With this arrangement, the improvement in positioning accuracy when the number of
tags exceeds three has little effect, and this subsequent test provides a basis for this. The trajectory
of the simulation and the Anchor arrangement are shown in Fig.8(a). The numerically analyzed
positioning accuracy is shown in Fig.8(b)(c). In this section, the positioning error is divided into
vertical and horizontal display in view of the gap between the horizontal and vertical positioning
errors.</p>
        <p>(a) Anchor and Robot Trajectory</p>
      </sec>
      <sec id="sec-3-4">
        <title>3.1.3. UWB Tag distance FIM analysis</title>
        <p>The distance of UWB tags is also a factor to be explored, the number of UWB tags is 3 the number
of base stations is 4 and the base station rows are the same as described above when the distances of
UWB tags are 0.5m, 1m, and 2m respectively. the experimental trajectories and the errors of
localization are shown in Fig.9.</p>
        <p>The results show that the enhancement for localization is no longer significant at distances
greater than one meter for UWB tags.</p>
      </sec>
      <sec id="sec-3-5">
        <title>3.2. KITTI Dataset Simulation</title>
        <p>
          The KITTI dataset contains a VELODYNE 64 LIDAR, and we added pseudo-ranging labels to the
dataset with the locations (0,0,0),(0,200,0),(20,0,0),(200,200,0). The output frequency of the
pseudoranging is the same as that of the lidar. We tested this on KITTI Odometry 02/05/07 and the
comparison was FLOAM[
          <xref ref-type="bibr" rid="ref6">8</xref>
          ] (only LIDAR). The experimental trajectories and the errors of
localization are shown in Fig.10.
        </p>
        <p>Error
Figure 9: FIM Analysis of Tag Distance
(a)Horizontal
(b)Vertical Error
(a) KITTI_02 comparison</p>
        <p>(b) KITTI_05 comparison
(c) KITTI_07 comparison
Figure 10: KITTI position estimation comparison</p>
        <p>We show the results of global mapping based on KITTI 02/05, as shown in Fig11. The comparison
of the positioning error is ATE (absolute trajectory error) and the comparison of the error is shown
in the Tabel I.</p>
        <p>(a)KITTI_05 Point cloud Map
(b)KITTI_02 Point cloud Map</p>
      </sec>
      <sec id="sec-3-6">
        <title>3.3. Real Scenario Test</title>
        <p>Our device is shown in Fig. 12. We conducted two tests of real-time localization and map building
in a real scenario with the test environment shown in Fig.13,14. Positioning and seeing effects are
shown in the figure. Our method of comparison remains FLOAM. One of the first tests using only
LiDAR showed a significant localization failure, which proved the effectiveness of our system.</p>
      </sec>
    </sec>
    <sec id="sec-4">
      <title>4. Conclusion</title>
      <p>This framework achieves a high level of orientation and map building effectiveness. The next step
of the framework needs to be extended to a multi-node localization and graph building system.
[2] Dubé R, Gawel A, Sommer H, et al. An online multi-robot SLAM system for 3D LiDARs[C]//2017
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2017:
10041011</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [3]
          <string-name>
            <surname>Ferrigno</surname>
            <given-names>L</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Miele</surname>
            <given-names>G</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Milano</surname>
            <given-names>F</given-names>
          </string-name>
          , et al.
          <article-title>A UWB -based localization system: analysis of the effect of anchor positions and robustness enhancement in indoor environments</article-title>
          [C]//2021 IEEE International Instrumentation and Measurement Technology Conference (
          <year>I2MTC</year>
          ). IEEE,
          <year>2021</year>
          :
          <fpage>1</fpage>
          -
          <lpage>6</lpage>
          ..
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          [4]
          <string-name>
            <surname>Zhou</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Yao</surname>
            <given-names>Z</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lu</surname>
            <given-names>M.</given-names>
          </string-name>
          <article-title>Lidar/UWB fusion based SLAM with anti-degeneration capability[J]</article-title>
          .
          <source>IEEE Transactions on Vehicular Technology</source>
          ,
          <year>2020</year>
          ,
          <volume>70</volume>
          (
          <issue>1</issue>
          ):
          <fpage>820</fpage>
          -
          <lpage>830</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          [5]
          <string-name>
            <surname>Wang</surname>
            <given-names>X</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Gao</surname>
            <given-names>F</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Huang</surname>
            <given-names>J</given-names>
          </string-name>
          , et al.
          <source>UWB/LiDAR Tightly Coupled Positioning Algorithm Based on ISSA Optimized Particle Filter[J]. IEEE Sensors Journal</source>
          ,
          <year>2024</year>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          [6]
          <string-name>
            <surname>Queralta</surname>
            <given-names>J P</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Almansa</surname>
            <given-names>C M</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Schiano</surname>
            <given-names>F</given-names>
          </string-name>
          , et al.
          <article-title>Uwb -based system for uav localization in gnssdenied environments: Characterization and</article-title>
          dataset[C]//2020 IEEE/RSJ International Conference on
          <article-title>Intelligent Robots and Systems (IROS)</article-title>
          . IEEE,
          <year>2020</year>
          :
          <fpage>4521</fpage>
          -
          <lpage>4528</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          [7]
          <string-name>
            <surname>Zhang</surname>
            <given-names>J</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Singh</surname>
            <given-names>S. LOAM</given-names>
          </string-name>
          :
          <article-title>Lidar odometry and mapping in real-time[C]//Robotics: Science and systems</article-title>
          .
          <year>2014</year>
          ,
          <volume>2</volume>
          (
          <issue>9</issue>
          ):
          <fpage>1</fpage>
          -
          <lpage>9</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          [8]
          <string-name>
            <surname>Wang</surname>
            <given-names>H</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Wang</surname>
            <given-names>C</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Chen C L</surname>
          </string-name>
          , et al. F
          <article-title>-loam: Fast lidar odometry</article-title>
          and mapping[C]//2021 IEEE/RSJ International Conference on
          <article-title>Intelligent Robots and Systems (IROS)</article-title>
          . IEEE,
          <year>2021</year>
          :
          <fpage>4390</fpage>
          -
          <lpage>4396</lpage>
          .
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>