<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Experimental Evaluation of an IR and US Multi-Sensory Positioning Fusion Method</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Elena Aparicio-Esteve</string-name>
          <email>elena.aparicio@uah.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>José M. Villadangos</string-name>
          <email>jm.villadangos@uah.es</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Álvaro Hernández</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Jesús Ureña</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Electronics Department, University of Alcala</institution>
          ,
          <addr-line>Alcalá de Henares (Madrid)</addr-line>
          ,
          <country country="ES">Spain</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>Certain indoor applications, mainly related to unmanned mobile vehicles or accurate monitoring of targets, robots or people, require positioning systems with centimeter accuracy. Although some RFbased systems, such as UWB, have recently provided commercially available solutions for that purpose, ultrasound- or infrared-based systems still represent a feasible approach, due to their particular features and advantages. Whether having a direct line of sight between the emitting beacons and the receivers, these systems provide signal confinement in a reduced environment (typically room level), thus providing high robustness against external interference. Furthermore, their combination in mixed solutions may also achieve better performances, by mitigating the complementary drawbacks from each other, covering larger areas while minimizing interferences between beacons (alternating technologies), or increasing the availability of measurements. In this context, this work describes the experimental evaluation of a loosely-coupled fusion method that merges two positioning systems, one based on ultrasounds and the other on infrareds. Both systems are described hereinafter, and the range and accuracy performance individually obtained are presented as well. Experimental results for both systems are similar in terms of accuracy (below 15 cm between 80 and 95% of cases) in the common coverage area. These figures are similar when measurements are merged by means of a Kalman Filter (KF) into a single position estimate, while increasing the availability of the final system and discarding the efect from possible outliers in the original independent estimates.</p>
      </abstract>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1. Introduction</title>
      <p>Some positioning applications and services only requires a contextual location (room level), such
as guiding/monitoring people or customized advertising on mobile devices in commercial centres.
Nevertheless, in other cases the accuracy and availability in the determination of a target’s
position become a challenging issue, where only errors in the range of decimetres or centimetres
are accepted, in unmanned vehicle guidance for example. Furthermore, there are other features
that are also desirable in a local positioning system (LPS): the ease of deployment and derived
costs, the coverage, the compatibility with other exiting systems (including communications),
privacy policy, or the robustness against external interference. In general terms, positioning
nEvelop-O
systems can be classified according to the sensory technology involved [ 1]: optical, mechanical,
magnetic, acoustic, or radio frequency (RF).</p>
      <p>On the other hand, the widespread use of mobile devices, such as smartphones or tablets,
with connection to Internet anywhere and anytime, has emerged a huge variety of
locationbased services and applications using location, taking advantage of the communication nodes
already deployed. This approach is commonly based on the existing infrastructures (WiFi nodes,
for example), or on ad-hoc networks (such as Bluetooth Low Energy) [2, 3], but with a clear
predominance of radio-frequency technologies. A particular interesting proposal, with high
accuracies (lower than decimetres), is ultra-wide band (UWB), which has emerged as a suitable
solution for indoor positioning, and it has already begun to be integrated into advanced versions
of smartphones. Another positive aspect of UWB is its large coverage and range capabilities
(more than 100 m in direct Line-Of-Sight, LOS). Furthermore, UWB transmissions can partially
penetrate walls and obstacles, although their accuracy and maximum range are greatly reduced
in practice when operating indoors, especially due to the NLOS (Non-Line-Of-Sight) efect and
the influence from the environment [ 4]. UWB-based systems are likely to keep improving
themselves and decreasing their price, so they will play a predominant role in most indoor
positioning applications in coming years. However, it is also worldwide accepted that diferent
technologies may be complementary for indoor positioning in many cases, depending on the
application under study.</p>
      <p>With regard to ultrasound-based LPS [5, 6], they usually provide a low cost whereas errors
are in the range of centimeters, being necessary to deal with some drawbacks, such as multipath
or near-far efects. The most typical arrangement in ultrasonic LPSs is the deployment of fixed
transmitting beacons at known positions [7, 8], so those receiving targets in the coverage area
can detect the corresponding transmissions and determine the Times-of-Arrival (ToA) or the
Time-Diferences-of-Arrival (TDoA) to estimate their own positions by means of spherical or
hyperbolic trilateration, respectively [9].</p>
      <p>Concerning infrared-based LPSs, there is an emerging interest nowadays in this optical
technology, thanks to all the LED lamps already existing in public buildings, companies and
homes. This implies likely a low cost, as well as broad distribution in the vast majority of indoor
spaces [10, 11]. Infrared Local Positioning Systems (IRLPS) commonly apply triangulation for
positioning estimation, as they consist of measuring the Angles-of-Arrival (AoA). This approach
avoids, not only involving the velocity of light in calculations when using Times-of-Flight (ToF),
but also the influence from light reflections and the multipath efect [ 12].</p>
      <p>In this context, this work evaluates a loosely-coupled fusion method to merge two diferent
LPS, based on optical and ultrasonic technologies, which cover a common area and whose
measurements can be acquired simultaneously. Merging both systems enhances the coverage
area with a higher reliability and availability. The position estimates coming from both are
fused by means of a Kalman filter (KF) to provide a more robust estimated position. The whole
proposal has been validated experimentally, achieving the final approach positioning errors in
the range of 10 cm for almost 90% of cases. The rest of the manuscript is organised as follows:
Sections II and III describe the infrared and ultrasonic LPSs, respectively; Section IV presents
the obtained experimental results; and, finally, conclusions are discussed in Section V.</p>
    </sec>
    <sec id="sec-2">
      <title>2. Description of the Infrared LPS</title>
      <p>The infrared LPS is based on a set of four emitters or LED beacons placed at known positions,
so that they cover a certain area where the receiver can estimate its position. A general scheme
of the proposal is presented in Fig. 1. It is assumed hereinafter that the LEDs are placed in the
ceiling, whereas the receiver can move in a certain plane (for example, on the ground). The
transmitters are neither rotated nor inclined, while the receiver can be rotated in the  axis.
Thus, the proposed system can be applied in its current configuration as a 3D IRLPS to obtain
the pose of a mobile robot ( ,  ,  ,  ), even when a low SNR (Signal-to-Noise Ratio) is expected
(distances even greater than about 4 meters with 0.5 W emitters).</p>
      <p>Every LED transmits an 1151-bit LS sequence   with a BPSK (Binary Phase Shift Keying)
modulation with a carrier of 25 kHz [13]. The reception system consists of a QADA (Quadrant
photodiode Angular Diversity Aperture) circular photoreceptor QP50-6-18u-TO8 [14], a filtering
stage, a synchronism detector and an acquisition system STM32F469I Discovery [15] connected
by USB to a computer, where the detected signals are processed. The light emitted by the LEDs
illuminates the QADA receiver, thus generating four currents (one per quadrant). The QADA
receiver actually provides three output currents: the sum of all quadrant currents (  ), and
the diferences of currents in the axes  (  ) and  (  ). These three signals are acquired and
processed to obtain the point of incidence (  ,   ) of the transmitters on the surface of the QADA.</p>
      <p>
        It is worth noting that emitters and receivers are synchronized by means of an additional
infrared synchronism beacon. It emits a pulse every 2 Hz and, when the receiver module detects
it, it begins to acquire simultaneously with the emitters’ transmission. A CDMA (Code-Division
Multiple Access) medium access technique has been considered, where each transmission is
identified by using a matched filter for every transmitted code. This procedure is based on the
correlation of the received signals   ,   and   with the transmitted codes   , while reducing
other interference (noise, ambient light, incident sunlight, etc.). The resulting correlation peaks
allow to obtain the ratios (  ,   ) between the correlation peaks of the diference signals and
the correlation peak of the sum signal. Afterwards, the position of the image point projected
on the QADA photoreceptor can be estimated for each transmitter according to (
        <xref ref-type="bibr" rid="ref1">1</xref>
        ). Note that
the misalignment of the aperture  has also been considered as an intrinsic parameter when
estimating the image points (  ,   ), as well as its central point (  ,   ), the aperture length  and
the ratio between the expected focal length hap and the actual focal length ℎ’ :  = ℎ’  ⁄ ℎ .
[  ] = − ⋅  ⋅ [   +  ⋅   ] + [  ]
  2 − ⋅   +    
(
        <xref ref-type="bibr" rid="ref1">1</xref>
        )
      </p>
      <p>After estimating the positions of the image points (   ,   ) for each emitter  , the algorithm
detects the rotation  of the receiver around the  axis. Since the transmitters are arranged in a
square, the image points must have the same shape. Therefore, if the receiver rotates a certain
angle  around the  axis, the image points will also rotate an angle  . The rotation angle  is
obtained by means of trigonometric equations using the rotated image points (  ,   ) [13], and
then the image points can be unrotated. This step is necessary as the final positioning algorithm
requires the receiver to be aligned with the reference frame. The positioning algorithm continues
with the estimation of the final coordinates (  ,  ,  ) of the receiver by using an LSE (Least Squares
Estimator), as well as diferent trigonometric considerations [ 16].</p>
      <p>To detail how the proposed IRLPS behaves in the test area, the Position Dilution of Precision
(PDOP) is presented in Fig. 2 when the receiver is located at a height of  = 0 m (on the floor).
The projection of the transmitters in the   plane are also presented with black crosses. It can
be clearly observed an increase of the PDOP at the corners of the coverage area, with respect to
the centre of the room.</p>
    </sec>
    <sec id="sec-3">
      <title>3. Description of the Ultrasonic LPS</title>
      <p>The ultrasonic LPS consists of a set of emitting beacons, together with a synchronism block.
Every beacon transmits a diferent Kasami code with a length of 255 bits, also BPSK modulated
with a carrier of 41.667 kHz [8]. Note that the modulation symbol consists of two carrier periods.
The ultrasonic receiver includes a MEMS microphone SPU0414HR5H-SB [17], connected to an
analog input of the STM32F103 microcontroller to acquire the incoming signal at   = 100 kHz
with 8 bits. All these elements, both ultrasonic beacons and receiver, are synchronized through
an IR synchronism block, based on the LPC1768 microcontroller. The synchronism beacon is
the same one from the previous IRLPS, so that both positioning systems (US and IR) emit and
receive simultaneously. Fig. 3 shows a general scheme of the proposed ultrasonic LPS.</p>
      <p>To estimate the receiver’s position based on the distances measured by the ToFs, the
trilateration equation system is solved using the Gauss-Newton algorithm. This is an iterative approach
for solving the system of non-linear equations resulting from the distance measurements derived
from the ToFs between the receiver and the beacons. As before, these distances are determined
again from the matched filtering between the received signal and the emitted Kasami codes.
In spherical trilateration, with the location of the beacons in the plane of the ceiling, only
three correct measurements are needed to estimate the receiver’s position. Whether more
measurements are available, the algorithm dynamically adapts and solves an oversized system.
More details can be found in [8], where the ultrasonic LPS with large coverage is described, as
well in [4], where the IR is added and a comparison with an UWB solution is provided.</p>
      <p>Similar to the analysis performed for the IRLPS system, the PDOP of the proposed ULPS
system is presented in Fig. 4, when the receiver is located at  = 0 m (on the floor). A lower PDOP
is observed in the ULPS system with respect to the IRLPS system. Note that the projections
of the US beacons in the   plane are not plotted since they are located at the corners of the
room, far from the central coverage area shown in Fig. 4.</p>
    </sec>
    <sec id="sec-4">
      <title>4. Experimental Results</title>
      <p>The experimental tests have been carried out in a room of 8 × 7 m2 with a height of 3.4 m, under
normal light and noise conditions, although due to the coverage restrictions of the IR beacons,
only the central part of the room has been used. The IR beacons have been placed on the ceiling
of the room, in its central part, distributed at the four corners of a square with a 1.2 m long side.
On the other hand, the ultrasonic beacons are at the corners of the room. The infrared (IR) and
ultrasound (US) receivers are placed on a line-following robot on the room floor, as shown in
Fig. 5. The ground-truth of the analysed trajectories is determined by using a Leica TS60 total
station and a 360º mini prism. This is a high-precision system, which allows the 3D position of
the desired object to be obtained with an accuracy of 1.5 mm.</p>
      <p>Two trajectories are analyzed: the first one is a square with a side of 3 m (outer trajectory),
whereas the second is a trajectory in an area of 2 × 2 m2 (inner trajectory). Figs. 6 and 7 show
the experimental measurements obtained in the   plane using either IR or US measurements,
as well as using a KF that merges both IR and US measurements. The ground-truth of the two
trajectories is also plotted in a black line, and the projections of the IR and US beacons are
presented with a triangle and a square, respectively. The average speed of the mobile robot
during the experimental tests is 15 cm/s. Note that since the length of the IR and US signals are
46.3 ms and 12.24 ms, respectively, no great influence is associated with the speed of the robot
in the acquisition of the transmitted signals.</p>
      <p>The first step in the proposed Kalman Filter (KF) is to detect if the estimated receiver’s position
using the IRLPS or the ULPS is an outlier. It is considered an outlier when the diference between
the position of the receiver and the previous KF solution is higher than a certain threshold. In
this case, that value is neglected, and it will not enter in the KF. In particular, a threshold of
35 cm is selected. On the other hand, if both measurements are outliers, the average of the
previous four KF solutions is considered as the initial estimation for the KF. Note that, this is a
particular situation that only occurs in the 6.37% and 0.82% of the total measurements for the
outer and the inner trajectory, respectively. This method assures that the criteria for discarding
an outlier is equal for both systems.</p>
      <p>The estimated coordinates  and  are plotted for both trajectories in Figs. 8 and 9, respectively,
for the estimated position using the ULPS and the IRLPS, as well as the merged solution from
the KF. It can be verified that the estimated position using the KF decreases the number of
outliers and increases the availability of the total system.</p>
      <p>Finally, Figs. 10 and 11 show the Cumulative Distribution Functions (CDFs) of the absolute
errors obtained in the   plane for the position estimation, considering both positioning systems
for the outer and the inner trajectories, respectively, as well as their mean absolute error. The
absolute error has been determined as the distance between each estimated point and the nearest
ground-truth point [18]. In particular, the mean absolute errors for the IR, US and KF estimated
positions are 0.24 m, 0.36 m and 0.06 m; and 0.06 m, 0.18 m and 0.03 m for the outer and inner
trajectories, respectively.</p>
      <p>The absolute errors obtained in 90% of the cases for the KF approach are lower than 13 cm
and 7 cm in the outer and inner trajectories, respectively. It can also be observed that higher
errors are obtained at the corners of the room for the IR system, where there is a longer distance
between the transmitters and the receiver. Both systems have errors in the same range in the
inner path, where the coverage conditions are similar (although it should be remarked that the
ultrasound beacons are further away as they were installed at the corners of the room). Note
that the acquisitions of the IR and US signals are simultaneous, but these measurements are not
simultaneous with the ground-truth measurements from the Leica total station.</p>
      <p>Furthermore, for both analysed trajectories, there are sections where the performance of
positioning systems degrades (this is where discarded outliers accumulate). This is due to
particular issues in the signals’ transmission (multipath conditions, low SNR, etc.). Combining
the results from both systems with the KF provides a clear improvement in terms of positioning
availability along the whole trajectory. It should be noted that no integration of odometry from
the mobile robot has been done at this stage, although it could also help filter or mitigate the
dispersion of values along the path. Future works will study using an adaptive error covariance
matrix in the measurements to match the distances or angles estimated in each step of the filter.</p>
    </sec>
    <sec id="sec-5">
      <title>5. Conclusions</title>
      <p>This work has presented a comparison based on experimental tests of two diferent technologies
used to design indoor local positioning systems. An ultrasound-based LPS has been presented,
consisting of a set of beacons and a mobile receiver. On the other hand, an infrared-based LPS
has also been described, with LED-based beacons installed in the ceiling and a mobile QADA
receiver. Both systems are synchronised. They have been experimentally tested in a large room
(8 × 7 × 3.4 m3), with a central test area, and comparatively validated. The infrared solution
presents a greater restriction in the provided coverage, which causes the performance to be
reduced earlier when moving away from the room’s central area (this would be mitigated by
installing a larger number of IR emitters). On the other hand, their accuracy is higher than
ultrasounds in the central area, perhaps also due to the distance of the ultrasonic emitters.
Overall, the position errors achieved when merging both proposals with a KF are less than 10
cm in 90% of cases, while increasing the availability of the positioning system.</p>
    </sec>
    <sec id="sec-6">
      <title>Acknowledgments</title>
      <p>This work has been funded by the Spanish Ministry of Science, Innovation and Universities
(project POM, ref. PID2019-105470RA-C33, and project MICROCEBUS, ref.
RTI2018-095168BC51), Comunidad de Madrid and University of Alcala (project CODEUS, ref. CM/JIN/2019-043,
and project PUILPOS, ref. CM/JIN/2019-038).
[2] J. Torres-Sospedra, R. Montoliu, S. Trilles Oliver, O. Belmonte Fernández, J. Huerta,
Comprehensive Analysis of Distance and Similarity Measures for Wi-Fi Fingerprinting
Indoor Positioning Systems, Expert Systems with Applications 42 (2015) 9263–9278.
doi:1 0 . 1 0 1 6 / j . e s w a . 2 0 1 5 . 0 8 . 0 1 3 .
[3] F. Aranda-Polo, J. Parades, T. A. Benítez, F. Á. Franco, Improving BLE deterministic
ifngerprinting by using a weighted k-NN algorithm over filtered RSSI data, in: Proc.
International Conference on Indoor Positioning and Indoor Navigation (IPIN 2019), 2019,
pp. 431–438.
[4] D. Gualda, J. M. Villadangos, J. Ureña, A. R. J. Ruiz, F. Seco, Á. Hernández, Indoor
positioning in large environments: ultrasonic and UWB technologies, in: Proc. International
Conference on Indoor Positioning and Indoor Navigation (IPIN 2019), 2019, pp. 1–8.
[5] A. Ward, A. Jones, A. Hopper, A new location technique for the active ofice, IEEE Personal</p>
      <p>Communications 4 (1997) 42–47. doi:1 0 . 1 1 0 9 / 9 8 . 6 2 6 9 8 2 .
[6] N. B. Priyantha, A. Chakraborty, H. Balakrishnan, The cricket location-support system,
in: Proc. of the 6th Ann. Int. Conf. on Mobile Computing and Networking, MobiCom
’00, Association for Computing Machinery, New York, NY, USA, 2000, p. 32–43. URL:
https://doi.org/10.1145/345910.345917. doi:1 0 . 1 1 4 5 / 3 4 5 9 1 0 . 3 4 5 9 1 7 .
[7] Á. Hernández, E. García, D. Gualda, J. M. Villadangos, F. Nombela, J. Ureña,
FPGABased Architecture for Managing Ultrasonic Beacons in a Local Positioning System, IEEE
Transactions on Instrumentation and Measurement 66 (2017) 1954–1964. doi:1 0 . 1 1 0 9 / T I M .
2 0 1 7 . 2 6 8 2 9 3 8 .
[8] J. Ureña, Á. Hernández, J. J. García, J. M. Villadangos, M. Carmen Pérez, D. Gualda,
F. J. Álvarez, T. Aguilera, Acoustic Local Positioning With Encoded Emission Beacons,
Proceedings of the IEEE 106 (2018) 1042–1062. doi:1 0 . 1 1 0 9 / J P R O C . 2 0 1 8 . 2 8 1 9 9 3 8 .
[9] M. Defenbaugh, J. Bellingham, H. Schmidt, The relationship between spherical and
hyperbolic positioning, in: OCEANS 96 MTS/IEEE Conference Proceedings. The Coastal
Ocean - Prospects for the 21st Century, volume 2, 1996, pp. 590–595 vol.2. doi:1 0 . 1 1 0 9 /
O C E A N S . 1 9 9 6 . 5 6 8 2 9 3 .
[10] C. Wang, L. Wang, X. Chi, S. Liu, W. Shi, J. Deng, The research of indoor positioning based
on visible light communication, China Communications 12 (2015) 85–92. doi:1 0 . 1 1 0 9 / C C .
2 0 1 5 . 7 2 2 4 7 0 9 .
[11] T. Q. Wang, Y. A. Sekercioglu, A. Neild, J. Armstrong, Position Accuracy of Time-of-Arrival
Based Ranging Using Visible Light With Application in Indoor Localization Systems,
Journal of Lightwave Technology 31 (2013) 3302–3308. doi:1 0 . 1 1 0 9 / J L T . 2 0 1 3 . 2 2 8 1 5 9 2 .
[12] F. Alam, M. T. Chew, T. Wenge, G. S. Gupta, An Accurate Visible Light Positioning System
Using Regenerated Fingerprint Database Based on Calibrated Propagation Model, IEEE
Transactions on Instrumentation and Measurement 68 (2019) 2714–2723. doi:1 0 . 1 1 0 9 / T I M .
2 0 1 8 . 2 8 7 0 2 6 3 .
[13] E. Aparicio-Esteve, Á. Hernández, J. Ureña, J. M. Villadangos, F. Ciudad, Estimation of the
Polar Angle in a 3D Infrared Indoor Positioning System based on a QADA receiver, in:
2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN), 2019,
pp. 1–8. doi:1 0 . 1 1 0 9 / I P I N . 2 0 1 9 . 8 9 1 1 7 7 5 .
[14] F. S. Inc., Series 6 Data Sheet Quad Sum and Diference Amplifier, Part Description</p>
      <p>QP50-6-18u-SD2, Product Specification (2012).
[15] STMicroelectronics, STM32F469IDiscovery, Product Specification (2015) 1–40.
[16] E. Aparicio-Esteve, Á. Hernández, J. Ureña, J. M. Villadangos, Visible Light Positioning
System Based on a Quadrant Photodiode and Encoding Techniques, IEEE Transactions on
Instrumentation and Measurement 69 (2020) 5589–5603. doi:1 0 . 1 1 0 9 / T I M . 2 0 1 9 . 2 9 6 2 5 6 3 .
[17] L. Knowles Acoustics, Amplified ”ultra-mini” sisonictm microphone specificationwith
maxrf protection, Product Specification (2012).
[18] M. C. Pérez-Rubio, C. Losada-Gutiérrez, F. Espinosa, J. Macias-Guarasa, J. Tiemann, F.
Eckermann, C. Wietfeld, M. Katkov, S. Huba, J. Ureña, J. M. Villadangos, D. Gualda, E. Díaz, R.
Nieto, E. Santiso, P. del Portillo, M. Martínez, A realistic evaluation of indoor robot position
tracking systems: The IPIN 2016 competition experience, Measurement 135 (2019) 151–162.
URL: https://www.sciencedirect.com/science/article/pii/S0263224118310728. doi:h t t p s :
/ / d o i . o r g / 1 0 . 1 0 1 6 / j . m e a s u r e m e n t . 2 0 1 8 . 1 1 . 0 1 8 .</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          [1]
          <string-name>
            <given-names>R.</given-names>
            <surname>Mautz</surname>
          </string-name>
          , Indoor positioning technologies,
          <source>Ph.D. thesis</source>
          , ETH Zurich, Zurich,
          <year>2012</year>
          .
          <source>doi:1 0 . 3 9</source>
          <volume>2 9</volume>
          / e t h z -
          <source>a - 0</source>
          <volume>0 7 3 1 3 5 5 4 .</volume>
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>