=Paper= {{Paper |id=Vol-2387/20190178 |storemode=property |title=Formation Control of Multiple Autonomous Fixed-Wing Unmanned Aerial Vehicles in Dynamic Environment |pdfUrl=https://ceur-ws.org/Vol-2387/20190178.pdf |volume=Vol-2387 |authors=Ihor Skyrda,Valeriy Chepizhenko,Tetiana Davydenko |dblpUrl=https://dblp.org/rec/conf/icteri/SkyrdaCD19 }} ==Formation Control of Multiple Autonomous Fixed-Wing Unmanned Aerial Vehicles in Dynamic Environment== https://ceur-ws.org/Vol-2387/20190178.pdf
Formation Control of Multiple Autonomous Fixed-Wing
 Unmanned Aerial Vehicles in Dynamic Environment

    Ihor Skyrda1[0000-0002-9363-8921], Valeriy Chepizhenko2 and Tetiana Davydenko3
             1 Ukrainian State Air Traffic Services Enterprise, Boryspil, Ukraine
                        2 National Aviation University, Kyiv, Ukraine
                        3 National Aviation University, Kyiv, Ukraine

                                  skyrda2@gmail.com



       Abstract. This paper presents Modified Artificial Potential Field (MAPF) ap-
       proach application for decentralized formation control of multiple Unmanned
       Aerial Vehicles (UAVs) flying through dynamic environment. MAPF is based
       on Formation Potential Field (FPF) and it allows preventing mid-air collisions
       within defined security zone around multiple UAVs. This technique combines
       issue resolution connected with oscillation effects produced by potential fields,
       UAV fixed-wing type specification with the respect to application in the dynamic
       environment. Based on measured ranges between Remotely Piloted Aircraft
       (RPA) and obstacles (buildings, restricted areas), attraction and repulsion forces
       are formulated and are converted to aircraft flight control commands via rudder,
       aileron trims and engine throttle. The simulation results are used to validate and
       verify a given approach of real application, provision of optimal, collision-free,
       and safety flight path between initial UAVs positions and destination area.

       Keywords: multiple unmanned aerial vehicles, remotely piloted aircraft, artifi-
       cial potential field, formation control, mid-air collision, obstacle collision
       avoidance, path planning, dynamic environment.


1      Introduction

Unmanned Aerial Vehicles (UAVs) are the remotely piloted aircraft (RPA), automation
levels of such vehicles vary from those that are fully piloted from a remote location to
fully automated. These ‘pilotless’ aircraft are developed for a big variety of applica-
tions, such as surveillance, rescue, border control, agricultural production support, etc.
UAVs’ world legal acceptance is connected with their integration into the existing avi-
ation system without negatively affecting manned aviation and infrastructure, such as
mid-air collisions (MACs) – that is the main challenge today [1]. The International Civil
Aviation Organization’ (ICAO) and current European Commission’ (EC) regulatory
documents will only permit the autonomous maneuvers to override operator command
in emergencies such as communication failure or collision risk. Multiple UAVs opera-
tions have both practical potential in different applications and theoretical challenges
arising in coordination and control of the vehicles group. One of the main problems
regarding to autonomous UAVs activities in a group is an ability to move between ob-
stacles and avoid collision with them effectively, which itself includes subproblems
such as obstacles detection, path planning, group formation and data exchange between
vehicles.
   UAVs are usually used in remote and dangerous areas, especially fixed-wing that
have a high speed and heavy payload in comparison to rotary wing UAVs type. The
complexity appears because of the UAVs’ size is becoming smaller and as a result their
weight is becoming lighter. Therefore, taking into account these properties, UAVs have
not the ability of carrying heavy sensors such as Light Identification Detection and
Ranging (LIDAR) [2] or radar. Hence, the suitable solution is to use the on-board cam-
eras due to their advantage of lightweight and low power consumption.
   In addition to camera’s lightweight and the lower power consumption, the cameras
are able to provide detailed environmental information Therefore, they are considered
as the important sensors mounted on the small UAVs. The following obstacle avoid-
ance sensors are being used in the RPAs, e.g.:

- Stereo Vision;
- Ultrasonic (Sonar);
- Time-of-Flight;
- Infrared;
- Monocular Vision.

   Another issue is connected with the path planning, which consists of defining a set
of paths, parameterized by time in order to accomplish a mission determined by way-
points respecting flight specifications limits of both the UAV and the environment [3].
Also, path planning for multiple UAVs requires continues data exchange between for-
mation members, so it should take into account confounding factors such as network
latency, packet loss, and the unique UAV’s flight peculiarities.
   The collision avoidance algorithms applied to UAVs operation can be divided into
5 main groups [4]:

  1) Geometric Approach;
  2) Evolutionary Algorithm Approach;
  3) Grid-based Approach;
  4) Mixed Integer Linear Programming Approach;
  5) Artificial Potential Field Approach.

    The artificial potential field method (APF) is an approach of generating trajectories
online. It enables UAVs to navigate in a real condition environment with static and
dynamic obstacles by avoiding them. It is widespread due to its mathematical, algorith-
mic simplicity and not computationally expensive [3]. This reduction in computational
complexity makes the APF approach tractable for large numbers of UAVs. Moreover,
because the force on each UAV is calculated independently, the problem could poten-
tially be distributed onto flight management systems aboard each of the UAVs, which
further reduces the computational burden on any single machine. Additionally, since
the UAVs operate independently, uncooperative aircraft in the airspace can be handled
without issues [5].


2      Related Work

The first approach proposed for collision avoidance based on artificial potential field
(APF) application was developed by Khatib [6]. The paper presented the process of
mobile robots movement to the goal position with one obstacle under the action attrac-
tion force produced by the destination point and artificial repulsion force created by the
obstacle surface. The main drawback of such classic approach connects with the calcu-
lation of local minima in case of the presence more than one obstacle. L. Wang, K.
Chen, and Y.S. Ong [4] proposed to eliminate such effect by decomposing a complex
problem into a set of simple one (subgoals) with grid-world environment dynamically
and automatically, but the resultant paths are not the optimal solutions. In [7] this work
the authors tried to apply APF for helicopter type UAVs formation flight control with
a virtual leader of the group and extended version of the potential field solution. The
reason for this was a swarm constellation instability during an obstacle and collision
avoidance. It is not applicable in case of fixed-wing UAVs operation because of flight
features (velocity limits, unable to hover). The main task of tradition APF is connected
with a centralized control scheme required to have either ground control station or vir-
tual leader, so it directly influences on a reliability level in case of failure, and does not
guarantee the effectiveness in a dynamic, unknown environment. The robust swarm
control strategy for multiple UAVs operation in uncertainties conditions and varying
mission environment have been proposed by K. Han, J. Lee, and Y. Kim [8]. The swarm
should perform highly coordinated movements when the UAVs meet the pop-up
threats. It is realized through assignment swarm geometry center and behavior set of
rules, e.g.: avoidance rule, velocity matching rule, flock center rule. The resultant vector
is used in the rules represented as a gradient vector, composed of attractive and repul-
sive potential functions. The UAVs must deal with a constant movement and limited
turning ability, which make a collision avoidance more complicated, especially in the
case of collision avoidance with dynamic obstacles in a limited airspace. The work done
in [5] using APF minimize the number of potential collisions and the amount of re-
quired maneuvers to avoid other UAVs in a way.
    P. Vadakkepat, K. Chen Tan and W. Ming-Liang [9] proposed an evolutionary arti-
ficial potential field (EAPF) approach for a real time path planning composed of artifi-
cial potential field method and artificial intelligence combination. In comparison to tra-
ditional APF, where an obstacle is considered as a point of highest potential, and a goal
as a point of the lowest potential, vehicle moves from a high potential point to a low
potential one, EAPF method uses the multi-objective evolutionary algorithms to opti-
mize the potential field functions.
    H. Yin, L. L. Cam, U. Roy [10] outlined two main drawbacks of APF approaches
for multiple UAVs formation control proposed earlier. First, the gradients at some spe-
cific points of field may not exist due to the presence of global attractive potential and
has a disrupting effect on the smoothness of the whole potential field. Second, the
method can still fail to achieve its goal when agents are not well distributed around the
formation area in other words UAVs can’t find the way to the target position since the
influence of a local attractive potential has been blocked by other vehicles. Modified
Artificial Potential Field (MAPF) [10] excludes these disadvantages by application For-
mation Potential Field (FPF) [11] and avoids situations where other repulsive potential
field neutralizes the attractions of the target attractive potential field when it should not,
simultaneously a potential function is divided into global and local.


3      Problem Statement

The global purpose of this research is to create an algorithm that guarantees safe flight
generation and collisions avoidance for autonomous UAVs operation without human
controlling within a limited airspace.
   The main requirement is to handle collisions with fixed-wing UAVs that move at a
constant speed (cruise speed, Vcruise) because of low energy consumption.
   The effectiveness will be evaluated as a possibility to avoid potential collisions and
conflicts, at maximum turn rate with correspondent velocity value (Vturn), occurred on
the way and guarantee destination zone achievement. Potential collision is character-
ized by inner protection zone (rmin) intersection with an obstacle and conflict – outer
protection zone (rmax) (Fig. 1). The sizes will be represented in a timely manner, for
small UAV (with a weight that does not exceed 20 kg) it may be tmin=5 and tmax=10
seconds correspondently.

                                𝑟𝑚𝑖𝑛 = 𝑉𝑡𝑢𝑟𝑛 × 𝑡𝑚𝑖𝑛 ;                                     (1)
                                𝑟𝑚𝑎𝑥 = 𝑉𝑐𝑟𝑢𝑖𝑠𝑒 × 𝑡𝑚𝑎𝑥 ;                                   (2)

These values satisfy next conditions: minimum number of collisions and maneuvers,
UAV-to-UAV communication network latency, packet loss, obstacles detection range,
unique UAV flight specifications depending on size or payload.




Fig. 1. UAV protection zone, inner circle corresponds to maximum turn rate in few seconds and
outer circle characterized by cruise speed
The algorithm tests will be done using a simulator, which has such advantages: to allow
finding the maximum number of UAVs safely operates in limited airspace, to model
ideal conditions without unforeseen environmental factors and, in opposite side, with
weather or technical factors influences. The main issues are connected with wireless
communication between UAVs in a group. For this case, there is a lot of technologies
for short-range line-of-sight (LoS) links deployment, which are flexibly configured and
can be installed fast. The important criteria, which influence on communication link
type, are data exchange rate, physical size and energy consumption. In general, UAVs
supposed to be used in remote areas without a ground control station coverage, for ex-
ample, in cases of severe shadowing by urban or mountains terrain, or communication
infrastructure damages by natural disasters.
    Artificial Potential Field method is more preferable for the solution of such issues as
collision avoidance and formation control, because it is relatively simple for implemen-
tation, more efficient, fast and accurate. It assumes destination area or waypoints signed
as positive charges and other dynamic objects (UAVs or obstacles) in the space as neg-
ative charges. An optimal flight path is found by calculating a total force from the at-
traction force of UAVs towards their destination and repulsion force away from other
obstacles presented in the area (Fig. 2).




    Fig. 2. Two obstacles and destination zone formulate potential field in the optimal way

However, the traditional APF usually has problems connected with local minimums in
the potential field, which generate limitations such as (Fig. 3):

  1. No flight path between closely spaced obstacles.
  2. Oscillations in the presence of obstacles.
    3. Oscillations in narrow flight paths.
    4. Non-reachable destination area or waypoint.




     Fig. 3. Two obstacles and destination zone with high potentials formulate potential field


4       Proposed Approach

In this paper, an online (global) path-planning algorithm based on a modified APF ap-
proach is proposed for the control of UAVs swarm in dynamic environment, which
causes constant collision avoidance with buildings, UAVs coordinates and position cal-
culation errors based on Global Navigation Satellite System (GNSS), Inertial Naviga-
tion System (INS) and visual/radio sensors. The modification of the APF is for gener-
ating the shortest and safest path for the UAVs. Simulations are used to verify the pro-
posed approach using MATLAB.
   The Artificial Potential Field is one of the classical path planning approaches that is
used for global and local path planning in the dynamic or static environments. The con-
cept about APF is to find a mathematical function to represent attraction and repulsion
forces acting UAVs and destination area both forces are generated by mathematical
functions that are represented graphically by high and low areas in the simulated space.
   We model the UAVs as negatively charged particles and destination area as a posi-
tively charged (Fig. 4). A repulsion force often dominates over the attraction force in
scenarios containing multiple UAVs causing the vehicles to never reach their destina-
tion area. Mathematical formulation of approach assumes a numerical value in each
point in space and time, and whose gradient represents forces (3).

                                  𝐹𝑡𝑜𝑡𝑎𝑙 = 𝜉 × 𝐹 + + (1 − 𝜉) × 𝐹 − ;                             (3)

where Ftotal is a total force acting on one UAV, F+ – is an attraction force, F- – is a
repulsion force, ξ is an attraction force weighting coefficient (0 < ξ < 2) which ensures
attraction force domination under repulsion in order to guarantee UAV flight towards
destination area (Fig. 5).




                 Fig. 4. Dynamic objects’ interaction with different potentials




    Fig. 5. Attraction force weighting coefficient dependence on distance to the destination

Oscillation effect referred to traditional effect is eliminated by changing circle to ellip-
tical artificial potential field around UAV with the same area. It increases in a size
toward the heading of UAV, indicating a flight direction (Fig. 1).
   Additionally, the deadlock problem solution is presented, where at least two UAVs
are approaching each other head-on with destinations directly behind each other, since
UAVs cannot turn sharply or come to a complete stop to resolve this issue one UAV
turn to the left or right due to the action of artificial vortex repulsion field (Fig 6). In
some cases this principle is applied for collision avoidance with static obstacles [5].
             Fig. 6. Artificial vortex repulsion field is formulated around obstacle

Path planning using MAPF is based on a design of a standard attraction force function
for the goal point, and repulsion force function with tunable parameters depending on
shape, size and location of obstacles. At each point the resulting potential field angle is
lying along the angle of the resultant attraction and repulsion forces formulated by
UAVs, potential field functions considered as function of distance (Fig. 7).




Fig. 7. Two obstacles and destination zone formulate potential field (red – obstacles, black –
destination)


5      Formation Control of Multiple Autonomous Fixed-Wing
       Unmanned Aerial Vehicles Simulation

It is assumed that there are six UAVs, two obstacles and one destination zone for a
group. The aim is to plan an optimal collision-free path for the group, in case of multiple
UAVs application in a dynamic environment, where due to signal delay, multipath and
close obstacle location present an error of UAV coordinates definition and cooperation
in a group. The protection zone radius is equal to minimum value and remains a con-
stant during flight. The main peculiarity of such approach in comparison to others [1,
5, 7, 8] is that a group is operated without any leader.
   UAV movement can be described by kinematic equation system:
                              𝑑𝑥𝑖
                                    = 𝑓(𝑥𝑖 (𝑡), 𝑉𝑖 (𝑡), 𝜑𝑖 (𝑡));                             (4)
                               𝑑𝑡

                              𝑑𝑦𝑖
                                    = 𝑓(𝑦𝑖 (𝑡), 𝑉𝑖 (𝑡), 𝜑𝑖 (𝑡));                             (5)
                               𝑑𝑡

where, i=1, 2, …, n is the index of multiple UAV, xi, yi – coordinates of the i-th UAV,
Vi – is a flight-path velocity vector of the i-th UAV, φi – is the course angle character-
izing the direction of the velocity vector to the destination zone.
   The UAV coordinates can be calculated as a resultant force acting on i-th UAV pro-
vided by destination zone, obstacles and other UAVs:
                                       1
                              𝑥̈ 𝑖 =        ∑𝑛𝑖≠𝑗 𝐹𝑥𝑖𝑗
                                                   +      −
                                                       − 𝐹𝑥𝑖𝑗 ;                              (6)
                                       𝑚𝑖

                                       1
                              𝑦̈ 𝑖 =        ∑𝑛𝑖≠𝑗 𝐹𝑦𝑖𝑗
                                                   +      −
                                                       − 𝐹𝑦𝑖𝑗 ;                              (7)
                                       𝑚𝑖

where, mi – is a mass of the i-th UAV
  Attraction F+ and repulsion F- forces can be calculated as:
                                       𝐺𝑚𝑖 𝑚𝑗
                              𝐹𝑖𝑗+ =     𝛼         ;              α ϵ {2, 3, …};             (8)
                                        𝑟𝑖𝑗
                                       𝐺𝑚𝑖 𝑚𝑗 𝑟кр
                              𝐹𝑖𝑗− =          𝛽        ;          β ϵ {3, 4, …};             (9)
                                             𝑟𝑖𝑗

                             rij = √(xi − xj )2 + (yi − yj )2 ;                             (10)

where, G – is a gravitational constant and rij – is a distance between UAV,
    In order to provide the UAV movement to the destination zone, it is necessary that
its attraction force should be greater than total attraction force formulated by obstacles
and other UAVs [12].
    The heading angle φ can be estimated as a relation of attraction and repulsion force
influence on the UAV movement with correspondent coordinates.
                                                           𝑦̇               𝑦 (𝑘)−𝑦 (𝑘−1)
                             𝜑𝑖 (𝑘) = 𝑎𝑟𝑐𝑡𝑔 ( 𝑖) = 𝑎𝑟𝑐𝑡𝑔 ( 𝑖 (𝑘)−𝑥 𝑖(𝑘−1));                 (11)
                                                           𝑥̇ 𝑖             𝑥𝑖     𝑖

where, k – is the integration step of the equation system.
Fig. 8. Experiment 1. Flight trajectory of 6-th UAVs in a group with constant radius of protection
zone

The formation control problem of UAVs group in static and dynamic environment con-
sists of three main problems: plan, control and form a UAVs formation in a group at
their initial positions; group motion from initial position to destination; collisions
avoidance during the flight (Fig. 8).




Fig. 9. Experiment 2. Flight trajectory of 6-th UAVs in a group with varying radius of protection
zone

The zone around obstacles has double radius value and in case of its penetration, the
UAV security zone will be increased in accordance to Fig. 1, where radius is inversely
proportional to the distance between UAV and the nearest obstacle edge point of con-
tour, because obstacles can have rather different shapes.
   The results of simulation depict applicability of MAPF regarding UAVs operation
in the real world with static obstacles. Experiment 2 (Fig. 9) has expensed less time to
reach the destination area in comparison to Experiment 1, where UAVs trajectories, in
some cases, drawing obstacle shapes. In Experiment 2 (Fig. 10) UAVs start collision
avoidance maneuvers earlier and characterized by potential collisions absence.




 Fig. 10. Experiment 2. Destination zone is reached by 6-th UAVs in a group in 2400 seconds

The UAV motion in a dynamic environment is connected with potential conflicts pres-
ence with dynamic objects like UAV that has another speed value, shape, onboard
equipment, so they can’t be compatible for position data interchange performance. In
this case, UAV should be able detect any dynamic obstacles operatively, calculate
ranges and motion parameters. The traditional APF is characterized by dead lock prob-
lem and the solution provided by artificial vortex fields (Fig. 6) that act only around
obstacles and do not make an impact on a global potential function. In order to check
this Experiment 3 (Fig. 11) and Experiment 4 (Fig. 12) have been done. The main dif-
ference between them is an application of varying security zone radius. Experiment 3
shows a flight performance of two vehicles and their destination zones. In Fig. 11(b)
the flight path is optimal with less time consumption and slight maneuvers.
                       a)                                            b)
Fig. 11. Experiment 3. Collision avoidance with dynamic obstacle, like UAV with constant (a)
and varying (b) radiuses of protection zone

Proposed MAPF has showed the best result in case of UAVs group motion in dynamic
environment based on time consumption and number of flight maneuvers correspond-
ing to lower energy consumption, it is the main issue characterized UAV operation
(Fig. 12).




Fig. 12. Experiment 4. Collision avoidance with dynamic obstacle, like UAV with constant ra-
dius of protection zone around UAVs in a group and varying around standalone


6      Conclusions

In this paper, the Modified Artificial Potential Field has been proposed to control a
group of autonomous UAVs to achieve the destination zone and maintain a given for-
mation while avoiding collisions with static and dynamic obstacles. Unlike other cen-
tralized UAV formation control methods, the MAPF method does not require a high
computational capability and the flying trajectory can be modified in real time when an
unexpected obstacle has been detected.
   The MAPF approach is based on application of artificial vortex fields around obsta-
cles and varying protection zone radius of UAVs. It allows for significant scalability to
hundreds or thousands of autonomous UAVs provide enough airspace for a safe oper-
ation in a dynamic environment with non homogeneous vehicles types.


References
  1. Chang, K., Xia, Yu., Huang, K.: UAV formation control design with obstacle avoidance in
   dynamic three-dimensional environment. Chang et al. SpringerPlus 5:1124. DOI
   10.1186/s40064-016-2476-y (2016).
  2. Al-Kaff, A., Garcia, F., Martin, D., Escalera, A., Armingol, J. M.: Obstacle Detection and
   Avoidance System Based on Monocular Camera and Size Expansion Algorithm for UAVs.
   Sensors 2017, 17, 1061; DOI:10.3390/s17051061 (2017).
  3. Benghezal, A., Louali, R., Bazoula, A., Chettibib, T.: Trajectory generation for a fixed-
   wing UAV by the potential field method. Conference Paper May 2015 DOI:
   10.1109/CEIT.2015.7233049 (2015).
  4. Chen, H., Yin, Ch., Xie, L.: Automatic Discovery of Subgoals Sequential Decision Prob-
   lems Using Potential Fields. Conference Paper in Communications in Computer and Infor-
   mation Science August 2007 DOI: 10.1007/978-3-540-74282-1_66 (2007).
  5. Ruchti, J., Senkbeil, R., Carroll, J., Dickinson, J., Holt, J., Biaz, S.: UAV Collision Avoid-
   ance Using Artificial Potential Fields. Technical Report #CSSE11 – 03 (2011).
  6. Khatib, O.: Real-Time Obstacle Avoidance for Manipulators and Mobile Robots. The In-
   ternational Journal of Robotics Research (1986).
  7. Tobias, P., Krogstad, T. R., Gravdahl, J. T.: UAV Formation Flight using 3D Potential
   Field. Conference Paper July 2008 DOI: 10.1109/MED.2008.4601984 Source: IEEE Xplore
   (2008).
  8. Han, K., Lee, J., Kim, Y.: Unmanned aerial vehicle swarm control using potential functions
   and sliding mode control. Proc. IMechE Vol. 222 Part G: J. Aerospace Engineering DOI:
   10.1243/09544100JAERO352 (2008).
  9. Vadakkepat, P., Tan, K. Ch., Ming-Liang, W.: Evolutionary Artificial Potential Fields and
   Their Application in Real Time Robot Path Planning (2000).
  10. Yin, H., Cam, L.L., Roy, U.: Formation control for multiple unmanned aerial vehicles in
   constrained space using modified artificial potential field. Math. Model. Eng. Probl. 4(2),
   pp. 100–105. DOI: 10.18280/mmep.040207 (2017).
  11. Morais, C., Nascimento, T., Brito, A., Basso, G.: A 3D Anti-Collision based on Artifiacial
   Potential Field Method for a Mobile Robot. Conference Paper January 2017 In Proceedings
   of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017) -
   Volume 1, pp. 308-313. DOI: 10.5220/0006245303080313 (2017).
  12. Skyrda, I.: Decentralized Autonomous Unmanned Aerial Vehicle Swarm Formation and
   Flight Control. In: Ermolayev V., Suárez-Figueroa M., Yakovyna V., Mayr H., Nikitchenko
   M., Spivakovsky A. (eds) Information and Communication Technologies in Education, Re-
   search, and Industrial Applications. ICTERI 2018. Communications in Computer and Infor-
   mation Science, vol 1007. Springer, Cham, pp 197-219. DOI: 10.1007/978-3-030-13929-
   2_10 (2019)