<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>Scheduling and Control of Unmanned Ground Vehicles for Precision Farming: A Real-time Navigation Tool</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Dimitrios Bechtsis</string-name>
          <xref ref-type="aff" rid="aff2">2</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Vasileios Moisiadis</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Naoum Tsolakis</string-name>
          <xref ref-type="aff" rid="aff1">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dimitrios Vlachos</string-name>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Dionysis Bochtis</string-name>
          <xref ref-type="aff" rid="aff3">3</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Aristotle University of Thessaloniki, Department of Mechanical Engineering</institution>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff1">
          <label>1</label>
          <institution>Centre for International Manufacturing, Institute for Manufacturing, Department of Engineering, University of Cambridge</institution>
          ,
          <country country="UK">United Kingdom</country>
        </aff>
        <aff id="aff2">
          <label>2</label>
          <institution>Department of Automation Engineering, Alexander Technological Educational Institute of Thessaloniki</institution>
          ,
          <country country="GR">Greece</country>
        </aff>
        <aff id="aff3">
          <label>3</label>
          <institution>Institute for Bio-economy and Agri-technology (IBO), Centre for Research &amp; Technology- Hellas (CERTH)</institution>
          ,
          <addr-line>6th km Charilaou-Thermi Rd, GR 57001 Thermi, Thessaloniki</addr-line>
          ,
          <country country="GR">Greece</country>
        </aff>
      </contrib-group>
      <fpage>180</fpage>
      <lpage>187</lpage>
      <abstract>
        <p>Autonomous systems are a promising alternative for effectively executing agricultural field management strategies. Unmanned Ground Vehicles perform farming activities on custom agricultural fields, using realtime navigation. The aim of this study is to provide a software tool for optimizing accuracy and efficiency in precision farming activities, hence leading to improved farming output, while dynamically addressing operational and tactical level uncertainties. This paper contributes to the operations research field by allowing the application of simulated results direct to the guidance of a physical vehicle. Unlike existing sophisticated tools, the developed navigation mechanism is user-friendly and highly customizable at outdoor navigation.</p>
      </abstract>
      <kwd-group>
        <kwd>Unmanned Ground Vehicles</kwd>
        <kwd>Precision farming</kwd>
        <kwd>Robot Operating System</kwd>
        <kwd>Real-time navigation</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>1 Introduction</title>
      <p>The paper focuses on the real-time scheduling and control of Unmanned Ground
Vehicles (UGVs) designed to perform precision farming activities on custom
agricultural fields, under the occurrence of any geomorphological and environmental
uncertainties. More specifically, the aim of this study is to provide a software tool for
the real-time navigation of UGVs in agricultural fields to optimize accuracy and
efficiency in precision farming activities, hence leading to improved farming output,
while dynamically addressing operational and tactical level uncertainties.</p>
      <p>
        Research that motivates the integration of the UGV's ramifications onto the SC
ecosystem in general is not sufficient
        <xref ref-type="bibr" rid="ref1">(Bechtsis et al., 2017)</xref>
        and this is also projected
to the agricultural sector. In traditional agriculture, farmers’ lack of accuracy and
lack of proper feedback leads to: (i) loss of situation awareness
        <xref ref-type="bibr" rid="ref10">(Walker et al., 2008)</xref>
        ,
(ii) vigilance decrement
        <xref ref-type="bibr" rid="ref7">(Finomore et al., 2009)</xref>
        , (iii) complacency
        <xref ref-type="bibr" rid="ref9">(Kaber and
Endsley, 2004)</xref>
        , and (iv) skill degradation and human errors
        <xref ref-type="bibr" rid="ref2">(Billings, 1996)</xref>
        . In this
regard, semi- or fully-autonomous vehicles that are controlled by computers
        <xref ref-type="bibr" rid="ref8">(Ho et
al., 2012)</xref>
        are being used to address such difficulties and increase agricultural
operations efficiency
        <xref ref-type="bibr" rid="ref12">(Zheng et al., 2016)</xref>
        . More specifically, autonomous systems
are a promising alternative for effectively executing agricultural field management
strategies and agricultural operations considering that UGVs: (i) provide business
intelligence with real-time feedback on field’s parameters, (ii) can better handle
throughput volatility, (iii) can optimally operate autonomously on a 24/7 shift with
reliable performance, (iv) save energy compared to conventional man-driven farming
vehicles, (v) promote the smart agriculture vision, and (vi) increase safety at the field
level.
      </p>
      <p>
        Despite the evident benefits of UGVs in agriculture, the application of
autonomous mechanization in the sector is challenged by inherent factors including
both field geometry and morphology particularities
        <xref ref-type="bibr" rid="ref3">(Bochtis and Sørensen, 2009)</xref>
        ,
and environmental uncertainties like volatile weather conditions and encounters with
random objects and obstacles
        <xref ref-type="bibr" rid="ref4">(Bochtis et al., 2014)</xref>
        . This calls for automated systems
with scheduling and control intelligence capabilities that evaluate alternative
navigation decisions based on real-time feedback including field’s and crops’ states
assessed through real-time data
        <xref ref-type="bibr" rid="ref11">(Wulfsohn et al., 2012)</xref>
        . However, existing systems
have not been able to overcome problems such as low resolution maps, low
positioning accuracy, low grade process automation and incorrect or incomplete
measurements.
      </p>
      <p>The aim of this paper is to present an engineering-driven system for the
scheduling and control of agricultural UGVs with the objective of executing
precision farming activities in an optimal manner, form an intra-logistics field
operations perspective. The research principle relies on the basic hypothesis that an
agricultural field presents obstacles (both random and static) that a UGV should
detect and recalculate an optimal pathway to perform its farming tasks. A key
theoretical contribution in the existing body of literature is the proposition of a UGV
software tool for the real-time field recognition that guides the vehicle to execute its
precision farming activities whilst allowing for a better usage of resources and
potentially a better harvest.</p>
      <p>The remainder of the manuscript is organized as follows. In Section 2 we provide
the system description, along with the required input and operational data, and the
field monitoring process. In Section 3, we discuss the key findings of the simulation
tool in a conceptual field. Finally, in Section 4 we wrap-up with conclusions and
limitations, while we further outline beyond state-of-the-art applications of the
proposed system in the agricultural sector.</p>
    </sec>
    <sec id="sec-2">
      <title>2 System Description</title>
      <p>The proposed simulation system aims to navigate an UGV in custom agricultural
fields to perform related precision farming activities (e.g. seeding, spraying, and
fertilizing). The proposed system basically comprises of an information system that
consists of the following: (i) field layer representing the landscape and the static
objects (obstacles, trees), (ii) simulation layer which includes the action agents –
representing the UGV whose task is to perform precision farming activities, (iii)
message layer – representing the continuous transactions between the system nodes
to produce and manage raw data, and (iv) application layer which handles all the
vehicles activities including the action scheduler and the data acquisition block –
determining, prioritizing and optimally scheduling the optimal navigation pathway of
the UGV in the field based on encounters with obstacles and any particular
geomorphological characteristics.</p>
      <p>
        From a farm’s geometrical area perspective, the devised system regards the most
common area coverage practice which involves a set of parallel field-work tracks, or
trips, which starts at one boundary of the field and terminates at the opposite
boundary
        <xref ref-type="bibr" rid="ref5">(Bochtis et al., 2012)</xref>
        . In the exemplar demonstrator case under study, we
consider a set of five -equidistant- parallel tracks. An overview of the system
components as well as their inter-connections and related processes is presented in
Fig. 1.
      </p>
      <p>ROS Tools</p>
      <p>Objects/Actions
Rvis</p>
      <p>• Nodes
rqt_graph • Topics
• Action Server/Publish
• Action Client/Subscribe
Rvis
Gazebo
Gazebo
• Robot Joints
• Robot Links
• Robot Sensors
• Robot Actuators
• Landscape
• Static Objects</p>
      <sec id="sec-2-1">
        <title>2.1 Simulation Model Development</title>
        <p>At the proposed research paper the Robot Operating System (ROS) is used to
simulate an autonomous vehicle’s farming activities. The model’s layout is created at
the Gazebo simulation tool; for optimized path tracking, the inherent ROS
Simultaneous Localization And Mapping (SLAM) procedure informs the UGV's
movement.</p>
        <p>ROS is powerful and robust software with numerous third-party compatible tools
and relies on an extensive community of users and researchers that support it. A
significant number of ready to use outdoor robotic systems are compatible with ROS.
Indicatively, the Husky research robot developed by Clearpath
(https://www.clearpathrobotics.com/) and the Thorvald multipurpose agricultural
vehicle by SAGA robotics (https://sagarobotics.com/) are two well-established
examples. Simulation, on the other hand, offers a test bed for developing algorithms
and testing different UGV properties on various fields (Farinelly et al., 2016). ROS
allows researchers to elaborate their ideas and safely simulate them at a lab level,
before testing them on the field.</p>
      </sec>
      <sec id="sec-2-2">
        <title>2.2 Field and Operational Level Parameters</title>
      </sec>
      <sec id="sec-2-3">
        <title>2.2.1 Field Representation</title>
        <p>Initially, a 3-dimensional (3-D) coordinate system is assigned to the field. The 3D
world model is the simulation environment of the robot. Gazebo offers the tools for
building the facility layout of the robot's world and the user can add texture, color
and even objects. Fig. 2 depicts the experimental five-row crop cultivation field. The
model’s layout was created at the Gazebo simulation tool using the extensible
markup language and the Digital Elevation Model (DEM) for a 3-D representation of
the terrain. By convention Gazebo platform uses the right-handed coordinate system,
with X- and Y-axes in the plane, and Z-axis increasing with the altitude.</p>
      </sec>
      <sec id="sec-2-4">
        <title>2.2.2 Field-Specific Data</title>
        <p>Field-specific data are associated with the direct field attributes, including:
• Field boundaries – The vehicle navigates in a pre-specific region in order to map
the field's layout. Field boundaries should be introduced either directly by passing
the absolute coordinates of the field's boundaries to the system or indirectly by
means of specific physical landscape morphology (hills with intense slope around
the field).
•</p>
        <p>Field coordinates – The field includes the crop lines and several physical
obstacles (rocks, trees and hills). The map creation process identifies the field's
layout and the vehicle can navigate to specific coordinates using a global
optimum path. The start and end points of each field-work track can be passed as
arguments to the system.</p>
        <p>Potential obstacles – The vehicle identifies potential obstacles as a result of the
field area scanning procedure, after sending the original signal the vehicle
interprets the signals’ feedback of any spatially distributed obstacles to relative
map coordinates.</p>
        <p>Driving direction – This regards the direction of the parallel field-work tracks and
is obtained using the field's map.
2.2.3</p>
      </sec>
      <sec id="sec-2-5">
        <title>Operation-Specific Data</title>
        <p>Operation-specific data include the width between the field-work tracks and the
width of the action agent. The conceptual UGV is programmed to be equipped with a
light detection and ranging (LiDAR) sensor that is further developed, programmed
and tested at the 3-D agricultural field. The two-dimensional LiDAR sensor, with a
180-degree scanning angle, uses a laser meter which identifies distributed points in
the field that may represent trees or obstacles, and calculates the relative points’
distance thus informing the ROS about the corresponding X- and Y-axes coordinates.
In case a linear distribution of points is recognized, then the ROS recognizes a
fieldwork track of planted trees. As the UGV navigates in the field (Fig. 3), the scanning
angle changes resulting in a vast amount of the information generated via the LiDAR
sensor resulting in the full representation of the field and obstacles. A local pathway
is constantly updated as the UGV tries to contend with the global prescheduled path.</p>
        <p>In order to maintain a safety distance from the identified trees and obstacles, the
global cost-map takes into account the UGV's size and the identified points are
inflated by the inscribed radius of the UGV. The global path creation is performed by
the ROS and an inter-row global optimal path is followed for the scheduled activities
at the working shift. The final mapping of the field’s layout is used by ROS to
calculate a special matrix for finding the optimized path from a single point to the
other (global cost-map) and create the global UGV’s navigation pathway in the field.</p>
        <p>The developed algorithm reads sensor’s input from the UGV to detect the
landscape in real-time and gradually creates the mapping of the overall field’s layout
(Fig. 4). The created map is periodically saved as a snapshot of the working process
in the file system structure. Each file is continuously compared using image
processing techniques with previews file sequences in order to determine the end of
mapping procedure. The optimized map is identified and used as an input for the
creation of the global cost map and the robots movement. More specifically, Fig. 4
provides the starting image of the mapping procedure where the UGV first activates
the LiDAR sensor to transmit signals into the field’s layout until the entire
agricultural field is mapped. At the starting point, the LiDAR signals are represented
by gray that are used to identify the uncharted area, gradually forming the visible
areas. The linearly distributed black points indicate the field tracks and the obstacles’
contour. The boundary of the scanned area is produced from the 3-D terrain altitude
differences.</p>
      </sec>
    </sec>
    <sec id="sec-3">
      <title>3 Results</title>
      <p>The simulation results demonstrate that with the proposed software system
farming tasks can be scheduled step-by-step, with extreme accuracy, as the vehicle
passes through the trees’ field tracks. For crop line planting, irrigation and weeding
the X-, Y-, Z-axes coordinates of the landscape are pre-programmed and are
imported to the UGV’s schedule. Fig. 5 indicates the real-time SLAM of the UGV at
the field level as the LiDAR sensor constantly scans for possible real-time collisions.</p>
      <p>The paper contributes to sustainable precision farming operations by providing a
software tool for the real-time scheduling and control of UGV vehicles’ navigation in
custom agricultural fields under possible uncertainties. Sustainability parameters are
addressed at economic (optimize performance and increase production),
environmental (optimize energy consumption on UGVs and equipment at operational
level), and social (increase safety levels at field level, improve ergonomics for human
workers) levels. Overall, this research makes contextual/business environmental
elements of operational management into more dominant elements of an operational
system. More specifically, the low computational time requirements of the
underlying process allow for the implementation of the proposed system as a
realtime tool in agricultural operations. The developed system can be extended to capture
multi-criteria optimization aspects to promote agricultural supply chain sustainability
from a cradle-to-grave perspective.</p>
      <p>Finally, the system is prone to be tested in real field conditions with the use of a
custom or a commercial UGV robot. In order to make the transfer to the real world
the vehicle should be equipped with the proper sensors (lidar sensors, depth cameras,
inertial sensors etc) and could either be a simple ROS node that exchanges
information with the ROS core platform or a complete ROS enabled platform (with
an embedded pc) that performs all the necessary computations.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1.
          <string-name>
            <surname>Bechtsis</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Tsolakis</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Vlachos</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Iakovou</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2017</year>
          )
          <article-title>Sustainable supply chain management in the digitalisation era: The impact of Automated Guided Vehicles</article-title>
          .
          <source>Journal of Cleaner Production</source>
          ,
          <volume>142</volume>
          , p.
          <fpage>3970</fpage>
          -
          <lpage>84</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2.
          <string-name>
            <surname>Billings</surname>
            ,
            <given-names>C.E.</given-names>
          </string-name>
          (
          <year>1996</year>
          )
          <article-title>Aviation automation: The search for a human-centered approach</article-title>
          . Lawrence Erlbaum Associates, Mahwah, NJ, USA.
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bochtis</surname>
            ,
            <given-names>D.D.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Sørensen</surname>
            ,
            <given-names>C.G.</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>The vehicle routing problem in field logistics part I</article-title>
          . Biosystems Engineering,
          <volume>104</volume>
          , p.
          <fpage>447</fpage>
          -
          <lpage>57</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Bochtis</surname>
            ,
            <given-names>D.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sørensen</surname>
            ,
            <given-names>C.G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Busato</surname>
            ,
            <given-names>P.</given-names>
          </string-name>
          (
          <year>2014</year>
          )
          <article-title>Advances in agricultural machinery management: A review</article-title>
          .
          <source>Biosystems Engineering</source>
          ,
          <volume>126</volume>
          , p.
          <fpage>69</fpage>
          -
          <lpage>81</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Bochtis</surname>
            ,
            <given-names>D.D.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Sørensen</surname>
            ,
            <given-names>C.G.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Green</surname>
            ,
            <given-names>O.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>A DSS for planning of soilsensitive field operations</article-title>
          .
          <source>Decision Support Systems</source>
          ,
          <volume>53</volume>
          ,
          <issue>1</issue>
          , p.
          <fpage>66</fpage>
          -
          <lpage>75</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Farinelli</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Boscolo</surname>
            ,
            <given-names>N.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Zanotto</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Pagello</surname>
            ,
            <given-names>E.</given-names>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>Advanced approaches for multi-robot coordination in logistic scenarios</article-title>
          ,
          <source>Robotics and Autonomous Systems</source>
          , In press.
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Finomore</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Matthews</surname>
            ,
            <given-names>G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shaw</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Warm</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          (
          <year>2009</year>
          )
          <article-title>Predicting vigilance: a fresh look at an old problem</article-title>
          .
          <source>Ergonomics</source>
          ,
          <volume>52</volume>
          , p.
          <fpage>791</fpage>
          -
          <lpage>808</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Ho</surname>
          </string-name>
          , Y.-C.,
          <string-name>
            <surname>Liu</surname>
          </string-name>
          , H.-C. and
          <string-name>
            <surname>Yih</surname>
            ,
            <given-names>Y.</given-names>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>A multiple-attribute method for concurrently solving the pickup-dispatching problem and the load-selection problem of multiple-load AGVs</article-title>
          .
          <source>Journal of Manufacturing Systems</source>
          ,
          <volume>31</volume>
          , p.
          <fpage>288</fpage>
          -
          <lpage>300</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Kaber</surname>
            ,
            <given-names>D.B.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Endsley</surname>
            ,
            <given-names>M.R.</given-names>
          </string-name>
          (
          <year>2004</year>
          )
          <article-title>The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task</article-title>
          .
          <source>Theoretical Issues in Ergonomics Science</source>
          ,
          <volume>5</volume>
          , p.
          <fpage>113</fpage>
          -
          <lpage>53</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Walker</surname>
            ,
            <given-names>G.H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Stanton</surname>
            ,
            <given-names>N.A.</given-names>
          </string-name>
          and
          <string-name>
            <surname>Young</surname>
            ,
            <given-names>M.S.</given-names>
          </string-name>
          (
          <year>2008</year>
          )
          <article-title>Feedback and driver situation awareness (SA): a comparison of SA measures and contexts</article-title>
          .
          <source>Transportation Research Part F: Traffic Psychology and Behaviour</source>
          ,
          <volume>11</volume>
          , p.
          <fpage>282</fpage>
          -
          <lpage>99</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>Wulfsohn</surname>
            ,
            <given-names>D.</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>Aravena</given-names>
            <surname>Zamora</surname>
          </string-name>
          ,
          <string-name>
            <given-names>F.</given-names>
            ,
            <surname>Potin Téllez</surname>
          </string-name>
          ,
          <string-name>
            <given-names>C.</given-names>
            ,
            <surname>Zamora</surname>
          </string-name>
          <string-name>
            <surname>Lagos</surname>
          </string-name>
          ,
          <string-name>
            <given-names>I.</given-names>
            and
            <surname>García-Fiñana</surname>
          </string-name>
          ,
          <string-name>
            <surname>M.</surname>
          </string-name>
          (
          <year>2012</year>
          )
          <article-title>Multilevel systematic sampling to estimate total fruit number for yield forecasts</article-title>
          .
          <source>Precision Agriculture</source>
          ,
          <volume>13</volume>
          , p.
          <fpage>256</fpage>
          -
          <lpage>75</lpage>
          .
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Zheng</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Negenborn</surname>
            ,
            <given-names>R.R.</given-names>
          </string-name>
          and Lodewijks,
          <string-name>
            <surname>G.</surname>
          </string-name>
          (
          <year>2016</year>
          )
          <article-title>Closed-loop scheduling and control of waterborne AGVs for energy-efficient Inter Terminal Transport</article-title>
          . Transportation Research Part E: Logistics and
          <string-name>
            <given-names>Transportation</given-names>
            <surname>Review</surname>
          </string-name>
          , Article In Press.
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>