<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta />
    <article-meta>
      <title-group>
        <article-title>An Automated Guided Vehicle for Flexible and Interactive Task Execution in Hospital Scenarios</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <string-name>Riccardo Caccavale</string-name>
          <email>riccardo.caccavale@unina.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <contrib contrib-type="author">
          <string-name>Alberto Finzi</string-name>
          <email>alberto.finzi@unina.it</email>
          <xref ref-type="aff" rid="aff0">0</xref>
        </contrib>
        <aff id="aff0">
          <label>0</label>
          <institution>Universi di Napoli Federico II</institution>
          ,
          <addr-line>DIETI, via Claudio 21, 80125 Napoli</addr-line>
          ,
          <country country="IT">Italy</country>
        </aff>
      </contrib-group>
      <abstract>
        <p>We present the control architecture of a modular robotic system designed for hospital logistics. The robotics system is an automated guided vehicle that can autonomously perform tasks like carrying and delivering objects, medicines or devices, while interacting with humans in the hospital environment. Specically, the robotic platform is designed to dock and move passive vehicles (like carts, containers, etc.), which dynamically change the robot shape and function during the task execution. We describe the overall control architecture focusing on the executive and the planning systems. We discuss the system at work in dierent scenarios considering both autonomous and interactive tasks.</p>
      </abstract>
      <kwd-group>
        <kwd>Service Robotics AI and Robotics Automated Guided Vehicles Human-Robot Interaction Robot Healthcare</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec id="sec-1">
      <title>-</title>
      <p>
        Hospital logistic is an important aspect for the healthcare systems since it allows
to optimize costs and to improve the quality of service in hospitals [
        <xref ref-type="bibr" rid="ref1">1</xref>
        ]. In
particular, medical supply distribution like sterile instruments to operating rooms or
food and medicines to patients, are some of the most common processes in
hospitals [
        <xref ref-type="bibr" rid="ref13">13</xref>
        ]. In this context Automated Guided Vehicles (AGVs) are often deployed
[
        <xref ref-type="bibr" rid="ref2 ref3">3, 2</xref>
        ] to help employees to transport these materials, making them available at
the right time and at the right place minimizing errors and eorts. The capability
of transporting dierent supplies for dierent purposes in a dynamic environment
such as an hospital requires a robotic system capable of exibly adapting
behaviors with respect to the environmental and the contextual changes. In this
paper, we present a control architecture for hospital logistic AGVs that enables
exible planning and execution of structured tasks and motions in the presence
of physical human-robot interaction.
      </p>
      <p>In the following sections we rstly introduce the scenario in which the work
is carried out, then we detail the overall control architecture focusing on its
principal components and nally we describe case studies of supplies transportation
in both simulated and real hospital scenarios.</p>
      <p>Copyright © 2020 for this paper by its authors. Use permitted under Creative
Commons License Attribution 4.0 International (CC BY 4.0).
The proposed robotic system is framed in the context of the RoMoLO -
Modular robots for hospital logistics project. The project proposal aims at creating
a mobile and modular robotic system capable of performing dierent logistic
tasks in a hospital scenario. The proposed platform is an omnidirectional mobile
robotic base able to hook passive vehicles with dierent functions: transport of
sheets, drug dispensing system, telepresence vision system, etc.. The
peculiarity of the system is the adoption of a single type of mobile base, which can
then integrate dierent types of passive vehicles on wheels for multiple usage.
Specically, an automatic coupling system can dock dierent types of passive
vehicles: the mobile robot moves under the passive vehicle, docks it, and carries
it through restricted environments, replacing the manual thrust. Therefore, the
same mobile robot platform can be exploited for dierent logistic processes, e.g.
to circulate drugs, sheets and waste in the hospital, interacting with sta and
patients to receive instructions or communicate information.</p>
      <p>These vehicles, compared to the state of the art, should allow greater
exibility while containing costs since a single mobile platform may be adapted to
perform several tasks. In summary, the proposed robotic system should support
the following functionalities: autonomous or remote navigation, pick-carry-place
dierent passive vehicles, physical human-robot interaction, possibility of
manual driving by lightly pushing the vehicles and using the mobile robot as a force
amplier.
3</p>
    </sec>
    <sec id="sec-2">
      <title>System Architecture</title>
      <p>
        In this section, we illustrate the overall control architecture of the RoMoLO
system (see Figure 1) describing its main components and functionalities. In
particular, we rst describe the executive system, then we focus on task and
motion planning/execution, and nally on human-robot interaction.
Executive System. The robot behavior is managed by the executive system that
interacts with the robotic system and the human operator. We deploy the
framework by [
        <xref ref-type="bibr" rid="ref6 ref7">7, 6</xref>
        ] that provides the high-level control mechanisms needed to exibly
orchestrate the execution of multiple hierarchically structured tasks. Following a
supervisory attentional system and contention scheduling approach [
        <xref ref-type="bibr" rid="ref12 ref9">12, 9</xref>
        ], this
orchestration is obtained not only by enabling or disabling processes at dierent
levels of abstraction, but also through regulations that enhance or reduce the
activation of the processes. Specically, the supervisory system can monitor and
execute multiple hierarchically structured tasks exploiting bottom-up
(stimulioriented) and top-down (task-oriented) inuences. This process is managed by a
control cycle that continuously updates an internal hierarchical structure, that
we call Working Memory (WM), and a set of behaviors representing the
overall processes involved in the execution exploiting schemata specications
represented in the Long Term Memory (LTM). The LTM is a repository that collects
the declarative representations of all the possible behaviors and tasks available
to the robot, including collaborative activities. The WM represents the
executive state of the system as an annotated tree structure, whose nodes represent
processes/behaviors allocated and available for the execution, while the edges
represent parental relations among sub-processes/sub-behaviors. Each node is
annotated with preconditions, eects, and an activation level. It is worth
noticing that, not only multiple tasks can be allocated in the WM, but also multiple
methods for the same tasks may compete for the actual execution. The
orchestration of multiple tasks/activities, possibly in conicts, is obtained by exploiting
attention regulations aecting the activation of the behaviors. Specically, the
most active behavior is selected following a winner-take-all approach. Additional
details can be found in [
        <xref ref-type="bibr" rid="ref6 ref7 ref8">7, 6, 8</xref>
        ].
      </p>
      <p>
        Task and motion planning and execution. The supervisory system can also invoke
task and motion planning processes during the execution of the tasks. Dierent
task and motion planning methods can be available to the system and can be
associated to dierent contexts. The planning and execution process starts from
the executive system, where high level tasks are hierarchically decomposed into
sub-tasks at dierent levels of abstraction. The task decomposition process can
allocate path and motion planning processes. For instance, Figure 2 depicts task
and motion planning during the execution of simple cart-taking activity. Here,
the hospital map is provided, a Dijkstra-based path planning is deployed to
nd a feasible sequence of waypoints, while the navigation between waypoints
is performed using an RRT-based planner. In this case, task, path, and motion
planning are separated processes. In other cases, in the presence of more complex
activities involving multiple carts movement with dierent shapes in cluttered
environments, the system can also deploy combined task and motion planning
engines that take into account both logical and kinematic constraints (see e.g.
[
        <xref ref-type="bibr" rid="ref10">10</xref>
        ]). In this respect, we are currently investigating a RRT-based [
        <xref ref-type="bibr" rid="ref11">11</xref>
        ] combined
task and motion planning. Additional details will be provided in the simulated
case study.
      </p>
      <p>
        Physical human-robot interaction system. The proposed platform should also
support the human guidance (performed by hospital employees) as normal
passive carts, hence physical human-robot interaction has to be taken into account.
To this end the robotic system is endowed with seven load cells, which are
directly integrated in the lifting system as shown in Figure 3. Four of the seven
cells are positioned on the corners of the lifter allowing the robot to estimate the
weight and the center of mass of the cart (purple arrows), while the other three
are along the x and y and around the z axis of the lifter in order to estimate
the torque and the forces applied by the cart (blue, red and green arrows). This
mechanism allows the HRI module to estimate the forces due to the natural cart
shifting and to isolate only the external ones (provided by the human). When
relevant external forces are detected, a HRI behavior acquires the control of the
robot actuators in order to make the robot compliant with respect to the
human guidance. Notice that robot compliance here is needed at dierent levels of
abstraction, not only for the robot motion, but also at the path and task level.
In this respect, we are investigating how to adapt methods similar to the ones
proposed in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ] for collaborative manipulation tasks along with mechanisms for
mixed-initiative control with haptic feedback as in [
        <xref ref-type="bibr" rid="ref5">5</xref>
        ].
4
      </p>
    </sec>
    <sec id="sec-3">
      <title>Case Studies</title>
      <p>In this section, we describe the RoMoLO system at work in hospital
scenarios. In particular, the aim is to illustrate the following features: structured task
orchestration, task and motion planning, and human-robot interaction. The
testing environment is a 15x10m closed space composed by a corridor connecting 3
rooms through 3 openings of 1:2m width (Figure 2). The AGV has four
independent mecanum wheels, 4 LIDARs (one for each of the robot corner) for the
obstacle avoidance and a frontal camera for carts recognition using ARtags.
Flexible Task Execution. The rst case study consists of an autonomous cart
transportation from a room to another. The operation is performed by providing
the robot with high level commands. For instance, in Figure 4 (top right) the high
level task moveCart(marker4; room2; room3) is decomposed into two subtasks,
takeCart and leaveCart, which in turn are decomposed by the system till the
primitive actions (Figure 4 (top left)).</p>
      <p>The initial conguration of the task is the one depicted in Figure 4 (top left).
Initially, the robot is heading towards the room2 and it is reaching the
Landmark corr2 rst (middle and bottom, rst left). Then a sequence of four subtasks
(blue ovals in Figure 4 (top right)) is executed. The robot moves towards room2
(sutask 2). When the cart is detected by the robot (marker marker4), pickCart
is enabled (subtask 3) to reach an approach point, move the robot under the
cart and lift it. Once lifted the cart, takeCart is completed and leaveCart (in
room3) is enabled. When the robot carries a cart, the robot’s footprint in the
motionPlanner tasks is appropriately increased. Therefore, the task aects not
only logic constraints, but also the kinematic ones. Figure 4 (bottom) shows
how the robots size is updated when the cart is carried (third and fourth,
bottom). Notice also that multiple tasks can be allocated and exibly orchestrated
by the executive system. For instance, during navigation additional deliveries
may be on-line requested and opportunistically executed. Notice also that the
WM provides an explicit representation of the activities which are planned,
executed, enabled, disabled, etc., therefore it also supports task-level explainability.
The robot executive status can be inspected at dierent levels of abstraction,
while a human operator can also disable or enable activities at run-time. We
are currently investigation adaptive human-machine interfaces suitable for this
scenario.</p>
      <p>Manual carriage. In a dierent case study, manual carriage transport was
simulated using the estimate of external forces through the load cells of the lifting
system. Figure 5 shows the manual transport of the trolley from room room3 to
room room2. The force impressed by the human to move the trolley is between
1 and 2 kg. During the hand guidance, the robot and the human activities are
supervised and regulated by executive system, this way the robot can follow the
human guidance, while maintaining a compliant behavior. A specic HRI
be</p>
      <p>Goal
Cart2
placed
Cart1
placed</p>
      <p>Start</p>
      <p>Cart1
taken</p>
      <p>
        Cart2
taken
havior is activated to manage this interaction, but we are currently developing
and testing more complex interactions as in [
        <xref ref-type="bibr" rid="ref4">4</xref>
        ].
      </p>
      <p>Task and motion planning with two carts. In this case study, we consider a
simulated scenario where two carts are present. As illustrated in Figure 4 (left)
the robot has to move both carts outside of the room. Notice that this task can
only be performed by moving the left cart (cart1) before the right one (cart2)
because the second one is blocking the room opening. In this particular case,
decoupled task and motion planning can be ineective: the executive system may
select the wrong cart to be moved rst and this fault will be detected during
the execution, in so inducing replanning. In order to avoid these situations, we
developed an integrated task and motion planner. In particular, in the proposed
approach, task and motion constraints are handled by an extended RRT-based
planning system, which generates not only the robot movement, but also the
tasks the robot is to execute in order to reach the goal state. In the case of
the two carts, the result of this combined task and motion planning process is
depicted in Figure (right) where the blue rectangles represent samples of the
robot plan. In the planned sequence the robot rstly takes cart1 from the room
leaving it in the right-position, afterwards the cart2 can be taken and transported
outside to the left-position. The integrated plan can be generated in about 3 sec
(3:11 avg and 1:67 std of 30 runs on a platform Intel i5 5200U 2:20GHz,
8Gb ram with a single threaded implementation). We are currently carrying out
tests in simulation to assess the performance of the integrated task and motion
planner in dierent contexts.
5</p>
    </sec>
    <sec id="sec-4">
      <title>Conclusion</title>
      <p>We presented the control architecture of a modular robotic system designed for
hospital logistics. We described the overall system that enables exible execution
of multiple complex tasks. We discuss the system at work in dierent
scenarios considering both autonomous and interactive tasks. In this scenario, we are
currently investigating: i) human guidance in the presence of complex tasks; ii)
human-machine interfaces for the logistic scenario; iii) methods for integrated
task and motion planning, where both logical and kinematic constraints are
considered.</p>
      <p>Acknowledgement. The research leading to these results has been supported by
the H2020-ICT-731590 REFILLs, MISE ROMOLO, and MIUR PON ICOSAF.</p>
    </sec>
  </body>
  <back>
    <ref-list>
      <ref id="ref1">
        <mixed-citation>
          1. -api
          <string-name>
            <surname>¢</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Novakovi</surname>
            <given-names>¢</given-names>
          </string-name>
          , ., Milenkov,
          <string-name>
            <surname>P.</surname>
          </string-name>
          :
          <article-title>Hospital logistics</article-title>
          .
          <source>In: 2nd Logistics International Conference</source>
          . Belgrade: LOGIC. pp.
          <volume>309314</volume>
          (
          <year>2015</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref2">
        <mixed-citation>
          2. Ba£k, J., urovsky, F.,
          <string-name>
            <surname>Biro</surname>
            <given-names>†</given-names>
          </string-name>
          ,
          <string-name>
            <given-names>M.</given-names>
            ,
            <surname>Kyslan</surname>
          </string-name>
          ,
          <string-name>
            <given-names>K.</given-names>
            ,
            <surname>PerdukovÆ</surname>
          </string-name>
          ,
          <string-name>
            <given-names>D.</given-names>
            ,
            <surname>Padmanaban</surname>
          </string-name>
          ,
          <string-name>
            <surname>S.</surname>
          </string-name>
          :
          <article-title>Pathnderdevelopment of automated guided vehicle for hospital logistics</article-title>
          .
          <source>IEEE Access 5</source>
          ,
          <issue>2689226900</issue>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref3">
        <mixed-citation>
          3.
          <string-name>
            <surname>Bloss</surname>
          </string-name>
          , R.:
          <article-title>Mobile hospital robots cure numerous logistic needs</article-title>
          .
          <source>Industrial Robot: An International Journal</source>
          <volume>38</volume>
          (
          <issue>6</issue>
          ),
          <volume>567571</volume>
          (
          <year>2011</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref4">
        <mixed-citation>
          4.
          <string-name>
            <surname>Cacace</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Caccavale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lippiello</surname>
            ,
            <given-names>V.</given-names>
          </string-name>
          :
          <article-title>Interactive plan execution during human-robot cooperative manipulation</article-title>
          .
          <source>IFAC-PapersOnLine</source>
          <volume>51</volume>
          (
          <issue>22</issue>
          ),
          <volume>500505</volume>
          (
          <year>2018</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref5">
        <mixed-citation>
          5.
          <string-name>
            <surname>Cacace</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lippiello</surname>
          </string-name>
          , V.:
          <article-title>A mixed-initiative control system for an aerial service vehicle supported by force feedback</article-title>
          .
          <source>In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems</source>
          , Chicago, IL, USA, September
          <volume>14</volume>
          -
          <issue>18</issue>
          ,
          <year>2014</year>
          . pp.
          <fpage>12301235</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2014</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref6">
        <mixed-citation>
          6.
          <string-name>
            <surname>Caccavale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Cacace</surname>
            ,
            <given-names>J.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fiore</surname>
            ,
            <given-names>M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Alami</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Attentional supervision of human-robot collaborative plans</article-title>
          .
          <source>In: Robot and Human Interactive Communication (RO-MAN)</source>
          ,
          <year>2016</year>
          25th IEEE International Symposium on. pp.
          <fpage>867873</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2016</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref7">
        <mixed-citation>
          7.
          <string-name>
            <surname>Caccavale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Flexible task execution and attentional regulations in human-robot interaction</article-title>
          .
          <source>IEEE Transactions on Cognitive and Developmental Systems</source>
          <volume>9</volume>
          (
          <issue>1</issue>
          ),
          <volume>6879</volume>
          (
          <year>2017</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref8">
        <mixed-citation>
          8.
          <string-name>
            <surname>Caccavale</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Finzi</surname>
            ,
            <given-names>A.</given-names>
          </string-name>
          :
          <article-title>Learning attentional regulations for structured tasks execution in robotic cognitive control</article-title>
          .
          <source>Auton. Robots</source>
          <volume>43</volume>
          (
          <issue>8</issue>
          ),
          <volume>22292243</volume>
          (
          <year>2019</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref9">
        <mixed-citation>
          9.
          <string-name>
            <surname>Cooper</surname>
            ,
            <given-names>R.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shallice</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Contention scheduling and the control of routine activities</article-title>
          .
          <source>Cognitive Neuropsychology</source>
          <volume>17</volume>
          ,
          <issue>297338</issue>
          (
          <year>2000</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref10">
        <mixed-citation>
          10.
          <string-name>
            <surname>Kaelbling</surname>
            ,
            <given-names>L.P.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Lozano-PØrez</surname>
          </string-name>
          , T.:
          <article-title>Hierarchical task and motion planning in the now</article-title>
          .
          <source>In: Proceedings of the 1st AAAI Conference on Bridging the Gap Between Task and Motion Planning</source>
          . pp.
          <fpage>3342</fpage>
          . AAAIWS'
          <fpage>10</fpage>
          -
          <lpage>01</lpage>
          (
          <year>2010</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref11">
        <mixed-citation>
          11.
          <string-name>
            <surname>LaValle</surname>
            ,
            <given-names>S.M.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Jr.</surname>
            ,
            <given-names>J.J.K.</given-names>
          </string-name>
          :
          <article-title>Randomized kinodynamic planning</article-title>
          .
          <source>In: 1999 IEEE International Conference on Robotics and Automation</source>
          . pp.
          <volume>473479</volume>
          (
          <year>1999</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref12">
        <mixed-citation>
          12.
          <string-name>
            <surname>Norman</surname>
            ,
            <given-names>D.A.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Shallice</surname>
            ,
            <given-names>T.</given-names>
          </string-name>
          :
          <article-title>Attention to action: Willed and automatic control of behavior</article-title>
          . In:
          <article-title>Consciousness and self-regulation: Advances in research and theory</article-title>
          , vol.
          <volume>4</volume>
          , pp.
          <volume>118</volume>
          (
          <year>1986</year>
          )
        </mixed-citation>
      </ref>
      <ref id="ref13">
        <mixed-citation>
          13.
          <string-name>
            <surname>Ozkil</surname>
            ,
            <given-names>A.G.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Fan</surname>
            ,
            <given-names>Z.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Dawids</surname>
            ,
            <given-names>S.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Aanes</surname>
            ,
            <given-names>H.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Kristensen</surname>
            ,
            <given-names>J.K.</given-names>
          </string-name>
          ,
          <string-name>
            <surname>Christensen</surname>
            ,
            <given-names>K.H.</given-names>
          </string-name>
          :
          <article-title>Service robots for hospitals: A case study of transportation tasks in a hospital</article-title>
          .
          <source>In: 2009 IEEE international conference on automation and logistics</source>
          . pp.
          <fpage>289294</fpage>
          .
          <string-name>
            <surname>IEEE</surname>
          </string-name>
          (
          <year>2009</year>
          )
        </mixed-citation>
      </ref>
    </ref-list>
  </back>
</article>