A System Layout for Cognitive Service Robots

Abstract

-In this paper we discuss a system layout for cognitive service robots. The goal is to sketch components and their interplay needed for cognitive robotics as introduced by Ray Reiter. We are particularly interested in applications in domestic service robotics where we focus on integrating qualitative reasoning and human-robot interaction. The overall objective is to build and maintain a knowledge-based system and agent specification.

-

II. A COGNITIVE SERVICE ROBOT SYSTEM LAYOUT We now discuss a system layout for such a cognitive service robot in domestic applications. Figure 1 shows an overview of the elements that we think are necessary and useful for a cognitive robotic system. The particular focus here is on integrating qualitative reasoning and human-robot interaction [ 7 ], [ 8 ] for applications in domestic domains [ 11 ].

The blue elements are components that provide basic capabilities like collision avoidance and localization. The green boxes represent high-level components, that is, components featuring a sophisticated reasoning mechanism. We use a logic-based high-level language called ReadyLog [ 4 ] which, among other things, features decision-theoretic planning in the spirit of [ 2 ]. The orange components bridge between the high-level and the human or extend the high-level with mechanisms to facilitate intuitive interaction. The yellow box finally, is an optional but desirable component to enable e c n a n e t n i a M lfe S l o r t n o C y z z u F

High-level Reasoning

iev -n o& anum itsoon t ilaauQ rseeepR ittsan H N t

Base Components

l ita son ign a Sp ita on e t s iv en ea ta se R tauQ repR and li

N atural L Interpretaatniognuage s itc ion n t a ta eSm onnA

um BInsitcerHaction M a an-Roodbuoltes

Fig. 1: A cognitive service robot system layout enduring autonomy. It is an extension of the high-level control that has tight connections to the basic components.

A. Basic Human-Robot Interaction Modules

Our domestic service robot is supposed to interact with laymen. Hence, it needs to be operable by such laymen and the interaction between the human and the robot needs to be as natural and intuitive as possible. This is why we argue for extending the basic capabilities with modules for three important human-robot interaction components, namely speech, face, and gesture recognition. Examplary solutions for such components tailored for the particular application scenarios can be found in [ 3 ], [ 1 ], and [ 9 ] respectively. We consider these components since they represent (perhaps the most) important modalities in human-robot interaction. Human-robot interaction can be made even more natural and affective with additional components such as text-to-speech and an animated visual appearance.

B. High-level Reasoning

A domestic service robot that needs to assist humans with complex and cognitively challenging tasks, must be endowed with some form of reasoning that allows it to take decisions in such complex scenarios. This high-level reasoning abstracts from the details of lower levels and provides mechanisms to come up with a dedicated course of action for a robot to reach a particular goal. Our robot features a logic-based high-level reasoning component for that purpose. It allows for flexibly combining programming and planning in the behavior specification of the robot.

One of the issues in developing a robotic system that interacts with humans is the difference in representations with humans and machines. A technical system mostly uses numbers to represent things like speed, distance, and orientation while humans use imprecise linguistic notions. A robotic system that assists humans in their daily life, must be equipped with means to understand and to communicate with humans in terms and with notions that are natural to humans. The qualitative representations and reasoning with them should be available especially for positional information (e.g. as proposed in [ 12 ]) since these are very frequent in domestic settings, for example, with references to objects and places.

D. Semantic Annotations

Another building block to mediate between the raw sensor data and the numerical information that the base components of a cognitive robot work with are semantic annotations. In our cognitive robot system, for instance, we allow for generating semantically annotated maps [ 10 ]. This attaches semantic information to places like functions of a room or where it is likely to find people in an apartment. Another example could be part of the object recognition [ 6 ], where objects are described by a set of (semantic) attributes. This way, one can dynamically build classes of objects, for example, all objects with a specific color.

E. Natural Language Interpretation

Humans tend to be imprecise and imperfect in their natural spoken language. Therefore, when natural language is used to give instructions to a robot, the robot is potentially confronted with incomplete, ambiguous, or even incorrect commands. Aiming for a robust and flexible system a method for natural language interpretation that can account for handling such fallibility is beneficial. We present such a system [ 13 ] that uses decision-theoretic planning in the spirit of DT-Golog [ 2 ] to interpret the instruction given to the robot. It is able to account for imprecise and missing information and initiates steps for clarification accordingly.

F. Self-Maintenance

A robotic system that is capable of planning and executing complex tasks is a complex system itself. That is why such a system is itself vulnerable to errors. These errors are not restricted to action execution but span to internal system errors as well. As an additional component in the system layout we proposed a system for self-maintenance [ 14 ] that is able to detect and circumvent certain errors. Thus we increase the system’s robustness and enable longer-term autonomous operation.

III. CONCLUSION

In this paper, we discussed the layout of a cognitive service robotic system that integrates qualitative reasoning and human-robot interaction for applications in domestic service robotics. The system layout features components that allow for implementing a capable service robotic system. The layout addresses bridging the gap between the robot and the human with several measures, making available the qualitative notions that humans commonly use in the robot system, in general, and in the high-level reasoning, in particular. This allows for natural interaction and with its advanced reasoning the robot can assist its human users with complex and cognitively challenging tasks. This is especially useful with disabled or elderly people.

References

[1] Vaishak Belle , Thomas Deselaers, and Stefan Schiffer . Randomized trees for real-time one-step face detection and recognition . In Proc. Int'l Conf. on Pattern Recognition (ICPR'08) , pages 1 - 4 . IEEE Computer Society, December 8-11 2008 .

[2] Craig Boutilier , Ray Reiter, Mikhail Soutchanski, and Sebastian Thrun . Decision-theoretic, high-level agent programming in the situation calculus . In Proc. Nat'l Conf. on Artificial Intelligence (AAAI-00) , pages 355 - 362 , Menlo Park, CA, July 30- 3 2000 . AAAI Press.

[3] Masrur Doostdar , Stefan Schiffer, and Gerhard Lakemeyer . Robust speech recognition for service robotics applications . In Proc. Int'l RoboCup Symposium (RoboCup 2008 ), volume 5399 of LNCS , pages 1 - 12 . Springer, July 14 -18 2008 .

[4] Alexander Ferrein and Gerhard Lakemeyer . Logic-based robot control in highly dynamic domains . Robotics and Autonomous Systems , 56 ( 11 ): 980 - 991 , 2008 .

[5] Hector J. Levesque and Gerhard Lakemeyer . Cognitive Robotics . In Frank van Harmelen, Vladimir Lifschitz , and Bruce Porter, editors, Handbook of Knowledge Representation , chapter 23 , pages 869 - 886 . Elsevier, 2008 .

[6] Tim Niemueller , Stefan Schiffer, Gerhard Lakemeyer, and Safoura Rezapour-Lakani. Life-long learning perception using cloud database technology . In Proc. IROS Workshop on Cloud Robotics , 2013 .

[7] Stefan Schiffer . Integrating Qualitative Reasoning and Human-Robot Interaction for Domestic Service Robots . Dissertation, RWTH Aachen University, Department of Computer Science, Feb 2015 .

[8] Stefan Schiffer . Integrating qualitative reasoning and human-robot interaction in domestic service robotics . KI - Ku¨nstliche Intelligenz , 30 ( 3 ): 257 - 265 , 2016 .

[9] Stefan Schiffer , Tobias Baumgartner, and Gerhard Lakemeyer . A modular approach to gesture recognition for interaction with a domestic service robot . In Intelligent Robotics and Applications , pages 348 - 357 . Springer, 2011 .

[10] Stefan Schiffer , Alexander Ferrein, and Gerhard Lakemeyer . Football is coming home . In Proc. 2006 Int'l Symp. on Practical Cognitive Agents and Robots (PCAR'06) , pages 39 - 50 , New York, NY, USA, November 27 -28 2006 . ACM.

[11] Stefan Schiffer , Alexander Ferrein, and Gerhard Lakemeyer . CAESAR - An Intelligent Domestic Service Robot . Journal of Intelligent Service Robotics , pages 1 - 15 , 2012 .

[12] Stefan Schiffer , Alexander Ferrein, and Gerhard Lakemeyer . Reasoning with Qualitative Positional Information for Domestic Domains in the Situation Calculus . Journal of Intelligent and Robotic Systems , 66 ( 1- 2 ): 273 - 300 , 2012 .

[13] Stefan Schiffer , Niklas Hoppe, and Gerhard Lakemeyer . Natural language interpretation for an interactive service robot in domestic domains . In Agents and Artificial Intelligence , volume 358 , pages 39 - 53 . Springer, 2013 .

[14] Stefan Schiffer , Andreas Wortmann, and Gerhard Lakemeyer. SelfMaintenance for Autonomous Robots controlled by ReadyLog . In Proc. IARP Workshop on Technical Challenges for Dependable Robots in Human Environments , pages 101 - 107 , Toulouse, France, June 16-17 2010 .

[15] Thomas Wisspeintner , Tijn van der Zant, Luca Iocchi, and Stefan Schiffer. RoboCup@Home: Scientific Competition and Benchmarking for Domestic Service Robots . Interaction Studies , 10 ( 3 ): 392 - 426 , 2009 .