Symbiotic Interaction and Harmonious Collaboration for Wisdom Computing (SymCollab 2018) Kenji Mase Norihiro Hagita Yukiko Nakano Nagoya University ATR Intelligent Robotics and Seikei University Nagoya, Japan Communication Labs, Kyoto, Japan Musashino, Japan mase@nagoya-u.jp hagita@atr.jp y.nakano@st.seikei.ac.jp ABSTRACT 5.5 year project of the CREST, team-oriented research pro- This half-day workshop introduce the state-of-the-art tech- gram [1]. It has also promoted the sister CREST program on nologies on HCI for symbiotic society. They come from “Intelligent Systems creating co-experience knowledge and wisdom with human-machine harmonious collaboration” team-oriented research programs (CREST); “Symbiotic that started in 2014 by the leadership of the Research Super- Interaction” and “Harmonious Collaboration” between hu- visor, Norihiro Hagita [2]. man and computers, organized by the Japan Science and Technology Agency (JST). This workshop will introduce several research projects in these two CREST programs. It is also open for the presenta- Author Keywords tions of the following topics that may be the candidates of Symbiotic Interaction; Augmented Human; Ambient Intelli- future research proposals. gence; Human-Robot Interaction; Human Agent Interaction; Ethical, Legal, Social and Economic Issues. - Human Augmentation: ACM Classification Keywords advanced multi-modal communication, advanced H.5.m. Information interfaces and presentation (e.g., HCI): collaborative work, community formation Miscellaneous - Ambient Intelligence: WORKSHOP TOPIC AND GOAL interaction with intelligent agents, robots, etc., The cyber-physical world is advancing rapidly based on the interaction design for intelligent systems; self-driving technologies of artificial intelligence, robotics and IoT. The cars and smart homes, networked life-logging environ- symbiotic society requires to design novel interactions be- ments tween humans and computers in order to maximize the ben- - Fundamental interaction theory and modeling: efit to humans, considering ethical, legal, social and eco- modeling of augmented-human interactions, system nomic (ELSE) issues. They include augmented humans, con- design principles based on relations between humans nected things, ambient intelligence (i.e., a smart intelligence and ambient intelligences environment), internet of wisdoms, etc. At the same time, however, as ICT reaches deeper and deeper into society, the - Co-experience knowledge and wisdom with harmoni- volume of information emanating from the Internet, mobile ous human-machine collaboration, services with hu- devices, sensors, robots, IoT, and other sources continues to man-robot interaction and collaboration, wearable sen- rise, leading to problems in terms of the inability to effec- sors, and the development of an open platform using the tively apply knowledge gained from these sources and creat- state-of-the-art technologies ing new problems regarding matters such as ethical, legal, social and economic (ELSE) issues. OUTLINE OF THE WORKSHOP This workshop, therefore, focuses on advanced interaction, The workshop program will start from overview of two called “symbiotic interaction,” and its intelligent systems CREST programs: “Harmonious collaboration” by profes- with “harmonious collaboration” between human and com- sor Norihiro Hagita and “Symbiotic Interaction” between hu- puters for the symbiotic society. The Japan Science and man and computers, professor Kenji Mase, respectively. Pro- Technology Agency (JST) has started a new research pro- fessor Daniel Gatica-Perez from Idiap research institute, gram to create and develop the core technologies that realize Switzer-land will give a keynote talk about multimodal in- the symbiotic interaction based on understanding and design- teraction and then position and full paper sessions. We have ing interactions in a symbiotic society; “Symbiotic Interac- two full papers and six position papers. The accepted papers tion: Creation and development of core technologies inter- covered the broad range of areas targeted by the CREST pro- facing human and information environments” in 2017 as an grams. In the area of Human Augmentation, Koike et al. pro- posed a skill acquisition mechanism and developed Skill © 2018. Copyright for the individual papers remains with the authors. Cop- Transfer systems. Fang et al. proposed an Interactive Selfie ying permitted for private and academic purposes. application in which crowdsourcing-based learning is uti- SymCollab '18, March 11, Tokyo, Japan. lized to define good head postures. In the topic of Ambient Intelligence, Nakazawa introduced a project that aims to un- Technology from the University of Tokyo, Japan. With derstand and support the tender care skill Humanitude, and the goal of allowing more natural human-computer inter- Watanabe et al. proposed a concept: “Implicit Ambient Sur- action, she has addressed issues on modelling conversa- face Information” (IASI), which was applied to measuring tions by analyzing human verbal and nonverbal commu- athlete’s physiological states and body movements. There nicative behaviors, and developing Multimodal Conver- are two papers concerning the topic of Fundamental interac- sational Interfaces (MCIs) based on the empirical models. tion theory and modeling. Tsuda et al. introduced a project http://www.ci.seikei.ac.jp/nakano/index_e.html focusing on the principle of Emerging Interactions that pro- duces functional differentiation via interaction with complex environment. Tomiyama et al. proposed a model for Dis- SENIOR ADVISORS course Segmentation for group discussions using deep learn-  Minoru Asada (Osaka University, JAPAN) ing. For co-experience knowledge and wisdom, Satake and Kanda reported a situation where robot activity is interrupted  Andreas Bulling (Max Planck Institute for Informatics, by children and claimed the necessity of Moral Interaction Germany) in human-robot interaction. A paper by Suzuki described the  Daniel Gatica-Perez (Idiap research institute, Switzer- overview of Social Imaging technologies and its application land) to empower people with social impairments.  Hans Gellersen (Lancaster University, UK) ORGANIZERS  Kenji Mase (primary contact person): Kenji Mase re- ACKNOWLEGDEMENT ceived the B.E. degree in Electrical Engineering and the This workshop and its presented works have been supported M.E.and Ph.D. degrees in Information Engineering by JST CREST. We thank to all the PC members: Dragan from Nagoya University in 1979, 1981 and 1992 Ahmetovic (CMU, USA), Takashi Miyaki (University of To- kyo, Japan), Atsushi Nakazawa (Kyoto University, Japan), respectively. He is now with the Graduate School Nick Rhinehart (CMU, USA), Satoru Satake (ATR, Japan), of Informatics, Nagoya University. He joined the Yonghao Yue (University of Tokyo, Japan), and Xucong Nippon Telegraph and Telephone Corporation Zhang (Max Planck Institute for Informatics, Germany). NTT) in 1981 and had been with the NTT Human They took their great effort to review the submitted papers. Interface Laboratories. He was a visiting re- searcher at the Media Laboratory, MIT in 1988- 1989. He has been with ATR (Advanced Telecom- REFERENCES munications Research Institute) in 1995-2002. His re- 1. https://www.jst.go.jp/kisoken/crest/en/re- search interests include gesture recognition, artificial in- search_area/ongoing/areah29-4.html telligence and their applications for computer-aided com- 2. https://www.jst.go.jp/kisoken/crest/en/re- munications, wearable/ubiquitous computers and lifelog. search_area/ongoing/areah26-2.html http://www.cmc.is.i.nagoya-u.ac.jp  Norihiro Hagita: Norihiro Hagita received the B.E., M.E., and Ph.D. degrees in electrical engineering from Keio University in 1976, 1978, and 1986. In 1978, he joined Nippon Telegraph and Telephone Public Corporation (Now NTT). He is currently Board Director of ATR and ATR Fellow, director of the Intelligent Robotics and Communication Laboratories. He is also a visiting pro- fessor of Nara Institute of Science and Technology, Osaka University and Keio University. His major inter- ests are cloud networked robotics, human-robot interac- tion, ambient intelligence, pattern recognition and learn- ing. http://www.irc.atr.jp/hagita/hagita.html  Yukiko Nakano: Yukiko Nakano is a professor in the De- partment of Computer and Information Science at Seikei University, Japan, and leading the Intelligent User Inter- face Laboratory (IUI lab). She received her M.S. in Me- dia Arts and Sciences from Massachusetts Institute of Technology, USA, and Ph.D. in Information Science and