=Paper=
{{Paper
|id=Vol-2935/keynote1
|storemode=property
|title=Challenges for Chat-oriented Dialogue Systems --Experience from the Dialogue Breakdown Detection Challenge and the Dialogue System Live Competition-- (abstract)
|pdfUrl=https://ceur-ws.org/Vol-2935/keynote1.pdf
|volume=Vol-2935
|authors=Ryuichiro Higashinaka
}}
==Challenges for Chat-oriented Dialogue Systems --Experience from the Dialogue Breakdown Detection Challenge and the Dialogue System Live Competition-- (abstract)==
<pdf width="1500px">https://ceur-ws.org/Vol-2935/keynote1.pdf</pdf>
<pre>
LaCATODA 2021 Invited Talk

Ryuichiro Higashinaka

Challenges for chat-oriented dialogue systems ---Experience from the
dialogue breakdown detection challenge and the dialogue system live
competition---

Abstract

Although many chat-oriented dialogue systems are emerging and showing promising
results, their performance is still limited and the dialogue with a system often breaks
down. To counter dialogue breakdowns, I have been leading dialogue breakdown
detection challenges, the aim of which is to develop algorithms to detect
inappropriate utterances by the system so that dialogue breakdowns can be avoided.
In this talk, I will go over the past challenges and mention the current performance of
dialogue breakdown detection and the types of errors that still need to be tackled. In
addition, I will describe the dialogue system live competitions that I have also been
involved with, in which the audience, consisting mainly of researchers in the dialogue
community, watch and evaluate a live dialogue conducted between users and dialogue
systems. The motivation behind the event is to cultivate state-of-the-art techniques in
chat-oriented dialogue systems and enable the dialogue community to share the
problems with current dialogue systems. I will talk about the lessons learnt from
organizing the event and mention possible directions for the dialogue systems
community.

Invited Speaker’s Bio

Ryuichiro Higashinaka received his B.A. degree in Environmental Information,
Masters in Media and Governance, and Ph.D. from Keio University, Kanagawa, in
1999, 2001, and 2008, respectively. He joined NTT corporation in 2001. He is
currently a professor at Nagoya University. He is a visiting senior distinguished
researcher at NTT Media Intelligence Laboratories. His research interests include
building question-answering systems and spoken-dialogue systems. From November
2004 to March 2006, he was a visiting researcher at the University of Shef eld, UK.
He received the “Commendation for Science and Technology by the Minister of
Education, Culture, Sports, Science and Technology” in 2016. He was a program co-
chair for SIGDIAL2016. Since 2017, he has been serving the SIGdial board. He has
worked as area chair (dialogue and interactive systems track) for
ACL2019/2020/2021, EMNLP2019, and NAACL2021.
                                                                 fi

</pre>