Abstract
Dialogue breakdown detection is a technique used for identifying inappropriate utterances in dialogue systems that has attracted increased attention, especially in chat-oriented dialogue systems. Although it is generally assumed that dialogue breakdown detection avoids generating system responses that then cause difficulties in continuing the given dialogue, this has yet to be verified experimentally or theoretically. In this paper, we apply the dialogue breakdown detection technique to generate responses for a chat-oriented dialogue system and experimentally verify that performance is improved by measuring the extent to which dialogue breakdown is avoided. Our experimental results show that dialogue breakdown detection indeed is able to improve the appropriateness of system responses; however, short, simple, and dull responses tend to increase when using this technique.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cromieres F (2016) Kyoto-NMT: a neural machine translation implementation in chainer. In: Proceedings of COLING 2016: system demonstrations, pp 307–311
Geurts P, Ernst D, Wehenkel L (2006) Extremely randomized trees. Mach Learn 63(1):3–42
Higashinaka R, Funakoshi K, Inaba M, Arase Y, Tsunomori Y (2016) The dialogue breakdown detection challenge 2. SIG-SLUD B5(02):64–69
Higashinaka R, Funakoshi K, Yuka K, Inaba M (2016) The dialogue breakdown detection challenge: task description, datasets, and evaluation metrics. In: 10th edition of the language resources and evaluation conference
Higashinaka R, Funakoshi K, Inaba M, Tsunomori Y, Takahashi T, Kaji N (2017) Overview of dialogue breakdown detection challenge 3. In: Proceedings of dialog system technology challenge 6 (DSTC6) workshop
Inaba M, Takahashi K (2016) Neural utterance ranking model for conversational dialogue systems. In: 17th annual meeting of the special interest group on discourse and dialogue, pp 393–403
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems, pp 3111–3119
Mori H, Araki M (2016) Selection method of an appropriate response in chat-oriented dialogue systems. In: Proceedings of the 17th annual meeting of the special interest group on discourse and dialogue, pp 228–231
Ritter A, Cherry C, Dolan WB (2011) Data-driven response generation in social media. In: Proceedings of the conference on empirical methods in natural language processing, pp 583–593
Sugiyama H (2016) Chat-oriented dialogue breakdown detection based on the analysis of error patterns in utterance generation. SIG-SLUD B5(02):81–84
Sugiyama H (2016) Utterance selection based on sentence similarities and dialogue breakdown detection on NTCIR-12 STC task, pp 552–553
Sugiyama H (2017) Dialogue breakdown detection based on estimating appropriateness of topic transition. In: Dialog system technology challenges (DSTC6)
Wallace R (2008) The anatomy of A.L.I.C.E. parsing the turing test, pp 181–210
Weizenbaum J (1966) ELIZA-a computer program for the study of natural language communication between man and machine. Commun ACM 9(1):36–45
Acknowledgements
This study received a grant of JSPS Grants-in-aid for Scientific Research 16H05880.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Inaba, M., Takahashi, K. (2019). Improving the Performance of Chat-Oriented Dialogue Systems via Dialogue Breakdown Detection. In: D'Haro, L., Banchs, R., Li, H. (eds) 9th International Workshop on Spoken Dialogue System Technology. Lecture Notes in Electrical Engineering, vol 579. Springer, Singapore. https://doi.org/10.1007/978-981-13-9443-0_30
Download citation
DOI: https://doi.org/10.1007/978-981-13-9443-0_30
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9442-3
Online ISBN: 978-981-13-9443-0
eBook Packages: Literature, Cultural and Media StudiesLiterature, Cultural and Media Studies (R0)