← 返回资源分享
Recipes for building an open-domain chatbot
论文
论文
发布时间2020-04-28
发表EACL 2021 2 · arXiv:2004.13637
作者:Jing Xu,Emily Dinan,Jason Weston,Y-Lan Boureau,Stephen Roller,Kurt Shuster,Myle Ott,Yinhan Liu,Naman Goyal,Da Ju,Mary Williamson,Eric M. Smith
详细介绍
Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, and displaying knowledge, empathy and personality appropriately, while maintaining a consistent persona. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.
代码仓库 (8)
huggingface/transformersPyTorch
facebookresearch/ParlAIPyTorch
hihellohowareyou/RESREF_Chatbot_data_for_KoreanPyTorch
hitchingsh/ml-examplesTensorFlow
kevinng77/blenderbot_paddlePaddlePaddle
PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/blenderbotPaddlePaddle
abhaskumarsinha/Keras-BlenderbotTensorFlow
pwc-1/Paper-8/tree/main/blenderbot_smallMindSpore
