Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight

Abstract

Current state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. However, due to the open-ended nature of human conversations, the quality of user-generated training data varies greatly, and effective training samples are typically insufficient while noisy samples frequently appear. This impedes the learning of those data-driven neural dialogue models. Therefore, effective dialogue learning requires not only more reliable learning samples, but also fewer noisy samples. In this paper, we propose a data manipulation framework to proactively reshape the data distribution towards reliable samples by augmenting and highlighting effective learning samples as well as reducing the effect of inefficient samples simultaneously. In particular, the data manipulation model selectively augments the training samples and assigns an importance weight to each instance to reform the training data. Note that, the proposed data manipulation framework is fully data-driven and learnable. It not only manipulates training samples to optimize the dialogue generation model, but also learns to increase its manipulation skills through gradient descent with validation samples. Extensive experiments show that our framework can improve the dialogue generation performance with respect to various automatic evaluation metrics and human judgments. * Work done at Data Science Lab, JD.com. ine ffic ien t co nv er sa tio ns augmentation reweighting eff ec tiv e co nv er sa tio ns au gm en te d eff ec tiv e co nv er sa tio ns

Energy-based Unknown Intent Detection with Data Manipulation

“…Second, our framework additionally contains a weighting module to reform the generated utterances. Our work is also inspired by Cai et al (2020), which proposes a framework to augment the IND data, while our framework aims to generate OOD data.…”

An Analysis of Simple Data Augmentation for Named Entity Recognition

“…Recently, there is an increased interest on applying data augmentation techniques on sentence-level and sentence-pair natural language processing (NLP) tasks, such as text classification (Wei and Zou, 2019;Xie et al, 2019), natural language inference (Min et al, 2020) and machine translation . Augmentation methods explored for these tasks either create augmented instances by manipulating a few words in the original instance, such as word replacement (Zhang et al, 2015;Wang and Yang, 2015;Cai et al, 2020), random deletion (Wei and Zou, 2019), or word position swap (Ş ahin and Steedman, 2018;Min et al, 2020); or create entirely artificial instances via generative models, such as variational auto encoders (Yoo et al, 2019;Mesbah et al, 2019) or back-translation models (Yu et al, 2018;Iyyer et al, 2018).…”

Diversifying Dialog Generation via Adaptive Label Smoothing

“…The backbone of our model is the transformerbased sequence to sequence model (Vaswani et al, 2017), and most hyper-parameters follow Cai et al (2020). Specifically, the encoder and decoder each contains 6 layers.…”