Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems

28 August 2021

Boi Faltings

Papers citing "Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems"

42 / 42 papers shown

Title
Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue State Tracking Zhaojiang Lin Bing-Quan Liu Seungwhan Moon Paul A. Crook Zhenpeng Zhou Zhiguang Wang Zhou Yu Andrea Madotto Eunjoon Cho R. Subba 63 90 0 10 May 2021
SlimIPL: Language-Model-Free Iterative Pseudo-Labeling Tatiana Likhomanenko Qiantong Xu Jacob Kahn Gabriel Synnaeve R. Collobert VLM 80 63 0 22 Oct 2020
Self-training Improves Pre-training for Natural Language Understanding Jingfei Du Edouard Grave Beliz Gunel Vishrav Chaudhary Onur Çelebi Michael Auli Ves Stoyanov Alexis Conneau VLM LRM SSL 45 164 0 05 Oct 2020
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems Fei Mi Liangwei Chen Mengjie Zhao Minlie Huang Boi Faltings CLL KELM 41 70 0 02 Oct 2020
SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness Nathan Ng Kyunghyun Cho Marzyeh Ghassemi 71 146 0 21 Sep 2020
Uncertainty-aware Self-training for Text Classification with Few Labels Subhabrata Mukherjee Ahmed Hassan Awadallah UQLM 36 43 0 27 Jun 2020
Rethinking Pre-training and Self-training Barret Zoph Golnaz Ghiasi Nayeon Lee Huayu Chen Hanxiao Liu E. D. Cubuk Quoc V. Le SSeg 78 651 0 11 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 665 41,736 0 28 May 2020
Improved Noisy Student Training for Automatic Speech Recognition Daniel S. Park Yu Zhang Ye Jia Wei Han Chung-Cheng Chiu Yue Liu Yonghui Wu Quoc V. Le 90 242 0 19 May 2020
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching Baolin Peng Chunyuan Li Jinchao Li Shahin Shayandeh Lars Liden Jianfeng Gao 96 125 0 11 May 2020
A Self-Training Method for Machine Reading Comprehension with Soft Evidence Extraction Yilin Niu Fangkai Jiao Mantong Zhou Ting Yao Jingfang Xu Minlie Huang SyDa 47 34 0 11 May 2020
A Simple Language Model for Task-Oriented Dialogue Ehsan Hosseini-Asl Bryan McCann Chien-Sheng Wu Semih Yavuz R. Socher 81 527 0 02 May 2020
MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification Jiaao Chen Zichao Yang Diyi Yang VLM 80 363 0 25 Apr 2020
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue Chien-Sheng Wu Guosheng Lin R. Socher Caiming Xiong 56 321 0 15 Apr 2020
Few-shot Natural Language Generation for Task-Oriented Dialog Baolin Peng Chenguang Zhu Chunyuan Li Xiujun Li Jinchao Li Michael Zeng Jianfeng Gao 72 201 0 27 Feb 2020
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures Gabriel Synnaeve Qiantong Xu Jacob Kahn Tatiana Likhomanenko Edouard Grave Vineel Pratap Anuroop Sriram Vitaliy Liptchinsky R. Collobert SSL AI4TS 105 247 0 19 Nov 2019
Self-training with Noisy Student improves ImageNet classification Qizhe Xie Minh-Thang Luong Eduard H. Hovy Quoc V. Le NoLa 288 2,387 0 11 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 371 20,053 0 23 Oct 2019
Revisiting Self-Training for Neural Sequence Generation Junxian He Jiatao Gu Jiajun Shen MarcÁurelio Ranzato SSL LRM 273 272 0 30 Sep 2019
Self-Training for End-to-End Speech Recognition Jacob Kahn Ann Lee Awni Y. Hannun SSL 58 235 0 19 Sep 2019
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction Stefan Larson Anish Mahendran Joseph Peper Christopher Clarke Andrew Lee ... Jonathan K. Kummerfeld Kevin Leach M. Laurenzano Lingjia Tang Jason Mars 83 528 0 04 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 520 24,351 0 26 Jul 2019
Hello, It's GPT-2 -- How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems Paweł Budzianowski Ivan Vulić 62 310 0 12 Jul 2019
Towards Universal Dialogue Act Tagging for Task-Oriented Dialogues Shachi Paul Rahul Goel Dilek Z. Hakkani-Tür 41 13 0 05 Jul 2019
Training Neural Response Selection for Task-Oriented Dialogue Systems Matthew Henderson Ivan Vulić D. Gerz I. Casanueva Paweł Budzianowski Sam Coope Georgios P. Spithourakis Tsung-Hsien Wen N. Mrksic Pei-hao Su 41 111 0 04 Jun 2019
Learning to Self-Train for Semi-Supervised Few-Shot Classification Xinzhe Li Qianru Sun Yaoyao Liu Shibao Zheng Qin Zhou Tat-Seng Chua Bernt Schiele SSL 59 269 0 03 Jun 2019
Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems Chien-Sheng Wu Andrea Madotto Ehsan Hosseini-Asl Caiming Xiong R. Socher Pascale Fung 73 435 0 21 May 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 190 1,554 0 08 May 2019
MixMatch: A Holistic Approach to Semi-Supervised Learning David Berthelot Nicholas Carlini Ian Goodfellow Nicolas Papernot Avital Oliver Colin Raffel 137 3,022 0 06 May 2019
Billion-scale semi-supervised learning for image classification I. Z. Yalniz Hervé Jégou Kan Chen Manohar Paluri D. Mahajan SSL 86 463 0 02 May 2019
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks Jason W. Wei Kai Zou 101 1,949 0 31 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling Paweł Budzianowski Tsung-Hsien Wen Bo-Hsiang Tseng I. Casanueva Stefan Ultes Osman Ramadan Milica Gasic 147 1,311 0 29 Sep 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 170 1,615 0 13 May 2018
Reinforced Co-Training Jiawei Wu Lei Li William Yang Wang OffRL 64 51 0 17 Apr 2018
Learning How to Self-Learn: Enhancing Self-Training Using Neural Reinforcement Learning Chenhua Chen Yue Zhang SSL 49 11 0 16 Apr 2018
SmoothGrad: removing noise by adding noise D. Smilkov Nikhil Thorat Been Kim F. Viégas Martin Wattenberg FAtt ODL 199 2,221 0 12 Jun 2017
Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning Takeru Miyato S. Maeda Masanori Koyama S. Ishii GAN 143 2,732 0 13 Apr 2017
Axiomatic Attribution for Deep Networks Mukund Sundararajan Ankur Taly Qiqi Yan OOD FAtt 175 5,968 0 04 Mar 2017
Temporal Ensembling for Semi-Supervised Learning S. Laine Timo Aila UQCV 179 2,552 0 07 Oct 2016
Adversarial Training Methods for Semi-Supervised Text Classification Takeru Miyato Andrew M. Dai Ian Goodfellow GAN 70 1,059 0 25 May 2016
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps Karen Simonyan Andrea Vedaldi Andrew Zisserman FAtt 287 7,279 0 20 Dec 2013