A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond

20 April 2022

Junliang Guo

Papers citing "A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond"

50 / 218 papers shown

Title
Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech Yongqian Li Cheng Yu Guangzhi Sun Hua Jiang Fanglei Sun Weiqin Zu Ying Wen Yang Yang Jun Wang 40 7 0 09 May 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering Jiadong Wang Chengyu Wang Minghui Qiu Qiuhui Shi Hongbin Wang Jun Huang Ming Gao RALM 46 16 0 06 May 2022
Non-Autoregressive Machine Translation: It's Not as Fast as it Seems Jindvrich Helcl Barry Haddow Alexandra Birch 43 20 0 04 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 350 6,854 0 13 Apr 2022
Hierarchical and Multi-Scale Variational Autoencoder for Diverse and Natural Non-Autoregressive Text-to-Speech Jaesung Bae Jinhyeok Yang Taejun Bak Young-Sun Joo DiffM 106 6 0 08 Apr 2022
$$\textit{latent}$-GLAT: Glancing at Latent Variables for Parallel Text Generation$ $\textit{latent}$ -GLAT: Glancing at Latent Variables for Parallel Text Generation Yu Bao Hao Zhou Shujian Huang Dongqi Wang Lihua Qian Xinyu Dai Jiajun Chen Lei Li 52 38 0 05 Apr 2022
vTTS: visual-text to speech Yoshifumi Nakano Takaaki Saeki Shinnosuke Takamichi Katsuhito Sudoh Hiroshi Saruwatari 46 4 0 28 Mar 2022
An Imitation Learning Curriculum for Text Editing with Non-Autoregressive Models Sweta Agrawal Marine Carpuat KELM 59 24 0 17 Mar 2022
Universal Conditional Masked Language Pre-training for Neural Machine Translation Pengfei Li Liangyou Li Meng Zhang Minghao Wu Qun Liu AI4CE 33 31 0 17 Mar 2022
A Multi-Scale Time-Frequency Spectrogram Discriminator for GAN-based Non-Autoregressive TTS Haohan Guo Hui Lu Xixin Wu Helen Meng 273 7 0 02 Mar 2022
Confidence Based Bidirectional Global Context Aware Training Framework for Neural Machine Translation Chulun Zhou Fandong Meng Jie Zhou Hao Fei Hongji Wang Jinsong Su 26 15 0 28 Feb 2022
Revisiting Over-Smoothness in Text to Speech Yi Ren Xu Tan Tao Qin Zhou Zhao Tie-Yan Liu 111 62 0 26 Feb 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 87 200 0 21 Feb 2022
Non-Autoregressive ASR with Self-Conditioned Folded Encoders Tatsuya Komatsu 108 8 0 17 Feb 2022
Improving non-autoregressive end-to-end speech recognition with pre-trained acoustic and language models Keqi Deng Zehui Yang Shinji Watanabe Yosuke Higuchi Gaofeng Cheng Pengyuan Zhang 44 23 0 25 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 71 222 0 14 Jan 2022
Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translation Jiaxin Guo Minghan Wang Daimeng Wei Hengchao Shang Yuxia Wang ... Chang Su Hao Fei Lizhi Lei Shimin Tao Hao Yang 24 12 0 22 Dec 2021
Diformer: Directional Transformer for Neural Machine Translation Minghan Wang Jiaxin Guo Yuxia Wang Daimeng Wei Hengchao Shang ... Yimeng Chen Yinglu Li Hao Fei Shimin Tao Hao Yang AI4CE 31 5 0 22 Dec 2021
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 300 3,582 0 20 Dec 2021
Step-unrolled Denoising Autoencoders for Text Generation Nikolay Savinov Junyoung Chung Mikolaj Binkowski Erich Elsen Aaron van den Oord DiffM 72 119 0 13 Dec 2021
Conditional Deep Hierarchical Variational Autoencoder for Voice Conversion K. Akuzawa Kotaro Onishi Keisuke Takiguchi Kohki Mametani K. Mori BDL DRL 54 7 0 06 Dec 2021
Character Transformations for Non-Autoregressive GEC Tagging Milan Straka Jakub Náplava Jana Straková 34 7 0 17 Nov 2021
Improving Non-autoregressive Generation with Mixup Training Ting Jiang Shaohan Huang Zihan Zhang Deqing Wang Fuzhen Zhuang Furu Wei Haizhen Huang Liangjie Zhang Qi Zhang 33 8 0 21 Oct 2021
Non-Autoregressive Translation with Layer-Wise Prediction and Deep Supervision Chenyang Huang Hao Zhou Osmar R. Zaïane Lili Mou Lei Li 122 59 0 14 Oct 2021
A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation Yosuke Higuchi Nanxin Chen Yuya Fujita Hirofumi Inaguma Tatsuya Komatsu Jaesong Lee Jumon Nozaki Tianzi Wang Shinji Watanabe 44 42 0 11 Oct 2021
Autoregressive Diffusion Models Emiel Hoogeboom Alexey A. Gritsenko Jasmijn Bastings Ben Poole Rianne van den Berg Tim Salimans DiffM 76 153 0 05 Oct 2021
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates Hirofumi Inaguma Siddharth Dalmia Brian Yan Shinji Watanabe 76 11 0 27 Sep 2021
Non-autoregressive Transformer with Unified Bidirectional Decoder for Automatic Speech Recognition Chuan-Fei Zhang Yang Liu Tianren Zhang Songlu Chen Feng Chen Xu-Cheng Yin 36 8 0 14 Sep 2021
AligNART: Non-autoregressive Neural Machine Translation by Jointly Learning to Estimate Alignment and Translate Jongyoon Song Sungwon Kim Sungroh Yoon 94 39 0 14 Sep 2021
Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring Hirofumi Inaguma Yosuke Higuchi Kevin Duh Tatsuya Kawahara Shinji Watanabe 70 11 0 09 Sep 2021
Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems Yicheng Zou Zhihua Liu Xingwu Hu Qi Zhang BDL 72 29 0 09 Sep 2021
MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation Pan Xie Zexian Li Xiaohui Hu 39 11 0 19 Aug 2021
An Effective Non-Autoregressive Model for Spoken Language Understanding Lizhi Cheng Weijia Jia Wenmian Yang OffRL 50 18 0 16 Aug 2021
Using Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation Yuichi Oka Katsuhito Sudoh Satoshi Nakamura 55 4 0 29 Jul 2021
Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models Tianzi Wang Yuya Fujita Xuankai Chang Shinji Watanabe 109 15 0 20 Jul 2021
VAENAR-TTS: Variational Auto-Encoder based Non-AutoRegressive Text-to-Speech Synthesis Hui Lu Zhiyong Wu Xixin Wu Xu Li Shiyin Kang Xunying Liu Helen Meng 51 12 0 07 Jul 2021
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 124 924 0 07 Jul 2021
Don't Take It Literally: An Edit-Invariant Sequence Loss for Text Generation Guangyi Liu Zichao Yang Tianhua Tao Xiaodan Liang Junwei Bao Zhen Li Bowen Zhou Shuguang Cui Zhiting Hu 46 20 0 29 Jun 2021
R-Drop: Regularized Dropout for Neural Networks Xiaobo Liang Lijun Wu Juntao Li Yue Wang Qi Meng Tao Qin Wei Chen Hao Fei Tie-Yan Liu 73 435 0 28 Jun 2021
Non-Autoregressive TTS with Explicit Duration Modelling for Low-Resource Highly Expressive Speech Raahil Shah Kamil Pokora Abdelhamid Ezzerg V. Klimkov Goeric Huybrechts Bartosz Putrycz Daniel Korzekwa Thomas Merritt 47 26 0 24 Jun 2021
An Improved Single Step Non-autoregressive Transformer for Automatic Speech Recognition Ruchao Fan Wei Chu Peng Chang Jing Xiao Abeer Alwan 54 15 0 18 Jun 2021
Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chain Pengcheng Guo Xuankai Chang Shinji Watanabe Lei Xie 29 18 0 16 Jun 2021
Progressive Multi-Granularity Training for Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu AI4TS 43 42 0 10 Jun 2021
Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translation Cunxiao Du Zhaopeng Tu Jing Jiang 57 88 0 09 Jun 2021
NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer Fei Huang Zikai Chen Chen Henry Wu Qihan Guo Xiaoyan Zhu Minlie Huang 62 20 0 04 Jun 2021
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling Libo Qin Fuxuan Wei Tianbao Xie Xiao Xu Wanxiang Che Ting Liu 51 85 0 03 Jun 2021
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction Piji Li Shuming Shi AI4TS 55 35 0 03 Jun 2021
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 51 47 0 02 Jun 2021
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? Weijia Xu Shuming Ma Dongdong Zhang Marine Carpuat 40 19 0 27 May 2021
Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation Shun-Po Chuang Yung-Sung Chuang Chih-Chiang Chang Hung-yi Lee 58 26 0 11 May 2021