A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond

20 April 2022

Junliang Guo

Papers citing "A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond"

50 / 218 papers shown

Title
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks Siddharth Dalmia Brian Yan Vikas Raunak Florian Metze Shinji Watanabe 60 31 0 02 May 2021
TalkNet 2: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis with Explicit Pitch and Duration Prediction Stanislav Beliaev Boris Ginsburg 43 9 0 16 Apr 2021
Span Pointer Networks for Non-Autoregressive Task-Oriented Semantic Parsing Akshat Shrivastava P. Chuang Arun Babu Shrey Desai Abhinav Arora Alexander Zotov Ahmed Aly 52 21 0 15 Apr 2021
Non-autoregressive sequence-to-sequence voice conversion Tomoki Hayashi Wen-Chin Huang Kazuhiro Kobayashi Tomoki Toda 29 23 0 14 Apr 2021
Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog Arun Babu Akshat Shrivastava Armen Aghajanyan Ahmed Aly Angela Fan Marjan Ghazvininejad 47 21 0 11 Apr 2021
Boundary and Context Aware Training for CIF-based Non-Autoregressive End-to-end ASR Fan Yu Haoneng Luo Pengcheng Guo Yuhao Liang Zhuoyuan Yao Lei Xie Yingying Gao Leijing Hou Shilei Zhang 13 11 0 10 Apr 2021
WNARS: WFST based Non-autoregressive Streaming End-to-End Speech Recognition Zhichao Wang Wenwen Yang Pan Zhou Wei Chen RALM 41 18 0 08 Apr 2021
Pushing the Limits of Non-Autoregressive Speech Recognition Edwin G. Ng Chung-Cheng Chiu Yu Zhang William Chan VLM 26 27 0 07 Apr 2021
Relaxing the Conditional Independence Assumption of CTC-based ASR by Conditioning on Intermediate Predictions Jumon Nozaki Tatsuya Komatsu 60 74 0 06 Apr 2021
Non-autoregressive Mandarin-English Code-switching Speech Recognition Shun-Po Chuang Heng-Jui Chang Sung-Feng Huang Hung-yi Lee 52 15 0 06 Apr 2021
Symbolic Music Generation with Diffusion Models Gautam Mittal Jesse Engel Curtis Hawthorne Ian Simon MGen DiffM 80 193 0 30 Mar 2021
Non-Autoregressive Translation by Learning Target Categorical Codes Yu Bao Shujian Huang Tong Xiao Dongqi Wang Xinyu Dai Jiajun Chen 51 35 0 21 Mar 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 303 3,671 0 18 Feb 2021
Non-Autoregressive Text Generation with Pre-trained Language Models Yixuan Su Deng Cai Yan Wang David Vandyke Simon Baker Piji Li Nigel Collier 63 46 0 16 Feb 2021
Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT Ye Bai Jiangyan Yi J. Tao Zhengkun Tian Zhengqi Wen Shuai Zhang RALM 75 51 0 15 Feb 2021
InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model Sidi Lu Tao Meng Nanyun Peng 84 12 0 12 Feb 2021
VARA-TTS: Non-Autoregressive Text-to-Speech Synthesis based on Very Deep VAE with Residual Attention Peng Liu Yuewen Cao Songxiang Liu Na Hu Guangzhi Li Chao Weng Dan Su 59 22 0 12 Feb 2021
Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions Emiel Hoogeboom Didrik Nielsen P. Jaini Patrick Forré Max Welling DiffM 277 416 0 10 Feb 2021
Intermediate Loss Regularization for CTC-based Speech Recognition Jaesong Lee Shinji Watanabe 122 138 0 05 Feb 2021
Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation Ye Liu Yao Wan Jianguo Zhang Wenting Zhao Philip S. Yu 73 23 0 22 Jan 2021
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade Jiatao Gu X. Kong 55 137 0 31 Dec 2020
BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining Weizhen Qi Yeyun Gong Jian Jiao Yu Yan Weizhu Chen ... Houqiang Li Jiusheng Chen Ruofei Zhang Ming Zhou Nan Duan 67 46 0 31 Dec 2020
Understanding and Improving Lexical Choice in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 132 77 0 29 Dec 2020
A Study on the Autoregressive and non-Autoregressive Multi-label Learning Elham J. Barezi Iacer Calixto Kyunghyun Cho Pascale Fung SSL DRL BDL 18 3 0 03 Dec 2020
Hierarchical Prosody Modeling for Non-Autoregressive Speech Synthesis C. Chien Hung-yi Lee 44 36 0 12 Nov 2020
Incorporating a Local Translation Mechanism into Non-autoregressive Translation X. Kong Zhisong Zhang Eduard H. Hovy 46 22 0 12 Nov 2020
Context-Aware Cross-Attention for Non-Autoregressive Translation Liang Ding Longyue Wang Di Wu Dacheng Tao Zhaopeng Tu 45 40 0 02 Nov 2020
Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies Alexander H. Liu Yu-An Chung James R. Glass SSL 62 88 0 01 Nov 2020
Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input Xingcheng Song Zhiyong Wu Yiheng Huang Chao Weng Dan Su Helen Meng 54 36 0 28 Oct 2020
CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition Ruchao Fan Wei Chu Peng Chang Jing Xiao 39 36 0 28 Oct 2020
Improved Mask-CTC for Non-Autoregressive End-to-End ASR Yosuke Higuchi Hirofumi Inaguma Shinji Watanabe Tetsuji Ogawa Tetsunori Kobayashi 51 61 0 26 Oct 2020
Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder Hirofumi Inaguma Yosuke Higuchi Kevin Duh Tatsuya Kawahara Shinji Watanabe 47 22 0 25 Oct 2020
Multi-Task Learning with Shared Encoder for Non-Autoregressive Machine Translation Yongchang Hao Shilin He Wenxiang Jiao Zhaopeng Tu Michael Lyu Xing Wang 125 28 0 24 Oct 2020
Align-Refine: Non-Autoregressive Speech Recognition via Iterative Realignment Ethan A. Chi Julian Salazar Katrin Kirchhoff AI4TS 59 51 0 24 Oct 2020
Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism Pan Xie Zhi Cui Preslav Nakov Xiaohui Hu Jianwei Cui Bin Wang 182 9 0 19 Oct 2020
Incorporating BERT into Parallel Sequence Decoding with Adapters Junliang Guo Zhirui Zhang Linli Xu Hao-Ran Wei Boxing Chen Enhong Chen 75 69 0 13 Oct 2020
SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling Di Wu Liang Ding Fan Lu Jian Xie VLM BDL 57 82 0 06 Oct 2020
DiffWave: A Versatile Diffusion Model for Audio Synthesis Zhifeng Kong Ming-Yu Liu Jiaji Huang Kexin Zhao Bryan Catanzaro DiffM BDL 113 1,455 0 21 Sep 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 104 1,090 0 18 Sep 2020
Code-switching pre-training for neural machine translation Zhen Yang Bojie Hu Ambyera Han Shen Huang Qi Ju 55 71 0 17 Sep 2020
Glancing Transformer for Non-Autoregressive Neural Machine Translation Lihua Qian Hao Zhou Yu Bao Mingxuan Wang Lin Qiu Weinan Zhang Yong Yu Lei Li 77 157 0 18 Aug 2020
An EM Approach to Non-autoregressive Conditional Sequence Generation Zhiqing Sun Yiming Yang 35 42 0 29 Jun 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 522 18,008 0 19 Jun 2020
Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation Jungo Kasai Nikolaos Pappas Hao Peng James Cross Noah A. Smith 63 137 0 18 Jun 2020
FastPitch: Parallel Text-to-speech with Pitch Prediction Adrian Lañcucki 68 340 0 11 Jun 2020
Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation Qiu Ran Yankai Lin Peng Li Jie Zhou 40 39 0 09 Jun 2020
Insertion-Based Modeling for End-to-End Automatic Speech Recognition Yuya Fujita Shinji Watanabe Motoi Omachi Xuankai Chan 60 31 0 27 May 2020
Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search Jaehyeon Kim Sungwon Kim Jungil Kong Sungroh Yoon 81 491 0 22 May 2020
Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict Yosuke Higuchi Shinji Watanabe Nanxin Chen Tetsuji Ogawa Tetsunori Kobayashi 44 138 0 18 May 2020
Quasi-Periodic Parallel WaveGAN Vocoder: A Non-autoregressive Pitch-dependent Dilated Convolution Model for Parametric Speech Generation Yi-Chiao Wu Tomoki Hayashi T. Okamoto Hisashi Kawai Tomoki Toda 48 4 0 18 May 2020