Glancing Transformer for Non-Autoregressive Neural Machine Translation

18 August 2020

Yong Yu

Lei Li

ArXiv PDF HTML

Papers citing "Glancing Transformer for Non-Autoregressive Neural Machine Translation"

50 / 90 papers shown

Title
Multilingual Non-Autoregressive Machine Translation without Knowledge Distillation Chenyang Huang Fei Huang Zaixiang Zheng Osmar R. Zaiane Hao Zhou Lili Mou 49 1 0 06 Feb 2025
Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning Jiacheng Ye Jiahui Gao Shansan Gong Lin Zheng Xin Jiang Z. Li Lingpeng Kong DiffM LRM 51 15 0 18 Oct 2024
The Mystery of the Pathological Path-star Task for Language Models Arvid Frydenlund LRM 27 4 0 17 Oct 2024
Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines Yuchen Li Alexandre Kirchmeyer Aashay Mehta Yilong Qin Boris Dadachev Kishore Papineni Sanjiv Kumar Andrej Risteski 59 0 0 22 Jul 2024
NARRepair: Non-Autoregressive Code Generation Model for Automatic Program Repair Zhenyu Yang Zhen Yang Zhongxing Yu 37 1 0 24 Jun 2024
CTC-based Non-autoregressive Textless Speech-to-Speech Translation Qingkai Fang Zhengrui Ma Yan Zhou Min Zhang Yang Feng 52 0 0 11 Jun 2024
A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Any Translation Zhengrui Ma Qingkai Fang Shaolei Zhang Shoutao Guo Yang Feng Min Zhang 53 9 0 11 Jun 2024
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs Chenxi Sun Hongzhi Zhang Zijia Lin Jingyuan Zhang Fuzheng Zhang ... Bin Chen Chengru Song Di Zhang Kun Gai Deyi Xiong 38 1 0 24 May 2024
What Have We Achieved on Non-autoregressive Translation? Yafu Li Huajian Zhang Jianhao Yan Yongjing Yin Yue Zhang 33 1 0 21 May 2024
SurfPro: Functional Protein Design Based on Continuous Surface Zhenqiao Song Tinglin Huang Lei Li Wengong Jin DiffM 19 2 0 07 May 2024
On the Information Redundancy in Non-Autoregressive Translation Zhihao Wang Longyue Wang Jinsong Su Junfeng Yao Zhaopeng Tu 35 0 0 04 May 2024
Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 using Weighted Finite State Automata Jinghong Chen Weizhe Lin Jingbiao Mei Bill Byrne AI4CE 32 1 0 10 Apr 2024
BAMM: Bidirectional Autoregressive Motion Model Ekkasit Pinyoanuntapong Muhammad Usama Saleem Pu Wang Minwoo Lee Srijan Das Cheng Chen VGen 40 23 0 28 Mar 2024
Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization Xinran Chen Sufeng Duan Gongshen Liu 27 0 0 15 Feb 2024
Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models Jiacheng Ye Shansan Gong Liheng Chen Lin Zheng Jiahui Gao ... Chuan Wu Xin Jiang Zhenguo Li Wei Bi Lingpeng Kong DiffM LRM AI4CE 46 12 0 12 Feb 2024
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding Heming Xia Zhe Yang Qingxiu Dong Peiyi Wang Yongqi Li Tao Ge Tianyu Liu Wenjie Li Zhifang Sui LRM 38 98 0 15 Jan 2024
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition Xiaomeng Yang Zhi Qiao Yu Zhou DiffM 62 1 0 19 Dec 2023
MMM: Generative Masked Motion Model Ekkasit Pinyoanuntapong Pu Wang Minwoo Lee Cheng Chen DiffM VGen 37 45 0 06 Dec 2023
DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models Peng Tang Pengkai Zhu Tian Li Srikar Appalaraju Vijay Mahadevan R. Manmatha 42 7 0 15 Nov 2023
Non-autoregressive Machine Translation with Probabilistic Context-free Grammar Shangtong Gui Chenze Shao Zhengrui Ma Xishan Zhang Yunji Chen Yang Feng 31 7 0 14 Nov 2023
Non-autoregressive Streaming Transformer for Simultaneous Translation Zhengrui Ma Shaolei Zhang Shoutao Guo Chenze Shao Min Zhang Yang Feng 24 12 0 23 Oct 2023
Simultaneous Machine Translation with Tailored Reference Shoutao Guo Shaolei Zhang Yang Feng 32 9 0 20 Oct 2023
Attentive Multi-Layer Perceptron for Non-autoregressive Generation Shuyang Jiang Jinchao Zhang Jiangtao Feng Lin Zheng Lingpeng Kong 54 0 0 14 Oct 2023
Non-autoregressive Text Editing with Copy-aware Latent Alignments Yu Zhang Yue Zhang Leyang Cui Guohong Fu BDL 29 5 0 11 Oct 2023
DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation Qingkai Fang Yan Zhou Yangzhou Feng 34 6 0 11 Oct 2023
Glancing Future for Simultaneous Machine Translation Shoutao Guo Shaolei Zhang Yang Feng 24 9 0 12 Sep 2023
INK: Injecting kNN Knowledge in Nearest Neighbor Machine Translation Wenhao Zhu Jingjing Xu Shujian Huang Lingpeng Kong Jiajun Chen 30 11 0 10 Jun 2023
Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC Shensian Syu Jun Xie Hung-yi Lee 32 0 0 10 Jun 2023
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification Inigo Jauregi Unanue Gholamreza Haffari Massimo Piccardi VLM 24 8 0 08 Jun 2023
CTC-based Non-autoregressive Speech Translation Chen Xu Xiaoqian Liu Xiaowen Liu Qingxuan Sun Yuhao Zhang ... Tom Ko Mingxuan Wang Tong Xiao Anxiang Ma Jingbo Zhu 19 11 0 27 May 2023
Revisiting Non-Autoregressive Translation at Scale Zhihao Wang Longyue Wang Jinsong Su Junfeng Yao Zhaopeng Tu 30 3 0 25 May 2023
Optimizing Non-Autoregressive Transformers with Contrastive Learning Chen An Jiangtao Feng Fei Huang Xipeng Qiu Lingpeng Kong 38 0 0 23 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 25 2 0 22 May 2023
Non-Autoregressive Document-Level Machine Translation Guangsheng Bao Zhiyang Teng Hao Zhou Jianhao Yan Yue Zhang 41 0 0 22 May 2023
Accelerating Transformer Inference for Translation via Parallel Decoding Andrea Santilli Silvio Severino Emilian Postolache Valentino Maiorca Michele Mancusi R. Marin Emanuele Rodolà 31 78 0 17 May 2023
Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation Kun Zhou Yifan Li Wayne Xin Zhao Ji-Rong Wen DiffM 26 14 0 06 May 2023
Importance Weighted Expectation-Maximization for Protein Sequence Design Zhenqiao Song Lei Li 26 17 0 30 Apr 2023
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation Fei Huang Pei Ke Minlie Huang AI4CE 35 8 0 24 Apr 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model Yisheng Xiao Ruiyang Xu Lijun Wu Juntao Li Tao Qin Yan-Tie Liu M. Zhang 22 9 0 13 Mar 2023
Fuzzy Alignments in Directed Acyclic Graph for Non-Autoregressive Machine Translation Zhengrui Ma Chenze Shao Shangtong Gui M. Zhang Yanghe Feng 30 14 0 12 Mar 2023
Lformer: Text-to-Image Generation with L-shape Block Parallel Decoding Jiacheng Li Longhui Wei Zongyuan Zhan Xinfu He Siliang Tang Qi Tian Yueting Zhuang 24 4 0 07 Mar 2023
Plan-then-Seam: Towards Efficient Table-to-Text Generation Liang Li Ruiying Geng Chengyang Fang Bing Li Can Ma Binhua Li Yongbin Li LMTD 25 2 0 10 Feb 2023
N-Gram Nearest Neighbor Machine Translation Rui Lv Junliang Guo Rui Wang Xu Tan Qi Liu Tao Qin 23 2 0 30 Jan 2023
Candidate Soups: Fusing Candidate Results Improves Translation Quality for Non-Autoregressive Translation Huanran Zheng Wei-wei Zhu Pengfei Wang Xiaoling Wang 17 8 0 27 Jan 2023
Regeneration Learning: A Learning Paradigm for Data Generation Xu Tan Tao Qin Jiang Bian Tie-Yan Liu Yoshua Bengio GAN 38 15 0 21 Jan 2023
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning Lihua Qian Mingxuan Wang Yang Liu Hao Zhou DiffM 26 1 0 20 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 44 4 0 07 Dec 2022
Rephrasing the Reference for Non-Autoregressive Machine Translation Chenze Shao Jinchao Zhang Jie Zhou Yang Feng 19 5 0 30 Nov 2022
Helping the Weak Makes You Strong: Simple Multi-Task Learning Improves Non-Autoregressive Translators Xinyou Wang Zaixiang Zheng Shujian Huang 13 4 0 11 Nov 2022
Multi-Granularity Optimization for Non-Autoregressive Translation Yafu Li Leyang Cui Yongjing Yin Yue Zhang 29 7 0 20 Oct 2022