Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding

9 June 2021

Xin Sun

Tao Ge

Furu Wei

Houfeng Wang

ArXiv (abs)PDF HTML Github (41★)

Papers citing "Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding"

25 / 25 papers shown

Title
L-MTP: Leap Multi-Token Prediction Beyond Adjacent Context for Large Language Models Xiaohao Liu Xiaobo Xia Weixiang Zhao Manyi Zhang Xianzhi Yu Xiu Su Shuo Yang See-Kiong Ng Tat-Seng Chua KELM LRM 85 0 0 23 May 2025
EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test Yuhui Li Fangyun Wei Chao Zhang Hongyang R. Zhang 208 18 0 03 Mar 2025
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty Yuhui Li Fangyun Wei Chao Zhang Hongyang R. Zhang 133 165 0 26 Jan 2024
An Efficient Transformer Decoder with Compressed Sub-layers Yanyang Li Ye Lin Tong Xiao Jingbo Zhu 61 29 0 03 Jan 2021
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade Jiatao Gu X. Kong 71 137 0 31 Dec 2020
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction M. Chen Tao Ge Xingxing Zhang Furu Wei M. Zhou 69 47 0 07 Oct 2020
Seq2Edits: Sequence Transduction Using Span-level Edit Operations Felix Stahlberg Shankar Kumar BDL 85 84 0 23 Sep 2020
GECToR -- Grammatical Error Correction: Tag, Not Rewrite Kostiantyn Omelianchuk Vitaliy Atrasevych Artem Chernodub Oleksandr Skurzhanskyi 84 316 0 26 May 2020
Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction Masahiro Kaneko Masato Mita Shun Kiyono Jun Suzuki Kentaro Inui 106 146 0 03 May 2020
Improving Grammatical Error Correction with Machine Translation Pairs Wangchunshu Zhou Tao Ge Chang Mu Ke Xu Furu Wei M. Zhou 71 42 0 07 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 264 10,851 0 29 Oct 2019
Parallel Iterative Edit Models for Local Sequence Transduction Abhijeet Awasthi Sunita Sarawagi Rasna Goyal Sabyasachi Ghosh Vihari Piratla KELM 61 148 0 07 Oct 2019
Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting Yi Zhang Tao Ge Furu Wei Ming Zhou Xu Sun 69 19 0 13 Sep 2019
Encode, Tag, Realize: High-Precision Text Editing Eric Malmi Sebastian Krause S. Rothe Daniil Mirylenka Aliaksei Severyn 3DV 78 171 0 03 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 677 24,541 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 236 8,447 0 19 Jun 2019
Levenshtein Transformer Jiatao Gu Changhan Wang Jake Zhao 123 359 0 27 May 2019
Corpora Generation for Grammatical Error Correction Jared Lichtarge C. Alberti Shankar Kumar Noam M. Shazeer Niki Parmar Simon Tong 60 142 0 10 Apr 2019
Blockwise Parallel Decoding for Deep Autoregressive Models Mitchell Stern Noam M. Shazeer Ashley J. Llorens 65 238 0 07 Nov 2018
Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study Tao Ge Furu Wei M. Zhou 73 86 0 03 Jul 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 886 27,416 0 02 Dec 2015
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 228 7,757 0 31 Aug 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,312 0 22 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 446 20,590 0 10 Sep 2014