v1v2 (latest)

Accelerating BERT Inference for Sequence Labeling via Early-Exit

28 May 2021

Xiaonan Li

Yunfan Shao

Tianxiang Sun

Hang Yan

Xipeng Qiu

Xuanjing Huang

ArXiv (abs)PDF HTML

Papers citing "Accelerating BERT Inference for Sequence Labeling via Early-Exit"

25 / 25 papers shown

Title
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 127 56 0 09 Jul 2024
Coarse-to-Fine Pre-training for Named Entity Recognition Mengge Xue Yu Bowen Zhenyu Zhang Tingwen Liu Yue Zhang Bin Wang 56 53 0 16 Oct 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu Furu Wei 47 342 0 07 Jun 2020
BERTweet: A pre-trained language model for English Tweets Dat Quoc Nguyen Thanh Tien Vu A. Nguyen VLM 99 919 0 20 May 2020
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference Ji Xin Raphael Tang Jaejun Lee Yaoliang Yu Jimmy J. Lin 63 375 0 27 Apr 2020
The Right Tool for the Job: Matching Model and Instance Complexities Roy Schwartz Gabriel Stanovsky Swabha Swayamdipta Jesse Dodge Noah A. Smith 109 169 0 16 Apr 2020
CLUE: A Chinese Language Understanding Evaluation Benchmark Liang Xu Hai Hu Xuanwei Zhang Lu Li Chenjie Cao ... Cong Yue Xinrui Zhang Zhen-Yi Yang Kyle Richardson Zhenzhong Lan ELM 90 386 0 13 Apr 2020
Unified Multi-Criteria Chinese Word Segmentation with BERT Zhen Ke Liang Shi Erli Meng Bin Wang Xipeng Qiu Xuanjing Huang 39 13 0 13 Apr 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Haotang Deng Qi Ju 84 360 0 05 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 366 1,489 0 18 Mar 2020
Do We Need Zero Training Loss After Achieving Zero Training Error? Takashi Ishida Ikko Yamane Tomoya Sakai Gang Niu Masashi Sugiyama AI4CE 63 137 0 20 Feb 2020
TENER: Adapting Transformer Encoder for Named Entity Recognition Hang Yan Bocao Deng Xiaonan Li Xipeng Qiu 55 274 0 10 Nov 2019
Depth-Adaptive Transformer Maha Elbayad Jiatao Gu Edouard Grave Michael Auli 86 193 0 22 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 255 7,547 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 373 6,467 0 26 Sep 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 120 596 0 25 Sep 2019
TinyBERT: Distilling BERT for Natural Language Understanding Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li F. Wang Qun Liu VLM 113 1,869 0 23 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 680 24,541 0 26 Jul 2019
Are Sixteen Heads Really Better than One? Paul Michel Omer Levy Graham Neubig MoE 107 1,068 0 25 May 2019
Universally Slimmable Networks and Improved Training Techniques Jiahui Yu Thomas Huang 76 386 0 12 Mar 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
F-Score Driven Max Margin Neural Network for Named Entity Recognition in Chinese Social Media Hangfeng He Xu Sun 35 123 0 14 Nov 2016
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF Xuezhe Ma Eduard H. Hovy 111 2,655 0 04 Mar 2016
Bidirectional LSTM-CRF Models for Sequence Tagging Zhiheng Huang Wenyuan Xu Kai Yu 186 4,033 0 09 Aug 2015