DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference

24 September 2021

Papers citing "DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference"

6 / 6 papers shown

Title
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 44 638 0 09 Feb 2021
FastBERT: a Self-distilling BERT with Adaptive Inference Time Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Haotang Deng Qi Ju 66 356 0 05 Apr 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 82 7,386 0 02 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 234 6,420 0 26 Sep 2019
TinyBERT: Distilling BERT for Natural Language Understanding Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li F. Wang Qun Liu VLM 32 1,838 0 23 Sep 2019
Green AI Roy Schwartz Jesse Dodge Noah A. Smith Oren Etzioni 73 1,124 0 22 Jul 2019