BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks

6 September 2017

Surat Teerapittayanon

Papers citing "BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks"

50 / 254 papers shown

Title
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition Yulin Wang Rui Huang S. Song Zeyi Huang Gao Huang ViT 112 194 0 31 May 2021
Early Exiting with Ensemble Internal Classifiers Tianxiang Sun Yunhua Zhou Xiangyang Liu Xinyu Zhang Hao Jiang Bo Zhao Xuanjing Huang Xipeng Qiu 70 31 0 28 May 2021
Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 73 35 0 19 May 2021
Sound Event Detection with Adaptive Frequency Selection Zhepei Wang Jonah Casebeer Adam Clemmitt Efthymios Tzinis Paris Smaragdis 54 2 0 17 May 2021
AppealNet: An Efficient and Highly-Accurate Edge/Cloud Collaborative Architecture for DNN Inference Min Li Yu Li Ye Tian Li Jiang Qiang Xu 92 36 0 10 May 2021
BasisNet: Two-stage Model Synthesis for Efficient Inference Ruotong Wang Chun-Te Chu A. Zhmoginov Andrew G. Howard Brendan Jou Yukun Zhu Li Zhang R. Hwa Adriana Kovashka 3DH 80 7 0 07 May 2021
Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence Emna Baccour N. Mhaisen A. Abdellatif A. Erbad Amr M. Mohamed Mounir Hamdi Mohsen Guizani 98 94 0 04 May 2021
Single-Training Collaborative Object Detectors Adaptive to Bandwidth and Computation Juliano S. Assine José Cândido Silveira Santos Filho Eduardo Valle ObjD 96 8 0 03 May 2021
Improving the Accuracy of Early Exits in Multi-Exit Architectures via Curriculum Learning Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 99 13 0 21 Apr 2021
Consistent Accelerated Inference via Confident Adaptive Transformers Tal Schuster Adam Fisch Tommi Jaakkola Regina Barzilay AI4TS 257 73 0 18 Apr 2021
QuickLoc: Adaptive Deep-Learning for Fast Indoor Localization with Mobile Devices Saideep Tiku Prathmesh Kale S. Pasricha HAI 50 19 0 15 Apr 2021
Learning to Cascade: Confidence Calibration for Improving the Accuracy and Computational Cost of Cascade Inference Systems Shohei Enomoto Takeharu Eda UQCV 82 17 0 15 Apr 2021
Students are the Best Teacher: Exit-Ensemble Distillation with Multi-Exits Hojung Lee Jong-Seok Lee 42 8 0 01 Apr 2021
Dynamic Domain Adaptation for Efficient Inference Shuang Li Jinming Zhang Wen-hui Ma Chi Harold Liu Wei Li 66 13 0 26 Mar 2021
Deep Learning for Android Malware Defenses: a Systematic Literature Review Yue Liu Chakkrit Tantithamthavorn Li Li Yepang Liu AAML 88 81 0 09 Mar 2021
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges Yoshitomo Matsubara Marco Levorato Francesco Restuccia 133 215 0 08 Mar 2021
Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference Loss Michael L. Iuzzolino Michael C. Mozer Samy Bengio OOD 70 11 0 19 Feb 2021
VA-RED $^2$ : Video Adaptive Redundancy Reduction Bowen Pan Yikang Shen Camilo Luciano Fosco Chung-Ching Lin A. Andonian Yue Meng Kate Saenko A. Oliva Rogerio Feris 84 19 0 15 Feb 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 148 659 0 09 Feb 2021
Local Critic Training for Model-Parallel Learning of Deep Neural Networks Hojung Lee Cho-Jui Hsieh Jong-Seok Lee 63 15 0 03 Feb 2021
It's always personal: Using Early Exits for Efficient On-Device CNN Personalisation Ilias Leontiadis Stefanos Laskaridis Stylianos I. Venieris Nicholas D. Lane 123 30 0 02 Feb 2021
AdaSpring: Context-adaptive and Runtime-evolutionary Deep Model Compression for Mobile Applications Sicong Liu Bin Guo Ke Ma Zhiwen Yu Junzhao Du 53 9 0 28 Jan 2021
NetCut: Real-Time DNN Inference Using Layer Removal Mehrshad Zandigohar Deniz Erdogmus G. Schirner 44 5 0 13 Jan 2021
EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference Thierry Tambe Coleman Hooper Lillian Pentecost Tianyu Jia En-Yu Yang ... Victor Sanh P. Whatmough Alexander M. Rush David Brooks Gu-Yeon Wei 118 126 0 28 Nov 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 116 124 0 25 Nov 2020
Adversarial Generation of Continuous Images Ivan Skorokhodov Savva Ignatyev Mohamed Elhoseiny GAN 102 174 0 24 Nov 2020
PAC Confidence Predictions for Deep Neural Network Classifiers Sangdon Park Shuo Li Insup Lee Osbert Bastani UQCV 117 27 0 02 Nov 2020
Calibration-Aided Edge Inference Offloading via Adaptive Model Partitioning of Deep Neural Networks R. G. Pacheco R. S. Couto Osvaldo Simeone 74 25 0 30 Oct 2020
ApproxDet: Content and Contention-Aware Approximate Object Detection for Mobiles Ran Xu Chen-Da Liu-Zhang Pengcheng Wang Jayoung Lee Subrata Mitra Somali Chaterji Yin Li S. Bagchi 66 60 0 21 Oct 2020
Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search Gyuwan Kim Kyunghyun Cho 96 98 0 14 Oct 2020
A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference Sanghyun Hong Yigitcan Kaya Ionut-Vlad Modoranu Tudor Dumitras AAML 83 73 0 06 Oct 2020
Revisiting Batch Normalization for Training Low-latency Deep Spiking Neural Networks from Scratch Youngeun Kim Priyadarshini Panda 118 176 0 05 Oct 2020
ENAS4D: Efficient Multi-stage CNN Architecture Search for Dynamic Inference Zhihang Yuan Xin Liu Bingzhe Wu Guangyu Sun 33 4 0 19 Sep 2020
Orthogonalized SGD and Nested Architectures for Anytime Neural Networks Chengcheng Wan H. Hoffmann Shan Lu Michael Maire OOD 71 11 0 15 Aug 2020
SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloud Stefanos Laskaridis Stylianos I. Venieris Mario Almeida Ilias Leontiadis Nicholas D. Lane 102 276 0 14 Aug 2020
HAPI: Hardware-Aware Progressive Inference Stefanos Laskaridis Stylianos I. Venieris Hyeji Kim Nicholas D. Lane 87 47 0 10 Aug 2020
Fully Dynamic Inference with Deep Neural Networks Wenhan Xia Hongxu Yin Xiaoliang Dai N. Jha 3DH BDL 97 40 0 29 Jul 2020
Conditional Classification: A Solution for Computational Energy Reduction Ali Mirzaeian Mohammad Sabokrou Ashka Vakil Houman Homayoun Avesta Sasan 40 0 0 29 Jun 2020
ELF: An Early-Exiting Framework for Long-Tailed Classification Rahul Duggal Scott Freitas Sunny Dhamnani Duen Horng Chau Jimeng Sun 92 30 0 22 Jun 2020
Learning to Stop While Learning to Predict Xinshi Chen H. Dai Yu Li Xin Gao Le Song OOD 76 48 0 09 Jun 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu Furu Wei 79 344 0 07 Jun 2020
Inference Time Optimization Using BranchyNet Partitioning R. G. Pacheco R. S. Couto 51 28 0 01 May 2020
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference Ji Xin Raphael Tang Jaejun Lee Yaoliang Yu Jimmy J. Lin 72 377 0 27 Apr 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 110 7 0 24 Apr 2020
Intermittent Inference with Nonuniformly Compressed Multi-Exit Neural Network for Energy Harvesting Powered Devices Yawen Wu Zhepeng Wang Zhenge Jia Yiyu Shi Jiaxi Hu 86 54 0 23 Apr 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Haotang Deng Qi Ju 99 361 0 05 Apr 2020
Not all domains are equally complex: Adaptive Multi-Domain Learning Ali Senhaji Jenni Raitoharju Moncef Gabbouj Alexandros Iosifidis OOD 54 10 0 25 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 422 1,500 0 18 Mar 2020
Resolution Adaptive Networks for Efficient Inference Le Yang Yizeng Han Xi Chen Shiji Song Jifeng Dai Gao Huang 119 220 0 16 Mar 2020
Triple Wins: Boosting Accuracy, Robustness and Efficiency Together by Enabling Input-Adaptive Inference Ting-Kuei Hu Tianlong Chen Haotao Wang Zhangyang Wang OOD AAML 3DH 95 84 0 24 Feb 2020