Distillation Guided Residual Learning for Binary Convolutional Neural Networks

10 July 2020

Jingdong Wang

Papers citing "Distillation Guided Residual Learning for Binary Convolutional Neural Networks"

45 / 45 papers shown

Title
Low-complexity Approximate Convolutional Neural Networks R. de Sobral Cintra S. Duffner Christophe Garcia André Leite MQ 38 45 0 29 Jul 2022
ShiftAddNet: A Hardware-Inspired Deep Network Haoran You Xiaohan Chen Yongan Zhang Chaojian Li Sicheng Li Zihao Liu Zhangyang Wang Yingyan Lin OOD MQ 110 77 0 24 Oct 2020
Training Binary Neural Networks with Real-to-Binary Convolutions Brais Martínez Jing Yang Adrian Bulat Georgios Tzimiropoulos MQ 54 229 0 25 Mar 2020
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions Zechun Liu Zhiqiang Shen Marios Savvides Kwang-Ting Cheng MQ 117 354 0 07 Mar 2020
BATS: Binary ArchitecTure Search Adrian Bulat Brais Martínez Georgios Tzimiropoulos MQ 71 68 0 03 Mar 2020
Learning Architectures for Binary Networks Dahyun Kim Kunal Pratap Singh Jonghyun Choi MQ 54 44 0 17 Feb 2020
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 88 64 0 28 Nov 2019
Circulant Binary Convolutional Networks: Enhancing the Performance of 1-bit DCNNs with Circulant Back Propagation Chunlei Liu Wenrui Ding Xin Xia Baochang Zhang Jiaxin Gu Jianzhuang Liu Rongrong Ji David Doermann MQ 80 75 0 24 Oct 2019
XNOR-Net++: Improved Binary Neural Networks Adrian Bulat Georgios Tzimiropoulos MQ 73 203 0 30 Sep 2019
Forward and Backward Information Retention for Accurate Binary Neural Networks Haotong Qin Ruihao Gong Xianglong Liu Mingzhu Shen Ziran Wei F. Yu Jingkuan Song MQ 165 331 0 24 Sep 2019
RBCN: Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs Chunlei Liu Wenrui Ding Xin Xia Yuan Hu Baochang Zhang Jianzhuang Liu Bohan Zhuang G. Guo MQ 31 26 0 21 Aug 2019
Asymmetric Non-local Neural Networks for Semantic Segmentation Zhen Zhu Mengde Xu S. Bai Tengteng Huang X. Bai 215 609 0 21 Aug 2019
Bayesian Optimized 1-Bit CNNs Jiaxin Gu Junhe Zhao Xiaolong Jiang Baochang Zhang Jianzhuang Liu G. Guo Rongrong Ji BDL MQ 38 56 0 17 Aug 2019
Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks Ruihao Gong Xianglong Liu Shenghu Jiang Tian-Hao Li Peng Hu Jiazhen Lin F. Yu Junjie Yan MQ 67 458 0 14 Aug 2019
MoBiNet: A Mobile Binary Network for Image Classification Hai T. Phan Dang T. Huynh Yihui He Marios Savvides Zhiqiang Shen MQ 65 49 0 29 Jul 2019
Back to Simplicity: How to Train Accurate BNNs from Scratch? Joseph Bethge Haojin Yang Marvin Bornstein Christoph Meinel AAML MQ 52 58 0 19 Jun 2019
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning Zechun Liu Haoyuan Mu Xiangyu Zhang Zichao Guo Xin Yang K. Cheng Jian Sun 75 559 0 25 Mar 2019
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation Chenxi Liu Liang-Chieh Chen Florian Schroff Hartwig Adam Wei Hua Alan Yuille Li Fei-Fei SSeg 115 981 0 10 Jan 2019
A Main/Subsidiary Network Framework for Simplifying Binary Neural Network Yinghao Xu Xin Dong Yudian Li Hao Su 44 27 0 11 Dec 2018
Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation Jiaxin Gu Ce Li Baochang Zhang Jiawei Han Xianbin Cao Jianzhuang Liu David Doermann 3DV 202 87 0 30 Nov 2018
CCNet: Criss-Cross Attention for Semantic Segmentation Zilong Huang Xinggang Wang Yunchao Wei Lichao Huang Humphrey Shi Wenyu Liu Chang Huang VOS 212 2,546 0 28 Nov 2018
Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 86 154 0 22 Nov 2018
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks Yang He Guoliang Kang Xuanyi Dong Yanwei Fu Yi Yang AAML VLM 63 964 0 21 Aug 2018
Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm Zechun Liu Baoyuan Wu Wenhan Luo Xin Yang Wen Liu K. Cheng MQ 89 556 0 01 Aug 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 199 4,355 0 24 Jun 2018
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit? Shilin Zhu Xin Dong Hao Su MQ 76 137 0 20 Jun 2018
Model compression via distillation and quantization A. Polino Razvan Pascanu Dan Alistarh MQ 83 731 0 15 Feb 2018
Towards Accurate Binary Convolutional Neural Network Xiaofan Lin Cong Zhao Wei Pan MQ 81 644 0 30 Nov 2017
Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy Asit K. Mishra Debbie Marr FedML 65 331 0 15 Nov 2017
Towards Effective Low-bitwidth Convolutional Neural Networks Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 70 232 0 01 Nov 2017
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 424 26,500 0 05 Sep 2017
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices Xiangyu Zhang Xinyu Zhou Mengxiao Lin Jian Sun AI4TS 141 6,872 0 04 Jul 2017
Mask R-CNN Kaiming He Georgia Gkioxari Piotr Dollár Ross B. Girshick ObjD 352 27,195 0 20 Mar 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 118 2,581 0 12 Dec 2016
Local Binary Convolutional Neural Networks Felix Juefei Xu Vishnu Boddeti Marios Savvides MQ 63 253 0 22 Aug 2016
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen Yuheng Zou MQ 119 2,088 0 20 Jun 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 741 37,862 0 20 May 2016
Ternary Weight Networks Fengfu Li Bin Liu Xiaoxing Wang Bo Zhang Junchi Yan MQ 76 525 0 16 May 2016
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari Vicente Ordonez Joseph Redmon Ali Farhadi MQ 170 4,357 0 16 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 883 27,373 0 02 Dec 2015
BinaryConnect: Training Deep Neural Networks with binary weights during propagations Matthieu Courbariaux Yoshua Bengio J. David MQ 209 2,985 0 02 Nov 2015
Fast R-CNN Ross B. Girshick ObjD 303 25,059 0 30 Apr 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.6K 100,386 0 04 Sep 2014