v1v2 (latest)

Predicting Parameters in Deep Learning

3 June 2013

Papers citing "Predicting Parameters in Deep Learning"

50 / 392 papers shown

Title
Auto-Compressing Subset Pruning for Semantic Image Segmentation Konstantin Ditschuneit Johannes Otterbach 63 5 0 26 Jan 2022
TerViT: An Efficient Ternary Vision Transformer Sheng Xu Yanjing Li Teli Ma Bo-Wen Zeng Baochang Zhang Peng Gao Jinhu Lv ViT 76 11 0 20 Jan 2022
Conditional Generative Data-free Knowledge Distillation Xinyi Yu Ling Yan Yang Yang Libo Zhou Linlin Ou 78 8 0 31 Dec 2021
Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks Runpei Dong Zhanhong Tan Mengdi Wu Linfeng Zhang Kaisheng Ma MQ 94 12 0 30 Dec 2021
SNF: Filter Pruning via Searching the Proper Number of Filters Pengkun Liu Yaru Yue Yanjun Guo Xingxiang Tao Xiaoguang Zhou 3DPC 58 0 0 14 Dec 2021
Network Compression via Central Filter Y. Duan Xiaofang Hu Yue Zhou Qiang Liu Shukai Duan 3DPC 78 1 0 10 Dec 2021
Neural Network Quantization for Efficient Inference: A Survey Olivia Weng MQ 75 26 0 08 Dec 2021
Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularization Bo-Shiuan Chu Che-Rung Lee 52 11 0 07 Dec 2021
Neuron-based Pruning of Deep Neural Networks with Better Generalization using Kronecker Factored Curvature Approximation Abdolghani Ebrahimi Diego Klabjan 34 4 0 16 Nov 2021
Parameter Prediction for Unseen Deep Architectures Boris Knyazev M. Drozdzal Graham W. Taylor Adriana Romero Soriano OOD 122 83 0 25 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 66 4 0 17 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 85 13 0 12 Oct 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 94 8 0 11 Oct 2021
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 56 1 0 09 Oct 2021
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM) Jie Bu Arka Daw M. Maruf Anuj Karpatne 107 5 0 01 Oct 2021
Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework Zhuowen Zou H. Alimohamadi Farhad Imani Yeseong Kim Mohsen Imani 113 19 0 01 Oct 2021
Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition Marawan Gamal Abdel Hameed Marzieh S. Tahaei A. Mosleh V. Nia 90 26 0 29 Sep 2021
$ECQ$^{\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs$ ECQ $^{\text{x}}$ : Explainability-Driven Quantization for Low-Bit and Sparse DNNs Daniel Becking Maximilian Dreyer Wojciech Samek Karsten Müller Sebastian Lapuschkin MQ 356 16 0 09 Sep 2021
Learning the hypotheses space from data through a U-curve algorithm Diego Marcondes Adilson Simonis Junior Barrera 66 1 0 08 Sep 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 106 18 0 30 Aug 2021
Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation Samuel Cahyawijaya 103 12 0 24 Aug 2021
An empirical investigation into audio pipeline approaches for classifying bird species David Behr C. Maina Vukosi Marivate 26 2 0 10 Aug 2021
InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimation Dahu Shi Xing Wei Xiaodong Yu Wenming Tan Ye Ren Shiliang Pu 3DH 93 35 0 19 Jul 2021
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion Mingbao Lin Bohong Chen Yong Li Rongrong Ji VLM 75 24 0 14 Jul 2021
Weight Reparametrization for Budget-Aware Network Pruning Robin Dupont H. Sahbi Guillaume Michel 43 1 0 08 Jul 2021
A Generalized Lottery Ticket Hypothesis Ibrahim Alabdulmohsin L. Markeeva Daniel Keysers Ilya O. Tolstikhin 69 6 0 03 Jul 2021
Learning Gradual Argumentation Frameworks using Genetic Algorithms J. Spieler Nico Potyka Steffen Staab AI4CE 63 4 0 25 Jun 2021
Knowledge Distillation via Instance-level Sequence Learning Haoran Zhao Changrui Chen Junyu Dong Zihe Dong Qiong Li 58 24 0 21 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 801 10,658 0 17 Jun 2021
Dynamic Sparse Training for Deep Reinforcement Learning Ghada Sokar Elena Mocanu Decebal Constantin Mocanu Mykola Pechenizkiy Peter Stone 111 60 0 08 Jun 2021
Feature Flow Regularization: Improving Structured Sparsity in Deep Neural Networks Yue Wu Yuan Lan Luchan Zhang Yang Xiang 51 6 0 05 Jun 2021
Spectral Pruning for Recurrent Neural Networks Takashi Furuya Kazuma Suetake K. Taniguchi Hiroyuki Kusumoto Ryuji Saiin Tomohiro Daimon 62 4 0 23 May 2021
Deep Neural Networks as Point Estimates for Deep Gaussian Processes Vincent Dutordoir J. Hensman Mark van der Wilk Carl Henrik Ek Zoubin Ghahramani N. Durrande BDL UQCV 106 31 0 10 May 2021
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 157 57 0 03 May 2021
Policy Manifold Search: Exploring the Manifold Hypothesis for Diversity-based Neuroevolution Nemanja Rakićević Antoine Cully Petar Kormushev 54 34 0 27 Apr 2021
Piggyback GAN: Efficient Lifelong Learning for Image Conditioned Generation Mengyao Zhai Lei Chen Jiawei He Megha Nawhal Frederick Tung Greg Mori CLL 67 29 0 24 Apr 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 84 40 0 20 Mar 2021
Robust Model Compression Using Deep Hypotheses Omri Armstrong Ran Gilad-Bachrach OOD 26 2 0 13 Mar 2021
Reframing Neural Networks: Deep Structure in Overcomplete Representations Calvin Murdock George Cazenavette Simon Lucey BDL 69 5 0 10 Mar 2021
Consistent Sparse Deep Learning: Theory and Computation Y. Sun Qifan Song F. Liang BDL 87 30 0 25 Feb 2021
Scaling Up Exact Neural Network Compression by ReLU Stability Thiago Serra Xin Yu Abhinav Kumar Srikumar Ramalingam 68 24 0 15 Feb 2021
ChipNet: Budget-Aware Pruning with Heaviside Continuous Approximations Rishabh Tiwari Udbhav Bamba Arnav Chavan D. K. Gupta 69 31 0 14 Feb 2021
Neural Architecture Search as Program Transformation Exploration Jack Turner Elliot J. Crowley Michael F. P. O'Boyle 62 14 0 12 Feb 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 148 659 0 09 Feb 2021
Truly Sparse Neural Networks at Scale Selima Curci Decebal Constantin Mocanu Mykola Pechenizkiy 141 22 0 02 Feb 2021
Deep Model Compression based on the Training History S. H. Shabbeer Basha M. Farazuddin Viswanath Pulabaigari S. Dubey Snehasis Mukherjee VLM 66 18 0 30 Jan 2021
Fine-Grained Dynamic Head for Object Detection Lin Song Yanwei Li Zhengkai Jiang Zeming Li Hongbin Sun Jian Sun N. Zheng ObjD 93 45 0 07 Dec 2020
Cross-Layer Distillation with Semantic Calibration Defang Chen Jian-Ping Mei Yuan Zhang Can Wang Yan Feng Chun-Yen Chen FedML 114 304 0 06 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 116 125 0 25 Nov 2020
Deep learning insights into cosmological structure formation Luisa Lucie-Smith H. Peiris A. Pontzen Brian D. Nord Jeyan Thiyagalingam 67 6 0 20 Nov 2020