Convolutional neural networks with low-rank regularization

19 November 2015

Papers citing "Convolutional neural networks with low-rank regularization"

50 / 85 papers shown

Title
A Hardware-Efficient Photonic Tensor Core: Accelerating Deep Neural Networks with Structured Compression Shupeng Ning Hanqing Zhu Chenghao Feng Jiaqi Gu David Z. Pan Ray T. Chen 42 0 0 01 Feb 2025
Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement Gaurav Patel Christopher Sandino Behrooz Mahasseni Ellen L. Zippi Erdrin Azemi Ali Moin Juri Minxha TTA AI4TS 50 3 0 03 Oct 2024
Topological Persistence Guided Knowledge Distillation for Wearable Sensor Data Eun Som Jeon Hongjun Choi A. Shukla Yuan Wang Hyunglae Lee M. Buman Pavan Turaga 35 3 0 07 Jul 2024
Structure-Preserving Network Compression Via Low-Rank Induced Training Through Linear Layers Composition Xitong Zhang Ismail R. Alkhouri Rongrong Wang 43 0 0 06 May 2024
Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward Arnav Chavan Raghav Magazine Shubham Kushwaha M. Debbah Deepak Gupta 18 18 0 02 Feb 2024
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 26 19 0 17 Oct 2023
Survey on Computer Vision Techniques for Internet-of-Things Devices Ishmeet Kaur Adwaita Janardhan Jadhav AI4CE 27 1 0 02 Aug 2023
Knowledge Distillation Under Ideal Joint Classifier Assumption Huayu Li Xiwen Chen G. Ditzler Janet Roveda Ao Li 18 1 0 19 Apr 2023
Are Visual Recognition Models Robust to Image Compression? Joao Maria Janeiro Stanislav Frolov Alaaeldin El-Nouby Jakob Verbeek VLM 28 4 0 10 Apr 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review Li Shen Yan Sun Zhiyuan Yu Liang Ding Xinmei Tian Dacheng Tao VLM 30 41 0 07 Apr 2023
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa Shreyas Saxena Abhay Gupta Sean Lie 36 3 0 21 Mar 2023
DoCoFL: Downlink Compression for Cross-Device Federated Learning Ron Dorfman S. Vargaftik Y. Ben-Itzhak Kfir Y. Levy FedML 32 19 0 01 Feb 2023
SpArX: Sparse Argumentative Explanations for Neural Networks [Technical Report] Hamed Ayoobi Nico Potyka Francesca Toni 24 17 0 23 Jan 2023
CSTAR: Towards Compact and STructured Deep Neural Networks with Adversarial Robustness Huy Phan Miao Yin Yang Sui Bo Yuan S. Zonouz AAML GNN 32 8 0 04 Dec 2022
GhostNetV2: Enhance Cheap Operation with Long-Range Attention Yehui Tang Kai Han Jianyuan Guo Chang Xu Chaoting Xu Yunhe Wang 22 270 0 23 Nov 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 33 0 0 24 Oct 2022
Posterior Regularized Bayesian Neural Network Incorporating Soft and Hard Knowledge Constraints Jiayu Huang Yutian Pang Yongming Liu Hao Yan BDL UQCV 26 15 0 16 Oct 2022
Neural Network Compression by Joint Sparsity Promotion and Redundancy Reduction T. M. Khan Syed S. Naqvi A. Robles-Kelly Erik H. W. Meijering 46 7 0 14 Oct 2022
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search Zhewen Yu C. Bouganis 37 4 0 22 Aug 2022
FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification Xiao-Ze Lin Seungbae Kim Jungseock Joo CVBM 39 38 0 22 Jul 2022
Canonical convolutional neural networks Lokesh Veeramacheneni Moritz Wolter Reinhard Klein Jochen Garcke 26 3 0 03 Jun 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 31 9 0 24 May 2022
Compact Model Training by Low-Rank Projection with Energy Transfer K. Guo Zhenquan Lin Xiaofen Xing Fang Liu Xiangmin Xu 35 2 0 12 Apr 2022
Deep neural network goes lighter: A case study of deep compression techniques on automatic RF modulation recognition for Beyond 5G networks Anu Jagannath Jithin Jagannath Yanzhi Wang Tommaso Melodia 28 3 0 09 Apr 2022
Learning Self-Supervised Low-Rank Network for Single-Stage Weakly and Semi-Supervised Semantic Segmentation Junwen Pan Pengfei Zhu Kaihua Zhang Bing Cao Yu Wang Dingwen Zhang Junwei Han Q. Hu 21 60 0 19 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 46 32 0 10 Mar 2022
Neural Network Module Decomposition and Recomposition Hiroaki Kingetsu Kenichi Kobayashi Taiji Suzuki 27 10 0 25 Dec 2021
Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularization Bo-Shiuan Chu Che-Rung Lee 26 11 0 07 Dec 2021
Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition Junhao Xu Jianwei Yu Shoukang Hu Xunying Liu Helen Meng MQ 30 13 0 29 Nov 2021
Nonlinear Tensor Ring Network Xiao Peng Li Qi Liu Hayden Kwok-Hay So 19 0 0 12 Nov 2021
A compact butterfly-style silicon photonic-electronic neural chip for hardware-efficient deep learning Chenghao Feng Jiaqi Gu Hanqing Zhu Zhoufeng Ying Zheng Zhao David Z. Pan Ray T. Chen 22 39 0 11 Nov 2021
Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching Tahseen Rabbani Brandon Yushan Feng Marco Bornstein Kyle Rui Sang Yifan Yang Arjun Rajkumar A. Varshney Furong Huang FedML 59 2 0 17 Sep 2021
Data-Driven Low-Rank Neural Network Compression D. Papadimitriou Swayambhoo Jain BDL 24 3 0 13 Jul 2021
Learning Gradual Argumentation Frameworks using Genetic Algorithms J. Spieler Nico Potyka Steffen Staab AI4CE 36 4 0 25 Jun 2021
Layer Folding: Neural Network Depth Reduction using Activation Linearization Amir Ben Dror Niv Zehngut Avraham Raviv E. Artyomov Ran Vitek R. Jevnisek 29 20 0 17 Jun 2021
Marginalizable Density Models D. Gilboa Ari Pakman Thibault Vatter BDL 32 5 0 08 Jun 2021
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 65 56 0 03 May 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 21 38 0 20 Mar 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 37 35 0 02 Mar 2021
CNNPruner: Pruning Convolutional Neural Networks with Visual Analytics Guan Li Junpeng Wang Han-Wei Shen Kaixin Chen Guihua Shan Zhonghua Lu AAML 31 47 0 08 Sep 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks Minsoo Kang Bohyung Han AAML 35 139 0 08 Jul 2020
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering Qingqing Cao H. Trivedi A. Balasubramanian Niranjan Balasubramanian 32 66 0 02 May 2020
Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification Huanrui Yang Minxue Tang W. Wen Feng Yan Daniel Hu Ang Li H. Li Yiran Chen 36 63 0 20 Apr 2020
A Survey of Methods for Low-Power Deep Learning and Computer Vision Abhinav Goel Caleb Tung Yung-Hsiang Lu George K. Thiruvathukal VLM 15 92 0 24 Mar 2020
Efficient Crowd Counting via Structured Knowledge Transfer Lingbo Liu Jiaqi Chen Hefeng Wu Tianshui Chen Guanbin Li Liang Lin 29 64 0 23 Mar 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 19 119 0 04 Jan 2020
Efficient Differentiable Neural Architecture Search with Meta Kernels Shoufa Chen Yunpeng Chen Shuicheng Yan Jiashi Feng 19 18 0 10 Dec 2019
Decomposable-Net: Scalable Low-Rank Compression for Neural Networks A. Yaguchi Taiji Suzuki Shuhei Nitta Y. Sakata A. Tanizawa 19 9 0 29 Oct 2019
Adaptative Inference Cost With Convolutional Neural Mixture Models Adria Ruiz Jakob Verbeek VLM 30 22 0 19 Aug 2019
Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations Bohan Zhuang Jing Liu Mingkui Tan Lingqiao Liu Ian Reid Chunhua Shen MQ 29 45 0 10 Aug 2019