Predicting Parameters in Deep Learning

3 June 2013

Papers citing "Predicting Parameters in Deep Learning"

50 / 240 papers shown

Title
Two is Better than One: Efficient Ensemble Defense for Robust and Compact Models Yoojin Jung Byung Cheol Song AAML VLM MQ 41 0 0 07 Apr 2025
Task Singular Vectors: Reducing Task Interference in Model Merging Antonio Andrea Gargiulo Donato Crisostomi Maria Sofia Bucarelli Simone Scardapane Fabrizio Silvestri Emanuele Rodolà MoMe 95 9 0 26 Nov 2024
Feature Map Similarity Reduction in Convolutional Neural Networks Zakariae Belmekki Jun Li Patrick Reuter David Antonio Gómez Jáuregui Karl Jenkins 31 0 0 05 Nov 2024
Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement Gaurav Patel Christopher Sandino Behrooz Mahasseni Ellen L. Zippi Erdrin Azemi Ali Moin Juri Minxha TTA AI4TS 55 3 0 03 Oct 2024
Convolutional Kolmogorov-Arnold Networks Alexander Dylan Bodner Antonio Santiago Tepsich Jack Natan Spolski Santiago Pourteau 42 68 0 19 Jun 2024
Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation Can Yaras Peng Wang Laura Balzano Qing Qu AI4CE 39 14 0 06 Jun 2024
Structure-Preserving Network Compression Via Low-Rank Induced Training Through Linear Layers Composition Xitong Zhang Ismail R. Alkhouri Rongrong Wang 50 0 0 06 May 2024
Convolutional Neural Network Compression via Dynamic Parameter Rank Pruning Manish Sharma Jamison Heard Eli Saber Panos P. Markopoulos 31 1 0 15 Jan 2024
RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures Anastasiia Prutianova Alexey Zaytsev Chung-Kuei Lee Fengyu Sun Ivan Koryakovskiy MQ 26 0 0 09 Nov 2023
Compression of Recurrent Neural Networks using Matrix Factorization Lucas Maison Hélion Marie du Mas des Bourboux Thomas Courtat 25 0 0 19 Oct 2023
Q-YOLO: Efficient Inference for Real-time Object Detection Mingze Wang H. Sun Jun Shi Xuhui Liu Baochang Zhang Xianbin Cao ObjD 42 8 0 01 Jul 2023
$Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph$ Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph Camilo Ruiz Hongyu Ren Kexin Huang J. Leskovec 33 2 0 07 Jun 2023
MetaGait: Learning to Learn an Omni Sample Adaptive Representation for Gait Recognition Huanzhang Dou Pengyi Zhang Wei Su Yunlong Yu Xi Li CVBM 31 31 0 06 Jun 2023
Analyzing Compression Techniques for Computer Vision Maniratnam Mandal Imran Khan 27 1 0 14 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models D. Honegger Konstantin Schurholt Damian Borth 37 4 0 26 Apr 2023
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer Sheng Xu Yanjing Li Mingbao Lin Penglei Gao Guodong Guo Jinhu Lu Baochang Zhang MQ 37 23 0 01 Apr 2023
Directional Connectivity-based Segmentation of Medical Images Ziyun Yang Sina Farsiu 38 36 0 31 Mar 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 36 4 0 22 Mar 2023
Considering Layerwise Importance in the Lottery Ticket Hypothesis Benjamin Vandersmissen José Oramas 37 1 0 22 Feb 2023
Learning a Consensus Sub-Network with Polarization Regularization and One Pass Training Xiaoying Zhi Varun Babbar P. Sun Fran Silavong Ruibo Shi Sean J. Moran Sean Moran 60 1 0 17 Feb 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 40 7 0 19 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 172 87 0 16 Jan 2023
Deep Diversity-Enhanced Feature Representation of Hyperspectral Images Jinhui Hou Zhiyu Zhu Junhui Hou Hui Liu Huanqiang Zeng Deyu Meng 18 6 0 15 Jan 2023
Constructing Organism Networks from Collaborative Self-Replicators Steffen Illium Maximilian Zorn Cristian Lenta Michael Kolle Claudia Linnhoff-Popien Thomas Gabor 21 0 0 20 Dec 2022
Structural Knowledge Distillation for Object Detection Philip de Rijk Lukas Schneider Marius Cordts D. Gavrila 27 24 0 23 Nov 2022
Embedding Compression for Text Classification Using Dictionary Screening Jing Zhou Xinru Jing Mu Liu Hansheng Wang 29 0 0 23 Nov 2022
Sparsity in Continuous-Depth Neural Networks H. Aliee Till Richter Mikhail Solonin I. Ibarra Fabian J. Theis Niki Kilbertus 36 10 0 26 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 56 68 0 08 Oct 2022
IDa-Det: An Information Discrepancy-aware Distillation for 1-bit Detectors Sheng Xu Yanjing Li Bo-Wen Zeng Teli Ma Baochang Zhang Xianbin Cao Penglei Gao Jinhu Lv 30 15 0 07 Oct 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models Konstantin Schurholt Diyar Taskiran Boris Knyazev Xavier Giró-i-Nieto Damian Borth 60 29 0 29 Sep 2022
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models Rohan Anil S. Gadanho Danya Huang Nijith Jacob Zhuoshu Li ... Cristina Pop Kevin Regan G. Shamir Rakesh Shivanna Qiqi Yan 3DV 29 41 0 12 Sep 2022
What to Prune and What Not to Prune at Initialization Maha Haroon 18 0 0 06 Sep 2022
Recurrent Bilinear Optimization for Binary Neural Networks Sheng Xu Yanjing Li Tian Wang Teli Ma Baochang Zhang Peng Gao Yu Qiao Jinhu Lv Guodong Guo MQ 22 14 0 04 Sep 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 50 3 0 22 Aug 2022
Enhancing Targeted Attack Transferability via Diversified Weight Pruning Hung-Jui Wang Yuehua Wu Shang-Tse Chen AAML 37 2 0 18 Aug 2022
Quantum-Inspired Tensor Neural Networks for Partial Differential Equations Raj G. Patel Chia-Wei Hsing Serkan Şahi̇n S. Jahromi Samuel Palmer ... Stephane Aubert Pierre Castellani Chi-Guhn Lee Samuel Mugel Roman Orus 29 14 0 03 Aug 2022
Fault Detection and Classification of Aerospace Sensors using a VGG16-based Deep Neural Network Zhongzhi Li Yunmei Zhao Jinyi Ma J. Ai Yiqun Dong 18 2 0 27 Jul 2022
Defending against the Label-flipping Attack in Federated Learning N. Jebreel J. Domingo-Ferrer David Sánchez Alberto Blanco-Justicia AAML 18 36 0 05 Jul 2022
PrUE: Distilling Knowledge from Sparse Teacher Networks Shaopu Wang Xiaojun Chen Mengzhen Kou Jinqiao Shi 27 2 0 03 Jul 2022
FL-Defender: Combating Targeted Attacks in Federated Learning N. Jebreel J. Domingo-Ferrer AAML FedML 43 57 0 02 Jul 2022
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm Aidan Good Jia-Huei Lin Hannah Sieg Mikey Ferguson Xin Yu Shandian Zhe J. Wieczorek Thiago Serra 42 11 0 07 Jun 2022
Blueprint Separable Residual Network for Efficient Image Super-Resolution Zheyu Li Yingqi Liu Xiangyu Chen Haoming Cai Jinjin Gu Yu Qiao Chao Dong 35 132 0 12 May 2022
Statistical Guarantees for Approximate Stationary Points of Simple Neural Networks Mahsa Taheri Fang Xie Johannes Lederer 31 0 0 09 May 2022
Multiply-and-Fire (MNF): An Event-driven Sparse Neural Network Accelerator Miao Yu Tingting Xiang Venkata Pavan Kumar Miriyala Trevor E. Carlson 23 1 0 20 Apr 2022
Learning Compressed Embeddings for On-Device Inference Niketan Pansare J. Katukuri Aditya Arora F. Cipollone R. Shaik Noyan Tokgozoglu Chandru Venkataraman 37 14 0 18 Mar 2022
Compressing CNN Kernels for Videos Using Tucker Decompositions: Towards Lightweight CNN Applications Tobias Engelhardt Rasmussen Line H. Clemmensen Andreas Baum 35 4 0 10 Mar 2022
Data-Efficient Structured Pruning via Submodular Optimization Marwa El Halabi Suraj Srinivas Simon Lacoste-Julien 22 18 0 09 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 44 48 0 09 Mar 2022
Symmetric Convolutional Filters: A Novel Way to Constrain Parameters in CNN Harish Agrawal T. Sumana S. Nandy 22 0 0 26 Feb 2022
Distilled Neural Networks for Efficient Learning to Rank F. M. Nardini Cosimo Rulli Salvatore Trani Rossano Venturini FedML 29 16 0 22 Feb 2022