v1v2 (latest)

DiracNets: Training Very Deep Neural Networks Without Skip-Connections

1 June 2017

ArXiv (abs)PDF HTML Github (586★)

Papers citing "DiracNets: Training Very Deep Neural Networks Without Skip-Connections"

50 / 52 papers shown

Title
Auto-Compressing Networks Vaggelis Dorovatas Georgios Paraskevopoulos Alexandros Potamianos 72 0 0 11 Jun 2025
Gap Preserving Distillation by Building Bidirectional Mappings with A Dynamic Teacher Yong Guo Shulian Zhang Haolin Pan Jing Liu Yulun Zhang Jian Chen 93 0 0 05 Oct 2024
TopoNAS: Boosting Search Efficiency of Gradient-based NAS via Topological Simplification Giacomo Vedovati ShiNung Ching Bo Yuan 91 0 0 02 Aug 2024
Enhancing Monotonic Modeling with Spatio-Temporal Adaptive Awareness in Diverse Marketing Bin Li Jiayan Pei Feiyang Xiao Yifan Zhao Zhixing Zhang Diwei Liu Hengxu He Jia Jia 83 0 0 20 Jun 2024
LIPT: Latency-aware Image Processing Transformer Junbo Qiao Wei Li Haizhen Xie Hanting Chen Yunshuai Zhou Zhijun Tu Jie Hu Shaohui Lin SupR VLM 110 2 0 09 Apr 2024
Pre-Trained Model Recommendation for Downstream Fine-tuning Jiameng Bai Sai Wu Mingli Song Junbo Zhao Gang Chen 126 3 0 11 Mar 2024
Adaptive Discovering and Merging for Incremental Novel Class Discovery Guangyao Chen Peixi Peng Yangru Huang Mengyue Geng Yonghong Tian CLL MoMe 93 9 0 06 Mar 2024
Towards Accurate Post-training Quantization for Reparameterized Models Luoming Zhang Yefei He Wen Fei Zhenyu Lou Weijia Wu YangWei Ying Hong Zhou MQ 83 0 0 25 Feb 2024
Peeking Behind the Curtains of Residual Learning Tunhou Zhang Feng Yan Hai Helen Li Yiran Chen 34 0 0 13 Feb 2024
$HyperZ$\cdot$Z$\cdot$W Operator Connects Slow-Fast Networks for Full Context Interaction$ HyperZ $\cdot$ Z $\cdot$ W Operator Connects Slow-Fast Networks for Full Context Interaction Harvie Zhang 63 0 0 31 Jan 2024
Improved Implicit Neural Representation with Fourier Reparameterized Training Kexuan Shi Xingyu Zhou Shuhang Gu 182 21 0 15 Jan 2024
RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures Anastasiia Prutianova Alexey Zaytsev Chung-Kuei Lee Fengyu Sun Ivan Koryakovskiy MQ 71 0 0 09 Nov 2023
On Unsupervised Image-to-image translation and GAN stability BahaaEddin AlAila Zahra Jandaghi Abolfazl Farahani M. Al-Saad GAN 54 1 0 18 Oct 2023
RefConv: Re-parameterized Refocusing Convolution for Powerful ConvNets Zhicheng Cai Xiaohan Ding Qiu Shen Xun Cao 76 20 0 16 Oct 2023
Understanding Parameter Sharing in Transformers Ye Lin Mingxuan Wang Zhexi Zhang Xiaohui Wang Tong Xiao Jingbo Zhu MoE 87 2 0 15 Jun 2023
Efficient Skip Connections Realization for Secure Inference on Encrypted Data Nir Drucker Itamar Zimerman 43 1 0 11 Jun 2023
FalconNet: Factorization for the Light-weight ConvNets Zhicheng Cai Qiu Shen 125 14 0 10 Jun 2023
Multi-Path Transformer is Better: A Case Study on Neural Machine Translation Ye Lin Shuhan Zhou Yanyang Li Anxiang Ma Tong Xiao Jingbo Zhu 83 0 0 10 May 2023
RIFormer: Keep Your Vision Backbone Effective While Removing Token Mixer Jiahao Wang Songyang Zhang Yong Liu Taiqiang Wu Yujiu Yang Xihui Liu Kai-xiang Chen Ping Luo Dahua Lin 85 22 0 12 Apr 2023
InceptionNeXt: When Inception Meets ConvNeXt Weihao Yu Pan Zhou Shuicheng Yan Xinchao Wang 194 142 0 29 Mar 2023
QuickSRNet: Plain Single-Image Super-Resolution Architecture for Faster Inference on Mobile Platforms Guillaume Berger Manik Dhingra Antoine Mercier Yash Savani Sunny Panchal Fatih Porikli SupR 75 5 0 08 Mar 2023
Towards Efficient Visual Adaption via Structural Re-parameterization Gen Luo Minglang Huang Yiyi Zhou Xiaoshuai Sun Guannan Jiang Zhiyu Wang Rongrong Ji VLM VPVLM 114 82 0 16 Feb 2023
Unlocking Deterministic Robustness Certification on ImageNet Kaiqin Hu Andy Zou Zifan Wang Klas Leino Matt Fredrikson OOD 135 14 0 29 Jan 2023
Tailor: Altering Skip Connections for Resource-Efficient Inference Olivia Weng Gabriel Marcano Vladimir Loncar Alireza Khodamoradi Nojan Sheybani Andres Meza F. Koushanfar K. Denolf Javier Mauricio Duarte Ryan Kastner 104 13 0 18 Jan 2023
RepMode: Learning to Re-parameterize Diverse Experts for Subcellular Structure Prediction Donghao Zhou Chunbin Gu Junde Xu Furui Liu Qiong Wang Guangyong Chen Pheng-Ann Heng MoE 69 4 0 20 Dec 2022
Make RepVGG Greater Again: A Quantization-aware Approach Xiangxiang Chu Liang Li Bo Zhang MQ 144 51 0 03 Dec 2022
AugOp: Inject Transformation into Neural Operator Longqing Ye ViT 51 0 0 23 Nov 2022
RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization Chengpeng Chen Zichao Guo Haien Zeng Pengfei Xiong Jian Dong 97 43 0 11 Nov 2022
Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report Andrey D. Ignatov Radu Timofte Maurizio Denna Abdelbadie Younes Ganzorig Gankhuyag ... Jing Liu Garas Gendy Nabil Sabor J. Hou Guanghui He SupR MQ 99 32 0 07 Nov 2022
What Makes Convolutional Models Great on Long Sequence Modeling? Yuhong Li Tianle Cai Yi Zhang De-huai Chen Debadeepta Dey VLM 115 99 0 17 Oct 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 127 265 0 17 Oct 2022
Inference Latency Prediction at the Edge Zhuojin Li Marco Paolieri L. Golubchik 71 3 0 06 Oct 2022
Constrained Monotonic Neural Networks D. Runje Sharath M. Shankaranarayana 66 20 0 24 May 2022
RepSR: Training Efficient VGG-style Super-Resolution Networks with Structural Re-Parameterization and Batch Normalization Xintao Wang Chao Dong Ying Shan 135 48 0 11 May 2022
Boosting Pruned Networks with Linear Over-parameterization Yundi Qian Siyuan Pan Xiaoshuang Li Jie Zhang Liang Hou Xiaobing Tu 59 2 0 25 Apr 2022
RMNet: Equivalently Removing Residual Connection from Networks Fanxu Meng Hao Cheng Jia-Xin Zhuang Ke Li Xing Sun 62 11 0 01 Nov 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 145 10 0 12 Jul 2021
Joint-DetNAS: Upgrade Your Detector with NAS, Pruning and Dynamic Distillation Lewei Yao Renjie Pi Hang Xu Wei Zhang Zhenguo Li Tong Zhang 144 41 0 27 May 2021
A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks Asaf Noy Yi Tian Xu Y. Aflalo Lihi Zelnik-Manor Rong Jin 93 3 0 12 Jan 2021
RepVGG: Making VGG-style ConvNets Great Again Xiaohan Ding Xinming Zhang Ningning Ma Jungong Han Guiguang Ding Jian Sun 320 1,630 0 11 Jan 2021
Deep Isometric Learning for Visual Recognition Haozhi Qi Chong You Xinyu Wang Yi-An Ma Jitendra Malik VLM 110 55 0 30 Jun 2020
On the Demystification of Knowledge Distillation: A Residual Network Perspective N. Jha Rajat Saini Sparsh Mittal 59 4 0 30 Jun 2020
Deep Learning for Image Denoising: A Survey Chunwei Tian Yong-mei Xu Lunke Fei Ke Yan 88 93 0 11 Oct 2018
Neural Proximal Gradient Descent for Compressive Imaging Morteza Mardani Qingyun Sun Shreyas S. Vasawanala Vardan Papyan Hatef Monajemi John M. Pauly D. Donoho 124 155 0 01 Jun 2018
Single Image Super-Resolution via Cascaded Multi-Scale Cross Network Yanting Hu Xinbo Gao Jie Li Yuanfei Huang Hanzi Wang SupR 76 52 0 24 Feb 2018
Overcoming the vanishing gradient problem in plain recurrent networks Yuhuang Hu Adrian E. G. Huber Jithendar Anumula Shih-Chii Liu GNN 102 104 0 18 Jan 2018
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions George Philipp Basel Alomair J. Carbonell ODL 117 46 0 15 Dec 2017
CrescendoNet: A Simple Deep Convolutional Neural Network with Ensemble Behavior Xiang Zhang Nishant Vishwamitra Hongxin Hu Feng Luo 42 2 0 30 Oct 2017
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations Yiping Lu Aoxiao Zhong Quanzheng Li Bin Dong 241 505 0 27 Oct 2017
FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising Peng Sun W. Zuo Lei Zhang 187 2,145 0 11 Oct 2017