On the Effect of Pruning on Adversarial Robustness

10 August 2021

Papers citing "On the Effect of Pruning on Adversarial Robustness"

50 / 53 papers shown

Title
DropNet: Reducing Neural Network Complexity via Iterative Pruning Chong Min John Tan Mehul Motani 55 55 0 14 Jul 2022
Does enhanced shape bias improve neural network robustness to common corruptions? Chaithanya Kumar Mummadi Ranjitha Subramaniam Robin Hutmacher Julien Vitay Volker Fischer J. H. Metzen 91 40 0 20 Apr 2021
Improving Adversarial Robustness via Channel-wise Activation Suppressing Yang Bai Yuyuan Zeng Yong Jiang Shutao Xia Xingjun Ma Yisen Wang AAML 64 131 0 11 Mar 2021
Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth Yihe Dong Jean-Baptiste Cordonnier Andreas Loukas 115 385 0 05 Mar 2021
Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not? Ning Liu Geng Yuan Zhengping Che Xuan Shen Xiaolong Ma Qing Jin Jian Ren Jian Tang Sijia Liu Yanzhi Wang 65 32 0 19 Feb 2021
Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets Kai Han Yunhe Wang Qiulin Zhang Wei Zhang Chunjing Xu Tong Zhang 59 88 0 28 Oct 2020
How Does Mixup Help With Robustness and Generalization? Linjun Zhang Zhun Deng Kenji Kawaguchi Amirata Ghorbani James Zou AAML 78 250 0 09 Oct 2020
Bag of Tricks for Adversarial Training Tianyu Pang Xiao Yang Yinpeng Dong Hang Su Jun Zhu AAML 66 269 0 01 Oct 2020
Informative Dropout for Robust Representation Learning: A Shape-bias Perspective Baifeng Shi Dinghuai Zhang Qi Dai Zhanxing Zhu Yadong Mu Jingdong Wang OOD 56 112 0 10 Aug 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu Furu Wei 47 341 0 07 Jun 2020
An Empirical Evaluation on Robustness and Uncertainty of Regularization Methods Sanghyuk Chun Seong Joon Oh Sangdoo Yun Dongyoon Han Junsuk Choe Y. Yoo AAML OOD 395 53 0 09 Mar 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 265 1,050 0 06 Mar 2020
Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection Mao Ye Chengyue Gong Lizhen Nie Denny Zhou Adam R. Klivans Qiang Liu 64 110 0 03 Mar 2020
Understanding and Mitigating the Tradeoff Between Robustness and Accuracy Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang AAML 84 228 0 25 Feb 2020
HRank: Filter Pruning using High-Rank Feature Map Mingbao Lin Rongrong Ji Yan Wang Yichen Zhang Baochang Zhang Yonghong Tian Ling Shao 67 725 0 24 Feb 2020
Triple Wins: Boosting Accuracy, Robustness and Efficiency Together by Enabling Input-Adaptive Inference Ting-Kuei Hu Tianlong Chen Haotao Wang Zhangyang Wang OOD AAML 3DH 53 84 0 24 Feb 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 278 1,205 0 24 Dec 2019
Linear Mode Connectivity and the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin MoMe 146 618 0 11 Dec 2019
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty Dan Hendrycks Norman Mu E. D. Cubuk Barret Zoph Justin Gilmer Balaji Lakshminarayanan OOD UQCV 100 1,300 0 05 Dec 2019
Adversarial Examples Improve Image Recognition Cihang Xie Mingxing Tan Boqing Gong Jiang Wang Alan Yuille Quoc V. Le AAML 116 565 0 21 Nov 2019
Neural Network Pruning with Residual-Connections and Limited-Data Jian-Hao Luo Jianxin Wu 61 114 0 19 Nov 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 117 592 0 25 Sep 2019
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt D. Song OODD 200 1,469 0 16 Jul 2019
Adversarial Training Can Hurt Generalization Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang 82 242 0 14 Jun 2019
Intriguing properties of adversarial training at scale Cihang Xie Alan Yuille AAML 46 68 0 10 Jun 2019
The Generalization-Stability Tradeoff In Neural Network Pruning Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 69 76 0 09 Jun 2019
Unlabeled Data Improves Adversarial Robustness Y. Carmon Aditi Raghunathan Ludwig Schmidt Percy Liang John C. Duchi 121 752 0 31 May 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 137 18,115 0 28 May 2019
OICSR: Out-In-Channel Sparsity Regularization for Compact Deep Neural Networks Jiashi Li Q. Qi Jingyu Wang Ce Ge Yujian Betterest Li Zhangzhang Yue Haifeng Sun BDL CML 51 53 0 28 May 2019
Adversarially robust transfer learning Ali Shafahi Parsa Saadatpanah Chen Zhu Amin Ghiasi Christoph Studer David Jacobs Tom Goldstein OOD 44 116 0 20 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 609 4,778 0 13 May 2019
Towards Efficient Model Compression via Learned Global Ranking Ting-Wu Chin Ruizhou Ding Cha Zhang Diana Marculescu 54 171 0 28 Apr 2019
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Karthik A. Sankararaman Soham De Zheng Xu Wenjie Huang Tom Goldstein ODL 59 104 0 15 Apr 2019
A Target-Agnostic Attack on Deep Models: Exploiting Security Vulnerabilities of Transfer Learning Shahbaz Rezaei Xin Liu SILM AAML 122 46 0 08 Apr 2019
Adversarial Robustness vs Model Compression, or Both? Shaokai Ye Kaidi Xu Sijia Liu Jan-Henrik Lambrechts Huan Zhang Aojun Zhou Kaisheng Ma Yanzhi Wang Xue Lin AAML 55 165 0 29 Mar 2019
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations Dan Hendrycks Thomas G. Dietterich OOD VLM 170 3,431 0 28 Mar 2019
Are All Layers Created Equal? Chiyuan Zhang Samy Bengio Y. Singer 58 140 0 06 Feb 2019
Using Pre-Training Can Improve Model Robustness and Uncertainty Dan Hendrycks Kimin Lee Mantas Mazeika NoLa 71 727 0 28 Jan 2019
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness Robert Geirhos Patricia Rubisch Claudio Michaelis Matthias Bethge Felix Wichmann Wieland Brendel 100 2,668 0 29 Nov 2018
ExpandNets: Linear Over-parameterization to Train Compact Convolutional Networks Shuxuan Guo J. Álvarez Mathieu Salzmann 66 80 0 26 Nov 2018
Spectral Signatures in Backdoor Attacks Brandon Tran Jerry Li Aleksander Madry AAML 88 788 0 01 Nov 2018
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration Yang He Ping Liu Ziwei Wang Zhilan Hu Yi Yang AAML 3DPC 90 1,048 0 01 Nov 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 36 1,471 0 11 Oct 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 225 3,463 0 09 Mar 2018
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 93 385 0 30 Nov 2017
SkipNet: Learning Dynamic Routing in Convolutional Networks Xin Wang Feng Yu Zi-Yi Dou Trevor Darrell Joseph E. Gonzalez 101 636 0 26 Nov 2017
BlockDrop: Dynamic Inference Paths in Residual Networks Zuxuan Wu Tushar Nagarajan Abhishek Kumar Steven J. Rennie L. Davis Kristen Grauman Rogerio Feris 87 466 0 22 Nov 2017
Mitigating Adversarial Effects Through Randomization Cihang Xie Jianyu Wang Zhishuai Zhang Zhou Ren Alan Yuille AAML 113 1,058 0 06 Nov 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 83 561 0 05 Jul 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 304 12,063 0 19 Jun 2017