The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models

12 December 2020

Papers citing "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models"

32 / 82 papers shown

Title
How Well Do Sparse Imagenet Models Transfer? Eugenia Iofinova Alexandra Peste Mark Kurtz Dan Alistarh 24 38 0 26 Nov 2021
You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership Xuxi Chen Tianlong Chen Zhenyu (Allen) Zhang Zhangyang Wang WIGM 24 21 0 30 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021
Universality of Winning Tickets: A Renormalization Group Perspective William T. Redman Tianlong Chen Zhangyang Wang Akshunna S. Dogra UQCV 59 7 0 07 Oct 2021
RRLFSOR: An Efficient Self-Supervised Learning Strategy of Graph Convolutional Networks Feng Sun Ajith Kumar Guanci Yang Qikui Zhu Yiyun Zhang Ansi Zhang Dhruv Makwana SSL GNN 36 0 0 17 Aug 2021
How much pre-training is enough to discover a good subnetwork? Cameron R. Wolfe Fangshuo Liao Qihan Wang J. Kim Anastasios Kyrillidis 30 3 0 31 Jul 2021
Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot? Xiaolong Ma Geng Yuan Xuan Shen Tianlong Chen Xuxi Chen ... Ning Liu Minghai Qin Sijia Liu Zhangyang Wang Yanzhi Wang 19 63 0 01 Jul 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang D. Mocanu OOD 31 49 0 28 Jun 2021
On the Robustness of Pretraining and Self-Supervision for a Deep Learning-based Analysis of Diabetic Retinopathy Vignesh Srinivasan Nils Strodthoff Jackie Ma Alexander Binder Klaus-Robert Muller Wojciech Samek OOD 14 6 0 25 Jun 2021
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration Shiwei Liu Tianlong Chen Xiaohan Chen Zahra Atashgahi Lu Yin Huanyu Kou Li Shen Mykola Pechenizkiy Zhangyang Wang D. Mocanu 34 111 0 19 Jun 2021
A Random CNN Sees Objects: One Inductive Bias of CNN and Its Applications Yun Cao Jianxin Wu SSL 31 26 0 17 Jun 2021
Algorithm to Compilation Co-design: An Integrated View of Neural Network Sparsity Fu-Ming Guo Austin Huang 17 1 0 16 Jun 2021
PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition Cheng-I Jeff Lai Yang Zhang Alexander H. Liu Shiyu Chang Yi-Lun Liao Yung-Sung Chuang Kaizhi Qian Sameer Khurana David D. Cox James R. Glass VLM 57 70 0 10 Jun 2021
Chasing Sparsity in Vision Transformers: An End-to-End Exploration Tianlong Chen Yu Cheng Zhe Gan Lu Yuan Lei Zhang Zhangyang Wang ViT 13 216 0 08 Jun 2021
Dynamic Sparse Training for Deep Reinforcement Learning Ghada Sokar Elena Mocanu D. Mocanu Mykola Pechenizkiy Peter Stone 23 52 0 08 Jun 2021
Efficient Lottery Ticket Finding: Less Data is More Zhenyu (Allen) Zhang Xuxi Chen Tianlong Chen Zhangyang Wang 11 54 0 06 Jun 2021
GANs Can Play Lottery Tickets Too Xuxi Chen Zhenyu (Allen) Zhang Yongduo Sui Tianlong Chen GAN 19 58 0 31 May 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization Chen Liang Simiao Zuo Minshuo Chen Haoming Jiang Xiaodong Liu Pengcheng He T. Zhao Weizhu Chen 20 67 0 25 May 2021
On Lottery Tickets and Minimal Task Representations in Deep Reinforcement Learning Marc Aurel Vischer R. T. Lange Henning Sprekeler OOD UQCV OffRL 17 23 0 04 May 2021
Playing Lottery Tickets with Vision and Language Zhe Gan Yen-Chun Chen Linjie Li Tianlong Chen Yu Cheng Shuohang Wang Jingjing Liu Lijuan Wang Zicheng Liu VLM 106 54 0 23 Apr 2021
The Elastic Lottery Ticket Hypothesis Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Jingjing Liu Zhangyang Wang OOD 23 34 0 30 Mar 2021
Recent Advances on Neural Network Pruning at Initialization Huan Wang Can Qin Yue Bai Yulun Zhang Yun Fu CVBM 33 64 0 11 Mar 2021
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective Tianlong Chen Yu Cheng Zhe Gan Jingjing Liu Zhangyang Wang 18 49 0 28 Feb 2021
Spending Your Winning Lottery Better After Drawing It Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang 22 6 0 08 Jan 2021
SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training Xiaohan Chen Yang Katie Zhao Yue Wang Pengfei Xu Haoran You Chaojian Li Y. Fu Yingyan Lin Zhangyang Wang 38 1 0 04 Jan 2021
EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Zhangyang Wang Jingjing Liu 36 99 0 31 Dec 2020
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 83 60 0 08 Dec 2020
Pre-Trained Image Processing Transformer Hanting Chen Yunhe Wang Tianyu Guo Chang Xu Yiping Deng Zhenhua Liu Siwei Ma Chunjing Xu Chao Xu Wen Gao VLM ViT 37 1,637 0 01 Dec 2020
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 156 345 0 23 Jul 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,375 0 09 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 224 383 0 05 Mar 2020
Explicit Group Sparse Projection with Applications to Deep Learning and NMF Riyasat Ohib Nicolas Gillis Niccolò Dalmasso Sameena Shah Vamsi K. Potluru Sergey Plis 14 8 0 09 Dec 2019