Distilling Representations from GAN Generator via Squeeze and Span

6 November 2022

ArXiv (abs)PDF HTML Github (7★)

Papers citing "Distilling Representations from GAN Generator via Squeeze and Span"

50 / 60 papers shown

Title
Learning to Annotate Part Segmentation with Gradient Matching Yu Yang Xiaotian Cheng Hakan Bilen Xiangyang Ji GAN 91 7 0 06 Nov 2022
CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs Jiteng Mu Shalini De Mello Zhiding Yu Nuno Vasconcelos Xinyu Wang Jan Kautz Sifei Liu GAN 53 18 0 30 Mar 2022
GAN-Supervised Dense Visual Alignment William S. Peebles Jun-Yan Zhu Richard Y. Zhang Antonio Torralba Alexei A. Efros Eli Shechtman 78 67 0 09 Dec 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 197 1,360 0 18 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 467 7,814 0 11 Nov 2021
Projected GANs Converge Faster Axel Sauer Kashyap Chitta Jens Muller Andreas Geiger 95 234 0 01 Nov 2021
Alias-Free Generative Adversarial Networks Tero Karras M. Aittala S. Laine Erik Härkönen Janne Hellsten J. Lehtinen Timo Aila GAN 177 1,600 0 23 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
Ensembling with Deep Generative Views Lucy Chai Jun-Yan Zhu Eli Shechtman Phillip Isola Richard Y. Zhang GAN 56 71 0 29 Apr 2021
DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort Yuxuan Zhang Huan Ling Jun Gao K. Yin Jean-Francois Lafleche Adela Barriuso Antonio Torralba Sanja Fidler 3DH GAN VLM 74 335 0 13 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 157 1,868 0 05 Apr 2021
Repurposing GANs for One-shot Semantic Part Segmentation Nontawat Tritrong Pitchaporn Rewatbowornwong Supasorn Suwajanakorn 83 109 0 07 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 335 2,362 0 04 Mar 2021
GAN "Steerability" without optimization Nurit Spingarn-Eliezer Ron Banner T. Michaeli LLMSV 74 56 0 09 Dec 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 114 278 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,067 0 20 Nov 2020
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering Yuxuan Zhang Wenzheng Chen Huan Ling Jun Gao Yinan Zhang Antonio Torralba Sanja Fidler DRL 145 139 0 18 Oct 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,833 0 13 Jun 2020
Training Generative Adversarial Networks with Limited Data Tero Karras M. Aittala Janne Hellsten S. Laine J. Lehtinen Timo Aila GAN 161 1,886 0 11 Jun 2020
GANSpace: Discovering Interpretable GAN Controls Erik Härkönen Aaron Hertzmann J. Lehtinen Sylvain Paris 123 902 0 06 Apr 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 486 3,442 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 372 18,778 0 13 Feb 2020
Unsupervised Discovery of Interpretable Directions in the GAN Latent Space A. Voynov Artem Babenko 138 419 0 10 Feb 2020
Weakly-Supervised Disentanglement Without Compromises Francesco Locatello Ben Poole Gunnar Rätsch Bernhard Schölkopf Olivier Bachem Michael Tschannen CoGe OOD DRL 240 319 0 07 Feb 2020
Controlling generative models with continuous factors of variations Antoine Plumerault Hervé Le Borgne C´eline Hudelot DRL 80 127 0 28 Jan 2020
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 306 5,823 0 03 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 207 12,085 0 13 Nov 2019
On the Efficacy of Knowledge Distillation Ligang He Rui Mao 94 616 0 03 Oct 2019
Interpreting the Latent Space of GANs for Semantic Face Editing Yujun Shen Jinjin Gu Xiaoou Tang Bolei Zhou CVBM GAN 117 1,121 0 25 Jul 2019
On the "steerability" of generative adversarial networks Ali Jahanian Lucy Chai Phillip Isola GAN OOD 129 397 0 16 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 130 543 0 04 Jul 2019
GANalyze: Toward Visual Definitions of Cognitive Image Properties L. Goetschalckx A. Andonian A. Oliva Phillip Isola FAtt GAN 82 314 0 24 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 171 2,409 0 13 Jun 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 141 1,429 0 01 May 2019
Variational Information Distillation for Knowledge Transfer SungSoo Ahn S. Hu Andreas C. Damianou Neil D. Lawrence Zhenwen Dai 89 620 0 11 Apr 2019
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? Rameen Abdal Yipeng Qin Peter Wonka GAN 104 1,110 0 05 Apr 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 593 10,561 0 12 Dec 2018
Large Scale GAN Training for High Fidelity Natural Image Synthesis Andrew Brock Jeff Donahue Karen Simonyan 264 5,401 0 28 Sep 2018
Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students Chenglin Yang Lingxi Xie Siyuan Qiao Alan Yuille 70 136 0 15 May 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 258 3,297 0 21 Mar 2018
Knowledge Transfer with Jacobian Matching Suraj Srinivas François Fleuret 53 170 0 01 Mar 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer Jangho Kim Seonguk Park Nojun Kwak 77 550 0 14 Feb 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 377 11,877 0 11 Jan 2018
Demystifying MMD GANs Mikolaj Binkowski Danica J. Sutherland Michael Arbel Arthur Gretton EGVM 144 1,493 0 04 Jan 2018
Multi-task Self-Supervised Visual Learning Carl Doersch Andrew Zisserman SSL 78 634 0 25 Aug 2017
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Priya Goyal Piotr Dollár Ross B. Girshick P. Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He 3DH 128 3,685 0 08 Jun 2017
Learning from Noisy Labels with Distillation Yuncheng Li Jianchao Yang Yale Song Liangliang Cao Jiebo Luo Li Li NoLa 80 550 0 07 Mar 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 127 2,583 0 12 Dec 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 333 8,169 0 13 Aug 2016
Adversarially Learned Inference Vincent Dumoulin Ishmael Belghazi Ben Poole Olivier Mastropietro Alex Lamb Martín Arjovsky Aaron Courville GAN 81 1,314 0 02 Jun 2016