Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness

22 July 2022

Kang Zhang

In So Kweon

ArXiv (abs)PDF HTML Github (19★)

Papers citing "Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness"

50 / 62 papers shown

Title
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo Chaoning Zhang Kang Zhang T. Pham Axi Niu Zhinan Qiao Chang D. Yoo In So Kweon 107 57 0 30 Mar 2022
How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning Chaoning Zhang Kang Zhang Chenshuang Zhang T. Pham Chang D. Yoo In So Kweon SSL 70 74 0 30 Mar 2022
When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning? Lijie Fan Sijia Liu Pin-Yu Chen Gaoyuan Zhang Chuang Gan AAML VLM 78 124 0 01 Nov 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 225 190 0 13 Oct 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 99 213 0 17 Jun 2021
XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Hervé Jégou ViT 146 513 0 17 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
Universal Adversarial Training with Class-Wise Perturbations Philipp Benz Chaoning Zhang Adil Karjauv In So Kweon AAML 48 27 0 07 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 157 1,868 0 05 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 344 2,362 0 04 Mar 2021
Universal Adversarial Perturbations Through the Lens of Deep Steganography: Towards A Fourier Perspective Chaoning Zhang Philipp Benz Adil Karjauv In So Kweon AAML 76 42 0 12 Feb 2021
Adversarial Momentum-Contrastive Pre-Training Cong Xu Dan Li Min Yang SSL 60 15 0 24 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,067 0 20 Nov 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li SSL 77 689 0 18 Nov 2020
Robust Pre-Training by Adversarial Contrastive Learning Ziyu Jiang Tianlong Chen Ting-Li Chen Zhangyang Wang 98 234 0 26 Oct 2020
ResNet or DenseNet? Introducing Dense Shortcuts to ResNet Chaoning Zhang Philipp Benz Dawit Mureja Argaw Seokju Lee Junsik Kim François Rameau Jean-Charles Bazin In So Kweon 56 114 0 23 Oct 2020
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 295 115 0 20 Oct 2020
Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examples Sven Gowal Chongli Qin J. Uesato Timothy A. Mann Pushmeet Kohli AAML 55 331 0 07 Oct 2020
Double Targeted Universal Adversarial Perturbations Philipp Benz Chaoning Zhang Tooba Imtiaz In So Kweon AAML 76 48 0 07 Oct 2020
Bag of Tricks for Adversarial Training Tianyu Pang Xiao Yang Yinpeng Dong Hang Su Jun Zhu AAML 78 269 0 01 Oct 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 93 315 0 13 Jul 2020
Understanding Adversarial Examples from the Mutual Influence of Images and Perturbations Chaoning Zhang Philipp Benz Tooba Imtiaz In-So Kweon SSL AAML 67 119 0 13 Jul 2020
Smooth Adversarial Training Cihang Xie Mingxing Tan Boqing Gong Alan Yuille Quoc V. Le OOD 80 154 0 25 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 249 4,097 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 374 6,833 0 13 Jun 2020
Adversarial Self-Supervised Contrastive Learning Minseon Kim Jihoon Tack Sung Ju Hwang SSL 66 251 0 13 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 160 1,854 0 20 May 2020
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Tianlong Chen Sijia Liu Shiyu Chang Yu Cheng Lisa Amini Zhangyang Wang AAML 61 250 0 28 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 486 3,442 0 09 Mar 2020
Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks Francesco Croce Matthias Hein AAML 224 1,855 0 03 Mar 2020
DC-BERT: Decoupling Question and Document for Efficient Contextual Encoding Yuyu Zhang Ping Nie Xiubo Geng Arun Ramamurthy Le Song Daxin Jiang 64 61 0 28 Feb 2020
Overfitting in adversarially robust deep learning Leslie Rice Eric Wong Zico Kolter 113 804 0 26 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
Where is the Bottleneck of Adversarial Learning with Unlabeled Data? Jingfeng Zhang Bo Han Gang Niu Tongliang Liu Masashi Sugiyama 106 6 0 20 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 207 12,121 0 13 Nov 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 371 6,463 0 26 Sep 2019
VL-BERT: Pre-training of Generic Visual-Linguistic Representations Weijie Su Xizhou Zhu Yue Cao Bin Li Lewei Lu Furu Wei Jifeng Dai VLM MLLM SSL 169 1,666 0 22 Aug 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 174 2,409 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 195 1,476 0 03 Jun 2019
Adversarially Robust Generalization Just Requires More Unlabeled Data Runtian Zhai Tianle Cai Di He Chen Dan Kun He John E. Hopcroft Liwei Wang 68 158 0 03 Jun 2019
Unlabeled Data Improves Adversarial Robustness Y. Carmon Aditi Raghunathan Ludwig Schmidt Percy Liang John C. Duchi 130 754 0 31 May 2019
Are Labels Required for Improving Adversarial Robustness? J. Uesato Jean-Baptiste Alayrac Po-Sen Huang Robert Stanforth Alhussein Fawzi Pushmeet Kohli AAML 74 334 0 31 May 2019
Robustness to Adversarial Perturbations in Learning from Incomplete Data Amir Najafi S. Maeda Masanori Koyama Takeru Miyato OOD 83 131 0 24 May 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 138 1,432 0 22 May 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 95 447 0 29 Mar 2019
Theoretically Principled Trade-off between Robustness and Accuracy Hongyang R. Zhang Yaodong Yu Jiantao Jiao Eric Xing L. Ghaoui Michael I. Jordan 140 2,559 0 24 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,114 0 11 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 335 2,670 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,349 0 10 Jul 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 179 3,465 0 05 May 2018