Learning Robust Global Representations by Penalizing Local Predictive Power

29 May 2019

Papers citing "Learning Robust Global Representations by Penalizing Local Predictive Power"

50 / 238 papers shown

Title
Enhance the Visual Representation via Discrete Adversarial Training Xiaofeng Mao YueFeng Chen Ranjie Duan Yao Zhu Gege Qi Shaokai Ye Xiaodan Li Rong Zhang Hui Xue 44 31 0 16 Sep 2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei 29 306 0 12 Aug 2022
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 47 99 0 10 Aug 2022
Visual correspondence-based explanations improve AI robustness and human-AI team accuracy Giang Nguyen Mohammad Reza Taesiri Anh Totti Nguyen 30 42 0 26 Jul 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip Torr P. Dokania UQCV AAML 33 49 0 22 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 60 71 0 19 Jul 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 45 38 0 18 Jul 2022
Contrastive Adapters for Foundation Model Group Robustness Michael Zhang Christopher Ré VLM 18 62 0 14 Jul 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 32 16 0 14 Jul 2022
Convolutional Bypasses Are Better Vision Transformer Adapters Shibo Jie Zhi-Hong Deng VPVLM 21 131 0 14 Jul 2022
Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation Ashraful Islam Bengt Lundell H. Sawhney Sudipta N. Sinha Peter Morales Richard J. Radke SSL 34 10 0 10 Jul 2022
Removing Batch Normalization Boosts Adversarial Training Haotao Wang Aston Zhang Shuai Zheng Xingjian Shi Mu Li Zhangyang Wang 40 41 0 04 Jul 2022
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip Torr P. Dokania UQCV 33 34 0 29 Jun 2022
How Robust is Unsupervised Representation Learning to Distribution Shift? Yuge Shi Imant Daunhawer Julia E. Vogt Philip Torr Amartya Sanyal OOD 35 25 0 17 Jun 2022
A Meta-Analysis of Distributionally-Robust Models Ben Feuer Ameya Joshi C. Hegde OOD VLM 40 3 0 15 Jun 2022
INDIGO: Intrinsic Multimodality for Domain Generalization Puneet Mangla Shivam Chandhok Milan Aggarwal V. Balasubramanian Balaji Krishnamurthy VLM 41 2 0 13 Jun 2022
Neural Prompt Search Yuanhan Zhang Kaiyang Zhou Ziwei Liu VPVLM VLM 43 144 0 09 Jun 2022
Optimizing Relevance Maps of Vision Transformers Improves Robustness Hila Chefer Idan Schwartz Lior Wolf ViT 35 38 0 02 Jun 2022
Prefix Conditioning Unifies Language and Label Supervision Kuniaki Saito Kihyuk Sohn Xinming Zhang Chun-Liang Li Chen-Yu Lee Kate Saenko Tomas Pfister VLM CLIP 34 16 0 02 Jun 2022
CropMix: Sampling a Rich Input Distribution via Multi-Scale Cropping Junlin Han L. Petersson Hongdong Li Ian Reid 36 9 0 31 May 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 189 272 0 30 May 2022
SupMAE: Supervised Masked Autoencoders Are Efficient Vision Learners Feng Liang Yangguang Li Diana Marculescu SSL TPM ViT 51 22 0 28 May 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 182 133 0 28 May 2022
Linear Connectivity Reveals Generalization Strategies Jeevesh Juneja Rachit Bansal Kyunghyun Cho João Sedoc Naomi Saphra 244 45 0 24 May 2022
Learn2Weight: Parameter Adaptation against Similar-domain Adversarial Attacks Siddhartha Datta AAML 34 4 0 15 May 2022
When does dough become a bagel? Analyzing the remaining mistakes on ImageNet Vijay Vasudevan Benjamin Caine Raphael Gontijo-Lopes Sara Fridovich-Keil Rebecca Roelofs VLM UQCV 46 57 0 09 May 2022
Sequencer: Deep LSTM for Image Classification Yuki Tatsunami Masato Taki VLM ViT 19 78 0 04 May 2022
CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu Zirui Wang Vijay Vasudevan Legg Yeung Mojtaba Seyedhosseini Yonghui Wu VLM CLIP OffRL 79 1,262 0 04 May 2022
Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP) Alex Fang Gabriel Ilharco Mitchell Wortsman Yu Wan Vaishaal Shankar Achal Dave Ludwig Schmidt VLM OOD 33 139 0 03 May 2022
Causal Transportability for Visual Recognition Chengzhi Mao K. Xia James Wang Hongya Wang Junfeng Yang Elias Bareinboim Carl Vondrick CML OOD BDL 30 35 0 26 Apr 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 31 310 0 14 Apr 2022
No Token Left Behind: Explainability-Aided Image Classification and Generation Roni Paiss Hila Chefer Lior Wolf VLM 34 29 0 11 Apr 2022
The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalization Zeyi Huang Haohan Wang Dong Huang Yong Jae Lee Eric P. Xing 16 22 0 09 Apr 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 44 265 0 04 Apr 2022
Improving Vision Transformers by Revisiting High-frequency Components Jiawang Bai Liuliang Yuan Shutao Xia Shuicheng Yan Zhifeng Li Wei Liu ViT 16 90 0 03 Apr 2022
Generating High Fidelity Data from Low-density Regions using Diffusion Models Vikash Sehwag C. Hazirbas Albert Gordo Firat Ozgenel Cristian Canton Ferrer DiffM 38 66 0 31 Mar 2022
WOODS: Benchmarks for Out-of-Distribution Generalization in Time Series Jean-Christophe Gagnon-Audet Kartik Ahuja Mohammad Javad Darvishi Bayazi Pooneh Mousavi G. Dumas Irina Rish OOD CML AI4TS 32 29 0 18 Mar 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time Mitchell Wortsman Gabriel Ilharco S. Gadre Rebecca Roelofs Raphael Gontijo-Lopes ... Hongseok Namkoong Ali Farhadi Y. Carmon Simon Kornblith Ludwig Schmidt MoMe 54 922 1 10 Mar 2022
Global-Local Regularization Via Distributional Robustness Hoang Phan Trung Le Trung-Nghia Phung Tu Bui Nhat Ho Dinh Q. Phung OOD 22 12 0 01 Mar 2022
Deconstructing Distributions: A Pointwise Framework of Learning Gal Kaplun Nikhil Ghosh Saurabh Garg Boaz Barak Preetum Nakkiran OOD 33 21 0 20 Feb 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 26 110 0 16 Feb 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet? Nenad Tomašev Ioana Bica Brian McWilliams Lars Buesing Razvan Pascanu Charles Blundell Jovana Mitrović SSL 90 81 0 13 Jan 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 42 4,983 0 10 Jan 2022
Optimal Representations for Covariate Shift Yangjun Ruan Yann Dubois Chris J. Maddison OOD 28 68 0 31 Dec 2021
Measure and Improve Robustness in NLP Models: A Survey Xuezhi Wang Haohan Wang Diyi Yang 139 130 0 15 Dec 2021
Dilated convolution with learnable spacings Ismail Khalfaoui-Hassani Thomas Pellegrini T. Masquelier 19 31 0 07 Dec 2021
A Systematic Review of Robustness in Deep Learning for Computer Vision: Mind the gap? Nathan G. Drenkow Numair Sani I. Shpitser Mathias Unberath 19 75 0 01 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 26 51 0 01 Dec 2021
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data Samarth Mishra Yikang Shen Cheng Perng Phoo Chun-Fu Chen Leonid Karlinsky Kate Saenko Venkatesh Saligrama Rogerio Feris 26 35 0 30 Nov 2021