Learning Robust Global Representations by Penalizing Local Predictive Power

29 May 2019

Papers citing "Learning Robust Global Representations by Penalizing Local Predictive Power"

50 / 238 papers shown

Title
Patch-Prompt Aligned Bayesian Prompt Tuning for Vision-Language Models Xinyang Liu Dongsheng Wang Bowei Fang Miaoge Li Zhibin Duan Yishi Xu Bo Chen Mingyuan Zhou VLM VPVLM 29 5 0 16 Mar 2023
CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning Hritik Bansal Nishad Singhi Yu Yang Fan Yin Aditya Grover Kai-Wei Chang AAML 34 42 0 06 Mar 2023
PixMIM: Rethinking Pixel Reconstruction in Masked Image Modeling Yuan Liu Songyang Zhang Jiacheng Chen Kai-xiang Chen Dahua Lin 75 28 0 04 Mar 2023
Dropout Reduces Underfitting Zhuang Liu Zhi-Qin John Xu Joseph Jin Zhiqiang Shen Trevor Darrell 45 36 0 02 Mar 2023
Convolutional Visual Prompt for Robust Visual Perception Yun-Yun Tsai Chengzhi Mao Junfeng Yang VLM VPVLM 31 13 0 01 Mar 2023
Generic-to-Specific Distillation of Masked Autoencoders Wei Huang Zhiliang Peng Li Dong Furu Wei Jianbin Jiao QiXiang Ye 32 22 0 28 Feb 2023
A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinking Chang-Shu Liu Yinpeng Dong Wenzhao Xiang X. Yang Hang Su Junyi Zhu YueFeng Chen Yuan He H. Xue Shibao Zheng OOD VLM AAML 33 74 0 28 Feb 2023
Spatial Bias for Attention-free Non-local Neural Networks Junhyung Go Jongbin Ryu SSL 27 10 0 24 Feb 2023
Learning Visual Representations via Language-Guided Sampling Mohamed El Banani Karan Desai Justin Johnson SSL VLM 21 28 0 23 Feb 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom A. Madry OOD 20 34 0 15 Feb 2023
A Modern Look at the Relationship between Sharpness and Generalization Maksym Andriushchenko Francesco Croce Maximilian Müller Matthias Hein Nicolas Flammarion 3DH 19 55 0 14 Feb 2023
Symbolic Discovery of Optimization Algorithms Xiangning Chen Chen Liang Da Huang Esteban Real Kaiyuan Wang ... Xuanyi Dong Thang Luong Cho-Jui Hsieh Yifeng Lu Quoc V. Le 67 353 0 13 Feb 2023
A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models J. Allingham Jie Jessie Ren Michael W. Dusenberry Xiuye Gu Huayu Chen Dustin Tran J. Liu Balaji Lakshminarayanan LLMAG VLM 35 33 0 13 Feb 2023
CLIPood: Generalizing CLIP to Out-of-Distributions Yang Shu Xingzhuo Guo Jialong Wu Ximei Wang Jianmin Wang Mingsheng Long OODD VLM 52 74 0 02 Feb 2023
Fourier Sensitivity and Regularization of Computer Vision Models K. Krishnamachari See-Kiong Ng Chuan-Sheng Foo OOD 31 2 0 31 Jan 2023
Benchmarking Robustness to Adversarial Image Obfuscations Florian Stimberg Ayan Chakrabarti Chun-Ta Lu Hussein Hazimeh Otilia Stretcu ... Merve Kaya Cyrus Rashtchian Ariel Fuxman Mehmet Tek Sven Gowal AAML 32 10 0 30 Jan 2023
Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification Ali Borji VLM 37 0 0 29 Jan 2023
Alignment with human representations supports robust few-shot learning Ilia Sucholutsky Thomas L. Griffiths 24 25 0 27 Jan 2023
Out of Distribution Performance of State of Art Vision Model Salman Rahman W. Lee 40 2 0 25 Jan 2023
RILS: Masked Visual Reconstruction in Language Semantic Space Shusheng Yang Yixiao Ge Kun Yi Dian Li Ying Shan Xiaohu Qie Xinggang Wang CLIP 43 11 0 17 Jan 2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models Zhiqiu Lin Samuel Yu Zhiyi Kuang Deepak Pathak Deva Ramana VLM 20 100 0 16 Jan 2023
Rethinking Precision of Pseudo Label: Test-Time Adaptation via Complementary Learning Jiayi Han Longbin Zeng Liang Du Weiyang Ding Jianfeng Feng OOD TTA 21 14 0 15 Jan 2023
SMMix: Self-Motivated Image Mixing for Vision Transformers Yonghong Tian Mingbao Lin Zhihang Lin Yuxin Zhang Rongrong Ji Rongrong Ji 53 10 0 26 Dec 2022
TeTIm-Eval: a novel curated evaluation data set for comparing text-to-image models Federico A. Galatolo M. G. Cimino E. Cogotti 27 4 0 15 Dec 2022
Domain Generalization by Learning and Removing Domain-specific Features Yuzhu Ding Lei Wang Binxin Liang Shuming Liang Yang Wang Fangxiao Chen OOD 30 41 0 14 Dec 2022
Localized Latent Updates for Fine-Tuning Vision-Language Models Moritz Ibing I. Lim Leif Kobbelt VLM 26 1 0 13 Dec 2022
A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others Zhiheng Li Ivan Evtimov Albert Gordo C. Hazirbas Tal Hassner Cristian Canton Ferrer Chenliang Xu Mark Ibrahim 34 71 0 09 Dec 2022
Spuriosity Rankings: Sorting Data to Measure and Mitigate Biases Mazda Moayeri Wenxiao Wang Sahil Singla S. Feizi 69 14 0 05 Dec 2022
Improving Zero-shot Generalization and Robustness of Multi-modal Models Yunhao Ge Jie Jessie Ren Andrew Gallagher Yuxiao Wang Ming Yang Hartwig Adam Laurent Itti Balaji Lakshminarayanan Jiaping Zhao VLM 32 34 0 04 Dec 2022
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 50 138 0 01 Dec 2022
Exploiting Category Names for Few-Shot Classification with Vision-Language Models Taihong Xiao Zirui Wang Liangliang Cao Jiahui Yu Shengyang Dai Ming Yang VLM MLLM 33 5 0 29 Nov 2022
Context-Aware Robust Fine-Tuning Xiaofeng Mao YueFeng Chen Xiaojun Jia Rong Zhang Hui Xue Zhao Li VLM CLIP 35 25 0 29 Nov 2022
Interactive Visual Feature Search Devon Ulrich Ruth C. Fong FAtt 26 0 0 28 Nov 2022
1st Place Solution to NeurIPS 2022 Challenge on Visual Domain Adaptation Daehan Kim Min-seok Seo Youngjin Jeon Dong-Geol Choi OOD 36 1 0 26 Nov 2022
Localized Shortcut Removal Nicolas M. Muller Jochen Jacobs Jennifer Williams Konstantin Böttinger 23 0 0 24 Nov 2022
EVA: Exploring the Limits of Masked Visual Representation Learning at Scale Yuxin Fang Wen Wang Binhui Xie Quan-Sen Sun Ledell Yu Wu Xinggang Wang Tiejun Huang Xinlong Wang Yue Cao VLM CLIP 87 679 0 14 Nov 2022
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities Zhongzhi Chen Guangyi Liu Bo-Wen Zhang Fulong Ye Qinghong Yang Ledell Yu Wu VLM 37 80 0 12 Nov 2022
Zero-shot Visual Commonsense Immorality Prediction Yujin Jeong Seongbeom Park Suhong Moon Jinkyu Kim VLM 24 1 0 10 Nov 2022
Local Manifold Augmentation for Multiview Semantic Consistency Yu Yang Wing Yin Cheung Chang-rui Liu Xiang Ji 37 1 0 05 Nov 2022
Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models Cheng Ma Yang Liu Jiankang Deng Lingxi Xie Weiming Dong Changsheng Xu VLM VPVLM 37 44 0 04 Nov 2022
ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations Badr Youbi Idrissi Diane Bouchacourt Randall Balestriero Ivan Evtimov C. Hazirbas Nicolas Ballas Pascal Vincent M. Drozdzal David Lopez-Paz Mark Ibrahim VLM ViT 51 45 0 03 Nov 2022
MetaFormer Baselines for Vision Weihao Yu Chenyang Si Pan Zhou Mi Luo Yichen Zhou Jiashi Feng Shuicheng Yan Xinchao Wang MoE 40 156 0 24 Oct 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 32 24 0 19 Oct 2022
A Unified View of Masked Image Modeling Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei VLM 54 35 0 19 Oct 2022
Is synthetic data from generative models ready for image recognition? Ruifei He Shuyang Sun Xin Yu Chuhui Xue Wenqing Zhang Philip Torr Song Bai Xiaojuan Qi 52 287 0 14 Oct 2022
Learning to Decompose Visual Features with Latent Textual Prompts Feng Wang Manling Li Xudong Lin Hairong Lv A. Schwing Heng Ji VLM 19 23 0 09 Oct 2022
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 212 532 0 06 Oct 2022
PLOT: Prompt Learning with Optimal Transport for Vision-Language Models Guangyi Chen Weiran Yao Xiangchen Song Xinyue Li Yongming Rao Kun Zhang VPVLM VLM 8 62 0 03 Oct 2022
Visual Prompt Tuning for Generative Transfer Learning Kihyuk Sohn Yuan Hao José Lezama Luisa F. Polanía Huiwen Chang Han Zhang Irfan Essa Lu Jiang VPVLM VLM 56 81 0 03 Oct 2022
UniCLIP: Unified Framework for Contrastive Language-Image Pre-training Janghyeon Lee Jongsuk Kim Hyounguk Shon Bumsoo Kim Seung Wook Kim Honglak Lee Junmo Kim CLIP VLM 54 53 0 27 Sep 2022