Investigating the Limitation of CLIP Models: The Worst-Performing Categories

5 October 2023

Yu-Feng Li

Papers citing "Investigating the Limitation of CLIP Models: The Worst-Performing Categories"

21 / 21 papers shown

Title
From Head to Tail: Towards Balanced Representation in Large Vision-Language Models through Adaptive Data Calibration Mingyang Song Xiaoye Qu Jiawei Zhou Yu Cheng VLM 108 1 0 17 Mar 2025
Evaluating Vision-Language Models as Evaluators in Path Planning Mohamed Aghzal Xiang Yue Erion Plaku Ziyu Yao LRM 153 1 0 27 Nov 2024
ImageBind: One Embedding Space To Bind Them All Rohit Girdhar Alaaeldin El-Nouby Zhuang Liu Mannat Singh Kalyan Vasudev Alwala Armand Joulin Ishan Misra VLM 138 927 0 09 May 2023
No One Left Behind: Improving the Worst Categories in Long-Tailed Learning Yingxiao Du Jianxin Wu 77 15 0 07 Mar 2023
A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Models J. Allingham Jie Jessie Ren Michael W. Dusenberry Xiuye Gu Huayu Chen Dustin Tran J. Liu Balaji Lakshminarayanan LLMAG VLM 53 36 0 13 Feb 2023
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 180 3,449 0 16 Oct 2022
Visual Classification via Description from Large Language Models Sachit Menon Carl Vondrick VLM 61 302 0 13 Oct 2022
Learning to Decompose Visual Features with Latent Textual Prompts Feng Wang Manling Li Xudong Lin Hairong Lv Alex Schwing Heng Ji VLM 78 25 0 09 Oct 2022
ProposalCLIP: Unsupervised Open-Category Object Proposal Generation via Exploiting CLIP Cues Hengcan Shi Munawar Hayat Yicheng Wu Jianfei Cai VLM 62 62 0 18 Jan 2022
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 338 3,600 0 20 Dec 2021
Distributional Robustness Loss for Long-tail Learning Dvir Samuel Gal Chechik OOD 75 100 0 07 Apr 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 443 3,856 0 11 Feb 2021
Hard negative examples are hard, but useful Hong Xuan Abby Stylianou Xiaotong Liu Robert Pless DML 82 127 0 24 Jul 2020
Combining Weakly and Webly Supervised Learning for Classifying Food Images Parneet Kaur Karan Sikka Ajay Divakaran 54 22 0 23 Dec 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 133 1,817 0 31 Aug 2017
Robust Optimization for Non-Convex Objectives Robert S. Chen Brendan Lucier Yaron Singer Vasilis Syrgkanis 54 121 0 04 Jul 2017
Remote Sensing Image Scene Classification: Benchmark and State of the Art Gong Cheng Junwei Han Xiaoqiang Lu 103 2,255 0 01 Mar 2017
Training Region-based Object Detectors with Online Hard Example Mining Abhinav Shrivastava Abhinav Gupta Ross B. Girshick ObjD 148 2,418 0 12 Apr 2016
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 124 2,674 0 14 Nov 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 123 2,261 0 21 Jun 2013