Deciphering the Role of Representation Disentanglement: Investigating
Compositional Generalization in CLIP Models

v1v2 (latest)

Deciphering the Role of Representation Disentanglement: Investigating Compositional Generalization in CLIP Models

8 July 2024

ArXiv (abs)PDF HTML

Papers citing "Deciphering the Role of Representation Disentanglement: Investigating Compositional Generalization in CLIP Models"

12 / 12 papers shown

Title
Enhancing Compositional Generalization via Compositional Feature Alignment Haoxiang Wang Haozhe Si Huajie Shao Han Zhao 98 2 0 05 Feb 2024
COLA: A Benchmark for Compositional Text-to-image Retrieval Arijit Ray Filip Radenovic Abhimanyu Dubey Bryan A. Plummer Ranjay Krishna Kate Saenko CoGe VLM 72 37 0 05 May 2023
When and why vision-language models behave like bags-of-words, and what to do about it? Mert Yuksekgonul Federico Bianchi Pratyusha Kalluri Dan Jurafsky James Zou VLM CoGe 76 393 0 04 Oct 2022
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 126 105 0 10 Aug 2022
Towards Out-Of-Distribution Generalization: A Survey Jiashuo Liu Zheyan Shen Yue He Xingxuan Zhang Renzhe Xu Han Yu Peng Cui CML OOD 149 535 0 31 Aug 2021
Visual Representation Learning Does Not Generalize Strongly Within the Same Domain Lukas Schott Julius von Kügelgen Frederik Trauble Peter V. Gehler Chris Russell Matthias Bethge Bernhard Schölkopf Francesco Locatello Wieland Brendel OOD DRL 99 73 0 17 Jul 2021
Learning to Predict Visual Attributes in the Wild Khoi Pham Kushal Kafle Zhe Lin Zhi Ding Scott D. Cohen Q. Tran Abhinav Shrivastava 45 112 0 17 Jun 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 448 3,887 0 11 Feb 2021
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both? Peter Shaw Ming-Wei Chang Panupong Pasupat Kristina Toutanova CoGe 76 187 0 24 Oct 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
Disentangled Sequential Autoencoder Yingzhen Li Stephan Mandt CoGe 71 271 0 08 Mar 2018
Learning Deep Disentangled Embeddings with the F-Statistic Loss Karl Ridgeway Michael C. Mozer FedML DRL CoGe 69 218 0 14 Feb 2018