v1v2v3 (latest)

VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance

17 January 2025

Divyansh Srivastava

Beatriz Cabrero-Daniel

Christian Berger

VLM

ArXiv (abs)PDF HTML

Papers citing "VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance"

32 / 32 papers shown

Title
Evaluating Neuron Explanations: A Unified Framework with Sanity Checks Tuomas P. Oikarinen Ge Yan Tsui-Wei Weng FAtt XAI 49 1 0 06 Jun 2025
An Analysis of Concept Bottleneck Models: Measuring, Understanding, and Mitigating the Impact of Noisy Annotations Seonghwan Park Jueun Mun Donghyun Oh Namhoon Lee 43 0 0 22 May 2025
If Concept Bottlenecks are the Question, are Foundation Models the Answer? Nicola Debole Pietro Barbiero Francesco Giannini Andrea Passerini Stefano Teso Emanuele Marconato 520 1 0 28 Apr 2025
Leakage and Interpretability in Concept-Based Models Enrico Parisini Tapabrata Chakraborti Chris Harbron Ben D. MacArthur Christopher R. S. Banerji 132 1 0 18 Apr 2025
Attribute-formed Class-specific Concept Space: Endowing Language Bottleneck Model with Better Interpretability and Scalability Jianyang Zhang Qianli Luo Guowu Yang Wenjing Yang Weide Liu Guosheng Lin Fengmao Lv 115 0 0 26 Mar 2025
Interpretable Generative Models through Post-hoc Concept Bottlenecks Akshay Kulkarni Ge Yan Chung-En Sun Tuomas P. Oikarinen Tsui-Wei Weng 77 0 0 25 Mar 2025
Causally Reliable Concept Bottleneck Models Giovanni De Felice Arianna Casanova Flores Francesco De Santis Silvia Santini Johannes Schneider Pietro Barbiero Alberto Termine 139 4 0 06 Mar 2025
Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens Samuele Bortolotti Emanuele Marconato Paolo Morettin Andrea Passerini Stefano Teso 167 5 0 16 Feb 2025
Crafting Large Language Models for Enhanced Interpretability Chung-En Sun Tuomas P. Oikarinen Tsui-Wei Weng 84 8 0 05 Jul 2024
PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck Thang M. Pham Peijie Chen Tin Nguyen Seunghyun Yoon Trung Bui Peijie Chen VLM 113 9 0 08 Mar 2024
Eliminating Information Leakage in Hard Concept Bottleneck Models with Supervised, Hierarchical Concept Learning Ao Sun Yuanyuan Yuan Pingchuan Ma Shuai Wang 35 8 0 03 Feb 2024
Interpreting Pretrained Language Models via Concept Bottlenecks Zhen Tan Lu Cheng Song Wang Yuan Bo Wenlin Yao Huan Liu LRM 90 25 0 08 Nov 2023
Concept Bottleneck with Visual Concept Filtering for Explainable Medical Image Classification In-Ho Kim Jongha Kim Joon-Young Choi Hyunwoo J. Kim 68 14 0 23 Aug 2023
Learning Concise and Descriptive Attributes for Visual Recognition Andy Yan Yu Wang Yiwu Zhong Chengyu Dong Zexue He Yujie Lu William Wang Jingbo Shang Julian McAuley VLM 114 64 0 07 Aug 2023
Waffling around for Performance: Visual Classification with Random Words and Broad Concepts Karsten Roth Jae Myung Kim A. Sophia Koepke Oriol Vinyals Cordelia Schmid Zeynep Akata VLM 92 76 0 12 Jun 2023
Label-Free Concept Bottleneck Models Tuomas P. Oikarinen Subhro Das Lam M. Nguyen Tsui-Wei Weng 92 180 0 12 Apr 2023
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection Shilong Liu Zhaoyang Zeng Tianhe Ren Feng Li Hao Zhang ... Chun-yue Li Jianwei Yang Hang Su Jun Zhu Lei Zhang ObjD 201 2,035 0 09 Mar 2023
Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification Yue Yang Artemis Panagopoulou Shenghao Zhou Daniel Jin Chris Callison-Burch Mark Yatskar 144 235 0 21 Nov 2022
GLIPv2: Unifying Localization and Vision-Language Understanding Haotian Zhang Pengchuan Zhang Xiaowei Hu Yen-Chun Chen Liunian Harold Li Xiyang Dai Lijuan Wang Lu Yuan Lei Li Jianfeng Gao ObjD VLM 97 302 0 12 Jun 2022
Post-hoc Concept Bottleneck Models Mert Yuksekgonul Maggie Wang James Zou 245 198 0 31 May 2022
CLIP-Dissect: Automatic Description of Neuron Representations in Deep Vision Networks Tuomas P. Oikarinen Tsui-Wei Weng VLM 63 90 1 23 Apr 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning Weixin Liang Yuhui Zhang Yongchan Kwon Serena Yeung James Zou VLM 147 430 0 03 Mar 2022
Grounded Language-Image Pre-training Liunian Harold Li Pengchuan Zhang Haotian Zhang Jianwei Yang Chunyuan Li ... Lu Yuan Lei Zhang Lei Li Kai-Wei Chang Jianfeng Gao ObjD VLM 157 1,070 0 07 Dec 2021
Promises and Pitfalls of Black-Box Concept Learning Models Anita Mahinpei Justin Clark Isaac Lage Finale Doshi-Velez Weiwei Pan 96 96 0 24 Jun 2021
Leveraging Sparse Linear Layers for Debuggable Deep Networks Eric Wong Shibani Santurkar Aleksander Madry FAtt 67 92 0 11 May 2021
Do Concept Bottleneck Models Learn as Intended? Andrei Margeloiu Matthew Ashman Umang Bhatt Yanzhi Chen M. Jamnik Adrian Weller SLR 56 97 0 10 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 30,029 0 26 Feb 2021
Concept Bottleneck Models Pang Wei Koh Thao Nguyen Y. S. Tang Stephen Mussmann Emma Pierson Been Kim Percy Liang 126 835 0 09 Jul 2020
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization Shiori Sagawa Pang Wei Koh Tatsunori B. Hashimoto Percy Liang OOD 110 1,250 0 20 Nov 2019
Towards Robust Interpretability with Self-Explaining Neural Networks David Alvarez-Melis Tommi Jaakkola MILM XAI 135 948 0 20 Jun 2018
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.4K 195,003 0 10 Dec 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,704 0 01 Sep 2014