Text-To-Concept (and Back) via Cross-Model Alignment

10 May 2023

Papers citing "Text-To-Concept (and Back) via Cross-Model Alignment"

24 / 24 papers shown

Title
B-cosification: Transforming Deep Neural Networks to be Inherently Interpretable Shreyash Arya Sukrut Rao Moritz Bohle Bernt Schiele 161 3 0 28 Jan 2025
Explanation Bottleneck Models Shinýa Yamaguchi Kosuke Nishida LRM BDL 108 2 0 26 Sep 2024
Learning Discrete Concepts in Latent Hierarchical Models Lingjing Kong Guan-Hong Chen Erdun Gao Eric P. Xing Yuejie Chi Kun Zhang 91 5 0 01 Jun 2024
CRAFT: Concept Recursive Activation FacTorization for Explainability Thomas Fel Agustin Picard Louis Bethune Thibaut Boissin David Vigouroux Julien Colin Rémi Cadène Thomas Serre 70 115 0 17 Nov 2022
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 194 3,482 0 16 Oct 2022
Relative representations enable zero-shot latent space communication Luca Moschella Valentino Maiorca Marco Fumero Antonio Norelli Francesco Locatello Emanuele Rodolà 80 108 0 30 Sep 2022
CLIP-Dissect: Automatic Description of Neuron Representations in Deep Vision Networks Tuomas P. Oikarinen Tsui-Wei Weng VLM 50 89 1 23 Apr 2022
MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning C. Eichenberg Sid Black Samuel Weinbach Letitia Parcalabescu Anette Frank MLLM VLM 58 100 0 09 Dec 2021
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel Yoav Shalev Idan Schwartz Lior Wolf VLM 79 195 0 29 Nov 2021
LiT: Zero-Shot Transfer with Locked-image text Tuning Xiaohua Zhai Tianlin Li Basil Mustafa Andreas Steiner Daniel Keysers Alexander Kolesnikov Lucas Beyer VLM 103 556 0 15 Nov 2021
Similarity and Matching of Neural Network Representations Adrián Csiszárik Péter Korösi-Szabó Á. Matszangosz Gergely Papp D. Varga 44 71 0 27 Oct 2021
Multimodal Few-Shot Learning with Frozen Language Models Maria Tsimpoukelli Jacob Menick Serkan Cabi S. M. Ali Eslami Oriol Vinyals Felix Hill MLLM 173 786 0 25 Jun 2021
Knowledge distillation: A good teacher is patient and consistent Lucas Beyer Xiaohua Zhai Amelie Royer L. Markeeva Rohan Anil Alexander Kolesnikov VLM 107 296 0 09 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 694 6,121 0 29 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 157 1,868 0 05 Apr 2021
BREEDS: Benchmarks for Subpopulation Shift Shibani Santurkar Dimitris Tsipras Aleksander Madry OOD 59 175 0 11 Aug 2020
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor Aleksander Madry 81 425 0 16 Jul 2020
Concept Bottleneck Models Pang Wei Koh Thao Nguyen Y. S. Tang Stephen Mussmann Emma Pierson Been Kim Percy Liang 99 828 0 09 Jul 2020
Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors Ruihan Zhang Prashan Madumal Tim Miller Krista A. Ehinger Benjamin I. P. Rubinstein FAtt 61 106 0 27 Jun 2020
Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) Been Kim Martin Wattenberg Justin Gilmer Carrie J. Cai James Wexler F. Viégas Rory Sayres FAtt 219 1,842 0 30 Nov 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 283 8,904 0 25 Aug 2017
Deep Learning Face Attributes in the Wild Ziwei Liu Ping Luo Xiaogang Wang Xiaoou Tang CVBM 244 8,424 0 28 Nov 2014
Understanding image representations by measuring their equivariance and equivalence Karel Lenc Andrea Vedaldi SSL FAtt 112 533 0 21 Nov 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 138 2,674 0 14 Nov 2013