On Guiding Visual Attention with Language Specification

17 February 2022

Papers citing "On Guiding Visual Attention with Language Specification"

43 / 43 papers shown

Title
B-cosification: Transforming Deep Neural Networks to be Inherently Interpretable Shreyash Arya Sukrut Rao Moritz Bohle Bernt Schiele 174 3 0 28 Jan 2025
Refining Skewed Perceptions in Vision-Language Models through Visual Representations Haocheng Dai Sarang Joshi VLM 126 0 0 03 Jan 2025
Data Efficient Language-supervised Zero-shot Recognition with Optimal Transport Distillation Bichen Wu Rui Cheng Peizhao Zhang Tianren Gao Peter Vajda Joseph E. Gonzalez VLM 98 45 0 17 Dec 2021
Field-Guide-Inspired Zero-Shot Learning Utkarsh Mall Bharath Hariharan Kavita Bala VLM 104 7 0 24 Aug 2021
Just Train Twice: Improving Group Robustness without Training Group Information Emmy Liu Behzad Haghgoo Annie S. Chen Aditi Raghunathan Pang Wei Koh Shiori Sagawa Percy Liang Chelsea Finn OOD 107 563 0 19 Jul 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 29,926 0 26 Feb 2021
VinVL: Revisiting Visual Representations in Vision-Language Models Pengchuan Zhang Xiujun Li Xiaowei Hu Jianwei Yang Lei Zhang Lijuan Wang Yejin Choi Jianfeng Gao ObjD VLM 328 157 0 02 Jan 2021
Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles Christopher Clark Mark Yatskar Luke Zettlemoyer 65 62 0 07 Nov 2020
Using Sentences as Semantic Representations in Large Scale Zero-Shot Learning Yannick Le Cacheux Hervé Le Borgne M. Crucianu VLM 38 6 0 06 Oct 2020
Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting Sayna Ebrahimi Suzanne Petryk Akash Gokul William Gan Joseph E. Gonzalez Marcus Rohrbach Trevor Darrell CLL 77 47 0 04 Oct 2020
Towards Debiasing NLU Models from Unknown Biases Prasetya Ajie Utama N. Moosavi Iryna Gurevych 89 155 0 25 Sep 2020
Attribute Prototype Network for Zero-Shot Learning Wenjia Xu Yongqin Xian Jiuniu Wang Bernt Schiele Zeynep Akata 73 294 0 19 Aug 2020
Learning from Failure: Training Debiased Classifier from Biased Classifier J. Nam Hyuntak Cha SungSoo Ahn Jaeho Lee Jinwoo Shin 84 150 0 06 Jul 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks Xiujun Li Xi Yin Chunyuan Li Pengchuan Zhang Xiaowei Hu ... Houdong Hu Li Dong Furu Wei Yejin Choi Jianfeng Gao VLM 148 1,947 0 13 Apr 2020
Explainable Deep Classification Models for Domain Generalization Andrea Zunino Sarah Adel Bargal Riccardo Volpi M. Sameki Jianming Zhang Stan Sclaroff Vittorio Murino Kate Saenko FAtt 64 40 0 13 Mar 2020
Don't Judge an Object by Its Context: Learning to Overcome Contextual Bias Krishna Kumar Singh D. Mahajan Kristen Grauman Yong Jae Lee Matt Feiszli Deepti Ghadiyaram 65 109 0 09 Jan 2020
Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognition Jinwoo Choi Chen Gao Joseph C.E. Messou Jia-Bin Huang 135 182 0 11 Dec 2019
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization Shiori Sagawa Pang Wei Koh Tatsunori B. Hashimoto Percy Liang OOD 108 1,249 0 20 Nov 2019
Shaping Visual Representations with Language for Few-shot Classification Jesse Mu Percy Liang Noah D. Goodman VLM 75 49 0 06 Nov 2019
Interpretations are useful: penalizing explanations to align neural networks with prior knowledge Laura Rieger Chandan Singh W. James Murdoch Bin Yu FAtt 98 215 0 30 Sep 2019
Embedding Human Knowledge into Deep Neural Network via Attention Map Masahiro Mitsuhara Hiroshi Fukui Yusuke Sakashita Takanori Ogata Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi 72 73 0 09 May 2019
TAFE-Net: Task-Aware Feature Embeddings for Low Shot Learning Xin Wang Feng Yu Ruth Wang Trevor Darrell Joseph E. Gonzalez 76 105 0 11 Apr 2019
Learning Not to Learn: Training Deep Neural Networks with Biased Data Byungju Kim Hyunwoo Kim Kyungsu Kim Sungjin Kim Junmo Kim OOD 62 411 0 26 Dec 2018
Attention Branch Network: Learning of Attention Mechanism for Visual Explanation Hiroshi Fukui Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi XAI FAtt 70 409 0 25 Dec 2018
Object Hallucination in Image Captioning Anna Rohrbach Lisa Anne Hendricks Kaylee Burns Trevor Darrell Kate Saenko 199 443 0 06 Sep 2018
Women also Snowboard: Overcoming Bias in Captioning Models (Extended Abstract) Lisa Anne Hendricks Kaylee Burns Kate Saenko Trevor Darrell Anna Rohrbach 132 480 0 02 Jul 2018
RISE: Randomized Input Sampling for Explanation of Black-box Models Vitali Petsiuk Abir Das Kate Saenko FAtt 188 1,176 0 19 Jun 2018
Guide Me: Interacting with Deep Networks Christian Rupprecht Iro Laina Nassir Navab Gregory Hager Federico Tombari HAI 58 38 0 30 Mar 2018
Tell Me Where to Look: Guided Attention Inference Network Kunpeng Li Ziyan Wu Kuan-Chuan Peng Jan Ernst Y. Fu 124 532 0 27 Feb 2018
A Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts Yizhe Zhu Mohamed Elhoseiny Bingchen Liu Xi Peng Ahmed Elgammal VLM GAN 82 386 0 04 Dec 2017
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints Jieyu Zhao Tianlu Wang Mark Yatskar Vicente Ordonez Kai-Wei Chang FaML 113 974 0 29 Jul 2017
Teaching Machines to Describe Images via Natural Language Feedback Huan Ling Sanja Fidler 76 45 0 01 Jun 2017
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations A. Ross M. C. Hughes Finale Doshi-Velez FAtt 136 591 0 10 Mar 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 335 20,110 0 07 Oct 2016
Top-down Neural Attention by Excitation Backprop Jianming Zhang Zhe Lin Jonathan Brandt Xiaohui Shen Stan Sclaroff 92 949 0 01 Aug 2016
Attention Correctness in Neural Image Captioning Chenxi Liu Junhua Mao Fei Sha Alan Yuille 3DV 85 220 0 31 May 2016
Less is more: zero-shot learning from online textual documents with noise suppression Ruizhi Qiao Lingqiao Liu Chunhua Shen Anton Van Den Hengel 81 184 0 05 Apr 2016
Segmentation from Natural Language Expressions Ronghang Hu Marcus Rohrbach Trevor Darrell VLM EgoV 81 438 0 20 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,510 0 10 Dec 2015
Grounding of Textual Phrases in Images by Reconstruction Anna Rohrbach Marcus Rohrbach Ronghang Hu Trevor Darrell Bernt Schiele 82 497 0 12 Nov 2015
Predicting Deep Zero-Shot Convolutional Neural Networks using Textual Descriptions Jimmy Ba Kevin Swersky Sanja Fidler Ruslan Salakhutdinov VLM 95 439 0 01 Jun 2015
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models Bryan A. Plummer Liwei Wang Christopher M. Cervantes Juan C. Caicedo Julia Hockenmaier Svetlana Lazebnik 208 2,074 0 19 May 2015
Microsoft COCO Captions: Data Collection and Evaluation Server Xinlei Chen Hao Fang Nayeon Lee Ramakrishna Vedantam Saurabh Gupta Piotr Dollar C. L. Zitnick 224 2,496 0 01 Apr 2015