Discriminability objective for training descriptive captions

12 March 2018

Ruotian Luo

Brian L. Price

Scott D. Cohen

Gregory Shakhnarovich

ArXiv PDF HTML

Papers citing "Discriminability objective for training descriptive captions"

49 / 99 papers shown

Title
Counterfactual Maximum Likelihood Estimation for Training Deep Networks Xinyi Wang Wenhu Chen Michael Stephen Saxon Luu Anh Tuan OOD CML BDL 17 8 0 07 Jun 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 15 1,442 0 18 Apr 2021
Automatic Generation of Descriptive Titles for Video Clips Using Deep Learning Soheyla Amirian Khaled Rasheed T. Taha H. Arabnia VLM VGen 16 23 0 07 Apr 2021
On Hallucination and Predictive Uncertainty in Conditional Language Generation Yijun Xiao Luu Anh Tuan HILM 10 182 0 28 Mar 2021
Human-like Controllable Image Captioning with Verb-specific Semantic Roles Long Chen Zhihong Jiang Jun Xiao Wei Liu 30 74 0 22 Mar 2021
Causal Attention for Vision-Language Tasks Xu Yang Hanwang Zhang Guojun Qi Jianfei Cai CML 28 148 0 05 Mar 2021
Multi-modal Ensemble Models for Predicting Video Memorability Tony Zhao Irving Fang Jeffrey Kim Gerald Friedland 19 5 0 01 Feb 2021
Intrinsic Image Captioning Evaluation Chao Zeng Sam Kwong 21 0 0 14 Dec 2020
Towards Annotation-Free Evaluation of Cross-Lingual Image Captioning Aozhu Chen Xinyi Huang Hailan Lin Xirong Li 11 5 0 09 Dec 2020
Online Exemplar Fine-Tuning for Image-to-Image Translation Taewon Kang Soohyun Kim Sunwoo Kim Seungryong Kim 18 3 0 18 Nov 2020
Structural and Functional Decomposition for Personality Image Captioning in a Communication Game Minh-Thu Nguyen Duy Phung Minh Hoai Thien Huu Nguyen 25 4 0 17 Nov 2020
CapWAP: Captioning with a Purpose Adam Fisch Kenton Lee Ming-Wei Chang J. Clark Regina Barzilay 8 11 0 09 Nov 2020
Dual Attention on Pyramid Feature Maps for Image Captioning Litao Yu Jian Zhang Qiang Wu 21 47 0 02 Nov 2020
Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning Iro Laina Ruth C. Fong Andrea Vedaldi OCL 33 13 0 27 Oct 2020
Bayesian Attention Modules Xinjie Fan Shujian Zhang Bo Chen Mingyuan Zhou 117 59 0 20 Oct 2020
Towards Unique and Informative Captioning of Images Zeyu Wang Berthy Feng Karthik Narasimhan Olga Russakovsky 25 37 0 08 Sep 2020
Structure-Aware Generation Network for Recipe Generation from Images Hao Wang Guosheng Lin Guosheng Lin Chunyan Miao 16 32 0 02 Sep 2020
Graph Edit Distance Reward: Learning to Edit Scene Graph Lichang Chen Guosheng Lin Shijie Wang Qingyao Wu 9 18 0 15 Aug 2020
Fine-Grained Image Captioning with Global-Local Discriminative Objective Jie Wu Tianshui Chen Hefeng Wu Zhi Yang Guangchun Luo Liang Lin 25 59 0 21 Jul 2020
Compare and Reweight: Distinctive Image Captioning Using Similar Images Sets Jiuniu Wang Wenjia Xu Qingzhong Wang Antoni B. Chan 37 45 0 14 Jul 2020
Diversifying Dialogue Generation with Non-Conversational Text Hui Su Xiaoyu Shen Sanqiang Zhao Xiao Zhou Pengwei Hu Randy Zhong Cheng Niu Jie Zhou 17 46 0 09 May 2020
Pragmatic Issue-Sensitive Image Captioning Allen Nie Reuben Cohn-Gordon Christopher Potts 12 24 0 29 Apr 2020
Context-Aware Group Captioning via Self-Attention and Contrastive Features Zhuowan Li Quan Hung Tran Long Mai Zhe-nan Lin Alan Yuille VLM 14 44 0 07 Apr 2020
There and Back Again: Revisiting Backpropagation Saliency Methods Sylvestre-Alvise Rebuffi Ruth C. Fong Xu Ji Andrea Vedaldi FAtt XAI 17 113 0 06 Apr 2020
More Grounded Image Captioning by Distilling Image-Text Matching Model Yuanen Zhou Meng Wang Daqing Liu Zhenzhen Hu Hanwang Zhang 17 125 0 01 Apr 2020
Detection and Description of Change in Visual Streams Davis Gilton Ruotian Luo Rebecca Willett Gregory Shakhnarovich AI4TS 10 4 0 27 Mar 2020
A Better Variant of Self-Critical Sequence Training Ruotian Luo BDL 30 37 0 22 Mar 2020
Better Captioning with Sequence-Level Exploration Jia Chen Qin Jin 37 12 0 08 Mar 2020
Show, Recall, and Tell: Image Captioning with Recall Mechanism Li Wang Zechen Bai Yonghua Zhang Hongtao Lu 27 67 0 15 Jan 2020
Adaptive Correlated Monte Carlo for Contextual Categorical Sequence Generation Xinjie Fan Yizhe Zhang Zhendong Wang Mingyuan Zhou BDL 9 4 0 31 Dec 2019
Hidden State Guidance: Improving Image Captioning using An Image Conditioned Autoencoder Jialin Wu Raymond J. Mooney 21 0 0 31 Oct 2019
Tell-the-difference: Fine-grained Visual Descriptor via a Discriminating Referee Shuangjie Xu Feng Xu Yu Cheng Pan Zhou 21 2 0 14 Oct 2019
Talk2Nav: Long-Range Vision-and-Language Navigation with Dual Attention and Spatial Memory A. Vasudevan Ahmed K. Farahat Chetan Gupta LM&Ro 33 2 0 04 Oct 2019
Unpaired Cross-lingual Image Caption Generation with Self-Supervised Rewards Yuqing Song Shizhe Chen Yida Zhao Qin Jin SSL 21 40 0 15 Aug 2019
Towards Diverse and Accurate Image Captions via Reinforcing Determinantal Point Process Qingzhong Wang Antoni B. Chan 21 7 0 14 Aug 2019
Scene-based Factored Attention for Image Captioning Chen Shen Rongrong Ji Fuhai Chen Xiaoshuai Sun Xiangming Li 19 0 0 07 Aug 2019
Aligning Linguistic Words and Visual Semantic Units for Image Captioning Longteng Guo Jing Liu Jinhui Tang Jiangwei Li W. Luo Hanqing Lu 25 102 0 06 Aug 2019
Cooperative image captioning Gilad Vered Gal Oren Y. Atzmon Gal Chechik 26 2 0 26 Jul 2019
Aesthetic Attributes Assessment of Images Xin Jin Le Wu Geng Zhao Xiaodong Li Xiaokun Zhang Shiming Ge Dongqing Zou Bin Zhou Xinghui Zhou 22 36 0 11 Jul 2019
Expressing Visual Relationships via Language Hao Tan Franck Dernoncourt Zhe-nan Lin Trung Bui Joey Tianyi Zhou 21 63 0 18 Jun 2019
Deep Metric Learning Beyond Binary Supervision Sungyeon Kim Minkyo Seo Ivan Laptev Minsu Cho Suha Kwak SSL 20 94 0 21 Apr 2019
Learning to Collocate Neural Modules for Image Captioning Xu Yang Hanwang Zhang Jianfei Cai 25 77 0 18 Apr 2019
Reasoning Visual Dialogs with Structural and Partial Observations Zilong Zheng Wenguan Wang Siyuan Qi Song-Chun Zhu 39 117 0 11 Apr 2019
Context and Attribute Grounded Dense Captioning Guojun Yin Lu Sheng Bin Liu Nenghai Yu Xiaogang Wang Jing Shao 16 75 0 02 Apr 2019
Describing like humans: on diversity in image captioning Qingzhong Wang Antoni B. Chan 19 98 0 28 Mar 2019
Evaluating Text-to-Image Matching using Binary Image Selection (BISON) Hexiang Hu Ishan Misra L. V. D. van der Maaten 24 22 0 19 Jan 2019
Auto-Encoding Scene Graphs for Image Captioning Xu Yang Kaihua Tang Hanwang Zhang Jianfei Cai 21 692 0 06 Dec 2018
Object Hallucination in Image Captioning Anna Rohrbach Lisa Anne Hendricks Kaylee Burns Trevor Darrell Kate Saenko 27 402 0 06 Sep 2018
Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech Aditya Deshpande J. Aneja Liwei Wang A. Schwing David A. Forsyth 25 146 0 31 May 2018