Self-critical Sequence Training for Image Captioning

2 December 2016

Papers citing "Self-critical Sequence Training for Image Captioning"

50 / 858 papers shown

Title
A Semantics-Assisted Video Captioning Model Trained with Scheduled Sampling Haoran Chen Ke Lin A. Maye Jianmin Li Xiaoling Hu 25 47 0 31 Aug 2019
Reflective Decoding Network for Image Captioning Lei Ke Wenjie Pei Ruiyu Li Xiaoyong Shen Yu-Wing Tai ObjD 16 91 0 30 Aug 2019
Autoregressive Text Generation Beyond Feedback Loops Florian Schmidt Stephan Mandt Thomas Hofmann AI4TS 20 14 0 30 Aug 2019
Hierarchical Text Classification with Reinforced Label Assignment Yuning Mao Jingjing Tian Jiawei Han Xiang Ren 24 90 0 27 Aug 2019
Controllable Video Captioning with POS Sequence Guidance Based on Gated Fusion Network Bairui Wang Lin Ma Wei Zhang Wenhao Jiang Jingwen Wang Wei Liu 76 163 0 27 Aug 2019
Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning J. Aneja Harsh Agrawal Dhruv Batra Alex Schwing BDL VLM 26 66 0 22 Aug 2019
Improving Captioning for Low-Resource Languages by Cycle Consistency Yike Wu Shiwan Zhao Jia Chen Ying Zhang Xiaojie Yuan Zhong Su 25 8 0 21 Aug 2019
Saccader: Improving Accuracy of Hard Attention Models for Vision Gamaleldin F. Elsayed Simon Kornblith Quoc V. Le VLM 29 72 0 20 Aug 2019
Attention on Attention for Image Captioning Lun Huang Wenmin Wang Jie Chen Xiao-Yong Wei 24 823 0 19 Aug 2019
Unpaired Cross-lingual Image Caption Generation with Self-Supervised Rewards Yuqing Song Shizhe Chen Yida Zhao Qin Jin SSL 31 40 0 15 Aug 2019
Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation Yu Chen Lingfei Wu Mohammed J Zaki GNN 21 154 0 14 Aug 2019
Towards Diverse and Accurate Image Captions via Reinforcing Determinantal Point Process Qingzhong Wang Antoni B. Chan 27 7 0 14 Aug 2019
Towards Generating Stylized Image Captions via Adversarial Training Omid Mohamad Nezami Mark Dras Stephen Wan Cécile Paris Len Hamey GAN 23 18 0 08 Aug 2019
Image Captioning using Facial Expression and Attention Omid Mohamad Nezami Mark Dras Stephen Wan Cécile Paris CVBM 17 8 0 08 Aug 2019
Scene-based Factored Attention for Image Captioning Chen Shen Rongrong Ji Fuhai Chen Xiaoshuai Sun Xiangming Li 24 0 0 07 Aug 2019
Aligning Linguistic Words and Visual Semantic Units for Image Captioning Longteng Guo Jing Liu Jinhui Tang Jiangwei Li W. Luo Hanqing Lu 30 102 0 06 Aug 2019
Convolutional Auto-encoding of Sentence Topics for Image Paragraph Generation Jing Wang Yingwei Pan Ting Yao Jinhui Tang Tao Mei VLM BDL DiffM 27 36 0 01 Aug 2019
Curiosity-driven Reinforcement Learning for Diverse Visual Paragraph Generation Yadan Luo Zi Huang Zheng Zhang Ziwei Wang Jingjing Li Yang Yang 32 40 0 01 Aug 2019
Cooperative image captioning Gilad Vered Gal Oren Yuval Atzmon Gal Chechik 31 2 0 26 Jul 2019
Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methods Aditya Mogadala M. Kalimuthu Dietrich Klakow VLM 29 133 0 22 Jul 2019
Watch It Twice: Video Captioning with a Refocused Video Encoder Xiangxi Shi Jianfei Cai Chenyu You Jiuxiang Gu 21 29 0 21 Jul 2019
Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos Shizhe Chen Yuqing Song Yida Zhao Qin Jin Zhaoyang Zeng Bei Liu Jianlong Fu Alexander G. Hauptmann 12 11 0 11 Jul 2019
On the Weaknesses of Reinforcement Learning for Neural Machine Translation Leshem Choshen Lior Fox Zohar Aizenbud Omri Abend 28 104 0 03 Jul 2019
A Deep Decoder Structure Based on WordEmbedding Regression for An Encoder-Decoder Based Model for Image Captioning A. Asadi Reza Safabakhsh 17 3 0 26 Jun 2019
Expressing Visual Relationships via Language Hao Tan Franck Dernoncourt Zhe Lin Trung Bui Joey Tianyi Zhou 29 63 0 18 Jun 2019
Image Captioning with Integrated Bottom-Up and Multi-level Residual Top-Down Attention for Game Scene Understanding Jian Zheng S. Krishnamurthy Ruxin Chen Min-Hung Chen Zhenhao Ge Xiaohua Li 43 4 0 16 Jun 2019
Generating Diverse and Informative Natural Language Fashion Feedback Gil Sadeh L. Fritz Gabi Shalev Eduard Oks 16 5 0 15 Jun 2019
Improving Visual Question Answering by Referring to Generated Paragraph Captions Hyounghun Kim Joey Tianyi Zhou CoGe 19 20 0 14 Jun 2019
Trimmed Action Recognition, Dense-Captioning Events in Videos, and Spatio-temporal Action Localization with Focus on ActivityNet Challenge 2019 Zhaofan Qiu Dong Li Yehao Li Qi Cai Yingwei Pan Ting Yao 27 8 0 14 Jun 2019
Image Captioning: Transforming Objects into Words Simão Herdade Armin Kappeler K. Boakye Joao Soares ViT 50 462 0 14 Jun 2019
Vispi: Automatic Visual Perception and Interpretation of Chest X-rays X. Li Rui Cao D. Zhu 13 20 0 12 Jun 2019
Towards Amortized Ranking-Critical Training for Collaborative Filtering Sam Lobel Chunyuan Li Jianfeng Gao Lawrence Carin 19 14 0 10 Jun 2019
Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewards Hou Pong Chan Wang Chen Lu Wang Irwin King 27 82 0 10 Jun 2019
Figure Captioning with Reasoning and Sequence-Level Training Charles C. Chen Ruiyi Zhang Eunyee Koh Sungchul Kim Scott D. Cohen Tong Yu Ryan Rossi Razvan Bunescu AIMat 31 38 0 07 Jun 2019
Reconstruct and Represent Video Contents for Captioning via Reinforcement Learning Wei Zhang Bairui Wang Lin Ma Wei Liu 20 67 0 03 Jun 2019
Generating Question Relevant Captions to Aid Visual Question Answering Jialin Wu Zeyuan Hu Raymond J. Mooney 31 42 0 03 Jun 2019
Rewarding Smatch: Transition-Based AMR Parsing with Reinforcement Learning Tahira Naseem Abhishek Shah Hui Wan Radu Florian Salim Roukos Miguel Ballesteros 27 59 0 31 May 2019
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback Hui Wu Yupeng Gao Xiaoxiao Guo Ziad Al-Halah Steven J. Rennie Kristen Grauman Rogerio Feris EgoV 28 63 0 30 May 2019
Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer Yanshuai Cao Peng Xu 17 2 0 28 May 2019
Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation? Tianxing He Jingzhao Zhang Zhiming Zhou James R. Glass 38 32 0 25 May 2019
SuperCaptioning: Image Captioning Using Two-dimensional Word Embedding Baohua Sun Ling Yang Michael Lin Charles Young Patrick Dong Wenhan Zhang Jason Dong VLM 30 8 0 25 May 2019
Multimodal Transformer with Multi-View Visual Representation for Image Captioning Jun-chen Yu Jing Li Zhou Yu Qingming Huang ViT 27 377 0 20 May 2019
Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations Fenglin Liu Yuanxin Liu Xuancheng Ren Xiaodong He Xu Sun VLM 34 81 0 15 May 2019
FastDraw: Addressing the Long Tail of Lane Detection by Adapting a Sequential Prediction Network Jonah Philion 17 159 0 10 May 2019
Domain Adversarial Reinforcement Learning for Partial Domain Adaptation Jin Chen Xinxiao Wu Lixin Duan Shenghua Gao OOD 41 43 0 10 May 2019
Exact Adversarial Attack to Image Captioning via Structured Output Learning with Latent Variables Yan Xu Baoyuan Wu Fumin Shen Yanbo Fan Yong Zhang Heng Tao Shen Wei Liu AAML 33 55 0 10 May 2019
Memory-Attended Recurrent Network for Video Captioning Wenjie Pei Jiyuan Zhang Xiangrong Wang Lei Ke Xiaoyong Shen Yu-Wing Tai 17 200 0 10 May 2019
Context-Dependent Semantic Parsing over Temporally Structured Data Charles C. Chen Razvan Bunescu 10 3 0 01 May 2019
PR Product: A Substitute for Inner Product in Neural Networks Zhennan Wang Wenbin Zou Chen Xu 28 6 0 30 Apr 2019
Knowing When to Stop: Evaluation and Verification of Conformity to Output-size Specifications Chenglong Wang Rudy Bunel Krishnamurthy Dvijotham Po-Sen Huang Edward Grefenstette Pushmeet Kohli 30 5 0 26 Apr 2019