Guided Open Vocabulary Image Captioning with Constrained Beam Search

2 December 2016

Papers citing "Guided Open Vocabulary Image Captioning with Constrained Beam Search"

50 / 136 papers shown

Title
Zero-shot Clarifying Question Generation for Conversational Search Zhenduo Wang Yuancheng Tu Corby Rosset Nick Craswell Ming Wu Qingyao Ai 25 21 0 30 Jan 2023
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 37 5 0 22 Nov 2022
Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation Ke Min Wang Xin Ge Yuqi Zhang Yu Zhao Jiayi Wang 29 2 0 14 Nov 2022
Generalization Analysis on Learning with a Concurrent Verifier Masaaki Nishino Kengo Nakamura Norihito Yasuda 39 1 0 11 Oct 2022
Paraphrasing Is All You Need for Novel Object Captioning Cheng Yang Yao-Hung Hubert Tsai Wanshu Fan Ruslan Salakhutdinov Louis-Philippe Morency Yu-Chiang Frank Wang 51 4 0 25 Sep 2022
LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restriction Zhaoyun Jiang Jiaqi Guo Shizhao Sun Huayu Deng Zhongkai Wu V. Mijović Z. Yang Jian-Guang Lou Dongmei Zhang 26 35 0 17 Aug 2022
Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning J. Hu Roberto Cavicchioli Alessandro Capotondi 31 21 0 13 Aug 2022
Why is constrained neural language generation particularly challenging? Cristina Garbacea Qiaozhu Mei 67 14 0 11 Jun 2022
Controllable Text Generation with Neurally-Decomposed Oracle Tao Meng Sidi Lu Nanyun Peng Kai-Wei Chang BDL 44 35 0 27 May 2022
NaturalProver: Grounded Mathematical Proof Generation with Language Models Sean Welleck Jiacheng Liu Ximing Lu Hannaneh Hajishirzi Yejin Choi AIMat LRM 32 66 0 25 May 2022
Diverse Image Captioning with Grounded Style Franz Klein Shweta Mahajan S. Roth 22 7 0 03 May 2022
NOC-REK: Novel Object Captioning with Retrieved Vocabulary from External Knowledge D. Vo Hong Chen Akihiro Sugimoto Hideki Nakayama 16 13 0 28 Mar 2022
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection Thomas Hartvigsen Saadia Gabriel Hamid Palangi Maarten Sap Dipankar Ray Ece Kamar 38 354 0 17 Mar 2022
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation Wenliang Dai Lu Hou Lifeng Shang Xin Jiang Qun Liu Pascale Fung VLM 22 90 0 12 Mar 2022
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods Wei Li Wenhao Wu Moye Chen Jiachen Liu Xinyan Xiao Hua Wu HILM 29 27 0 10 Mar 2022
Interactive Machine Learning for Image Captioning Mareike Hartmann Aliki Anagnostopoulou Daniel Sonntag VLM 21 4 0 28 Feb 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 57 215 0 14 Jan 2022
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics Ximing Lu Sean Welleck Peter West Liwei Jiang Jungo Kasai ... Lianhui Qin Youngjae Yu Rowan Zellers Noah A. Smith Yejin Choi 11 158 0 16 Dec 2021
Injecting Semantic Concepts into End-to-End Image Captioning Zhiyuan Fang Jianfeng Wang Xiaowei Hu Lin Liang Zhe Gan Lijuan Wang Yezhou Yang Zicheng Liu ViT VLM 29 86 0 09 Dec 2021
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel Yoav Shalev Idan Schwartz Lior Wolf VLM 34 192 0 29 Nov 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning Jianfeng Wang Xiaowei Hu Zhe Gan Zhengyuan Yang Xiyang Dai Zicheng Liu Yumao Lu Lijuan Wang ViT 29 57 0 19 Nov 2021
ClipCap: CLIP Prefix for Image Captioning Ron Mokady Amir Hertz Amit H. Bermano CLIP VLM 28 658 0 18 Nov 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
CUNI systems for WMT21: Terminology translation Shared Task Josef Jon Michal Novák João Paulo Aires Duvsan Varivs Ondrej Bojar 24 4 0 20 Sep 2021
Transformer-based Lexically Constrained Headline Generation Kosuke Yamada Yuta Hitomi Hideaki Tamori Ryohei Sasano Naoaki Okazaki Kentaro Inui Koichi Takeda 26 12 0 15 Sep 2021
Partially-Supervised Novel Object Captioning Leveraging Context from Paired Data Shashank Bujimalla Mahesh Subedar Omesh Tickoo 40 1 0 10 Sep 2021
Caption Generation on Scenes with Seen and Unseen Object Categories B. Demirel R. G. Cinbis VLM 17 1 0 13 Aug 2021
A Thorough Review on Recent Deep Learning Methodologies for Image Captioning Ahmed Elhagry Karima Kadaoui VLM 33 17 0 28 Jul 2021
Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation Yufei Wang Can Xu Huang Hu Chongyang Tao Stephen Wan Mark Dras Mark Johnson Daxin Jiang 19 10 0 27 Jul 2021
From Show to Tell: A Survey on Deep Learning-based Image Captioning Matteo Stefanini Marcella Cornia Lorenzo Baraldi S. Cascianelli G. Fiameni Rita Cucchiara 3DV VLM MLLM 69 256 0 14 Jul 2021
Modeling Target-side Inflection in Placeholder Translation Ryokan Ri Toshiaki Nakazawa Yoshimasa Tsuruoka 17 1 0 01 Jul 2021
End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages Josef Jon João Paulo Aires Duvsan Varivs Ondrej Bojar 21 14 0 23 Jun 2021
On the Evaluation of Machine Translation for Terminology Consistency Md Mahfuz Ibn Alam Antonios Anastasopoulos Laurent Besacier James Cross Matthias Gallé Philipp Koehn Vassilina Nikoulina 42 33 0 22 Jun 2021
Constraining Linear-chain CRFs to Regular Languages Sean Papay Roman Klinger Sebastian Padó BDL 30 5 0 14 Jun 2021
Learning to Select: A Fully Attentive Approach for Novel Object Captioning Marco Cagrandi Marcella Cornia Matteo Stefanini Lorenzo Baraldi Rita Cucchiara 32 9 0 02 Jun 2021
Constrained Language Models Yield Few-Shot Semantic Parsers Richard Shin C. H. Lin Sam Thomson Charles C. Chen Subhro Roy Emmanouil Antonios Platanios Adam Pauls Dan Klein J. Eisner Benjamin Van Durme 305 199 0 18 Apr 2021
There Once Was a Really Bad Poet, It Was Automated but You Didn't Know It Jianyou Wang Xiaoxuan Zhang Yuren Zhou Christopher Suh Cynthia Rudin 33 5 0 05 Mar 2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo P. Sharma Nan Ding Radu Soricut VLM 308 1,086 0 17 Feb 2021
ECOL-R: Encouraging Copying in Novel Object Captioning with Reinforcement Learning Yufei Wang Ian D. Wood Stephen Wan Mark Johnson 28 7 0 25 Jan 2021
Graphmax for Text Generation Bin Liu Guosheng Yin 27 1 0 01 Jan 2021
Understanding Guided Image Captioning Performance across Domains Edwin G. Ng Bo Pang P. Sharma Radu Soricut 37 24 0 04 Dec 2020
EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints Weijia Xu Marine Carpuat KELM 35 47 0 13 Nov 2020
CapWAP: Captioning with a Purpose Adam Fisch Kenton Lee Ming-Wei Chang J. Clark Regina Barzilay 10 11 0 09 Nov 2020
Diverse Image Captioning with Context-Object Split Latent Spaces Shweta Mahajan Stefan Roth 19 41 0 02 Nov 2020
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints Ximing Lu Peter West Rowan Zellers Ronan Le Bras Chandra Bhagavatula Yejin Choi NAI 15 142 0 24 Oct 2020
Autoregressive Entity Retrieval Nicola De Cao Gautier Izacard Sebastian Riedel Fabio Petroni 82 433 0 02 Oct 2020
Spatial Attention as an Interface for Image Captioning Models P. Sadler 28 0 0 29 Sep 2020
VIVO: Visual Vocabulary Pre-Training for Novel Object Captioning Xiaowei Hu Xi Yin Kevin Qinghong Lin Lijuan Wang Lefei Zhang Jianfeng Gao Zicheng Liu VLM 22 56 0 28 Sep 2020
Effects of Word-frequency based Pre- and Post- Processings for Audio Captioning Daiki Takeuchi Yuma Koizumi Yasunori Ohishi Noboru Harada K. Kashino 6 26 0 24 Sep 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 45 30 0 31 Jul 2020