Guided Open Vocabulary Image Captioning with Constrained Beam Search

2 December 2016

Papers citing "Guided Open Vocabulary Image Captioning with Constrained Beam Search"

50 / 136 papers shown

Title
Visually Guided Decoding: Gradient-Free Hard Prompt Inversion with Language Models Donghoon Kim Minji Bae Kyuhong Shim B. Shim 43 0 0 13 May 2025
Semantic Probabilistic Control of Language Models Kareem Ahmed Catarina G Belém Padhraic Smyth Sameer Singh 49 0 0 04 May 2025
Efficient and Asymptotically Unbiased Constrained Decoding for Large Language Models Haotian Ye Himanshu Jain Chong You A. Suresh Haowei Lin James Zou Felix X. Yu 36 0 0 12 Apr 2025
GAPO: Learning Preferential Prompt through Generative Adversarial Policy Optimization Zhouhong Gu Xingzhou Chen Xiaoran Shi Tao Wang Suhang Zheng Tianyu Li Hongwei Feng Yanghua Xiao 78 0 0 26 Mar 2025
Teaching Models to Improve on Tape L. Bezalel Eyal Orgad Amir Globerson 42 0 0 03 Nov 2024
Focus On This, Not That! Steering LLMs With Adaptive Feature Specification Tom A. Lamb Adam Davies Alasdair Paren Philip Torr Francesco Pinto 54 0 0 30 Oct 2024
Control Large Language Models via Divide and Conquer Bingxuan Li Yiwei Wang Tao Meng Kai-Wei Chang Nanyun Peng 34 0 0 06 Oct 2024
Edit-Constrained Decoding for Sentence Simplification Tatsuya Zetsu Yuki Arase Tomoyuki Kajiwara 30 0 0 28 Sep 2024
Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysis Uri Berger Gabriel Stanovsky Omri Abend Lea Frermann 45 0 0 09 Aug 2024
A Data-Driven Guided Decoding Mechanism for Diagnostic Captioning Panagiotis Kaliosis John Pavlopoulos Foivos Charalampakos Georgios Moschovis Ion Androutsopoulos MedIm 29 1 0 20 Jun 2024
Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference Jiabao Ji Yujian Liu Yang Zhang Gaowen Liu Ramana Rao Kompella Sijia Liu Shiyu Chang KELM MU 42 24 0 12 Jun 2024
Grammar-Aligned Decoding Kanghee Park Jiayu Wang Taylor Berg-Kirkpatrick Nadia Polikarpova Loris Dántoni 42 10 0 31 May 2024
Constrained Decoding for Secure Code Generation Yanjun Fu Ethan Baker Yu Ding Yizheng Chen AAML 46 8 0 30 Apr 2024
DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference Jinwei Yao Kaiqi Chen Kexun Zhang Jiaxuan You Binhang Yuan Zeke Wang Tao Lin 48 2 0 30 Mar 2024
DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation Chen Xu Tian Lan Changlong Yu Wei Wang Jun Gao ... Qunxi Dong Kun Qian Piji Li Wei Bi Bin Hu 50 0 0 04 Mar 2024
HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding Zhaorun Chen Zhuokai Zhao Hongyin Luo Huaxiu Yao Bo Li Jiawei Zhou MLLM 46 60 0 01 Mar 2024
CorpusBrain++: A Continual Generative Pre-Training Framework for Knowledge-Intensive Language Tasks Jiafeng Guo Changjiang Zhou Ruqing Zhang Jiangui Chen Maarten de Rijke Yixing Fan Xueqi Cheng CLL 29 7 0 26 Feb 2024
Permute-and-Flip: An optimally stable and watermarkable decoder for LLMs Xuandong Zhao Lei Li Yu-Xiang Wang 55 10 0 08 Feb 2024
Consistent Joint Decision-Making with Heterogeneous Learning Models Hossein Rajaby Faghihi Parisa Kordjamshidi 42 2 0 06 Feb 2024
Constrained Decoding for Cross-lingual Label Projection Duong Minh Le Yang Chen Alan Ritter Wei Xu 27 7 0 05 Feb 2024
Controllable Decontextualization of Yes/No Question and Answers into Factual Statements Lingbo Mo B. Fetahu Oleg Rokhlenko S. Malmasi 34 0 0 18 Jan 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding Yuu Jinnai Kaito Ariu 29 8 0 05 Jan 2024
RCA-NOC: Relative Contrastive Alignment for Novel Object Captioning Jiashuo Fan Yaoyuan Liang Leyao Liu Shao-Lun Huang Lei Zhang 30 2 0 11 Dec 2023
PathFinder: Guided Search over Multi-Step Reasoning Paths O. Yu. Golovneva Sean O'Brien Ramakanth Pasunuru Tianlu Wang Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz LRM 35 7 0 08 Dec 2023
To be or not to be? an exploration of continuously controllable prompt engineering Yuhan Sun Mukai Li Yixin Cao Kun Wang Wenxiao Wang Xingyu Zeng Rui Zhao LLMAG 37 2 0 16 Nov 2023
Model-Based Minimum Bayes Risk Decoding for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda Kaito Ariu Kenshi Abe 27 6 0 09 Nov 2023
Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models Xiang Chen Xiaojun Wan 27 0 0 25 Oct 2023
Evaluating Large Language Models on Controlled Generation Tasks Jiao Sun Yufei Tian Wangchunshu Zhou Nan Xu Qian Hu Rahul Gupta John Wieting Nanyun Peng Xuezhe Ma LRM ELM 40 61 0 23 Oct 2023
EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification Yingjie Zhu Jiasheng Si Yibo Zhao Haiyang Zhu Deyu Zhou Yulan He 41 6 0 23 Oct 2023
Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning Shitong Duan Xiaoyuan Yi Peng Zhang Tun Lu Xing Xie Ning Gu 30 9 0 17 Oct 2023
Dont Add, dont Miss: Effective Content Preserving Generation from Pre-Selected Text Spans Aviv Slobodkin Avi Caciularu Eran Hirsch Ido Dagan 20 3 0 13 Oct 2023
Formally Specifying the High-Level Behavior of LLM-Based Agents Mayank Agarwal Ibrahim Abdelaziz Ramón Fernández Astudillo Kinjal Basu Soham Dan Yara Rizk Achille Fokoue Pavan Kapanipathi Salim Roukos Luis A. Lastras LLMAG 26 8 0 12 Oct 2023
Don't Fine-Tune, Decode: Syntax Error-Free Tool Use via Constrained Decoding Kexun Zhang Hongqiao Chen Lei Li Wenjie Wang 53 4 0 10 Oct 2023
Toward Unified Controllable Text Generation via Regular Expression Instruction Xin Zheng Hongyu Lin Xianpei Han Le Sun 57 4 0 19 Sep 2023
Zero-Resource Hallucination Prevention for Large Language Models Junyu Luo Cao Xiao Fenglong Ma HILM 39 16 0 06 Sep 2023
On the Depth between Beam Search and Exhaustive Search for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda 24 2 0 25 Aug 2023
With a Little Help from your own Past: Prototypical Memory Networks for Image Captioning Manuele Barraco Sara Sarto Marcella Cornia Lorenzo Baraldi Rita Cucchiara VLM 60 19 0 23 Aug 2023
Negative Lexical Constraints in Neural Machine Translation Josef Jon Duvsan Varivs Michal Novák João Paulo Aires Ondrej Bojar 22 1 0 07 Aug 2023
Transferable Decoding with Visual Entities for Zero-Shot Image Captioning Junjie Fei Teng Wang Jinrui Zhang Zhenyu He Chengjie Wang Feng Zheng VLM 36 34 0 31 Jul 2023
Towards Accurate Translation via Semantically Appropriate Application of Lexical Constraints Yujin Baek Ko-tik Lee Dayeon Ki Hyoung-Gyu Lee Cheonbok Park Jaegul Choo 38 5 0 21 Jun 2023
DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models Sidi Lu Wenbo Zhao Chenyang Tao Arpit Gupta Shan Wu Tagyoung Chung Nanyun Peng 32 1 0 20 Jun 2023
Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing Shufan Wang Sébastien Jean Sailik Sengupta James Gung Nikolaos Pappas Yi Zhang 31 6 0 24 May 2023
Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning Saibo Geng Martin Josifosky Maxime Peyrard Robert West 42 60 0 23 May 2023
Simple Token-Level Confidence Improves Caption Correctness Suzanne Petryk Spencer Whitehead Joseph E. Gonzalez Trevor Darrell Anna Rohrbach Marcus Rohrbach 31 7 0 11 May 2023
Controlled Text Generation with Natural Language Instructions Wangchunshu Zhou Yuchen Eleanor Jiang Ethan Gotlieb Wilcox Ryan Cotterell Mrinmaya Sachan 160 84 0 27 Apr 2023
A Lightweight Constrained Generation Alternative for Query-focused Summarization Zhichao Xu Daniel Cohen 32 10 0 23 Apr 2023
User Adaptive Language Learning Chatbots with a Curriculum Kun Qian Ryan Shea Yu Li Luke K. Fryer Zhou Yu 35 12 0 11 Apr 2023
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only Training Wei Li Linchao Zhu Longyin Wen Yi Yang VLM 50 86 0 06 Mar 2023
ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing Zequn Zeng Hao Zhang Zhengjue Wang Ruiying Lu Dongsheng Wang Bo Chen BDL DiffM 24 33 0 04 Mar 2023
GLUECons: A Generic Benchmark for Learning Under Constraints Hossein Rajaby Faghihi Aliakbar Nafar Chen Zheng Roshanak Mirzaee Yue Zhang Andrzej Uszok Alexander Wan Tanawan Premsri Dan Roth Parisa Kordjamshidi ELM VLM 40 13 0 16 Feb 2023