References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation

10 May 2025

Papers citing "References Indeed Matter? Reference-Free Preference Optimization for Conversational Query Reformulation"

41 / 41 papers shown

Title
Preference Optimization for Reasoning with Pseudo Feedback Fangkai Jiao Geyang Guo Xingxing Zhang Nancy F. Chen Shafiq Joty Furu Wei LRM 170 12 0 17 Feb 2025
Learning to Summarize from LLM-generated Feedback Hwanjun Song Taewon Yun Yuho Lee Jihwan Oh Gihun Lee Jason (Jinglun) Cai Hang Su 194 9 0 28 Jan 2025
Geometric-Averaged Preference Optimization for Soft Preference Labels Hiroki Furuta Kuang-Huei Lee Shixiang Shane Gu Y. Matsuo Aleksandra Faust Heiga Zen Izzeddin Gur 98 11 0 31 Dec 2024
AdaCQR: Enhancing Query Reformulation for Conversational Search via Sparse and Dense Retrieval Alignment Yilong Lai Jialong Wu Congzhi Zhang Haowen Sun Deyu Zhou 78 4 0 02 Jul 2024
Retrieval-augmented generation in multilingual settings Nadezhda Chirkova David Rau Hervé Déjean Thibault Formal Stéphane Clinchant Vassilina Nikoulina RALM 46 17 0 01 Jul 2024
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation David Rau Hervé Déjean Nadezhda Chirkova Thibault Formal Shuai Wang Vassilina Nikoulina Stéphane Clinchant 57 13 0 01 Jul 2024
A Survey on Human Preference Learning for Large Language Models Ruili Jiang Kehai Chen Xuefeng Bai Zhixuan He Juntao Li Muyun Yang Tiejun Zhao Liqiang Nie Min Zhang 99 8 0 17 Jun 2024
SPO: Multi-Dimensional Preference Sequential Alignment With Implicit Reward Modeling Xingzhou Lou Junge Zhang Jian Xie Lifeng Liu Dong Yan Kaiqi Huang 65 12 0 21 May 2024
Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity Soyeong Jeong Jinheon Baek Sukmin Cho Sung Ju Hwang Jong C. Park RALM 64 177 0 21 Mar 2024
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment Yiju Guo Ganqu Cui Lifan Yuan Ning Ding Jiexin Wang ... Ruobing Xie Jie Zhou Yankai Lin Zhiyuan Liu Maosong Sun 65 64 0 29 Feb 2024
RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering Zihan Zhang Meng Fang Ling-Hao Chen RALM 73 14 0 26 Feb 2024
Ask Optimal Questions: Aligning Large Language Models with Retriever's Preference in Conversational Search Chanwoong Yoon Gangwoo Kim Byeongguk Jeon Sungdong Kim Yohan Jo Jaewoo Kang RALM KELM 80 0 0 19 Feb 2024
Self-Rewarding Language Models Weizhe Yuan Richard Yuanzhe Pang Kyunghyun Cho Xian Li Sainbayar Sukhbaatar Jing Xu Jason Weston ReLM SyDa ALM LRM 346 327 0 18 Jan 2024
Robust Data Pruning under Label Noise via Maximizing Re-labeling Accuracy Dongmin Park Seola Choi Doyoung Kim Hwanjun Song Jae-Gil Lee NoLa 101 21 0 02 Nov 2023
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation Hwanjun Song Igor Shalyminov Hang Su Siffi Singh Kaisheng Yao Saab Mansour 53 6 0 20 Oct 2023
Knowledge-Augmented Language Model Verification Jinheon Baek Soyeong Jeong Minki Kang Jong C. Park Sung Ju Hwang RALM 67 13 0 19 Oct 2023
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection Akari Asai Zeqiu Wu Yizhong Wang Avirup Sil Hannaneh Hajishirzi RALM 251 746 0 17 Oct 2023
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting Fanghua Ye Meng Fang Shenghui Li Emine Yilmaz KELM 102 51 0 15 Oct 2023
Preference-grounded Token-level Guidance for Language Model Fine-tuning Shentao Yang Shujian Zhang Congying Xia Yihao Feng Caiming Xiong Mi Zhou 97 26 0 01 Jun 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 382 3,942 0 29 May 2023
ConvGQR: Generative Query Reformulation for Conversational Search Fengran Mo Kelong Mao Yutao Zhu Yihong Wu Kaiyu Huang J. Nie 75 50 0 25 May 2023
When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories Alex Troy Mallen Akari Asai Victor Zhong Rajarshi Das Daniel Khashabi Hannaneh Hajishirzi RALM HILM KELM 102 591 0 20 Dec 2022
Precise Zero-Shot Dense Retrieval without Relevance Labels Luyu Gao Xueguang Ma Jimmy J. Lin Jamie Callan RALM 80 328 0 20 Dec 2022
Self-Training: A Survey Massih-Reza Amini Vasilii Feofanov Loïc Pauletto Lies Hadjadj Emilie Devijver Yury Maximov SSL 91 103 0 24 Feb 2022
CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning Zeqiu Wu Yi Luan Hannah Rashkin David Reitter Hannaneh Hajishirzi Mari Ostendorf Gaurav Singh Tomar LRM 48 80 0 16 Dec 2021
Large Dual Encoders Are Generalizable Retrievers Jianmo Ni Chen Qu Jing Lu Zhuyun Dai Gustavo Hernández Ábrego ... Vincent Zhao Yi Luan Keith B. Hall Ming-Wei Chang Yinfei Yang DML 158 452 0 15 Dec 2021
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching Vaibhav Adlakha Shehzaad Dhuliawala Kaheer Suleman H. D. Vries Siva Reddy BDL 77 91 0 02 Oct 2021
A Theory of Label Propagation for Subpopulation Shift Tianle Cai Ruiqi Gao Jason D. Lee Qi Lei 58 50 0 22 Feb 2021
Open-Domain Question Answering Goes Conversational via Question Rewriting R. Anantha Svitlana Vakulenko Zhucheng Tu Shayne Longpre S. Pulman Srinivas Chappidi LRM 53 165 0 10 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 75 230 0 07 Oct 2020
Open-Retrieval Conversational Question Answering Chen Qu Liu Yang Cen Chen Minghui Qiu W. Bruce Croft Mohit Iyyer RALM 66 175 0 22 May 2020
Question Rewriting for Conversational Question Answering Svitlana Vakulenko Shayne Longpre Zhucheng Tu R. Anantha 50 180 0 30 Apr 2020
Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Models Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan-Ju Wang Jimmy J. Lin 34 83 0 04 Apr 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 155 3,549 0 21 Jan 2020
Self-training with Noisy Student improves ImageNet classification Qizhe Xie Minh-Thang Luong Eduard H. Hovy Quoc V. Le NoLa 307 2,386 0 11 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 419 20,127 0 23 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,193 0 27 Aug 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 321 5,801 0 21 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,770 0 11 Oct 2018
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 481 19,019 0 20 Jul 2017
Billion-scale similarity search with GPUs Jeff Johnson Matthijs Douze Hervé Jégou 257 3,721 0 28 Feb 2017