ResearchTrend.AI
Training language models to follow instructions with human feedback

Training language models to follow instructions with human feedback

Long Ouyang
Jeff Wu
Xu Jiang
Diogo Almeida
Carroll L. Wainwright
Pamela Mishkin
Chong Zhang
Sandhini Agarwal
Katarina Slama
Alex Ray
John Schulman
Jacob Hilton
Fraser Kelton
Luke E. Miller
Maddie Simens
Amanda Askell
Peter Welinder
Paul Christiano
Jan Leike
Ryan J. Lowe
ArXiv (abs)PDFHTML

Papers citing "Training language models to follow instructions with human feedback"

50 / 6,381 papers shown
Title
CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text
CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text
Zhenru Lin
Yiqun Yao
Yang Yuan
ELM
33
0
0
04 Mar 2024
WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations
WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations
Haolin Deng
Chang Wang
Xin Li
Dezhang Yuan
Junlang Zhan
Tianhua Zhou
Jin Ma
Jun Gao
Ruifeng Xu
HILM
89
2
0
04 Mar 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Differentially Private Synthetic Data via Foundation Model APIs 2: Text
Chulin Xie
Zinan Lin
A. Backurs
Sivakanth Gopi
Da Yu
...
Haotian Jiang
Huishuai Zhang
Yin Tat Lee
Yue Liu
Sergey Yekhanin
SyDa
115
45
0
04 Mar 2024
Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search
Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search
Ivan Sekulić
K. Balog
Fabio Crestani
KELM
74
5
0
04 Mar 2024
Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models
Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models
Yuchen Wu
Minshuo Chen
Zihao Li
Mengdi Wang
Yuting Wei
110
29
0
03 Mar 2024
Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey
Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey
Qizhi Pei
Lijun Wu
Kaiyuan Gao
Jinhua Zhu
Yue Wang
Zun Wang
Tao Qin
Rui Yan
AI4CE
127
18
0
03 Mar 2024
Ever-Evolving Memory by Blending and Refining the Past
Ever-Evolving Memory by Blending and Refining the Past
Seo Hyun Kim
Keummin Ka
Yohan Jo
Seung-won Hwang
Dongha Lee
Jinyoung Yeo
KELM
59
1
0
03 Mar 2024
Barrier Functions Inspired Reward Shaping for Reinforcement Learning
Barrier Functions Inspired Reward Shaping for Reinforcement Learning
Nilaksh Nilaksh
Abhishek Ranjan
Shreenabh Agrawal
Aayush Jain
Pushpak Jagtap
Shishir Kolathaya
OffRL
81
5
0
03 Mar 2024
What Is Missing in Multilingual Visual Reasoning and How to Fix It
What Is Missing in Multilingual Visual Reasoning and How to Fix It
Yueqi Song
Simran Khanuja
Graham Neubig
VLMLRM
200
6
0
03 Mar 2024
AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
Yifan Zeng
Yiran Wu
Xiao Zhang
Huazheng Wang
Qingyun Wu
LLMAGAAML
90
77
0
02 Mar 2024
DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling
DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling
Shanghaoran Quan
MoEOffRL
80
10
0
02 Mar 2024
Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding
Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding
Ha-Thanh Nguyen
Ken Satoh
106
3
0
02 Mar 2024
Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection
Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection
Chenchen Tao
Chong Wang
Yuexian Zou
Xiaohao Peng
Xiaogang Xu
Jiangbo Qian
83
3
0
02 Mar 2024
DINER: Debiasing Aspect-based Sentiment Analysis with Multi-variable Causal Inference
DINER: Debiasing Aspect-based Sentiment Analysis with Multi-variable Causal Inference
Jialong Wu
Linhai Zhang
Deyu Zhou
Guoqiang Xu
CML
69
3
0
02 Mar 2024
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
Linhai Zhang
Jialong Wu
Deyu Zhou
Guoqiang Xu
98
5
0
02 Mar 2024
HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
Xuanlei Zhao
Bin Jia
Hao Zhou
Ziming Liu
Shenggan Cheng
Yang You
38
5
0
02 Mar 2024
MuseGraph: Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Mining
MuseGraph: Graph-oriented Instruction Tuning of Large Language Models for Generic Graph Mining
Yanchao Tan
Hang Lv
Xin Huang
Jiawei Zhang
Shiping Wang
Carl Yang
112
12
0
02 Mar 2024
LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation
LLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation
Zeyuan Ma
Hongshu Guo
Jiacheng Chen
Guojun Peng
Zhiguang Cao
Yining Ma
Yue-Jiao Gong
SyDaALM
91
22
0
02 Mar 2024
Distilling Text Style Transfer With Self-Explanation From LLMs
Distilling Text Style Transfer With Self-Explanation From LLMs
Chiyu Zhang
Honglong Cai
Yuezhang Li
Li
Yuexin Wu
Le Hou
Muhammad Abdul-Mageed
112
11
0
02 Mar 2024
LAB: Large-Scale Alignment for ChatBots
LAB: Large-Scale Alignment for ChatBots
Shivchander Sudalairaj
Abhishek Bhandwaldar
Aldo Pareja
Kai Xu
David D. Cox
Akash Srivastava
OSLM
88
35
0
02 Mar 2024
Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks
Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks
Fakhraddin Alwajih
El Moatez Billah Nagoudi
Gagan Bhatia
Abdelrahman Mohamed
Muhammad Abdul-Mageed
VLMLRM
83
16
0
01 Mar 2024
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
Zelalem Gero
Chandan Singh
Yiqing Xie
Sheng Zhang
Tristan Naumann
Jianfeng Gao
Hoifung Poon
ELMALM
63
4
0
01 Mar 2024
Predictions from language models for multiple-choice tasks are not robust under variation of scoring methods
Predictions from language models for multiple-choice tasks are not robust under variation of scoring methods
Polina Tsvilodub
Hening Wang
Sharon Grosch
Michael Franke
82
9
0
01 Mar 2024
Formulation Comparison for Timeline Construction using LLMs
Formulation Comparison for Timeline Construction using LLMs
Kimihiro Hasegawa
Nikhil Kandukuri
Susan Holm
Yukari Yamakawa
Teruko Mitamura
88
0
0
01 Mar 2024
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems
Xiao Yu
Yunan Lu
Zhou Yu
RALM
73
7
0
01 Mar 2024
Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training
Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training
Qingyan Guo
Rui Wang
Junliang Guo
Xu Tan
Jiang Bian
Yujiu Yang
LRM
100
7
0
01 Mar 2024
LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues
LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues
Joe Stacey
Jianpeng Cheng
John Torr
Tristan Guigue
Joris Driesen
Alexandru Coca
Mark Gaynor
Anders Johannsen
93
5
0
01 Mar 2024
Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
Taewook Kim
Hyomin Han
Eytan Adar
Matthew Kay
John Joon Young Chung
AI4CE
126
19
0
01 Mar 2024
Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models
Rethinking Tokenization: Crafting Better Tokenizers for Large Language Models
Jinbiao Yang
LLMAG
169
11
0
01 Mar 2024
Provably Robust DPO: Aligning Language Models with Noisy Feedback
Provably Robust DPO: Aligning Language Models with Noisy Feedback
Sayak Ray Chowdhury
Anush Kini
Nagarajan Natarajan
106
70
0
01 Mar 2024
Gradient Cuff: Detecting Jailbreak Attacks on Large Language Models by Exploring Refusal Loss Landscapes
Gradient Cuff: Detecting Jailbreak Attacks on Large Language Models by Exploring Refusal Loss Landscapes
Xiaomeng Hu
Pin-Yu Chen
Tsung-Yi Ho
AAML
66
32
0
01 Mar 2024
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance
Rachith Aiyappa
Shruthi Senthilmani
Jisun An
Haewoon Kwak
Yong-Yeol Ahn
73
3
0
01 Mar 2024
Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models
Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models
Lei Li
Yuqi Wang
Runxin Xu
Peiyi Wang
Xiachong Feng
Lingpeng Kong
Qi Liu
131
58
0
01 Mar 2024
Improving Socratic Question Generation using Data Augmentation and Preference Optimization
Improving Socratic Question Generation using Data Augmentation and Preference Optimization
Nischal Ashok Kumar
Andrew Lan
115
9
0
01 Mar 2024
"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Models
"Flex Tape Can't Fix That": Bias and Misinformation in Edited Language Models
Karina Halevy
Anna Sotnikova
Badr AlKhamissi
Syrielle Montariol
Antoine Bosselut
KELM
86
4
0
29 Feb 2024
FAC$^2$E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition
FAC2^2E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition
Xiaoqiang Wang
Bang Liu
Lingfei Wu
92
0
0
29 Feb 2024
Loose LIPS Sink Ships: Asking Questions in Battleship with Language-Informed Program Sampling
Loose LIPS Sink Ships: Asking Questions in Battleship with Language-Informed Program Sampling
Gabriel Grand
Valerio Pepe
Jacob Andreas
Joshua B. Tenenbaum
ReLM
100
6
0
29 Feb 2024
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning
Kate Sanders
Nathaniel Weir
Benjamin Van Durme
LRM
97
11
0
29 Feb 2024
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Chao Qian
Jie Zhang
Wei Yao
Dongrui Liu
Zhen-fei Yin
Yu Qiao
Yong Liu
Jing Shao
LLMSVLRM
98
12
0
29 Feb 2024
Curiosity-driven Red-teaming for Large Language Models
Curiosity-driven Red-teaming for Large Language Models
Zhang-Wei Hong
Idan Shenfeld
Tsun-Hsuan Wang
Yung-Sung Chuang
Aldo Pareja
James R. Glass
Akash Srivastava
Pulkit Agrawal
LRM
116
45
0
29 Feb 2024
ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL
ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL
Yifei Zhou
Andrea Zanette
Jiayi Pan
Sergey Levine
Aviral Kumar
146
79
0
29 Feb 2024
Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines
Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines
Lijia Ma
Xingchen Xu
Yong-Ming Tan
52
9
0
29 Feb 2024
Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook
Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook
Xingchen Zou
Yibo Yan
Xixuan Hao
Yuehong Hu
Haomin Wen
...
Junbo Zhang
Yong Li
Tianrui Li
Yu Zheng
Yuxuan Liang
HAIAI4TS
106
45
0
29 Feb 2024
Memory-Augmented Generative Adversarial Transformers
Memory-Augmented Generative Adversarial Transformers
Stephan Raaijmakers
Roos Bakker
Anita Cremers
R. D. Kleijn
Tom Kouwenhoven
Tessa Verhoef
86
0
0
29 Feb 2024
Improving Legal Judgement Prediction in Romanian with Long Text Encoders
Improving Legal Judgement Prediction in Romanian with Long Text Encoders
Mihai Masala
Traian Rebedea
Horia Velicu
AILaw
84
3
0
29 Feb 2024
Large Language Models are Learnable Planners for Long-Term Recommendation
Large Language Models are Learnable Planners for Long-Term Recommendation
Wentao Shi
Xiangnan He
Yang Zhang
Chongming Gao
Xinyue Li
Jizhi Zhang
Qifan Wang
Fuli Feng
104
13
0
29 Feb 2024
Unveiling Typographic Deceptions: Insights of the Typographic Vulnerability in Large Vision-Language Model
Unveiling Typographic Deceptions: Insights of the Typographic Vulnerability in Large Vision-Language Model
Hao-Ran Cheng
Erjia Xiao
Jindong Gu
Le Yang
Jinhao Duan
Jize Zhang
Jiahang Cao
Kaidi Xu
Renjing Xu
103
9
0
29 Feb 2024
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment
Yiju Guo
Ganqu Cui
Lifan Yuan
Ning Ding
Jiexin Wang
...
Ruobing Xie
Jie Zhou
Yankai Lin
Zhiyuan Liu
Maosong Sun
100
67
0
29 Feb 2024
Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Study
Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Study
Prottay Kumar Adhikary
Aseem Srivastava
Shivani Kumar
Salam Michael Singh
Puneet Manuja
Jini K. Gopinath
Vijay Krishnan
Swati Kedia
K. Deb
Tanmoy Chakraborty
AI4MH
104
10
0
29 Feb 2024
Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognition
Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognition
Boyu Chen
Siran Chen
Kunchang Li
Qinglin Xu
Yu Qiao
Yali Wang
70
5
0
29 Feb 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.