Self-Instruct: Aligning Language Models with Self-Generated Instructions

20 December 2022

Daniel Khashabi

Papers citing "Self-Instruct: Aligning Language Models with Self-Generated Instructions"

50 / 1,588 papers shown

Title
Self-Agreement: A Framework for Fine-tuning Language Models to Find Agreement among Diverse Opinions Shiyao Ding Takayuki Ito SyDa 24 6 0 19 May 2023
AutoTrial: Prompting Language Models for Clinical Trial Design Zifeng Wang Cao Xiao Jimeng Sun LM&MA LRM 16 15 0 19 May 2023
VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks Wen Wang Zhe Chen Xiaokang Chen Jiannan Wu Xizhou Zhu ... Ping Luo Tong Lu Jie Zhou Yu Qiao Jifeng Dai MLLM VLM 35 460 0 18 May 2023
LIMA: Less Is More for Alignment Chunting Zhou Pengfei Liu Puxin Xu Srini Iyer Jiao Sun ... Susan Zhang Gargi Ghosh M. Lewis Luke Zettlemoyer Omer Levy ALM 36 780 0 18 May 2023
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities Dong Zhang Shimin Li Xin Zhang Jun Zhan Pengyu Wang Yaqian Zhou Xipeng Qiu AuLLM MLLM 62 297 0 18 May 2023
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval Yue Yu Yuchen Zhuang Rongzhi Zhang Yu Meng Jiaming Shen Chao Zhang VLM 38 33 0 18 May 2023
Instruction Tuned Models are Quick Learners Himanshu Gupta Saurabh Arjun Sawant Swaroop Mishra Mutsumi Nakamura Arindam Mitra Santosh Mashetty Chitta Baral 26 26 0 17 May 2023
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language Models Chuang Liu Renren Jin Yuqi Ren Linhao Yu Tianyu Dong ... Peiyi Zhang Qingqing Lyu Xiaowen Su Qun Liu Deyi Xiong ELM ALM 16 24 0 17 May 2023
Maybe Only 0.5% Data is Needed: A Preliminary Exploration of Low Training Data Instruction Tuning Haowen Chen Yiming Zhang Qi Zhang Hantao Yang Xiaomeng Hu Xuetao Ma Yifan YangGong J. Zhao ALM 69 47 0 16 May 2023
Interpretability at Scale: Identifying Causal Mechanisms in Alpaca Zhengxuan Wu Atticus Geiger Thomas Icard Christopher Potts Noah D. Goodman MILM 41 82 0 15 May 2023
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models Yuzhen Huang Yuzhuo Bai Zhihao Zhu Junlei Zhang Jinghan Zhang ... Yikai Zhang Jiayi Lei Yao Fu Maosong Sun Junxian He ELM LRM 30 499 0 15 May 2023
CodeT5+: Open Code Large Language Models for Code Understanding and Generation Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li Steven C. H. Hoi ALM 27 461 0 13 May 2023
On the Hidden Mystery of OCR in Large Multimodal Models Yuliang Liu Zhang Li Mingxin Huang Chunyuan Li Dezhi Peng Mingyu Liu Lianwen Jin Xiang Bai VLM MLLM 34 54 0 13 May 2023
PALR: Personalization Aware LLMs for Recommendation Fan Yang Zheng Chen Ziyan Jiang Eunah Cho Xiaojiang Huang Yanbin Lu 33 106 0 12 May 2023
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach Junjie Zhang Ruobing Xie Yupeng Hou Wayne Xin Zhao Leyu Lin Ji-Rong Wen 37 201 0 11 May 2023
Structured Chain-of-Thought Prompting for Code Generation Jia Li Ge Li Yongming Li Zhi Jin LRM 51 112 0 11 May 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning Wenliang Dai Junnan Li Dongxu Li A. M. H. Tiong Junqi Zhao Weisheng Wang Boyang Albert Li Pascale Fung Steven C. H. Hoi MLLM VLM 19 1,916 0 11 May 2023
InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language Zhaoyang Liu Yinan He Wenhai Wang Weiyun Wang Yi Wang ... Yali Wang Limin Wang Ping Luo Jifeng Dai Yu Qiao LRM MLLM 38 79 0 09 May 2023
Towards Building the Federated GPT: Federated Instruction Tuning Jianyi Zhang Saeed Vahidian Martin Kuo Chunyuan Li Ruiyi Zhang Tong Yu Yufan Zhou Guoyin Wang Yiran Chen ALM FedML 37 112 0 09 May 2023
MoT: Memory-of-Thought Enables ChatGPT to Self-Improve Xiaonan Li Xipeng Qiu ReLM KELM LRM AI4MH 26 32 0 09 May 2023
NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge Phillip Howard Junlin Wang Vasudev Lal Gadi Singer Yejin Choi Swabha Swayamdipta 37 9 0 08 May 2023
The Current State of Summarization Fabian Retkowski 23 6 0 08 May 2023
Exploring Human-Like Translation Strategy with Large Language Models Zhiwei He Tian Liang Wenxiang Jiao ZhuoSheng Zhang Yujiu Yang Rui Wang Zhaopeng Tu Shuming Shi Xing Wang 29 39 0 06 May 2023
LMEye: An Interactive Perception Network for Large Language Models Yunxin Li Baotian Hu Xinyu Chen Lin Ma Yong-mei Xu Hao Fei MLLM VLM 33 24 0 05 May 2023
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision Zhiqing Sun Songlin Yang Qinhong Zhou Hongxin Zhang Zhenfang Chen David D. Cox Yiming Yang Chuang Gan SyDa ALM 27 314 0 04 May 2023
Automatic Prompt Optimization with "Gradient Descent" and Beam Search Reid Pryzant Dan Iter Jerry Li Y. Lee Chenguang Zhu Michael Zeng 24 303 0 04 May 2023
Personalized Abstractive Summarization by Tri-agent Generation Pipeline Md Aminul Haque Palash Sourav Saha Faria Afrin Pengcheng He 42 4 0 04 May 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 63 17 0 29 Apr 2023
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model Peng Gao Jiaming Han Renrui Zhang Ziyi Lin Shijie Geng ... Pan Lu Conghui He Xiangyu Yue Hongsheng Li Yu Qiao MLLM 47 554 0 28 Apr 2023
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions Minghao Wu Abdul Waheed Chiyu Zhang Muhammad Abdul-Mageed Alham Fikri Aji ALM 135 119 0 27 Apr 2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan ... Junfeng Tian Qiang Qi Ji Zhang Feiyan Huang Jingren Zhou VLM MLLM 208 905 0 27 Apr 2023
Better Question-Answering Models on a Budget Yudhanjaya Wijeratne Ishan Marikar ALM 25 0 0 24 Apr 2023
WizardLM: Empowering Large Language Models to Follow Complex Instructions Can Xu Qingfeng Sun Kai Zheng Xiubo Geng Pu Zhao Jiazhan Feng Chongyang Tao Daxin Jiang ALM 46 911 0 24 Apr 2023
Phoenix: Democratizing ChatGPT across Languages Zhihong Chen Feng Jiang Junying Chen Tiannan Wang Fei Yu ... Zhiyi Zhang Jianquan Li Xiang Wan Benyou Wang Haizhou Li ALM 23 35 0 20 Apr 2023
Safety Assessment of Chinese Large Language Models Hao Sun Zhexin Zhang Jiawen Deng Jiale Cheng Minlie Huang ALM ELM 35 75 0 20 Apr 2023
Visual Instruction Tuning Haotian Liu Chunyuan Li Qingyang Wu Yong Jae Lee SyDa VLM MLLM 130 4,310 0 17 Apr 2023
Learning to Compress Prompts with Gist Tokens Jesse Mu Xiang Lisa Li Noah D. Goodman VLM 53 206 0 17 Apr 2023
LongForm: Effective Instruction Tuning with Reverse Instructions Abdullatif Köksal Timo Schick Anna Korhonen Hinrich Schütze SyDa ALM 31 34 0 17 Apr 2023
Tool Learning with Foundation Models Yujia Qin Shengding Hu Yankai Lin Weize Chen Ning Ding ... Cheng Yang Tongshuang Wu Heng Ji Zhiyuan Liu Maosong Sun 42 200 0 17 Apr 2023
Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca Yiming Cui Ziqing Yang Xin Yao ALM 31 297 0 17 Apr 2023
From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning Qian Liu Fan Zhou Zhengbao Jiang Longxu Dou Min-Bin Lin 18 17 0 17 Apr 2023
Chinese Open Instruction Generalist: A Preliminary Release Ge Zhang Yemin Shi Ruibo Liu Ruibin Yuan Yizhi Li ... Zhaoqun Li Zekun Wang Chenghua Lin Wen-Fen Huang Jie Fu ALM 33 29 0 17 Apr 2023
ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human Junfeng Tian Hehong Chen Guohai Xu Mingshi Yan Xing Gao ... Qinghao Ye Jie Zhang Ji Zhang Feiran Huang Jingren Zhou ALM VLM 34 15 0 16 Apr 2023
OpenAssistant Conversations -- Democratizing Large Language Model Alignment Andreas Kopf Yannic Kilcher Dimitri von Rutte Sotiris Anagnostidis Zhi Rui Tam ... Arnav Dantuluri Andrew Maguire Christoph Schuhmann Huu Nguyen A. Mattick ALM LM&MA 51 584 0 14 Apr 2023
API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs Minghao Li Yingxiu Zhao Yu Bowen Feifan Song Hangyu Li Haiyang Yu Zhoujun Li Fei Huang Yongbin Li ELM RALM CLL 31 143 0 14 Apr 2023
HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge Hao Wang Chi-Liang Liu Nuwa Xi Zewen Qiang Sendong Zhao Bing Qin Ting Liu LM&MA ALM 19 198 0 14 Apr 2023
RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment Hanze Dong Wei Xiong Deepanshu Goyal Yihan Zhang Winnie Chow Rui Pan Shizhe Diao Jipeng Zhang Kashun Shum Tong Zhang ALM 18 408 0 13 Apr 2023
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study Wei Ping Ming-Yu Liu P. Xu Lawrence C. McAfee Zihan Liu ... Oleksii Kuchaiev Bo-wen Li Chaowei Xiao Anima Anandkumar Bryan Catanzaro RALM 46 55 0 13 Apr 2023
Improving Diffusion Models for Scene Text Editing with Dual Encoders Jiabao Ji Guanhua Zhang Zhaowen Wang Bairu Hou Zhifei Zhang Brian L. Price Shiyu Chang DiffM 35 29 0 12 Apr 2023
RRHF: Rank Responses to Align Language Models with Human Feedback without tears Zheng Yuan Hongyi Yuan Chuanqi Tan Wei Wang Songfang Huang Feiran Huang ALM 42 348 0 11 Apr 2023