Cross-Task Generalization via Natural Language Crowdsourcing Instructions

18 April 2021

Daniel Khashabi

Papers citing "Cross-Task Generalization via Natural Language Crowdsourcing Instructions"

50 / 562 papers shown

Title
Ensemble-Instruct: Generating Instruction-Tuning Data with a Heterogeneous Mixture of LMs Young-Suk Lee Md Arafat Sultan Yousef El-Kurdi Tahira Naseem Asim Munawar Radu Florian Salim Roukos Ramón Fernández Astudillo SyDa 27 6 0 21 Oct 2023
Tuna: Instruction Tuning using Feedback from Large Language Models Haoran Li Yiran Liu Xingxing Zhang Wei Lu Furu Wei ALM 38 3 0 20 Oct 2023
Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling Yaqing Wang Jialin Wu T. Dabral Jiageng Zhang Geoff Brown ... Frederick Liu Yi Liang Bo Pang Michael Bendersky Radu Soricut VLM 25 14 0 18 Oct 2023
The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models Aviv Slobodkin Omer Goldman Avi Caciularu Ido Dagan Shauli Ravfogel HILM LRM 49 24 0 18 Oct 2023
Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning Ming Li Lichang Chen Jiuhai Chen Shwai He Heng-Chiao Huang Jiuxiang Gu Dinesh Manocha 113 23 0 18 Oct 2023
IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models Shaokun Zhang Xiaobo Xia Zhaoqing Wang Ling-Hao Chen Jiale Liu Qingyun Wu Tongliang Liu 42 20 0 16 Oct 2023
G-SPEED: General SParse Efficient Editing MoDel Haoke Zhang Yue Wang Juntao Li Xiabing Zhou Min Zhang SyDa KELM 30 1 0 16 Oct 2023
LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generation Kibum Kim Kanghoon Yoon Jaeyeong Jeon Yeonjun In Jinyoung Moon Donghyun Kim Chanyoung Park 31 15 0 16 Oct 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization Ondrej Skopek Rahul Aralikatte Sian Gooding Victor Carbune ELM 47 18 0 12 Oct 2023
InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining Wei Ping Ming-Yu Liu Lawrence C. McAfee Peng Xu Bo Li M. Shoeybi Bryan Catanzaro RALM 16 47 0 11 Oct 2023
KwaiYiiMath: Technical Report Jia-Yi Fu Lei Lin Xiaoyang Gao Pengli Liu Zhengzong Chen ... Zijia Lin Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM ReLM RALM 51 2 0 11 Oct 2023
Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Models Di Wu Wasi Uddin Ahmad Kai-Wei Chang 49 9 0 10 Oct 2023
Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models Huaixiu Steven Zheng Swaroop Mishra Xinyun Chen Heng-Tze Cheng Ed H. Chi Quoc V. Le Denny Zhou RALM LRM 33 109 0 09 Oct 2023
FireAct: Toward Language Agent Fine-tuning Baian Chen Chang Shu Ehsan Shareghi Nigel Collier Karthik Narasimhan Shunyu Yao ALM LLMAG 107 98 0 09 Oct 2023
Guiding Language Model Math Reasoning with Planning Tokens Xinyi Wang Lucas Caccia O. Ostapenko Xingdi Yuan William Yang Wang Alessandro Sordoni LRM 43 20 0 09 Oct 2023
Balancing Specialized and General Skills in LLMs: The Impact of Modern Tuning and Data Strategy Zhengwu Zhang Chen Zheng Da Tang Ke Sun Yukun Ma Yingtong Bu Xun Zhou Liang Zhao ALM 45 31 0 07 Oct 2023
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction Zeyuan Wang Qiang Zhang Keyan Ding Ming Qin Zhuang Xiang Xiaotong Li Huajun Chen 33 28 0 05 Oct 2023
JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuning Chang Gao Wenxuan Zhang Guizhen Chen Wai Lam 58 5 0 04 Oct 2023
Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation Chen Dun Mirian Hipolito Garcia Guoqing Zheng Ahmed Hassan Awadallah Anastasios Kyrillidis Robert Sim 90 6 0 04 Oct 2023
Large Language Models as Analogical Reasoners Michihiro Yasunaga Xinyun Chen Yujia Li Panupong Pasupat J. Leskovec Percy Liang Ed H. Chi Denny Zhou ReLM LRM 29 79 0 03 Oct 2023
Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models Man Luo Shrinidhi Kumbhar Ming shen Mihir Parmar Neeraj Varshney Pratyay Banerjee Somak Aditya Chitta Baral ReLM ELM LRM 47 27 0 02 Oct 2023
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models Zekun Wang Zhongyuan Peng Haoran Que Jiaheng Liu Wangchunshu Zhou ... Wanli Ouyang Ke Xu Wenhu Chen Jie Fu Junran Peng LLMAG 47 86 0 01 Oct 2023
Self-Specialization: Uncovering Latent Expertise within Large Language Models Junmo Kang Hongyin Luo Yada Zhu Jacob A. Hansen James R. Glass David D. Cox Alan Ritter Rogerio Feris Leonid Karlinsky ALM MoMe 32 4 0 29 Sep 2023
Intuitive or Dependent? Investigating LLMs' Behavior Style to Conflicting Prompts Jiahao Ying Yixin Cao Kai Xiong Yidong He Long Cui Yongbin Liu 33 7 0 29 Sep 2023
The Trickle-down Impact of Reward (In-)consistency on RLHF Lingfeng Shen Sihao Chen Linfeng Song Lifeng Jin Baolin Peng Haitao Mi Daniel Khashabi Dong Yu 42 21 0 28 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Rongxiang Weng Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
Are Human-generated Demonstrations Necessary for In-context Learning? Rui Li Guoyin Wang Jiwei Li LRM 23 12 0 26 Sep 2023
From Text to Source: Results in Detecting Large Language Model-Generated Content Wissam Antoun Benoît Sagot Djamé Seddah DeLMO 33 11 0 23 Sep 2023
UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt Yucheng Cai Wentao Ma Yuchuan Wu Shuzheng Si Yuan Shao Zhijian Ou Yongbin Li 43 3 0 20 Sep 2023
Understanding Catastrophic Forgetting in Language Models via Implicit Inference Suhas Kotha Jacob Mitchell Springer Aditi Raghunathan CLL 42 61 0 18 Sep 2023
LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models Zecheng Tang Chenfei Wu Juntao Li Nan Duan 3DV 28 9 0 18 Sep 2023
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca Pinzhen Chen Shaoxiong Ji Nikolay Bogoychev Andrey Kutuzov Barry Haddow Kenneth Heafield 46 45 0 16 Sep 2023
InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning Yi Yang Yixuan Tang Kar Yan Tam ALM AIFin 35 63 0 15 Sep 2023
Statistical Rejection Sampling Improves Preference Optimization Tianqi Liu Yao-Min Zhao Rishabh Joshi Misha Khalman Mohammad Saleh Peter J. Liu Jialu Liu 61 215 0 13 Sep 2023
DoG-Instruct: Towards Premium Instruction-Tuning Data via Text-Grounded Instruction Wrapping Yongrui Chen Haiyun Jiang Xinting Huang Shuming Shi Guilin Qi SyDa 10 11 0 11 Sep 2023
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning Ted Zadouri Ahmet Üstün Arash Ahmadian Beyza Ermics Acyr Locatelli Sara Hooker MoE 39 89 0 11 Sep 2023
Can NLP Models Ídentify', 'Distinguish', and 'Justify' Questions that Don't have a Definitive Answer? Ayushi Agarwal Nisarg Patel Neeraj Varshney Mihir Parmar Pavan Mallina Aryan Bhavin Shah Srihari Sangaraju Tirth Patel Nihar Thakkar Chitta Baral ELM 31 3 0 08 Sep 2023
Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets? Leon Weber-Genzel Robert Litschko Ekaterina Artemova Barbara Plank 29 2 0 04 Sep 2023
Taken out of context: On measuring situational awareness in LLMs Lukas Berglund Asa Cooper Stickland Mikita Balesni Max Kaufmann Meg Tong Tomasz Korbak Daniel Kokotajlo Owain Evans LLMAG LRM 21 62 0 01 Sep 2023
FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checking Tsun-hin Cheung K. Lam KELM HILM LRM 25 26 0 01 Sep 2023
Evaluating the Robustness to Instructions of Large Language Models Yuansheng Ni Sichao Jiang Xinyu Wu Hui Shen Yuli Zhou ALM 30 2 0 28 Aug 2023
SoTaNa: The Open-Source Software Development Assistant Ensheng Shi Fengji Zhang Yanlin Wang B. Chen Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 31 12 0 25 Aug 2023
Harnessing the Power of David against Goliath: Exploring Instruction Data Generation without Using Closed-Source Models Yue Wang Xinrui Wang Juntao Li Jinxiong Chang Qishen Zhang Zhongyi Liu Guannan Zhang Min Zhang ALM 27 6 0 24 Aug 2023
From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models Jing Yao Xiaoyuan Yi Xiting Wang Jindong Wang Xing Xie ALM 27 42 0 23 Aug 2023
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Fei Wu Guoyin Wang LM&MA 24 549 0 21 Aug 2023
ChatHaruhi: Reviving Anime Character in Reality via Large Language Model Cheng Li Ziang Leng Chenxi Yan Junyi Shen Hao Wang ... HaoSheng Wang Linkang Zhan Yaokai Jia Pingyu Wu Haozhen Sun 28 32 0 18 Aug 2023
RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models Jie Huang Ming-Yu Liu Peng Xu M. Shoeybi Kevin Chen-Chuan Chang Bryan Catanzaro RALM 37 33 0 15 Aug 2023
Dialogue for Prompting: a Policy-Gradient-Based Discrete Prompt Generation for Few-shot Learning Chengzhengxu Li Xiaoming Liu Yichen Wang Duyi Li Y. Lan Chao Shen 40 5 0 14 Aug 2023
EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce Yong Li Shirong Ma Xiaobin Wang Shen Huang Chengyue Jiang Haitao Zheng Pengjun Xie Fei Huang Yong-jia Jiang RALM ALM LRM 36 50 0 14 Aug 2023
ZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIF Víctor Gallego SyDa 51 4 0 11 Aug 2023