Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

10 April 2021

Ruiqi Zhong

Papers citing "Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections"

50 / 124 papers shown

Title
Controlled Text Generation with Natural Language Instructions Wangchunshu Zhou Yuchen Eleanor Jiang Ethan Gotlieb Wilcox Ryan Cotterell Mrinmaya Sachan 160 84 0 27 Apr 2023
TABLET: Learning From Instructions For Tabular Data Dylan Slack Sameer Singh LMTD ALM RALM 28 17 0 25 Apr 2023
MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning Bohan Li Longxu Dou Yutai Hou Yunlong Feng Honglin Mu Qingfu Zhu Qinghua Sun Wanxiang Che VLM 37 3 0 19 Apr 2023
A Comparative Study between Full-Parameter and LoRA-based Fine-Tuning on Chinese Instruction Data for Instruction Following Large Language Model Xianghui Sun Yunjie Ji Baochang Ma Xiangang Li ALM 13 18 0 17 Apr 2023
Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and Evaluation Yunjie Ji Yan Gong Yong Deng Yiping Peng Qiang Niu Baochang Ma Xiangang Li ALM ELM 24 22 0 16 Apr 2023
Instruction Tuning with GPT-4 Baolin Peng Chunyuan Li Pengcheng He Michel Galley Jianfeng Gao SyDa ALM LM&MA 162 579 0 06 Apr 2023
Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use Cases Yunjie Ji Yong Deng Yan Gong Yiping Peng Qiang Niu Lefei Zhang Baochang Ma Xiangang Li ALM 24 93 0 26 Mar 2023
Large Language Model Instruction Following: A Survey of Progresses and Challenges Renze Lou Kai Zhang Wenpeng Yin ALM LRM 32 20 0 18 Mar 2023
Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning Zhen Wang Yikang Shen Leonid Karlinsky Rogerio Feris Huan Sun Yoon Kim VLM VPVLM 44 107 0 06 Mar 2023
QAID: Question Answering Inspired Few-shot Intent Detection Asaf Yehudai Matan Vetzler Y. Mass Koren Lazar Doron Cohen Boaz Carmeli 18 7 0 02 Mar 2023
In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages Asim Ersoy Gerson Vizcarra T. Mayeesha Benjamin Muller 28 2 0 23 Feb 2023
InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis Kevin Scaria Himanshu Gupta Siddharth Goyal Saurabh Arjun Sawant Swaroop Mishra Chitta Baral 29 25 0 16 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Chenyu You VLM LRM 23 15 0 16 Feb 2023
BLIAM: Literature-based Data Synthesis for Synergistic Drug Combination Prediction Cai Yang Addie Woicik Hoifung Poon Sheng Wang 24 4 0 14 Feb 2023
Matching Exemplar as Next Sentence Prediction (MeNSP): Zero-shot Prompt Learning for Automatic Scoring in Science Education Xuansheng Wu Xinyu He Tianming Li Ninghao Liu Xiaoming Zhai 27 26 0 20 Jan 2023
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization Srinivasan Iyer Xi Lin Ramakanth Pasunuru Todor Mihaylov Daniel Simig ... Jeff Wang Christopher Dewan Asli Celikyilmaz Luke Zettlemoyer Veselin Stoyanov ALM 39 261 0 22 Dec 2022
Zero-shot Triplet Extraction by Template Infilling Bosung Kim Hayate Iso Nikita Bhutani Estevam R. Hruschka Ndapandula Nakashole Tom Mitchell ViT 24 10 0 21 Dec 2022
Task Ambiguity in Humans and Language Models Alex Tamkin Kunal Handa Ava Shrestha Noah D. Goodman UQLM 44 22 0 20 Dec 2022
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 27 282 0 19 Dec 2022
Improving Cross-task Generalization of Unified Table-to-text Models with Compositional Task Configurations Jifan Chen Yuhao Zhang Lan Liu Rui Dong Xinchi Chen Patrick K. L. Ng William Yang Wang Zhiheng Huang AI4CE 30 4 0 17 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 72 439 0 08 Dec 2022
Discovering Latent Knowledge in Language Models Without Supervision Collin Burns Haotian Ye Dan Klein Jacob Steinhardt 70 329 0 07 Dec 2022
Zero-Shot Text Classification with Self-Training Ariel Gera Alon Halfon Eyal Shnarch Yotam Perlitz L. Ein-Dor Noam Slonim VLM 31 59 0 31 Oct 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 85 2,999 0 20 Oct 2022
A Unified Framework for Multi-intent Spoken Language Understanding with prompting Feifan Song Lianzhe Huang Houfeng Wang 11 3 0 07 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 121 94 0 06 Oct 2022
Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft Prompt Seonghyeon Ye Joel Jang Doyoung Kim Yongrae Jo Minjoon Seo VLM 39 2 0 06 Oct 2022
Explaining Patterns in Data with Language Models via Interpretable Autoprompting Chandan Singh John X. Morris J. Aneja Alexander M. Rush Jianfeng Gao LRM 33 0 0 04 Oct 2022
Learning by Distilling Context Charles Burton Snell Dan Klein Ruiqi Zhong ReLM LRM 168 44 0 30 Sep 2022
MetaPrompting: Learning to Learn Better Prompts Yutai Hou Hongyuan Dong Xinghao Wang Bohan Li Wanxiang Che VLM 23 27 0 23 Sep 2022
HELP ME THINK: A Simple Prompting Strategy for Non-experts to Create Customized Content with Models Swaroop Mishra E. Nouri LRM 41 25 0 17 Aug 2022
Few-shot Adaptation Works with UnpredicTable Data Jun Shern Chan Michael Pieler Jonathan Jao Jérémy Scheurer Ethan Perez 31 5 0 01 Aug 2022
Low Resource Pipeline for Spoken Language Understanding via Weak Supervision Ayush Kumar R. Tripathi Jithendra Vepa 17 1 0 21 Jun 2022
DynaMaR: Dynamic Prompt with Mask Token Representation Xiaodi Sun Sunny Rajagopalan Priyank Nigam Weiyi Lu Yi Xu Belinda Zeng Trishul Chilimbi 25 1 0 07 Jun 2022
No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Marzieh Fadaee R. Lotufo Rodrigo Nogueira 24 26 0 06 Jun 2022
Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Task G. Rosa L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio R. Lotufo Rodrigo Nogueira AILaw ELM 36 10 0 30 May 2022
kNN-Prompt: Nearest Neighbor Zero-Shot Inference Weijia Shi Julian Michael Suchin Gururangan Luke Zettlemoyer RALM VLM 26 32 0 27 May 2022
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 44 47 0 25 May 2022
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning Mingkai Deng Jianyu Wang Cheng-Ping Hsieh Yihan Wang Han Guo Tianmin Shu Meng Song Eric P. Xing Zhiting Hu 27 322 0 25 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 35 28 0 11 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 38 64 0 03 May 2022
What Makes Instruction Learning Hard? An Investigation and a New Challenge in a Synthetic Environment Matthew Finlayson Kyle Richardson Ashish Sabharwal Peter Clark 30 12 0 19 Apr 2022
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks Yizhong Wang Swaroop Mishra Pegah Alipoormolabashi Yeganeh Kordi Amirreza Mirzaei ... Chitta Baral Yejin Choi Noah A. Smith Hannaneh Hajishirzi Daniel Khashabi ELM 53 785 0 16 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo M. H. Murad Chitta Baral 28 22 0 15 Apr 2022
GPT-NeoX-20B: An Open-Source Autoregressive Language Model Sid Black Stella Biderman Eric Hallahan Quentin G. Anthony Leo Gao ... Shivanshu Purohit Laria Reynolds J. Tow Benqi Wang Samuel Weinbach 99 802 0 14 Apr 2022
InCoder: A Generative Model for Code Infilling and Synthesis Daniel Fried Armen Aghajanyan Jessy Lin Sida I. Wang Eric Wallace Freda Shi Ruiqi Zhong Wen-tau Yih Luke Zettlemoyer M. Lewis SyDa 30 627 0 12 Apr 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting Gabriel Orlanski LRM 27 2 0 29 Mar 2022
ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations Oscar Sainz Haoling Qiu Oier López de Lacalle Eneko Agirre Bonan Min SyDa 31 12 0 25 Mar 2022
How Many Data Samples is an Additional Instruction Worth? Ravsehaj Singh Puri Swaroop Mishra Mihir Parmar Chitta Baral 25 17 0 17 Mar 2022
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching Alissa Ostapenko S. Wintner Melinda Fricke Yulia Tsvetkov 37 5 0 16 Mar 2022