Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

10 April 2021

Ruiqi Zhong

Papers citing "Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections"

50 / 124 papers shown

Title
Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events Yuanyuan Tian Wenwen Li Lei Hu Xinyu Chen Michael Brook Michael Brubaker Fan Zhang A. Liljedahl KELM 83 1 0 19 Nov 2024
TIP-I2V: A Million-Scale Real Text and Image Prompt Dataset for Image-to-Video Generation Wenhao Wang Yuqing Yang VGen 47 3 0 05 Nov 2024
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Data Anup Shirgaonkar Nikhil Pandey Nazmiye Ceren Abay Tolga Aktas Vijay Aski ALM SyDa 34 0 0 24 Oct 2024
Functional-level Uncertainty Quantification for Calibrated Fine-tuning on LLMs Ruijia Niu D. Wu Rose Yu Yi Ma 33 1 0 09 Oct 2024
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs Leo Micklem Yan-Bin Shen Wenjing Luo Yan Zhang Hao Liang ... Weipeng Chen Bin Cui Blair Thornton Wentao Zhang Zenan Zhou ELM 84 16 0 02 Aug 2024
Application of Prompt Learning Models in Identifying the Collaborative Problem Solving Skills in an Online Task Mengxiao Zhu Xin Wang Xiantao Wang Zihang Chen Wei Huang 34 1 0 17 Jul 2024
Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models Wangtao Sun Chenxiang Zhang Xueyou Zhang Ziyang Huang Haotian Xu Pei Chen Shizhu He Jun Zhao Kang Liu ELM LRM 38 0 0 11 Jul 2024
Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learning Kyoka Ono Simon A. Lee LMTD 24 7 0 19 Jun 2024
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions Huanxuan Liao Yao Xu Shizhu He Yuanzhe Zhang Yanchao Hao Shengping Liu Kang Liu Jun Zhao 44 1 0 18 Jun 2024
Deep Exploration of Cross-Lingual Zero-Shot Generalization in Instruction Tuning Janghoon Han Changho Lee Joongbo Shin Stanley Jungkyu Choi Honglak Lee Kynghoon Bae ALM 29 0 0 13 Jun 2024
Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classification Martin Juan José Bucher Marco Martini ALM AI4MH 29 28 0 12 Jun 2024
Crafting Interpretable Embeddings by Asking LLMs Questions Vinamra Benara Chandan Singh John X. Morris Richard Antonello Ion Stoica Alexander G. Huth Jianfeng Gao 26 5 0 26 May 2024
LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models Mihir Parmar Nisarg Patel Neeraj Varshney Mutsumi Nakamura Man Luo Santosh Mashetty Arindam Mitra Chitta Baral LRM ReLM ELM 38 24 0 23 Apr 2024
LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages Nataliia Kholodna Sahib Julka Mohammad Khodadadi Muhammed Nurullah Gumus Michael Granitzer 37 10 0 02 Apr 2024
CoLLEGe: Concept Embedding Generation for Large Language Models Ryan Teehan Brenden M. Lake Mengye Ren 52 3 0 22 Mar 2024
VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models Wenhao Wang Yi Yang VGen DiffM 33 33 0 10 Mar 2024
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning Zhisheng Lin Han Fu Chenghao Liu Zhuo Li Jianling Sun MoE MoMe 33 5 0 23 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov H. Linander UQCV 36 14 0 19 Feb 2024
A Unified Causal View of Instruction Tuning Luyao Chen Wei Huang Ruqing Zhang Wei Chen J. Guo Xueqi Cheng 28 1 0 09 Feb 2024
Self-Discover: Large Language Models Self-Compose Reasoning Structures Pei Zhou Jay Pujara Xiang Ren Xinyun Chen Heng-Tze Cheng Quoc V. Le Ed H. Chi Denny Zhou Swaroop Mishra Huaixiu Steven Zheng LRM ReLM 27 48 0 06 Feb 2024
VLLaVO: Mitigating Visual Gap through LLMs Shuhao Chen Yulong Zhang Weisen Jiang Jiangang Lu Yu Zhang VLM 54 2 0 06 Jan 2024
Aurora:Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning Rongsheng Wang Hao Chen Ruizhe Zhou Yaofei Duan Kunyan Cai ... Jiaxi Cui Jian Li P. Pang Yapeng Wang Tao Tan MoE 25 2 0 22 Dec 2023
The ICL Consistency Test Lucas Weber Elia Bruni Dieuwke Hupkes ALM 15 6 0 08 Dec 2023
Zero-shot Conversational Summarization Evaluations with small Large Language Models R. Manuvinakurike Saurav Sahay Sangeeta Manepalli L. Nachman ELM LM&MA 24 0 0 29 Nov 2023
Simple and Effective Input Reformulations for Translation Brian Yu Hansen Lillemark Kurt Keutzer 34 0 0 12 Nov 2023
LLMaAA: Making Large Language Models as Active Annotators Ruoyu Zhang Yanzeng Li Yongliang Ma Ming Zhou Lei Zou 35 68 0 30 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 37 3 0 24 Oct 2023
InstructExcel: A Benchmark for Natural Language Instruction in Excel Justin Payan Swaroop Mishra Mukul Singh Carina Negreanu Christian Poelitz Chitta Baral Subhro Roy Rasika Chakravarthy Benjamin Van Durme E. Nouri LMTD ELM 36 10 0 23 Oct 2023
Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning Lucas Weber Elia Bruni Dieuwke Hupkes 32 25 0 20 Oct 2023
End-to-end Story Plot Generator Hanlin Zhu Andrew Cohen Danqing Wang Kevin Kaichuang Yang Xiaomeng Yang Jiantao Jiao Yuandong Tian 27 5 0 13 Oct 2023
Ontology Enrichment for Effective Fine-grained Entity Typing Si-yuan Ouyang Jiaxin Huang Pranav Pillai Yunyi Zhang Yu Zhang Jiawei Han 107 4 0 11 Oct 2023
Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting Chao-Han Huck Yang Yile Gu Yi-Chieh Liu Shalini Ghosh I. Bulyko A. Stolcke KELM LRM 38 40 0 27 Sep 2023
Fine-grained Affective Processing Capabilities Emerging from Large Language Models Joost Broekens Bernhard Hilpert Suzan Verberne Kim Baraka Patrick Gebhard Aske Plaat AI4MH 35 12 0 04 Sep 2023
Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks Liam Collins Hamed Hassani Mahdi Soltanolkotabi Aryan Mokhtari Sanjay Shakkottai 39 10 0 13 Jul 2023
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning Aaron Mueller Kanika Narang Lambert Mathias Qifan Wang Hamed Firooz RALM 22 3 0 30 Jun 2023
GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction Rui Yang Lin Song Yanwei Li Sijie Zhao Yixiao Ge Xiu Li Ying Shan SyDa MLLM 33 209 0 30 May 2023
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning Haiteng Zhao Shengchao Liu Chang Ma Hannan Xu Jie Fu Zhihong Deng Lingpeng Kong Qi Liu 25 60 0 28 May 2023
EDM3: Event Detection as Multi-task Text Generation Ujjwala Anantheswaran Himanshu Gupta Mihir Parmar Kuntal Kumar Pal Chitta Baral 35 5 0 25 May 2023
Zero-shot Approach to Overcome Perturbation Sensitivity of Prompts Mohna Chakraborty Adithya Kulkarni Qi Li VLM 27 9 0 25 May 2023
Getting MoRE out of Mixture of Language Model Reasoning Experts Chenglei Si Weijia Shi Chen Zhao Luke Zettlemoyer Jordan L. Boyd-Graber LRM 26 24 0 24 May 2023
EXnet: Efficient In-context Learning for Data-less Text classification Debaditya Shome Kuldeep Yadav 31 1 0 24 May 2023
Meta-Tuning LLMs to Leverage Lexical Knowledge for Generalizable Language Style Understanding Ruohao Guo Wei-ping Xu Alan Ritter 21 2 0 24 May 2023
QLoRA: Efficient Finetuning of Quantized LLMs Tim Dettmers Artidoro Pagnoni Ari Holtzman Luke Zettlemoyer ALM 55 2,342 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 37 2 0 23 May 2023
Clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agents Kranti Chalamalasetti Jana Gotze Sherzod Hakimov Brielen Madureira P. Sadler David Schlangen ELM ALM LLMAG 28 32 0 22 May 2023
LogiCoT: Logical Chain-of-Thought Instruction-Tuning Hanmeng Liu Zhiyang Teng Leyang Cui Chaoli Zhang Qiji Zhou Yue Zhang LRM 25 24 0 20 May 2023
Zero-Shot Text Classification via Self-Supervised Tuning Chaoqun Liu Wenxuan Zhang Guizhen Chen Xiaobao Wu A. Luu Chip Hong Chang Lidong Bing VLM 37 11 0 19 May 2023
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval Yue Yu Yuchen Zhuang Rongzhi Zhang Yu Meng Jiaming Shen Chao Zhang VLM 38 33 0 18 May 2023
Explaining black box text modules in natural language with language models Chandan Singh Aliyah R. Hsu Richard Antonello Shailee Jain Alexander G. Huth Bin-Xia Yu Jianfeng Gao MILM 34 47 0 17 May 2023
Soft Prompt Decoding for Multilingual Dense Retrieval Zhiqi Huang Hansi Zeng Hamed Zamani James Allan RALM 63 13 0 15 May 2023