v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,607 papers shown

Title
Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks Minki Kang Seanie Lee Jinheon Baek Kenji Kawaguchi Sung Ju Hwang ALM LRM 117 66 0 28 May 2023
Emergent Modularity in Pre-trained Transformers Zhengyan Zhang Zhiyuan Zeng Yankai Lin Chaojun Xiao Xiaozhi Wang Xu Han Zhiyuan Liu Ruobing Xie Maosong Sun Jie Zhou MoE 117 25 0 28 May 2023
Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning Weize Chen Xu Han Yankai Lin Zhiyuan Liu Maosong Sun Jie Zhou 64 1 0 28 May 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Bo Zhao Maosong Sun KELM 104 6 0 28 May 2023
CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers Dachuan Shi Chaofan Tao Anyi Rao Zhendong Yang Chun Yuan Jiaqi Wang VLM 136 23 0 27 May 2023
Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning Zhenrui Yue Huimin Zeng Mengfei Lan Heng Ji D. Wang VLM 70 14 0 27 May 2023
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 160 205 0 27 May 2023
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution Tianjian Li Kenton W. Murray 104 26 0 27 May 2023
PromptNER: Prompt Locating and Typing for Named Entity Recognition Yongliang Shen Zeqi Tan Shuhui Wu Wenqi Zhang Rongsheng Zhang Yadong Xi Weiming Lu Yueting Zhuang 93 36 0 26 May 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks Kai Zhang Jun Yu Eashan Adhikarla Rong Zhou Zhilin Yan ... Xun Chen Yong Chen Quanzheng Li Hongfang Liu Lichao Sun LM&MA MedIm 105 186 0 26 May 2023
Submodular Minimax Optimization: Finding Effective Sets Loay Mualem Ethan R. Elenberg Moran Feldman Amin Karbasi 63 5 0 26 May 2023
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification Kexi Ji Yixin Lian Jingsheng Gao Baoyuan Wang VLM 89 22 0 26 May 2023
Parameter-Efficient Fine-Tuning without Introducing New Latency Baohao Liao Yan Meng Christof Monz 59 56 0 26 May 2023
PIP: Parse-Instructed Prefix for Syntactically Controlled Paraphrase Generation Yixin Wan Kuan-Hao Huang Kai-Wei Chang 101 7 0 26 May 2023
CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning Zhao-Heng Zheng Haidong Zhu Ramkant Nevatia CoGe 98 7 0 26 May 2023
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models Neal Lawton Anoop Kumar Govind Thattai Aram Galstyan Greg Ver Steeg 47 19 0 26 May 2023
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition Eunseop Yoon Hee Suk Yoon John Harvill M. Hasegawa-Johnson Chang D. Yoo VLM 58 3 0 25 May 2023
Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Models Haonan Duan Adam Dziedzic Nicolas Papernot Franziska Boenisch AAML 84 67 0 24 May 2023
TOAST: Transfer Learning via Attention Steering Baifeng Shi Siyu Gai Trevor Darrell Xin Wang 75 13 0 24 May 2023
Large Language Models are Few-Shot Health Learners Xin Liu Daniel J. McDuff G. Kovács I. Galatzer-Levy Jacob Sunshine Jiening Zhan M. Poh Shun Liao P. Achille Shwetak N. Patel LM&MA AI4MH 132 116 0 24 May 2023
Large Language Models for User Interest Journeys Konstantina Christakopoulou Alberto Lalama Cj Adams Iris Qu Yifat Amir ... Dina Bseiso Sarah Scodel Lucas Dixon Ed H. Chi Minmin Chen 102 30 0 24 May 2023
READ: Recurrent Adaptation of Large Transformers Sida I. Wang John Nguyen Ke Li Carole-Jean Wu 55 11 0 24 May 2023
Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model Zirui Liu Guanchu Wang Shaochen Zhong Zhaozhuo Xu Daochen Zha ... Zhimeng Jiang Kaixiong Zhou Vipin Chaudhary Shuai Xu Helen Zhou 106 15 0 24 May 2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning Zhen-Ru Zhang Chuanqi Tan Haiyang Xu Chengyu Wang Jun Huang Songfang Huang 73 38 0 24 May 2023
Prompt Evolution for Generative AI: A Classifier-Guided Approach Melvin Wong Yew-Soon Ong Abhishek Gupta K. Bali Caishun Chen 84 14 0 24 May 2023
Topic-Guided Self-Introduction Generation for Social Media Users Chunpu Xu Jing Li Pijian Li Min Yang 80 0 0 24 May 2023
The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing Debayan Banerjee Pranav Ajit Nair Ricardo Usbeck Chris Biemann 73 1 0 24 May 2023
Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptation Haonan Li Fajri Koto Minghao Wu Alham Fikri Aji Timothy Baldwin ALM 75 76 0 24 May 2023
Are Chatbots Ready for Privacy-Sensitive Applications? An Investigation into Input Regurgitation and Prompt-Induced Sanitization Aman Priyanshu Supriti Vijay Ayush Kumar Rakshit Naidu Fatemehsadat Mireshghallah SILM 136 25 0 24 May 2023
Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark Minje Choi Jiaxin Pei Sagar Kumar Chang Shu David Jurgens ALM LLMAG 133 72 0 24 May 2023
Universal Self-Adaptive Prompting Xingchen Wan Ruoxi Sun Hootan Nakhost H. Dai Julian Martin Eisenschlos Sercan O. Arik Tomas Pfister LRM 110 12 0 24 May 2023
Exploring Diverse In-Context Configurations for Image Captioning Xu Yang Yongliang Wu Mingzhuo Yang Haokun Chen Xin Geng MLLM 87 64 0 24 May 2023
Adapting Language Models to Compress Contexts Alexis Chevalier Alexander Wettig Anirudh Ajith Danqi Chen LLMAG 89 192 0 24 May 2023
In-Context Demonstration Selection with Cross Entropy Difference Dan Iter Reid Pryzant Ruochen Xu Shuohang Wang Yang Liu Yichong Xu Chenguang Zhu 73 14 0 24 May 2023
Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models Sheng Shen Le Hou Yan-Quan Zhou Nan Du Shayne Longpre ... Vincent Zhao Hongkun Yu Kurt Keutzer Trevor Darrell Denny Zhou ALM MoE 107 60 0 24 May 2023
Have Large Language Models Developed a Personality?: Applicability of Self-Assessment Tests in Measuring Personality in LLMs Xiaoyang Song Akshat Gupta Kiyan Mohebbizadeh Shujie Hu Anant Singh 76 28 0 24 May 2023
Few-shot Unified Question Answering: Tuning Models or Prompts? Srijan Bansal Semih Yavuz Bo Pang Meghana Moorthy Bhat Yingbo Zhou 108 2 0 23 May 2023
RetICL: Sequential Retrieval of In-Context Examples with Reinforcement Learning Alexander Scarlatos Andrew Lan OffRL LRM 104 24 0 23 May 2023
Do prompt positions really matter? Junyu Mao Stuart E. Middleton Mahesan Niranjan VLM 65 6 0 23 May 2023
QLoRA: Efficient Finetuning of Quantized LLMs Tim Dettmers Artidoro Pagnoni Ari Holtzman Luke Zettlemoyer ALM 165 2,644 0 23 May 2023
VIP5: Towards Multimodal Foundation Models for Recommendation Shijie Geng Juntao Tan Shuchang Liu Zuohui Fu Yongfeng Zhang 134 78 0 23 May 2023
$μ$ PLAN: Summarizing using a Content Plan as Cross-Lingual Bridge Fantine Huot Joshua Maynez Chris Alberti Reinald Kim Amplayo Priyanka Agrawal Constanza Fierro Shashi Narayan Mirella Lapata 105 7 0 23 May 2023
ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding Uri Shaham Maor Ivgi Avia Efrat Jonathan Berant Omer Levy VLM 119 141 0 23 May 2023
In-Context Probing: Toward Building Robust Classifiers via Probing Large Language Models Afra Amini Massimiliano Ciaramita ReLM 32 1 0 23 May 2023
Memory-Efficient Fine-Tuning of Compressed Large Language Models via sub-4-bit Integer Quantization Jeonghoon Kim J. H. Lee Sungdong Kim Joonsuk Park Kang Min Yoo S. Kwon Dongsoo Lee MQ 157 106 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 131 3 0 23 May 2023
The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning Seungone Kim Se June Joo Doyoung Kim Joel Jang Seonghyeon Ye Jamin Shin Minjoon Seo ALM RALM LRM 129 107 0 23 May 2023
Condensing Multilingual Knowledge with Lightweight Language-Specific Modules Haoran Xu Weiting Tan Shuyue Stella Li Yunmo Chen Benjamin Van Durme Philipp Koehn Kenton W. Murray 85 7 0 23 May 2023
Robust Prompt Optimization for Large Language Models Against Distribution Shifts Moxin Li Wenjie Wang Fuli Feng Yixin Cao Jizhi Zhang Tat-Seng Chua OffRL 150 20 0 23 May 2023
Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation Dan Luo Chen Zhang Jiahui Xu Bin Wang Yiming Chen Yan Zhang Haizhou Li VLM 53 0 0 23 May 2023