v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,608 papers shown

Title
Feedback-guided Data Synthesis for Imbalanced Classification Reyhane Askari Hemmat Mohammad Pezeshki Florian Bordes M. Drozdzal Adriana Romero Soriano SyDa 101 21 0 29 Sep 2023
Learning to Rewrite Prompts for Personalized Text Generation Cheng-rong Li Mingyang Zhang Qiaozhu Mei Weize Kong Michael Bendersky LLMAG 87 25 0 29 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 95 61 0 29 Sep 2023
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models Antoine Louis Gijs van Dijck Gerasimos Spanakis ELM AILaw 79 41 0 29 Sep 2023
Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution Chrisantha Fernando Dylan Banarse Henryk Michalewski Simon Osindero Tim Rocktaschel LLMAG ReLM LRM 105 211 0 28 Sep 2023
A Benchmark for Learning to Translate a New Language from One Grammar Book Garrett Tanzer Mirac Suzgun Chenguang Xi Dan Jurafsky Luke Melas-Kyriazi 98 61 0 28 Sep 2023
ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers Junjie Yin Jiahao Dong Yingheng Wang Christopher De Sa Volodymyr Kuleshov MQ 68 6 0 28 Sep 2023
Zero-Shot and Few-Shot Video Question Answering with Multi-Modal Prompts Bipin Rajendran Bashir M. Al-Hashimi MLLM VLM 98 3 0 27 Sep 2023
HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models Cheng Chen Yuchen Hu Chao-Han Huck Yang Sabato Marco Siniscalchi Pin-Yu Chen Eng Siong Chng 99 48 0 27 Sep 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh Chawla Panpan Xu AI4CE 109 49 0 27 Sep 2023
VPA: Fully Test-Time Visual Prompt Adaptation Jiachen Sun Mark Ibrahim Melissa Hall Ivan Evtimov Z. Morley Mao Cristian Canton Ferrer C. Hazirbas VLM 94 7 0 26 Sep 2023
ConPET: Continual Parameter-Efficient Tuning for Large Language Models Chenyan Song Xu Han Zheni Zeng Kuai Li Chen Chen Zhiyuan Liu Maosong Sun Taojiannan Yang CLL KELM 107 11 0 26 Sep 2023
Text-to-Image Generation for Abstract Concepts Jiayi Liao Xu Chen Qiang Fu Lun Du Xiangnan He Xiang Wang Shi Han Dongmei Zhang 115 16 0 26 Sep 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial Haoyi Xiong Jiang Bian Sijia Yang Xiaofei Zhang Linghe Kong Daqing Zhang LRM LLMAG 107 5 0 24 Sep 2023
Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks Zhaohan Xi Tianyu Du Changjiang Li Ren Pang S. Ji Jinghui Chen Fenglong Ma Ting Wang AAML 70 34 0 23 Sep 2023
Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation Kai Huang Hanyu Yin Heng Huang Wei Gao 95 11 0 22 Sep 2023
Transformer-based Image Compression with Variable Image Quality Objectives Chia-Hao Kao Yi-Hsin Chen Cheng Chien Wei-Chen Chiu Wen-Hsiao Peng 65 2 0 22 Sep 2023
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models Yukang Chen Shengju Qian Haotian Tang Xin Lai Zhijian Liu Song Han Jiaya Jia 180 170 0 21 Sep 2023
The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" Lukas Berglund Meg Tong Max Kaufmann Mikita Balesni Asa Cooper Stickland Tomasz Korbak Owain Evans LRM 195 279 0 21 Sep 2023
On the Relationship between Skill Neurons and Robustness in Prompt Tuning Leon Ackermann Xenia Ohmer AAML 54 0 0 21 Sep 2023
PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models Mingjun Zhou Daiqing Zhuoma Qun Nuo T. Nyima 90 0 0 21 Sep 2023
Prompt Tuned Embedding Classification for Multi-Label Industry Sector Allocation V. Buchner Lele Cao Jan-Christoph Kalo Vilhelm von Ehrenheim VLM 94 2 0 21 Sep 2023
Sparsely Shared LoRA on Whisper for Child Speech Recognition W. Liu Ying Qin Zhiyuan Peng Tan Lee 68 19 0 21 Sep 2023
Toward Unified Controllable Text Generation via Regular Expression Instruction Xin Zheng Hongyu Lin Xianpei Han Le Sun 108 5 0 19 Sep 2023
Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles Can Cui Yunsheng Ma Xu Cao Wenqian Ye Ziran Wang 124 115 0 19 Sep 2023
Deep Prompt Tuning for Graph Transformers Reza Shirkavand Heng-Chiao Huang 61 7 0 18 Sep 2023
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech Chien-yu Huang Ke-Han Lu Shi Wang Chi-Yuan Hsiao Chun-Yi Kuan ... Roshan S. Sharma Shinji Watanabe Bhiksha Ramakrishnan Shady Shehata Hung-yi Lee AuLLM 88 63 0 18 Sep 2023
Are Soft Prompts Good Zero-shot Learners for Speech Recognition? Dianwen Ng Chong Zhang Ruixi Zhang Yukun Ma Fabian Ritter-Gutierrez Trung Hieu Nguyen Chongjia Ni Shengkui Zhao Eng Siong Chng B. Ma VLM 67 1 0 18 Sep 2023
MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classification Junjie Zhu Yiying Li Chunping Qiu Ke Yang Naiyang Guan Xiaodong Yi 95 7 0 17 Sep 2023
Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF Simeng Sun Dhawal Gupta Mohit Iyyer 89 20 0 16 Sep 2023
EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning Rajasekhar Reddy Mekala Yasaman Razeghi Sameer Singh LRM 93 11 0 16 Sep 2023
How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study Andreas Waldis Yufang Hou Iryna Gurevych 78 4 0 15 Sep 2023
Self-Consistent Narrative Prompts on Abductive Natural Language Inference Chunkit Chan Xin Liu Tszho Chan Cheng Jiayang Yangqiu Song Ginny Wong Simon See LRM 70 8 0 15 Sep 2023
Ambiguity-Aware In-Context Learning with Large Language Models Lingyu Gao Aditi Chaudhary Krishna Srinivasan Kazuma Hashimoto K. Raman Michael Bendersky 73 9 0 14 Sep 2023
PRE: Vision-Language Prompt Learning with Reparameterization Encoder Anh Pham Thi Minh An Duc Nguyen Georgios Tzimiropoulos VPVLM VLM 98 3 0 14 Sep 2023
PerPLM: Personalized Fine-tuning of Pretrained Language Models via Writer-specific Intermediate Learning and Prompts Daisuke Oba Naoki Yoshinaga Masashi Toyoda 66 2 0 14 Sep 2023
Adaptive Prompt Learning with Distilled Connective Knowledge for Implicit Discourse Relation Recognition Bang Wang Zhenglin Wang Wei Xiang Yijun Mo CLL 96 2 0 14 Sep 2023
PromptASR for contextualized ASR with controllable style Xiaoyu Yang Wei Kang Zengwei Yao Yifan Yang Liyong Guo Fangjun Kuang Long Lin Daniel Povey 113 14 0 14 Sep 2023
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning Sanghyeon Kim Hyunmo Yang Younghyun Kim Youngjoon Hong Eunbyung Park AI4CE 78 18 0 13 Sep 2023
Scaled Prompt-Tuning for Few-Shot Natural Language Generation Ting Hu Christoph Meinel Haojin Yang 37 0 0 13 Sep 2023
Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer Yaoting Wang Weisong Liu Guangyao Li Jian Ding Di Hu Xi Li VLM 93 21 0 13 Sep 2023
The first step is the hardest: Pitfalls of Representing and Tokenizing Temporal Data for Large Language Models Dimitris Spathis F. Kawsar AI4TS 90 25 0 12 Sep 2023
Efficient Memory Management for Large Language Model Serving with PagedAttention Woosuk Kwon Zhuohan Li Siyuan Zhuang Ying Sheng Lianmin Zheng Cody Hao Yu Joseph E. Gonzalez Haotong Zhang Ion Stoica VLM 226 2,341 0 12 Sep 2023
Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts Zhi-Yi Chin Chieh-Ming Jiang Ching-Chun Huang Pin-Yu Chen Wei-Chen Chiu DiffM 96 78 0 12 Sep 2023
Characterizing Latent Perspectives of Media Houses Towards Public Figures S. Srivatsa Srinath Srinivasa 58 0 0 12 Sep 2023
Language Models as Black-Box Optimizers for Vision-Language Models Shihong Liu Zhiqiu Lin Samuel Yu Ryan Lee Tiffany Ling Deepak Pathak Deva Ramanan VLM 128 30 0 12 Sep 2023
Uncovering mesa-optimization algorithms in Transformers J. Oswald Eyvind Niklasson Maximilian Schlegel Seijin Kobayashi Nicolas Zucchet ... Mark Sandler Blaise Agüera y Arcas Max Vladymyrov Razvan Pascanu João Sacramento 72 64 0 11 Sep 2023
ITI-GEN: Inclusive Text-to-Image Generation Cheng Zhang Xuanbai Chen Siqi Chai Chen Henry Wu Dmitry Lagun Thabo Beeler Fernando de la Torre VLM 124 58 0 11 Sep 2023
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning Ted Zadouri Ahmet Üstün Arash Ahmadian Beyza Ermics Acyr Locatelli Sara Hooker MoE 114 101 0 11 Sep 2023
Can you text what is happening? Integrating pre-trained language encoders into trajectory prediction models for autonomous driving Ali Keysan Andreas Look Eitan Kosman Gonca Gürsun Jörg Wagner Yu Yao Barbara Rakitsch 97 31 0 11 Sep 2023