v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,608 papers shown

Title
An Empirical Study of Instruction-tuning Large Language Models in Chinese Q. Si Tong Wang Zheng Lin Xu Zhang Yanan Cao Weiping Wang ALM 139 17 0 11 Oct 2023
Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality Liyuan Wang Jingyi Xie Xingxing Zhang Mingyi Huang Hang Su Jun Zhu CLL 97 93 0 11 Oct 2023
Diversity of Thought Improves Reasoning Abilities of LLMs Ranjita Naik Varun Chandrasekaran Mert Yuksekgonul Hamid Palangi Besmira Nushi LRM 72 9 0 11 Oct 2023
Exploring Memorization in Fine-tuned Language Models Shenglai Zeng Yaxin Li Jie Ren Yiding Liu Han Xu Pengfei He Yue Xing Shuaiqiang Wang Jiliang Tang D. Yin PILM 104 26 0 10 Oct 2023
Topic-DPR: Topic-based Prompts for Dense Passage Retrieval Q. Xiao Shuangyin Li Lei Chen 127 2 0 10 Oct 2023
Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extraction C.A.I. Peng Xi Yang Kaleb E. Smith Zehao Yu Aokun Chen Jiang Bian Yonghui Wu VLM LRM 85 33 0 10 Oct 2023
Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing Wei Dong Dawei Yan Zhijun Lin Peng Wang 85 24 0 10 Oct 2023
Evolution of Natural Language Processing Technology: Not Just Language Processing Towards General Purpose AI Masahiro Yamamoto 63 1 0 10 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models Zuxin Liu Jesse Zhang Kavosh Asadi Yao Liu Ding Zhao Shoham Sabach Rasool Fakoor ALM AI4CE 123 30 0 09 Oct 2023
Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation Lijun Yu José Lezama N. B. Gundavarapu Luca Versari Kihyuk Sohn ... Boqing Gong Ming-Hsuan Yang Irfan Essa David A. Ross Lu Jiang 186 325 0 09 Oct 2023
Guiding Language Model Math Reasoning with Planning Tokens Xinyi Wang Lucas Caccia O. Ostapenko Xingdi Yuan William Yang Wang Alessandro Sordoni LRM 103 2 0 09 Oct 2023
Hierarchical Side-Tuning for Vision Transformers Weifeng Lin Ziheng Wu Wentao Yang Mingxin Huang Jun Huang Lianwen Jin 121 8 0 09 Oct 2023
Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems Yixin Wan Jieyu Zhao Aman Chadha Nanyun Peng Kai-Wei Chang 117 27 0 08 Oct 2023
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts Tharindu Kumarage Paras Sheth Raha Moraffah Joshua Garland Huan Liu DeLMO 63 26 0 08 Oct 2023
Self-Convinced Prompting: Few-Shot Question Answering with Repeated Introspection Haodi Zhang Min Cai Xinhe Zhang Chen Zhang Rui Mao Kaishun Wu KELM LRM ReLM 92 9 0 08 Oct 2023
Prompt-augmented Temporal Point Process for Streaming Event Sequence Siqiao Xue Yan Wang Zhixuan Chu Xiaoming Shi Caigao Jiang Hongyan Hao Gangwei Jiang Xiaoyun Feng James Y. Zhang Junqing Zhou AI4TS 76 25 0 08 Oct 2023
LLM4VV: Developing LLM-Driven Testsuite for Compiler Validation Christian Munley Aaron Jarmusch Sunita Chandrasekaran 102 21 0 08 Oct 2023
TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting Defu Cao Furong Jia Sercan O. Arik Tomas Pfister Yixiang Zheng Wen Ye Yan Liu AI4TS 117 138 0 08 Oct 2023
Parameterizing Context: Unleashing the Power of Parameter-Efficient Fine-Tuning and In-Context Tuning for Continual Table Semantic Parsing Yongrui Chen Shenyu Zhang Guilin Qi Xinnan Guo CLL 69 8 0 07 Oct 2023
Parameter Efficient Multi-task Model Fusion with Partial Linearization Anke Tang Li Shen Yong Luo Yibing Zhan Han Hu Bo Du Yixin Chen Dacheng Tao MoMe 124 36 0 07 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 96 10 0 06 Oct 2023
Talk like a Graph: Encoding Graphs for Large Language Models Bahare Fatemi Jonathan J. Halcrow Bryan Perozzi AI4CE 96 113 0 06 Oct 2023
Demystifying Embedding Spaces using Large Language Models Guy Tennenholtz Yinlam Chow Chih-Wei Hsu Jihwan Jeong Lior Shani Azamat Tulepbergenov Deepak Ramachandran Martin Mladenov Craig Boutilier 57 15 0 06 Oct 2023
Understanding prompt engineering may not require rethinking generalization Victor Akinwande Yiding Jiang Dylan Sam J. Zico Kolter VLM VPVLM 159 8 0 06 Oct 2023
Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To! Xiangyu Qi Yi Zeng Tinghao Xie Pin-Yu Chen Ruoxi Jia Prateek Mittal Peter Henderson SILM 187 637 0 05 Oct 2023
Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language Jingyuan Sun Xiaohan Zhang Marie-Francine Moens 115 7 0 05 Oct 2023
Fine-tune Language Models to Approximate Unbiased In-context Learning Timothy Chu Zhao Song Chiwun Yang 110 16 0 05 Oct 2023
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models Yefei He Jing Liu Weijia Wu Hong Zhou Bohan Zhuang DiffM MQ 168 51 0 05 Oct 2023
FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation Tu Vu Mohit Iyyer Xuezhi Wang Noah Constant Jerry W. Wei ... Chris Tar Yun-hsuan Sung Denny Zhou Quoc Le Thang Luong KELM HILM LRM 142 219 0 05 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 98 12 0 04 Oct 2023
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models Yiwen Tang Ivan Tang Ray Gu Dong Wang Eric Zhang Bin Zhao Xuelong Li 3DPC 153 22 0 04 Oct 2023
Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation Chen Dun Mirian Hipolito Garcia Guoqing Zheng Ahmed Hassan Awadallah Anastasios Kyrillidis Robert Sim 214 6 0 04 Oct 2023
Inclusive Data Representation in Federated Learning: A Novel Approach Integrating Textual and Visual Prompt Zihao Zhao Zhenpeng Shi Yang Liu Wenbo Ding FedML 87 1 0 04 Oct 2023
NOLA: Compressing LoRA using Linear Combination of Random Basis Soroush Abbasi Koohpayegani K. Navaneet Parsa Nooralinejad Soheil Kolouri Hamed Pirsiavash 147 16 0 04 Oct 2023
Prompting-based Temporal Domain Generalization Sepidehsadat Hosseini Mengyao Zhai Hossein Hajimirsadegh Frederick Tung AI4TS AI4CE OOD 77 0 0 03 Oct 2023
Think before you speak: Training Language Models With Pause Tokens Sachin Goyal Ziwei Ji A. S. Rawat A. Menon Sanjiv Kumar Vaishnavh Nagarajan LRM 126 122 0 03 Oct 2023
BYOM: Building Your Own Multi-Task Model For Free Weisen Jiang Baijiong Lin Han Shi Yu Zhang Zhenguo Li James T. Kwok MoMe 89 6 0 03 Oct 2023
Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations? Jingyuan Sun Marie-Francine Moens AAML 77 13 0 03 Oct 2023
Empirical Study of PEFT techniques for Winter Wheat Segmentation Mohamad Hasan Zahweh Hasan Nasrallah Mustafa Shukor G. Faour A. Ghandour 79 3 0 03 Oct 2023
Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models Zijun Wu Yongkang Wu Lili Mou VLM 79 5 0 02 Oct 2023
FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models Jingwei Sun Ziyue Xu Hongxu Yin Dong Yang Daguang Xu Yiran Chen Holger R. Roth VLM 144 26 0 02 Oct 2023
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video Xinhao Li Yuhan Zhu Limin Wang VLM 120 9 0 02 Oct 2023
SPELL: Semantic Prompt Evolution based on a LLM Yujian Betterest Li Kai Wu 106 12 0 02 Oct 2023
GRID: A Platform for General Robot Intelligence Development Sai H. Vemprala Shuhang Chen Abhinav Shukla Dinesh Narayanan Ashish Kapoor 97 10 0 02 Oct 2023
Do Compressed LLMs Forget Knowledge? An Experimental Study with Practical Implications Duc Hoang Minsik Cho Thomas Merth Mohammad Rastegari Zhangyang Wang KELM CLL 93 5 0 02 Oct 2023
Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformers Xiaoqiang Lin Zhaoxuan Wu Zhongxiang Dai Wenyang Hu Yao Shu See-Kiong Ng Patrick Jaillet Bryan Kian Hsiang Low 99 11 0 02 Oct 2023
Parameter-Efficient Tuning Helps Language Model Alignment Tianci Xue Ziqi Wang Heng Ji ALM 77 7 0 01 Oct 2023
SIP: Injecting a Structural Inductive Bias into a Seq2Seq Model by Simulation Matthias Lindemann Alexander Koller Ivan Titov AI4CE 83 5 0 01 Oct 2023
PETA: Parameter-Efficient Trojan Attacks Lauren Hong Ting Wang AAML 115 1 0 01 Oct 2023
AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ Jonas Belouadi Anne Lauscher Steffen Eger 91 31 0 30 Sep 2023