Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2104.08691
Cited By
v1
v2 (latest)
The Power of Scale for Parameter-Efficient Prompt Tuning
18 April 2021
Brian Lester
Rami Al-Rfou
Noah Constant
VPVLM
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"The Power of Scale for Parameter-Efficient Prompt Tuning"
50 / 2,607 papers shown
Title
Towards Efficient Visual-Language Alignment of the Q-Former for Visual Reasoning Tasks
Sungkyung Kim
Adam Lee
Junyoung Park
Andrew Chung
Jusang Oh
Jay-Yoon Lee
45
3
0
12 Oct 2024
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Ziming Yu
Pan Zhou
Sike Wang
Jia Li
Hua Huang
80
2
0
11 Oct 2024
Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation
Kun Ding
Qiang Yu
Haojian Zhang
Gaofeng Meng
Shiming Xiang
VLM
67
0
0
11 Oct 2024
StraGo: Harnessing Strategic Guidance for Prompt Optimization
Yurong Wu
Yan Gao
Bin Benjamin Zhu
Zineng Zhou
Xiaodi Sun
Sheng Yang
Jian-Guang Lou
Zhiming Ding
Linjun Yang
LLMAG
88
6
0
11 Oct 2024
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning
Nusrat Jahan Prottasha
Asif Mahmud
Md. Shohanur Islam Sobuj
Prakash Bhat
Md. Kowsher
Niloofar Yousefi
O. Garibay
113
7
0
11 Oct 2024
Emergent social conventions and collective bias in LLM populations
Ariel Flint Ashery
L. Aiello
Andrea Baronchelli
AI4CE
95
2
0
11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models
Kevin Galim
Wonjun Kang
Yuchen Zeng
H. Koo
Kangwook Lee
136
4
0
11 Oct 2024
Federated Learning in Practice: Reflections and Projections
Katharine Daly
Hubert Eichner
Peter Kairouz
H. B. McMahan
Daniel Ramage
Zheng Xu
FedML
94
10
0
11 Oct 2024
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
Dingkang Liang
Tianrui Feng
Xin Zhou
Yumeng Zhang
Zhikang Zou
Xiang Bai
68
7
0
10 Oct 2024
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture
Jiayi Han
Liang Du
Hongwei Du
Xiangguo Zhou
Yiwen Wu
Weibo Zheng
Donghong Han
CLL
MoMe
MoE
86
4
0
10 Oct 2024
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt Tuning
Yu-Chen Lin
Wei-Hua Li
Jun-Cheng Chen
Chu-Song Chen
65
1
0
10 Oct 2024
StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language Models
Minchan Kwon
Gaeun Kim
Jongsuk Kim
Haeil Lee
Junmo Kim
OffRL
LRM
LLMAG
75
4
0
10 Oct 2024
LecPrompt: A Prompt-based Approach for Logical Error Correction with CodeBERT
Zhenyu Xu
Victor S. Sheng
KELM
84
0
0
10 Oct 2024
COS-DPO: Conditioned One-Shot Multi-Objective Fine-Tuning Framework
Yinuo Ren
Tesi Xiao
Michael Shavlovsky
Lexing Ying
Holakou Rahmanian
74
1
0
10 Oct 2024
Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning
Abhinav Bandari
L. Yin
Cheng-Yu Hsieh
Ajay Kumar Jaiswal
Tianlong Chen
Li Shen
Ranjay Krishna
Shiwei Liu
79
8
0
09 Oct 2024
Parameter-Efficient Fine-Tuning via Selective Discrete Cosine Transform
Yixian Shen
Qi Bi
Jia-Hong Huang
Hongyi Zhu
Anuj Pathania
66
1
0
09 Oct 2024
Deep Correlated Prompting for Visual Recognition with Missing Modalities
Lianyu Hu
Tongkai Shi
Wei Feng
Fanhua Shang
Liang Wan
VLM
132
2
0
09 Oct 2024
Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
Zeman Li
Xinwei Zhang
Peilin Zhong
Yuan Deng
Meisam Razaviyayn
Vahab Mirrokni
116
5
0
09 Oct 2024
Towards Interpreting Visual Information Processing in Vision-Language Models
Clement Neo
Luke Ong
Philip Torr
Mor Geva
David M. Krueger
Fazl Barez
137
15
0
09 Oct 2024
Glider: Global and Local Instruction-Driven Expert Router
Pingzhi Li
Prateek Yadav
Jaehong Yoon
Jie Peng
Yi-Lin Sung
Joey Tianyi Zhou
Tianlong Chen
MoMe
MoE
94
2
0
09 Oct 2024
A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models
Cong Guo
Feng Cheng
Zhixu Du
James Kiessling
Jonathan Ku
...
Qilin Zheng
Guanglei Zhou
Hai
Li-Wei Li
Yiran Chen
60
7
0
08 Oct 2024
Manual Verbalizer Enrichment for Few-Shot Text Classification
Quang Anh Nguyen
Nadi Tomeh
M. Lebbah
Thierry Charnois
Hanene Azzag
Santiago Cordoba Muñoz
VLM
86
0
0
08 Oct 2024
Hyper Adversarial Tuning for Boosting Adversarial Robustness of Pretrained Large Vision Models
Kangtao Lv
Huangsen Cao
Kainan Tu
Yihuai Xu
Zhimeng Zhang
Xin Ding
Yongwei Wang
MoMe
AAML
VLM
53
1
0
08 Oct 2024
Generating Synthetic Datasets for Few-shot Prompt Tuning
Xu Guo
Zilin Du
Boyang Li
Chunyan Miao
95
2
0
08 Oct 2024
PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches
Rana Muhammad Shahroz Khan
Pingzhi Li
Sukwon Yun
Zhenyu Wang
S. Nirjon
Chau-Wai Wong
Tianlong Chen
KELM
118
3
0
08 Oct 2024
TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Models
Rabin Adhikari
Safal Thapaliya
Manish Dhakal
Bishesh Khanal
MLLM
VLM
77
0
0
07 Oct 2024
Item Cluster-aware Prompt Learning for Session-based Recommendation
Wooseong Yang
Chen Wang
Zihe Song
Weizhi Zhang
Philip S. Yu
VLM
86
0
0
07 Oct 2024
Provable Weak-to-Strong Generalization via Benign Overfitting
David X. Wu
A. Sahai
165
10
0
06 Oct 2024
Control Large Language Models via Divide and Conquer
Bingxuan Li
Yiwei Wang
Tao Meng
Kai-Wei Chang
Nanyun Peng
54
2
0
06 Oct 2024
On Evaluating LLMs' Capabilities as Functional Approximators: A Bayesian Perspective
Shoaib Ahmed Siddiqui
Yanzhi Chen
Juyeon Heo
Menglin Xia
Adrian Weller
47
0
0
06 Oct 2024
RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference
Yige Xu
Xu Guo
Zhiwei Zeng
Chunyan Miao
65
0
0
06 Oct 2024
Persona Knowledge-Aligned Prompt Tuning Method for Online Debate
Chunkit Chan
Cheng Jiayang
Xin Liu
Yauwai Yim
Yuxin Jiang
Zheye Deng
Haoran Li
Yangqiu Song
Ginny Wong
Simon See
114
0
0
05 Oct 2024
DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech
Dominika Woszczyk
Soteris Demetriou
73
0
0
05 Oct 2024
Hyperbolic Fine-tuning for Large Language Models
Menglin Yang
Aosong Feng
Bo Xiong
Jihong Liu
Irwin King
Rex Ying
88
6
0
05 Oct 2024
Auto-GDA: Automatic Domain Adaptation for Efficient Grounding Verification in Retrieval-Augmented Generation
Tobias Leemann
Periklis Petridis
G. Vietri
Dionysis Manousakas
Aaron Roth
Sergul Aydore
116
0
0
04 Oct 2024
Function-Guided Conditional Generation Using Protein Language Models with Adapters
Jason Yang
Aadyot Bhatnagar
Jeffrey A. Ruffolo
Ali Madani
80
5
0
04 Oct 2024
Coal Mining Question Answering with LLMs
Antonio Carlos Rivera
Anthony Moore
Steven Robinson
74
1
0
03 Oct 2024
Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocation
Xianzhi Li
Ran Zmigrod
Zhiqiang Ma
Xiaomo Liu
Xiaodan Zhu
116
3
0
03 Oct 2024
Reward-RAG: Enhancing RAG with Reward Driven Supervision
Thang Nguyen
Peter Chin
Yu-Wing Tai
RALM
130
5
0
03 Oct 2024
Can Language Models Take A Hint? Prompting for Controllable Contextualized Commonsense Inference
Pedro Colon-Hernandez
Nanxi Liu
Chelsea Joe
Peter Chin
Claire Yin
H. Lieberman
Yida Xin
C. Breazeal
ReLM
LRM
65
1
0
03 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among Prompts
Minh Le
Chau Nguyen
Huy Nguyen
Quyen Tran
Trung Le
Nhat Ho
135
8
0
03 Oct 2024
Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization
Xinhao Yao
Hongjin Qian
Xiaolin Hu
Gengze Xu
Wei Liu
Jian Luan
Bin Wang
Yang Liu
122
1
0
03 Oct 2024
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering
Yu Zhang
Kehai Chen
Xuefeng Bai
zhao kang
Quanjiang Guo
Min Zhang
120
12
0
02 Oct 2024
FedPT: Federated Proxy-Tuning of Large Language Models on Resource-Constrained Edge Devices
Zhidong Gao
Yu Zhang
Zhenxiao Zhang
Yanmin Gong
Yuanxiong Guo
69
1
0
01 Oct 2024
Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models
Ji Liu
Jiaxiang Ren
Ruoming Jin
Zijie Zhang
Yang Zhou
P. Valduriez
Dejing Dou
FedML
91
6
0
30 Sep 2024
HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
Bingshen Mu
Kun Wei
Qijie Shao
Yong Xu
Lei Xie
MoE
118
2
0
30 Sep 2024
X-Prompt: Multi-modal Visual Prompt for Video Object Segmentation
Pinxue Guo
Wanyun Li
Hao Huang
Lingyi Hong
Xinyu Zhou
Zhaoyu Chen
Jinglun Li
Kaixun Jiang
Wei Zhang
Wenqiang Zhang
VLM
VOS
106
4
0
28 Sep 2024
Realistic Evaluation of Model Merging for Compositional Generalization
Derek Tam
Yash Kant
Brian Lester
Igor Gilitschenski
Colin Raffel
MoMe
99
9
0
26 Sep 2024
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review
Emma Croxford
Yanjun Gao
Nicholas Pellegrino
Karen K. Wong
Graham Wills
Elliot First
Frank J. Liao
Cherodeep Goswami
Brian Patterson
Majid Afshar
HILM
ELM
LM&MA
129
1
0
26 Sep 2024
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdification
Tianfang Xie
Tianjing Li
Wei Zhu
Wei Han
Yi Zhao
85
5
0
26 Sep 2024
Previous
1
2
3
...
9
10
11
...
51
52
53
Next