Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2104.08691
Cited By
v1
v2 (latest)
The Power of Scale for Parameter-Efficient Prompt Tuning
18 April 2021
Brian Lester
Rami Al-Rfou
Noah Constant
VPVLM
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"The Power of Scale for Parameter-Efficient Prompt Tuning"
50 / 2,607 papers shown
Title
Generative Language Models Potential for Requirement Engineering Applications: Insights into Current Strengths and Limitations
Summra Saleem
Muhammad Nabeel Asim
L. V. Elst
Andreas Dengel
109
0
0
01 Dec 2024
Prompt as Free Lunch: Enhancing Diversity in Source-Free Cross-domain Few-shot Learning through Semantic-Guided Prompting
Linhai Zhuo
Zheng Wang
Yuqian Fu
Tianwen Qian
VLM
175
2
0
01 Dec 2024
Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
Kaustubh Ponkshe
Raghav Singhal
Eduard A. Gorbunov
Alexey Tumanov
Samuel Horváth
Praneeth Vepakomma
275
7
0
29 Nov 2024
PEFT-as-an-Attack! Jailbreaking Language Models during Federated Parameter-Efficient Fine-Tuning
Shenghui Li
Edith C.H. Ngai
Fanghua Ye
Thiemo Voigt
SILM
197
6
0
28 Nov 2024
SmartLLMSentry: A Comprehensive LLM Based Smart Contract Vulnerability Detection Framework
Oualid Zaazaa
H. Bakkali
128
3
0
28 Nov 2024
Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures
Yicheng Zhang
Zhen Qin
Zhaomin Wu
Jian Hou
Shuiguang Deng
185
3
0
28 Nov 2024
Enhancing Few-Shot Vision-Language Classification with Large Multimodal Model Features
Chancharik Mitra
Brandon Huang
Tianning Chai
Zhiqiu Lin
Assaf Arbelle
Rogerio Feris
Leonid Karlinsky
Trevor Darrell
Deva Ramanan
Roei Herzig
VLM
393
4
0
28 Nov 2024
CLIP meets DINO for Tuning Zero-Shot Classifier using Unlabeled Image Collections
Mohamed Fazli Mohamed Imam
Rufael Fedaku Marew
Jameel Hassan
Mustansar Fiaz
Alham Fikri Aji
Hisham Cholakkal
VLM
548
1
0
28 Nov 2024
How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario
Shih-Heng Wang
Zih-Ching Chen
Jiatong Shi
Ming-To Chuang
Guan-Ting Lin
Kuan Po Huang
David Harwath
Shang-Wen Li
Hung-yi Lee
128
1
0
27 Nov 2024
Chameleon: Adaptive Caching and Scheduling for Many-Adapter LLM Inference Environments
Nikoleta Iliakopoulou
Jovan Stojkovic
Chloe Alverti
Tianyin Xu
Hubertus Franke
Josep Torrellas
129
2
0
24 Nov 2024
LoRA-Mini : Adaptation Matrices Decomposition and Selective Training
Ayush Singh
Rajdeep Aher
Shivank Garg
129
1
0
24 Nov 2024
Exploring Large Language Models for Multimodal Sentiment Analysis: Challenges, Benchmarks, and Future Directions
Shezheng Song
86
0
0
23 Nov 2024
Adversarial Prompt Distillation for Vision-Language Models
Lin Luo
Xin Wang
Bojia Zi
Shihao Zhao
Xingjun Ma
Yu-Gang Jiang
AAML
VLM
182
4
0
22 Nov 2024
Panther: Illuminate the Sight of Multimodal LLMs with Instruction-Guided Visual Prompts
Honglin Li
Yuting Gao
Chenglu Zhu
Jingdong Chen
M. Yang
Lin Yang
MLLM
205
0
0
21 Nov 2024
Hymba: A Hybrid-head Architecture for Small Language Models
Xin Dong
Y. Fu
Shizhe Diao
Wonmin Byeon
Zijia Chen
...
Min-Hung Chen
Yoshi Suhara
Y. Lin
Jan Kautz
Pavlo Molchanov
Mamba
164
27
0
20 Nov 2024
MC-LLaVA: Multi-Concept Personalized Vision-Language Model
Ruichuan An
Sihan Yang
Ming Lu
Kai Zeng
Yulin Luo
...
Hao Liang
Qi She
Shanghang Zhang
Wentao Zhang
Wentao Zhang
200
11
0
18 Nov 2024
AllRestorer: All-in-One Transformer for Image Restoration under Composite Degradations
J. Mao
Yue Yang
Xuesong Yin
Ling Shao
Hao Tang
68
1
0
16 Nov 2024
IntentGPT: Few-shot Intent Discovery with Large Language Models
Juan A. Rodriguez
Nicholas Botzer
David Vazquez
Christopher Pal
M. Pedersoli
I. Laradji
VLM
144
3
0
16 Nov 2024
On the Privacy Risk of In-context Learning
Haonan Duan
Adam Dziedzic
Mohammad Yaghini
Nicolas Papernot
Franziska Boenisch
SILM
PILM
131
42
0
15 Nov 2024
Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation
Md. Asif Haider
Ayesha Binte Mostofa
Sk. Sabit Bin Mosaddek
Anindya Iqbal
Toufique Ahmed
ALM
92
3
0
15 Nov 2024
A Practical Guide to Fine-tuning Language Models with Limited Data
Márton Szép
Daniel Rueckert
Rüdiger von Eisenhart-Rothe
Florian Hinterwimmer
SyDa
ALM
130
2
0
14 Nov 2024
PyGen: A Collaborative Human-AI Approach to Python Package Creation
Saikat Barua
Mostafizur Rahman
Md Jafor Sadek
Rafiul Islam
Shehnaz Khaled
Md. Shohrab Hossain
123
2
0
13 Nov 2024
New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook
Meng Yang
Tianqing Zhu
Chi Liu
Wanlei Zhou
Shui Yu
Philip S. Yu
AAML
ELM
PILM
112
1
0
12 Nov 2024
On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models
Qian Sun
Hanpeng Wu
Xi Sheryl Zhang
72
0
0
11 Nov 2024
LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
Runming Yang
Taiqiang Wu
Jiahao Wang
Pengfei Hu
Ngai Wong
Yujiu Yang
Yujiu Yang
446
1
0
11 Nov 2024
Over-parameterized Student Model via Tensor Decomposition Boosted Knowledge Distillation
Yu-Liang Zhan
Zhong-Yi Lu
Hao Sun
Ze-Feng Gao
79
0
0
10 Nov 2024
Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
Xiwen Wei
Guihong Li
R. Marculescu
71
4
0
08 Nov 2024
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
Xingtai Lv
Ning Ding
Kaiyan Zhang
Ermo Hua
Ganqu Cui
Bowen Zhou
65
3
0
04 Nov 2024
Masked Autoencoders are Parameter-Efficient Federated Continual Learners
Yuchen He
Xiangfeng Wang
CLL
FedML
62
0
0
04 Nov 2024
FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework
Yuchen He
Chuyun Shen
Xiangfeng Wang
Bo Jin
FedML
118
1
0
04 Nov 2024
Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study
André Storhaug
Jingyue Li
ALM
78
2
0
04 Nov 2024
Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups
Razvan-Alexandru Smadu
David-Gabriel Ion
Dumitru-Clementin Cercel
Florin-Catalin Pop
Mihaela-Claudia Cercel
82
1
0
03 Nov 2024
UniGuard: Towards Universal Safety Guardrails for Jailbreak Attacks on Multimodal Large Language Models
Sejoon Oh
Yiqiao Jin
Megha Sharma
Donghyun Kim
Eric Ma
Gaurav Verma
Srijan Kumar
125
7
0
03 Nov 2024
Teaching Models to Improve on Tape
L. Bezalel
Eyal Orgad
Amir Globerson
68
0
0
03 Nov 2024
Visual Fourier Prompt Tuning
Runjia Zeng
Cheng Han
Qifan Wang
Chunshu Wu
Tong Geng
Lifu Huang
Ying Nian Wu
Dongfang Liu
VPVLM
VLM
130
8
0
02 Nov 2024
PMoL: Parameter Efficient MoE for Preference Mixing of LLM Alignment
Dongxu Liu
Bing Xu
Yinzhuo Chen
Bufan Xu
Wenpeng Lu
Muyun Yang
Tiejun Zhao
MoE
57
1
0
02 Nov 2024
Open LLMs are Necessary for Current Private Adaptations and Outperform their Closed Alternatives
Vincent Hanke
Tom Blanchard
Franziska Boenisch
Iyiola Emmanuel Olatunji
Michael Backes
Adam Dziedzic
PILM
98
6
0
02 Nov 2024
Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction
Liang Wang
Qiang Liu
Shaozhen Liu
Xin Sun
Shu Wu
Liang Wang
108
2
0
02 Nov 2024
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models
Huancheng Chen
Jingtao Li
Nidham Gazagnadou
Weiming Zhuang
Chen Chen
Lingjuan Lyu
VLM
CLL
158
2
0
01 Nov 2024
MoTaDual: Modality-Task Dual Alignment for Enhanced Zero-shot Composed Image Retrieval
Haiwen Li
Fei Su
Zhicheng Zhao
79
0
0
31 Oct 2024
Dynamic Information Sub-Selection for Decision Support
Hung-Tien Huang
M. Lennon
Shreyas Bhat Brahmavar
Sean Sylvia
Junier B. Oliva
65
0
0
30 Oct 2024
An Individual Identity-Driven Framework for Animal Re-Identification
Yihao Wu
Di Zhao
Jingfeng Zhang
Yun Sing Koh
71
0
0
30 Oct 2024
MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
Xujia Wang
Haiyan Zhao
Shuo Wang
Hanqing Wang
Zhiyuan Liu
MoMe
MoE
63
1
0
30 Oct 2024
Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesis
Théodor Lemerle
Harrison Vanderbyl
Vaibhav Srivastav
Nicolas Obin
Axel Roebel
80
1
0
30 Oct 2024
Demo-Craft: Using In-Context Learning to Improve Code Generation in Large Language Models
Nirmal Joshua Kapu
Mihit Sreejith
105
1
0
30 Oct 2024
Unified Domain Generalization and Adaptation for Multi-View 3D Object Detection
Gyusam Chang
Jiwon Lee
Donghyun Kim
Jinkyu Kim
Dongwook Lee
Daehyun Ji
Sujin Jang
Sangpil Kim
118
1
0
29 Oct 2024
Preserving Pre-trained Representation Space: On Effectiveness of Prefix-tuning for Large Multi-modal Models
Donghoon Kim
Gusang Lee
Kyuhong Shim
B. Shim
102
1
0
29 Oct 2024
MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding
Yuan Wang
Di Huang
Yaqi Zhang
Wanli Ouyang
J. Jiao
Xuetao Feng
Yan Zhou
Pengfei Wan
Shixiang Tang
Dan Xu
VGen
115
16
0
29 Oct 2024
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
Jui-Nan Yen
Si Si
Zhao Meng
Felix X. Yu
Sai Surya Duvvuri
Inderjit Dhillon
Cho-Jui Hsieh
Sanjiv Kumar
72
5
0
27 Oct 2024
Vector Quantization Prompting for Continual Learning
L. Jiao
Qiuxia Lai
Yu LI
Qiang Xu
VLM
CLL
62
5
0
27 Oct 2024
Previous
1
2
3
...
7
8
9
...
51
52
53
Next