v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,608 papers shown

Title
Unlearning Traces the Influential Training Data of Language Models Masaru Isonuma Ivan Titov MU 118 9 0 26 Jan 2024
HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy Yongkang Liu Yiqun Zhang Qian Li Tong Liu Shi Feng Daling Wang Yifei Zhang Hinrich Schütze 96 9 0 26 Jan 2024
Parameter-Efficient Conversational Recommender System as a Language Processing Task Mathieu Ravaut Hao Zhang Lu Xu Aixin Sun Yong Liu 116 11 0 25 Jan 2024
BayesPrompt: Prompting Large-Scale Pre-Trained Language Models on Few-shot Inference via Debiased Domain Abstraction Jiangmeng Li Fei Song Yifan Jin Jingyao Wang Changwen Zheng Gang Hua Hui Xiong VLM 142 4 0 25 Jan 2024
True Knowledge Comes from Practice: Aligning LLMs with Embodied Environments via Reinforcement Learning Weihao Tan Wentao Zhang Shanqi Liu Longtao Zheng Xinrun Wang Bo An OffRL 109 22 0 25 Jan 2024
MM-LLMs: Recent Advances in MultiModal Large Language Models Duzhen Zhang Yahan Yu Jiahua Dong Chenxing Li Dan Su Chenhui Chu Dong Yu OffRL LRM 174 217 0 24 Jan 2024
SpacTor-T5: Pre-training T5 Models with Span Corruption and Replaced Token Detection Ke Ye Heinrich Jiang Afshin Rostamizadeh Ayan Chakrabarti Giulia DeSalvo Jean-François Kagy Lazaros Karydas Gui Citovsky Sanjiv Kumar 76 0 0 24 Jan 2024
Facing the Elephant in the Room: Visual Prompt Tuning or Full Finetuning? Cheng Han Qifan Wang Yiming Cui Wenguan Wang Lifu Huang Siyuan Qi Dongfang Liu VLM 167 22 0 23 Jan 2024
SLANG: New Concept Comprehension of Large Language Models Lingrui Mei Shenghua Liu Yiwei Wang Baolong Bi Xueqi Chen KELM 89 8 0 23 Jan 2024
BiTA: Bi-Directional Tuning for Lossless Acceleration in Large Language Models Feng-Huei Lin Hanling Yi Hongbin Li Yifan Yang Xiaotian Yu Guangming Lu Rong Xiao 90 4 0 23 Jan 2024
Enhancing In-context Learning via Linear Probe Calibration Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 114 14 0 22 Jan 2024
APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference Bowen Zhao Hannaneh Hajishirzi Qingqing Cao 143 21 0 22 Jan 2024
INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning Zhiyuan Wang Xiaoyang Qu Jing Xiao Bokui Chen Jianzong Wang CLL 116 2 0 22 Jan 2024
P2DT: Mitigating Forgetting in task-incremental Learning with progressive prompt Decision Transformer Zhiyuan Wang Xiaoyang Qu Jing Xiao Bokui Chen Jianzong Wang CLL OffRL 38 1 0 22 Jan 2024
In-context Learning with Retrieved Demonstrations for Language Models: A Survey an Luo Xin Xu Yue Liu Panupong Pasupat Mehran Kazemi RALM 170 70 0 21 Jan 2024
Hierarchical Prompts for Rehearsal-free Continual Learning Yukun Zuo Hantao Yao Lu Yu Liansheng Zhuang Changsheng Xu CLL VLM 69 1 0 21 Jan 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation Nadav Benedek Lior Wolf 87 5 0 20 Jan 2024
LangBridge: Multilingual Reasoning Without Multilingual Supervision Dongkeun Yoon Joel Jang Sungdong Kim Seungone Kim Sheikh Shafayat Minjoon Seo LRM 58 15 0 19 Jan 2024
DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval Xiangpeng Yang Linchao Zhu Xiaohan Wang Yi Yang VLM 145 26 0 19 Jan 2024
OrchMoE: Efficient Multi-Adapter Learning with Task-Skill Synergy Haowen Wang Tao Sun Kaixiang Ji Jian Wang Cong Fan Jinjie Gu 37 1 0 19 Jan 2024
AAT: Adapting Audio Transformer for Various Acoustics Recognition Tasks Yun Liang Hai Lin Shaojian Qiu Yihang Zhang 43 1 0 19 Jan 2024
FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis Chao Zhang Yuren Mao Yijiang Fan Yu Mi Yunjun Gao Lu Chen Dongfang Lou Jinshu Lin 107 29 0 19 Jan 2024
LLMs for Relational Reasoning: How Far are We? Zhiming Li Yushi Cao Xiufeng Xu Junzhe Jiang Xu Liu Yon Shin Teo Shang-Wei Lin Yang Liu LRM 117 22 0 17 Jan 2024
Tuning Language Models by Proxy Alisa Liu Xiaochuang Han Yizhong Wang Yulia Tsvetkov Yejin Choi Noah A. Smith ALM 98 52 0 16 Jan 2024
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models Weixiang Zhao Shilong Wang Yulin Hu Yanyan Zhao Bing Qin Xuanyu Zhang Qing Yang Dongliang Xu Wanxiang Che KELM CLL 110 16 0 16 Jan 2024
PRewrite: Prompt Rewriting with Reinforcement Learning Weize Kong Spurthi Amba Hombaiah Mingyang Zhang Qiaozhu Mei Michael Bendersky LLMAG 54 17 0 16 Jan 2024
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims Fengzhu Zeng Wei Gao 132 20 0 16 Jan 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models Zhengxin Zhang Dan Zhao Xupeng Miao Gabriele Oliaro Qing Li Yong Jiang Zhihao Jia MQ 92 9 0 13 Jan 2024
A Novel Multi-Stage Prompting Approach for Language Agnostic MCQ Generation using GPT Subhankar Maity Aniket Deroy Sudeshna Sarkar LRM 77 15 0 13 Jan 2024
Parameter-Efficient Detoxification with Contrastive Decoding Tong Niu Caiming Xiong Semih Yavuz Yingbo Zhou 62 14 0 13 Jan 2024
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models Yae Jee Cho Luyang Liu Zheng Xu Aldi Fahrezi Gauri Joshi 92 68 0 12 Jan 2024
APLe: Token-Wise Adaptive for Multi-Modal Prompt Learning Guiming Cao Kaize Shi Hong Fu Huaiwen Zhang Guandong Xu VLM 77 2 0 12 Jan 2024
SamLP: A Customized Segment Anything Model for License Plate Detection Haoxuan Ding Junyuan Gao Yuan. Yuan Qi. Wang MLLM VLM 81 7 0 12 Jan 2024
Misconfidence-based Demonstration Selection for LLM In-Context Learning Shangqing Xu Chao Zhang 137 17 0 12 Jan 2024
Distilling Vision-Language Models on Millions of Videos Yue Zhao Long Zhao Xingyi Zhou Jialin Wu Chun-Te Chu ... Hartwig Adam Ting Liu Boqing Gong Philipp Krahenbuhl Liangzhe Yuan VLM 96 14 0 11 Jan 2024
Chain of History: Learning and Forecasting with LLMs for Temporal Knowledge Graph Completion Ruilin Luo Tianle Gu Haoling Li Junzhe Li Zicheng Lin Jiayi Li Yujiu Yang AI4CE 149 10 0 11 Jan 2024
Do Vision and Language Encoders Represent the World Similarly? Mayug Maniparambil Raiymbek Akshulakov Y. A. D. Djilali Sanath Narayan M. Seddik K. Mangalam Noel E. O'Connor VLM 106 14 0 10 Jan 2024
User Embedding Model for Personalized Language Prompting Sumanth Doddapaneni Krishna Sayana Ambarish Jash Sukhdeep S. Sodhi Dima Kuzmin RALM 78 10 0 10 Jan 2024
RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation Mahdi Nikdan Soroush Tabesh Elvir Crnčević Dan Alistarh 134 32 0 09 Jan 2024
Learning to Prompt Segment Anything Models Jiaxing Huang Kai Jiang Jingyi Zhang Han Qiu Lewei Lu Shijian Lu Eric Xing VLM LRM 100 7 0 09 Jan 2024
TechGPT-2.0: A large language model project to solve the task of knowledge graph construction Jiaqi Wang Yuying Chang Zhong Li Ning An Qi Ma Lei Hei Haibo Luo Yifei Lu Feiliang Ren 43 6 0 09 Jan 2024
A Survey on Efficient Federated Learning Methods for Foundation Model Training Herbert Woisetschläger Alexander Isenko Shiqiang Wang R. Mayer Hans-Arno Jacobsen FedML 117 26 0 09 Jan 2024
LAMPAT: Low-Rank Adaption for Multilingual Paraphrasing Using Adversarial Training Khoi M. Le Trinh Pham Tho Quan Anh Tuan Luu 92 7 0 09 Jan 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization Xinyu Tang Ashwinee Panda Milad Nasr Saeed Mahloujifar Prateek Mittal 222 26 0 09 Jan 2024
Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning Wenhan Xia Chengwei Qin Elad Hazan 125 61 0 08 Jan 2024
Plug-and-Play Transformer Modules for Test-Time Adaptation Xiangyu Chang Sk. Miraj Ahmed S. Krishnamurthy Başak Güler A. Swami Samet Oymak Amit K. Roy-Chowdhury 135 0 0 06 Jan 2024
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks Haoyuan Wu Haisheng Zheng Zhuolun He Bei Yu MoE ALM 111 16 0 05 Jan 2024
ClassWise-SAM-Adapter: Parameter Efficient Fine-tuning Adapts Segment Anything to SAR Domain for Semantic Segmentation Xinyang Pu He Jia Linghao Zheng Feng Wang Feng Xu 64 0 0 04 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 113 25 0 04 Jan 2024
Understanding LLMs: A Comprehensive Overview from Training to Inference Yi-Hsueh Liu Haoyang He Tianle Han Xu-Yao Zhang Mengyuan Liu ... Xintao Hu Tuo Zhang Ning Qiang Tianming Liu Bao Ge SyDa 166 80 0 04 Jan 2024