v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,608 papers shown

Title
Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning Jinta Weng Jiarui Zhang Yue Hu Daidong Fa Xiaofeng Xu Heyan Huang 71 1 0 13 Dec 2023
Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI Kai Huang Boyuan Yang Wei Gao 70 1 0 13 Dec 2023
diff History for Neural Language Agents Ulyana Piterbarg Lerrel Pinto Rob Fergus 106 3 0 12 Dec 2023
ICL Markup: Structuring In-Context Learning using Soft-Token Tags Marc-Etienne Brunet Ashton Anderson R. Zemel 73 5 0 12 Dec 2023
GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction Jiacheng Ruan Jingsheng Gao Mingye Xie Suncheng Xiang Zefang Yu Ting Liu Yuzhuo Fu MoE 100 6 0 12 Dec 2023
Adaptive Human Trajectory Prediction via Latent Corridors Neerja Thakkar K. Mangalam Andrea V. Bajcsy Jitendra Malik 84 5 0 11 Dec 2023
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 115 39 0 11 Dec 2023
GTA: Gated Toxicity Avoidance for LM Performance Preservation Heegyu Kim Hyunsouk Cho 54 1 0 11 Dec 2023
User Modeling in the Era of Large Language Models: Current Research and Future Directions Zhaoxuan Tan Meng Jiang 121 12 0 11 Dec 2023
Batched Low-Rank Adaptation of Foundation Models Yeming Wen Swarat Chaudhuri OffRL 111 21 0 09 Dec 2023
PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching Zhenting Qi Jue Chen Shaojie Shi Chao Qu Yinghui Xu Yuan Qi ALM 96 10 0 09 Dec 2023
From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos Yin Chen Jia Li Shiguang Shan Meng Wang Richang Hong 91 35 0 09 Dec 2023
Fine-Tuning InstructPix2Pix for Advanced Image Colorization Zifeng An Zijing Xu Eric Fan Qi Cao 52 1 0 08 Dec 2023
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey Jun Bai Xiaofeng Zhang Chen Li Hanhua Hong Xi Xu Chenghua Lin Wenge Rong 82 10 0 08 Dec 2023
Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attacks Shuli Jiang S. Kadhe Yi Zhou Ling Cai Nathalie Baracaldo SILM AAML 72 13 0 07 Dec 2023
How to guess a gradient Utkarsh Singhal Brian Cheung Kartik Chandra Jonathan Ragan-Kelley Joshua B. Tenenbaum Tomaso Poggio Stella X. Yu ODL 63 3 0 07 Dec 2023
An LLM Compiler for Parallel Function Calling Sehoon Kim Suhong Moon Ryan Tabrizi Nicholas Lee Michael W. Mahoney Kurt Keutzer A. Gholami LRM 74 65 0 07 Dec 2023
Merging by Matching Models in Task Parameter Subspaces Derek Tam Mohit Bansal Colin Raffel MoMe 116 12 0 07 Dec 2023
Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation Zhixiang Wei Lin Chen Yi Jin Xiaoxiao Ma Tianle Liu Pengyang Lin Ben Wang H. Chen Jinjin Zheng 111 48 0 07 Dec 2023
Fine-tuning vision foundation model for crack segmentation in civil infrastructures Kang Ge Chen Wang Yutao Guo Yansong Tang Zhenzhong Hu Hongbing Chen VLM 76 23 0 07 Dec 2023
Large Language Models for Intent-Driven Session Recommendations Zhu Sun Hongyang Liu Xinghua Qu Kaidong Feng Yan Wang Yew-Soon Ong LRM 108 32 0 07 Dec 2023
PneumoLLM: Harnessing the Power of Large Language Model for Pneumoconiosis Diagnosis Meiyue Song Zhihua Yu Weiwen Zhang Jiarui Wang Yuting Lu ... Nikolaos I. Kanellakis Jiangfeng Liu Jing Wang Binglu Wang Juntao Yang LM&MA 80 0 0 06 Dec 2023
MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning Qizhe Zhang Bocheng Zou Ruichuan An Jiaming Liu Shanghang Zhang MoE 115 3 0 05 Dec 2023
Large Language Models on Graphs: A Comprehensive Survey Bowen Jin Gang Liu Chi Han Meng Jiang Heng Ji Jiawei Han AI4CE 145 161 0 05 Dec 2023
Prompt Optimization via Adversarial In-Context Learning Do Xuan Long Yiran Zhao Hannah Brown Yuxi Xie James Xu Zhao Nancy F. Chen Kenji Kawaguchi Michael Qizhe Xie Junxian He 160 16 0 05 Dec 2023
FreestyleRet: Retrieving Images from Style-Diversified Queries Hao Li Curise Jia Peng Jin Ze-Long Cheng Kehan Li Jialu Sui Chang Liu Li-ming Yuan 3DH 108 8 0 05 Dec 2023
Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model Yuxia Geng Jiaoyan Chen Yuhang Zeng Zhuo Chen Wen Zhang Jeff Z. Pan Yuxiang Wang Xiaoliang Xu 164 3 0 04 Dec 2023
IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks Jiarui Xu Yossi Gandelsman Amir Bar Jianwei Yang Jianfeng Gao Trevor Darrell Xiaolong Wang VLM 60 3 0 04 Dec 2023
CLAMP: Contrastive LAnguage Model Prompt-tuning Piotr Teterwak Ximeng Sun Bryan A. Plummer Kate Saenko Ser-Nam Lim MLLM VLM 84 1 0 04 Dec 2023
Generating Action-conditioned Prompts for Open-vocabulary Video Action Recognition Chengyou Jia Minnan Luo Xiaojun Chang Zhuohang Dang Mingfei Han Mengmeng Wang Guangwen Dai Sizhe Dang Jingdong Wang VLM 89 7 0 04 Dec 2023
How to Configure Good In-Context Sequence for Visual Question Answering Li Li Jiawei Peng Huiyi Chen Chongyang Gao Xu Yang MLLM 108 22 0 04 Dec 2023
APoLLo: Unified Adapter and Prompt Learning for Vision Language Models Sanjoy Chowdhury Sayan Nag Dinesh Manocha VLM 77 19 0 04 Dec 2023
Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies Vithya Yogarajan Gillian Dobbie Te Taka Keegan R. Neuwirth ALM 115 13 0 03 Dec 2023
Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective Can Jin Tianjin Huang Yihua Zhang Mykola Pechenizkiy Sijia Liu Shiwei Liu Tianlong Chen VLM 152 26 0 03 Dec 2023
Prompt Tuning for Zero-shot Compositional Learning Lingyu Zhang Ting Hua Yilin Shen Hongxia Jin VLM 90 0 0 02 Dec 2023
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts Jialin Wu Xia Hu Yaqing Wang Bo Pang Radu Soricut MoE 82 16 0 01 Dec 2023
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models Srinath Namburi Makesh Narsimhan Sreedhar Srinath Srinivasan Frederic Sala MQ 77 11 0 01 Dec 2023
A Bayesian approach for prompt optimization in pre-trained language models Antonio Sabbatella Andrea Ponti Antonio Candelieri I. Giordani Francesco Archetti 76 2 0 01 Dec 2023
PEFTDebias : Capturing debiasing information using PEFTs Sumit Agarwal Aditya Srikanth Veerubhotla Srijan Bansal 82 3 0 01 Dec 2023
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way Kai Lv Shuo Zhang Tianle Gu Shuhao Xing Jiawei Hong ... Tengxiao Liu Yu Sun Penousal Machado Hang Yan Xipeng Qiu 92 7 0 01 Dec 2023
Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning Shaohua Dong Yunhe Feng Qing Yang Yan Huang Dongfang Liu Heng Fan VLM 111 23 0 01 Dec 2023
CAST: Cross-Attention in Space and Time for Video Action Recognition Dongho Lee Jongseo Lee Jinwoo Choi EgoV 117 13 0 30 Nov 2023
Audio Prompt Tuning for Universal Sound Separation Yuzhuo Liu Xubo Liu Yan Zhao Yuanyuan Wang Rui Xia Pingchuan Tain Yuxuan Wang VLM 108 6 0 30 Nov 2023
AviationGPT: A Large Language Model for the Aviation Domain Liya Wang Jason Chou Xin Zhou A. Tien Diane M. Baumgartner 48 9 0 29 Nov 2023
Continual Learning with Low Rank Adaptation Martin Wistuba Prabhu Teja Sivaprasad Lukas Balles Giovanni Zappella CLL 92 16 0 29 Nov 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 195 19 0 29 Nov 2023
Improving the Robustness of Transformer-based Large Language Models with Dynamic Attention Lujia Shen Yuwen Pu Shouling Ji Changjiang Li Xuhong Zhang Chunpeng Ge Ting Wang AAML 83 6 0 29 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 132 3 0 29 Nov 2023
End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames Shuming Liu Chen-Da Liu-Zhang Chen Zhao Guohao Li 123 29 0 28 Nov 2023
A Survey on Prompting Techniques in LLMs Prabin Bhandari 50 7 0 28 Nov 2023