ResearchTrend.AI
Adapting LLMs for Efficient Context Processing through Soft Prompt Compression

Adapting LLMs for Efficient Context Processing through Soft Prompt Compression

Cangqing Wang
Yutian Yang
Ruisi Li
Dan Sun
Ruicong Cai
Yuzhu Zhang
Chengqian Fu
Lillian Floyd
ArXivPDFHTML

Papers citing "Adapting LLMs for Efficient Context Processing through Soft Prompt Compression"

11 / 11 papers shown
Title
PIS: Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression
PIS: Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression
Lizhe Chen
Binjia Zhou
Yuyao Ge
Jiayi Chen
Shiguang NI
162
1
0
23 Apr 2025
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap
Gopi Krishnan Rajbahadur
G. Oliva
Dayi Lin
Ahmed E. Hassan
46
1
0
28 Jan 2025
CA-BERT: Leveraging Context Awareness for Enhanced Multi-Turn Chat Interaction
CA-BERT: Leveraging Context Awareness for Enhanced Multi-Turn Chat Interaction
Minghao Liu
Mingxiu Sui
Yi Nan
Cangqing Wang
Zhijie Zhou
30
2
0
05 Sep 2024
Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference
Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference
Barys Liskavets
Maxim Ushakov
Shuvendu Roy
Mark Klibanov
Ali Etemad
Shane Luke
46
7
0
02 Sep 2024
Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees
Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees
Cangqing Wang
Mingxiu Sui
Dan Sun
Zecheng Zhang
Yan Zhou
41
26
0
22 May 2024
Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base
Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base
Yuchen Wang
Yin-Shan Lin
Ruixin Huang
Jinyin Wang
Sensen Liu
23
7
0
19 May 2024
Enhancing 3D Object Detection by Using Neural Network with Self-adaptive Thresholding
Enhancing 3D Object Detection by Using Neural Network with Self-adaptive Thresholding
Houze Liu
Chongqing Wang
Xiaoan Zhan
Haotian Zheng
Chang Che
32
3
0
13 May 2024
Exploring Diverse Methods in Visual Question Answering
Exploring Diverse Methods in Visual Question Answering
Panfeng Li
Qikai Yang
Xieming Geng
Wenjing Zhou
Zhicheng Ding
Yi Nian
42
55
0
21 Apr 2024
Reinforcement Learning Approach for Integrating Compressed Contexts into Knowledge Graphs
Reinforcement Learning Approach for Integrating Compressed Contexts into Knowledge Graphs
Ngoc Quach
Qi Wang
Zijun Gao
Qifeng Sun
Bo Guan
Lillian Floyd
OffRL
GNN
39
5
0
19 Apr 2024
The Power of Scale for Parameter-Efficient Prompt Tuning
The Power of Scale for Parameter-Efficient Prompt Tuning
Brian Lester
Rami Al-Rfou
Noah Constant
VPVLM
280
3,858
0
18 Apr 2021
Big Bird: Transformers for Longer Sequences
Big Bird: Transformers for Longer Sequences
Manzil Zaheer
Guru Guruganesh
Kumar Avinava Dubey
Joshua Ainslie
Chris Alberti
...
Philip Pham
Anirudh Ravula
Qifan Wang
Li Yang
Amr Ahmed
VLM
288
2,017
0
28 Jul 2020