LLMs Can Understand Encrypted Prompt: Towards Privacy-Computing Friendly Transformers

28 May 2023

Papers citing "LLMs Can Understand Encrypted Prompt: Towards Privacy-Computing Friendly Transformers"

22 / 22 papers shown

Title
Private Transformer Inference in MLaaS: A Survey Yang Li Xinyu Zhou Yishuo Wang Liangxin Qian Jun Zhao 25 0 0 15 May 2025
Comet: Accelerating Private Inference for Large Language Model by Predicting Activation Sparsity Guang Yan Yuhui Zhang Zimu Guo Lutan Zhao Xiaojun Chen Chen Wang Wenhao Wang Dan Meng Rui Hou 33 0 0 12 May 2025
HawkEye: Statically and Accurately Profiling the Communication Cost of Models in Multi-party Learning Wenqiang Ruan Xin Lin Ruisheng Zhou Guopeng Lin Shui Yu Weili Han 45 0 0 16 Feb 2025
MPCache: MPC-Friendly KV Cache Eviction for Efficient Private Large Language Model Inference Wenxuan Zeng Ye Dong Jinjin Zhou Junming Ma Jin Tan Runsheng Wang Meng Li 49 0 0 12 Jan 2025
Power-Softmax: Towards Secure LLM Inference over Encrypted Data Itamar Zimerman Allon Adir E. Aharoni Matan Avitan Moran Baruch Nir Drucker Jenny Lerner Ramy Masalha Reut Meiri Omri Soceanu 32 2 0 12 Oct 2024
Confidential Prompting: Protecting User Prompts from Cloud LLM Providers In Gim Caihua Li Lin Zhong 52 2 0 27 Sep 2024
ObfuscaTune: Obfuscated Offsite Fine-tuning and Inference of Proprietary LLMs on Private Datasets Ahmed Frikha Nassim Walha Ricardo Mendes K. K. Nakka Xue Jiang Xuebing Zhou 74 2 0 03 Jul 2024
Data-Centric AI in the Age of Large Language Models Xinyi Xu Zhaoxuan Wu Rui Qiao Arun Verma Yao Shu ... Xiaoqiang Lin Wenyang Hu Zhongxiang Dai Pang Wei Koh Bryan Kian Hsiang Low ALM 48 2 0 20 Jun 2024
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration Ziqian Zeng Jianwei Wang Zhengdong Lu Huiping Zhuang Cen Chen RALM KELM 50 7 0 03 Jun 2024
Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumption Xuanqi Liu Zhuotao Liu Qi Li Ke Xu Mingwei Xu 29 7 0 17 Mar 2024
On Protecting the Data Privacy of Large Language Models (LLMs): A Survey Biwei Yan Kun Li Minghui Xu Yueyan Dong Yue Zhang Zhaochun Ren Xiuzhen Cheng AILaw PILM 78 78 0 08 Mar 2024
ConfusionPrompt: Practical Private Inference for Online Large Language Models Peihua Mai Ran Yan Rui Ye Youjia Yang Yinchuan Li Yan Pang 20 1 0 30 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 68 19 0 29 Nov 2023
Converting Transformers to Polynomial Form for Secure Inference Over Homomorphic Encryption Itamar Zimerman Moran Baruch Nir Drucker Gilad Ezov Omri Soceanu Lior Wolf 21 15 0 15 Nov 2023
Split-and-Denoise: Protect large language model inference with local differential privacy Peihua Mai Ran Yan Zhe Huang Youjia Yang Yan Pang 30 12 0 13 Oct 2023
East: Efficient and Accurate Secure Transformer Framework for Inference Yuanchao Ding Hua Guo Yewei Guan Weixin Liu Jiarong Huo Zhenyu Guan Xiyong Zhang 34 17 0 19 Aug 2023
PUMA: Secure Inference of LLaMA-7B in Five Minutes Ye Dong Wen-jie Lu Yancheng Zheng Haoqi Wu Derun Zhao Jin Tan Zhicong Huang Cheng Hong Tao Wei Wen-Chang Cheng 39 52 0 24 Jul 2023
MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots Gelei Deng Yi Liu Yuekang Li Kailong Wang Ying Zhang Zefeng Li Haoyu Wang Tianwei Zhang Yang Liu SILM 37 118 0 16 Jul 2023
Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics Prajjwal Bhargava Aleksandr Drozd Anna Rogers 102 102 0 04 Oct 2021
CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU Sijun Tan Brian Knott Yuan Tian David J. Wu BDL FedML 57 183 0 22 Apr 2021
CrypTFlow2: Practical 2-Party Secure Inference Deevashwer Rathee Mayank Rathee Nishant Kumar Nishanth Chandran Divya Gupta Aseem Rastogi Rahul Sharma 87 301 0 13 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018