Converting Transformers to Polynomial Form for Secure Inference Over
Homomorphic Encryption

Converting Transformers to Polynomial Form for Secure Inference Over Homomorphic Encryption

15 November 2023

Itamar Zimerman

Lior Wolf

Papers citing "Converting Transformers to Polynomial Form for Secure Inference Over Homomorphic Encryption"

11 / 11 papers shown

Title
Encryption-Friendly LLM Architecture Donghwan Rho Taeseong Kim Minje Park Jung Woo Kim Hyunsik Chae Jung Hee Cheon Ernest K. Ryu 57 2 0 24 Feb 2025
CipherPrune: Efficient and Scalable Private Transformer Inference Yancheng Zhang Jinbao Xue Mengxin Zheng Mimi Xie Mingzhe Zhang Lei Jiang Qian Lou 64 2 0 24 Feb 2025
AERO: Softmax-Only LLMs for Efficient Private Inference N. Jha Brandon Reagen 32 1 0 16 Oct 2024
ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models N. Jha Brandon Reagen OffRL AI4CE 33 0 0 12 Oct 2024
Efficient Privacy-Preserving KAN Inference Using Homomorphic Encryption Zhizheng Lai Yufei Zhou Peijia Zheng Lin Chen 29 0 0 12 Sep 2024
SLIP: Securing LLMs IP Using Weights Decomposition Yehonathan Refael Adam Hakim Lev Greenberg T. Aviv S. Lokam Ben Fishman Shachar Seidman 46 3 0 15 Jul 2024
On Protecting the Data Privacy of Large Language Models (LLMs): A Survey Biwei Yan Kun Li Minghui Xu Yueyan Dong Yue Zhang Zhaochun Ren Xiuzhen Cheng AILaw PILM 72 76 0 08 Mar 2024
The Hidden Attention of Mamba Models Ameen Ali Itamar Zimerman Lior Wolf Mamba 39 58 0 03 Mar 2024
DeepReShape: Redesigning Neural Networks for Efficient Private Inference N. Jha Brandon Reagen 36 10 0 20 Apr 2023
Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption Garam Lee Minsoo Kim J. Park Seung-won Hwang Jung Hee Cheon 38 16 0 05 Oct 2022
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 91 152 0 17 Sep 2021