Curse of High Dimensionality Issue in Transformer for Long-context Modeling

28 May 2025

Papers citing "Curse of High Dimensionality Issue in Transformer for Long-context Modeling"

3 / 3 papers shown

Title
ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification Yefei He Luoming Zhang Weijia Wu Jing Liu Hong Zhou Bohan Zhuang MQ 64 31 0 23 May 2024
Efficient Large Scale Language Modeling with Mixtures of Experts Mikel Artetxe Shruti Bhosale Naman Goyal Todor Mihaylov Myle Ott ... Jeff Wang Luke Zettlemoyer Mona T. Diab Zornitsa Kozareva Ves Stoyanov MoE 61 192 0 20 Dec 2021
Neural Autoregressive Flows Chin-Wei Huang David M. Krueger Alexandre Lacoste Aaron Courville DRL AI4CE 48 436 0 03 Apr 2018