Not All Memories are Created Equal: Learning to Forget by Expiring

Not All Memories are Created Equal: Learning to Forget by Expiring

13 May 2021

Sainbayar Sukhbaatar

Jason Weston

Angela Fan

Papers citing "Not All Memories are Created Equal: Learning to Forget by Expiring"

13 / 13 papers shown

Title
Temporal Graph Memory Networks For Knowledge Tracing Seif Gad Sherif M. Abdelfattah Ghodai M. Abdelrahman AI4Ed 26 0 0 23 Sep 2024
MemoNav: Working Memory Model for Visual Navigation Hongxin Li Zeyu Wang Xueke Yang Yu-Ren Yang Shuqi Mei Zhaoxiang Zhang 44 5 0 29 Feb 2024
Cached Transformers: Improving Transformers with Differentiable Memory Cache Zhaoyang Zhang Wenqi Shao Yixiao Ge Xiaogang Wang Liang Feng Ping Luo 19 2 0 20 Dec 2023
Transformer-VQ: Linear-Time Transformers via Vector Quantization Albert Mohwald 34 15 0 28 Sep 2023
Long-range Language Modeling with Self-retrieval Ohad Rubin Jonathan Berant RALM KELM 25 18 0 23 Jun 2023
Memory in humans and deep language models: Linking hypotheses for model augmentation Omri Raccah Pheobe Chen Ted Willke David Poeppel Vy A. Vo RALM 23 1 0 04 Oct 2022
MemoNav: Selecting Informative Memories for Visual Navigation Hongxin Li Xueke Yang Yu-Ren Yang Shuqi Mei Zhaoxiang Zhang 18 4 0 20 Aug 2022
Training Language Models with Memory Augmentation Zexuan Zhong Tao Lei Danqi Chen RALM 244 128 0 25 May 2022
Memorizing Transformers Yuhuai Wu M. Rabe DeLesley S. Hutchins Christian Szegedy RALM 30 173 0 16 Mar 2022
Block-Recurrent Transformers DeLesley S. Hutchins Imanol Schlag Yuhuai Wu Ethan Dyer Behnam Neyshabur 23 94 0 11 Mar 2022
MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition Chao-Yuan Wu Yanghao Li K. Mangalam Haoqi Fan Bo Xiong Jitendra Malik Christoph Feichtenhofer ViT 48 198 0 20 Jan 2022
Discourse-Aware Soft Prompting for Text Generation Marjan Ghazvininejad Vladimir Karpukhin Vera Gor Asli Celikyilmaz 31 6 0 10 Dec 2021
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 252 580 0 12 Mar 2020