On Sparse Modern Hopfield Model

v1v2 (latest)

On Sparse Modern Hopfield Model

22 September 2023

Jerry Yao-Chieh Hu

ArXiv (abs)PDF HTML

Papers citing "On Sparse Modern Hopfield Model"

17 / 17 papers shown

Title
PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity Kwanyoung Kim Byeongsu Sim DiffM VLM 140 0 0 10 Mar 2025
HSR-Enhanced Sparse Attention Acceleration Bo Chen Yingyu Liang Zhizhou Sha Zhenmei Shi Zhao Song 213 22 0 14 Oct 2024
Energy Transformer Benjamin Hoover Yuchen Liang Bao Pham Yikang Shen Hendrik Strobelt Duen Horng Chau Mohammed J Zaki Dmitry Krotov ViT 71 49 0 14 Feb 2023
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 174 187 0 18 May 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 522 6,293 0 05 Apr 2022
Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Models Beren Millidge Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz VLM 51 54 0 09 Feb 2022
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp Günter Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 271 104 0 21 Oct 2021
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 159 1,125 0 14 Sep 2020
Large Associative Memory Problem in Neurobiology and Machine Learning Dmitry Krotov J. Hopfield 58 142 0 16 Aug 2020
Modern Hopfield Networks and Attention for Immune Repertoire Classification Michael Widrich Bernhard Schafl Hubert Ramsauer Milena Pavlović Lukas Gruber ... Johannes Brandstetter G. K. Sandve Victor Greiff Sepp Hochreiter Günter Klambauer 235 118 0 16 Jul 2020
Hopfield Networks is All You Need Hubert Ramsauer Bernhard Schafl Johannes Lehner Philipp Seidl Michael Widrich ... David P. Kreil Michael K Kopp Günter Klambauer Johannes Brandstetter Sepp Hochreiter 119 437 0 16 Jul 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 179 4,092 0 10 Apr 2020
Sparse Sinkhorn Attention Yi Tay Dara Bahri Liu Yang Donald Metzler Da-Cheng Juan 88 342 0 26 Feb 2020
Adaptively Sparse Transformers Gonçalo M. Correia Vlad Niculae André F. T. Martins 90 256 0 30 Aug 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 129 1,915 0 23 Apr 2019
Attention-based Deep Multiple Instance Learning Maximilian Ilse Jakub M. Tomczak Max Welling 175 1,823 0 13 Feb 2018
Dissimilarity-based Ensembles for Multiple Instance Learning Veronika Cheplygina David Tax Marco Loog 47 45 0 06 Feb 2014