Recasting Self-Attention with Holographic Reduced Representations

31 May 2023

Papers citing "Recasting Self-Attention with Holographic Reduced Representations"

8 / 8 papers shown

Title
A Walsh Hadamard Derived Linear Vector Symbolic Architecture Mohammad Mahmudul Alam Alexander Oberle Edward Raff Stella Biderman Tim Oates James Holt LLMSV 31 0 0 30 Oct 2024
Multi-label Learning with Random Circular Vectors Ken Nishida Kojiro Machi Kazuma Onishi Katsuhiko Hayashi Hidetaka Kamigaito 62 0 0 08 Jul 2024
Benchmarking Neural Decoding Backbones towards Enhanced On-edge iBCI Applications Zhou Zhou Guohang He Zheng Zhang Luziwei Leng Qinghai Guo Jianxing Liao Xuan Song Ran Cheng 47 2 0 08 Jun 2024
Holographic Global Convolutional Networks for Long-Range Prediction Tasks in Malware Detection Mohammad Mahmudul Alam Edward Raff Stella Biderman Tim Oates James Holt AAML 38 3 0 23 Mar 2024
MIMONets: Multiple-Input-Multiple-Output Neural Networks Exploiting Computation in Superposition Nicolas Menet Michael Hersche G. Karunaratne Luca Benini Abu Sebastian Abbas Rahimi 38 13 0 05 Dec 2023
RWKV: Reinventing RNNs for the Transformer Era Bo Peng Eric Alcaide Quentin G. Anthony Alon Albalak Samuel Arcadinho ... Qihang Zhao P. Zhou Qinghua Zhou Jian Zhu Rui-Jie Zhu 90 562 0 22 May 2023
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences Zhenhai Zhu Radu Soricut 112 41 0 25 Jul 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 288 2,023 0 28 Jul 2020