ResearchTrend.AI
Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE

Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE

Koji Hashimoto
Yuji Hirono
Akiyoshi Sannai
ArXivPDFHTML

Papers citing "Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE"

4 / 4 papers shown
Title
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory
Yukun Zhang
Qi Dong
38
0
0
23 Jun 2024
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models
Iman Mirzadeh
Keivan Alizadeh-Vahid
Sachin Mehta
C. C. D. Mundo
Oncel Tuzel
Golnoosh Samei
Mohammad Rastegari
Mehrdad Farajtabar
126
60
0
06 Oct 2023
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
D. Kunin
Javier Sagastuy-Breña
Surya Ganguli
Daniel L. K. Yamins
Hidenori Tanaka
107
77
0
08 Dec 2020
Understanding symmetries in deep networks
Understanding symmetries in deep networks
Vijay Badrinarayanan
Bamdev Mishra
R. Cipolla
221
42
0
03 Nov 2015