LieTransformer: Equivariant self-attention for Lie Groups

20 December 2020

Papers citing "LieTransformer: Equivariant self-attention for Lie Groups"

32 / 32 papers shown

Title
Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines Olaya Álvarez-Tunón Yury Brodskiy Erdal Kayacan 73 6 0 04 Mar 2025
Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks Ashwin Samudre Mircea Petrache Brian D. Nord Shubhendu Trivedi 44 2 0 18 Sep 2024
Relaxing Continuous Constraints of Equivariant Graph Neural Networks for Physical Dynamics Learning Zinan Zheng Yang Liu Jia Li Jianhua Yao Yu Rong AI4CE 51 1 0 24 Jun 2024
From Learning to Optimize to Learning Optimization Algorithms Camille Castera Peter Ochs 62 1 0 28 May 2024
Steerable Transformers Soumyabrata Kundu Risi Kondor ViT LLMSV 30 1 0 24 May 2024
E(n) Equivariant Topological Neural Networks Claudio Battiloro Ege Karaismailoglu Mauricio Tec George Dasoulas Michelle Audirac Francesca Dominici 52 5 0 24 May 2024
Graph as Point Set Xiyuan Wang Pan Li Muhan Zhang GNN 3DPC PINN 44 4 0 05 May 2024
A Survey of Geometric Graph Neural Networks: Data Structures, Models and Applications Jiaqi Han Jiacheng Cen Liming Wu Zongzhao Li Xiangzhe Kong ... Zhewei Wei Deli Zhao Yu Rong Wenbing Huang Wenbing Huang AI4CE 34 20 0 01 Mar 2024
Lie Neurons: Adjoint-Equivariant Neural Networks for Semisimple Lie Algebras Tzu-Yuan Lin Minghan Zhu Maani Ghaffari 42 1 0 06 Oct 2023
EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning Chenxin Xu R. Tan Yuhong Tan Siheng Chen Yu Wang Xinchao Wang Yanfeng Wang 30 96 0 20 Mar 2023
GPS++: Reviving the Art of Message Passing for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander ... D. Beker Andrew Fitzgibbon Shenyang Huang Ladislav Rampášek Dominique Beaini 30 8 0 06 Feb 2023
An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models Yufeng Zhang Boyi Liu Qi Cai Lingxiao Wang Zhaoran Wang 50 11 0 30 Dec 2022
In What Ways Are Deep Neural Networks Invariant and How Should We Measure This? Henry Kvinge Tegan H. Emerson Grayson Jorgenson Scott Vasquez T. Doster Jesse D. Lew 43 8 0 07 Oct 2022
The Lie Derivative for Measuring Learned Equivariance Nate Gruver Marc Finzi Micah Goldblum A. Wilson 18 34 0 06 Oct 2022
Transformer Meets Boundary Value Inverse Problems Ruchi Guo Shuhao Cao Long Chen MedIm 33 20 0 29 Sep 2022
E2PN: Efficient SE(3)-Equivariant Point Network Minghan Zhu Maani Ghaffari W. A. Clark Huei Peng 3DPC 21 18 0 11 Jun 2022
Discovering and Explaining the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions Fang Wu Siyuan Li Lirong Wu Dragomir R. Radev Stan Z. Li 27 2 0 15 May 2022
When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning Chuizheng Meng Sungyong Seo Defu Cao Sam Griesemer Yan Liu PINN AI4CE 39 55 0 31 Mar 2022
Equivariant Graph Mechanics Networks with Constraints Wen-bing Huang J. Han Yu Rong Tingyang Xu Fuchun Sun Junzhou Huang AI4CE 33 79 0 12 Mar 2022
Symmetry Group Equivariant Architectures for Physics A. Bogatskiy S. Ganguly Thomas Kipf Risi Kondor David W. Miller ... Jan T. Offermann M. Pettee P. Shanahan C. Shimmin S. Thais AI4CE 24 27 0 11 Mar 2022
TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentials Philipp Thölke Gianni de Fabritiis AI4CE 34 185 0 05 Feb 2022
Independent SE(3)-Equivariant Models for End-to-End Rigid Protein Docking O. Ganea Xinyuan Huang Charlotte Bunne Yatao Bian Regina Barzilay Tommi Jaakkola Andreas Krause 30 151 0 15 Nov 2021
Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphs Fang Wu Dragomir R. Radev Huabin Xing ViT 36 54 0 04 Oct 2021
Geometric Deep Learning on Molecular Representations Kenneth Atz F. Grisoni G. Schneider AI4CE 34 287 0 26 Jul 2021
Equivariant Networks for Pixelized Spheres Mehran Shakerinava Siamak Ravanbakhsh 3DPC 25 19 0 12 Jun 2021
Choose a Transformer: Fourier or Galerkin Shuhao Cao 39 221 0 31 May 2021
E(n) Equivariant Normalizing Flows Victor Garcia Satorras Emiel Hoogeboom F. Fuchs Ingmar Posner Max Welling BDL 34 168 0 19 May 2021
Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure Samuel Kim Peter Y. Lu Charlotte Loh Jamie Smith Jasper Snoek M. Soljavcić BDL AI4CE 74 17 0 23 Apr 2021
Equivariant Learning of Stochastic Fields: Gaussian Processes and Steerable Conditional Neural Processes P. Holderrieth M. Hutchinson Yee Whye Teh BDL 33 30 0 25 Nov 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 280 2,015 0 28 Jul 2020
A General Theory of Equivariant CNNs on Homogeneous Spaces Taco S. Cohen Mario Geiger Maurice Weiler MLT AI4CE 165 308 0 05 Nov 2018
MoleculeNet: A Benchmark for Molecular Machine Learning Zhenqin Wu Bharath Ramsundar Evan N. Feinberg Joseph Gomes C. Geniesse Aneesh S. Pappu K. Leswing Vijay S. Pande OOD 172 1,778 0 02 Mar 2017