Group Equivariant Stand-Alone Self-Attention For Vision

2 October 2020

Papers citing "Group Equivariant Stand-Alone Self-Attention For Vision"

27 / 27 papers shown

Title
From Learning to Optimize to Learning Optimization Algorithms Camille Castera Peter Ochs 65 1 0 28 May 2024
Steerable Transformers Soumyabrata Kundu Risi Kondor ViT LLMSV 35 1 0 24 May 2024
Self-Supervised Detection of Perfect and Partial Input-Dependent Symmetries Alonso Urbano David W. Romero 30 1 0 19 Dec 2023
GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers Takeru Miyato Bernhard Jaeger Max Welling Andreas Geiger ViT 39 14 0 16 Oct 2023
Deep Neural Networks with Efficient Guaranteed Invariances M. Rath A. P. Condurache 16 4 0 02 Mar 2023
Steerable Equivariant Representation Learning Sangnie Bhardwaj Willie McClinton Tongzhou Wang Guillaume Lajoie Chen Sun Phillip Isola Dilip Krishnan OOD LLMSV 34 5 0 22 Feb 2023
An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models Yufeng Zhang Boyi Liu Qi Cai Lingxiao Wang Zhaoran Wang 53 11 0 30 Dec 2022
Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentation Simone Rossetti Damiano Zappia Marta Sanzari M. Schaerf F. Pirri ViT 36 57 0 31 Oct 2022
FedMCSA: Personalized Federated Learning via Model Components Self-Attention Qianling Guo Yong Qi Saiyu Qi Di Wu Qian Li FedML 21 9 0 23 Aug 2022
Unified Fourier-based Kernel and Nonlinearity Design for Equivariant Networks on Homogeneous Spaces Yinshuang Xu Jiahui Lei Yan Sun Kostas Daniilidis 23 19 0 16 Jun 2022
SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Space Evangelos Chatzipantazis Stefanos Pertigkiozoglou Yan Sun Kostas Daniilidis 3DPC 34 30 0 05 Apr 2022
ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification Thomas Stegmüller Behzad Bozorgtabar A. Spahr Jean-Philippe Thiran ViT MedIm 24 42 0 15 Feb 2022
Unsupervised Learning of Group Invariant and Equivariant Representations R. Winter Marco Bertolini Tuan Le Frank Noé Djork-Arné Clevert 25 40 0 15 Feb 2022
Improving the Sample-Complexity of Deep Classification Networks with Invariant Integration M. Rath A. P. Condurache 25 8 0 08 Feb 2022
Frame Averaging for Equivariant Shape Space Learning Matan Atzmon Koki Nagano Sanja Fidler S. Khamis Y. Lipman FedML 33 13 0 03 Dec 2021
Independent SE(3)-Equivariant Models for End-to-End Rigid Protein Docking O. Ganea Xinyuan Huang Charlotte Bunne Yatao Bian Regina Barzilay Tommi Jaakkola Andreas Krause 36 151 0 15 Nov 2021
Learning Partial Equivariances from Data David W. Romero Suhas Lohit 21 27 0 19 Oct 2021
Relative Molecule Self-Attention Transformer Lukasz Maziarka Dawid Majchrowski Tomasz Danel Piotr Gaiñski Jacek Tabor Igor T. Podolak Pawel M. Morkisz Stanislaw Jastrzebski MedIm 37 34 0 12 Oct 2021
Is Attention Better Than Matrix Decomposition? Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin 62 137 0 09 Sep 2021
Universal Approximation of Functions on Sets E. Wagstaff F. Fuchs Martin Engelcke Michael A. Osborne Ingmar Posner PINN 35 54 0 05 Jul 2021
Equivariant Networks for Pixelized Spheres Mehran Shakerinava Siamak Ravanbakhsh 3DPC 31 19 0 12 Jun 2021
DISCO: accurate Discrete Scale Convolutions Ivan Sosnovik A. Moskalev A. Smeulders 26 31 0 04 Jun 2021
E(n) Equivariant Graph Neural Networks Victor Garcia Satorras Emiel Hoogeboom Max Welling 30 979 0 19 Feb 2021
LieTransformer: Equivariant self-attention for Lie Groups M. Hutchinson Charline Le Lan Sheheryar Zaidi Emilien Dupont Yee Whye Teh Hyunjik Kim 26 111 0 20 Dec 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 285 2,015 0 28 Jul 2020
Universal Equivariant Multilayer Perceptrons Siamak Ravanbakhsh 100 48 0 07 Feb 2020
A General Theory of Equivariant CNNs on Homogeneous Spaces Taco S. Cohen Mario Geiger Maurice Weiler MLT AI4CE 165 308 0 05 Nov 2018