Spectral Transform Forms Scalable Transformer

15 November 2021

Papers citing "Spectral Transform Forms Scalable Transformer"

43 / 43 papers shown

Title
Choose a Transformer: Fourier or Galerkin Shuhao Cao 60 241 0 31 May 2021
FNet: Mixing Tokens with Fourier Transforms James Lee-Thorp Joshua Ainslie Ilya Eckstein Santiago Ontanon 90 526 0 09 May 2021
WGCN: Graph Convolutional Networks with Weighted Structural Features Yunxiang Zhao Jianzhong Qi Qingwei Liu Rui Zhang GNN 52 35 0 29 Apr 2021
How Framelets Enhance Graph Neural Networks Xuebin Zheng Bingxin Zhou Junbin Gao Yu Guang Wang Pietro Lio Ming Li Guido Montúfar 72 69 0 13 Feb 2021
A Survey on Understanding, Visualizations, and Explanation of Deep Neural Networks Atefeh Shahroudnejad FaML AAML AI4CE XAI 92 36 0 02 Feb 2021
Decimated Framelet System on Graphs and Fast G-Framelet Transforms Xuebin Zheng Bingxin Zhou Yu Guang Wang Xiaosheng Zhuang 71 35 0 12 Dec 2020
Graph Neural Networks for Improved El Niño Forecasting Salva Rühling Cachay Emma Erickson A. Bucker Ernest Pokropek Willa Potosnak Salomey Osei Björn Lütjens 22 11 0 02 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 530 40,739 0 22 Oct 2020
Temporal Graph Networks for Deep Learning on Dynamic Graphs Emanuele Rossi B. Chamberlain Fabrizio Frasca D. Eynard Federico Monti M. Bronstein AI4CE 138 643 0 18 Jun 2020
Learning to Simulate Complex Physics with Graph Networks Alvaro Sanchez-Gonzalez Jonathan Godwin Tobias Pfaff Rex Ying J. Leskovec Peter W. Battaglia PINN AI4CE 129 1,080 0 21 Feb 2020
Inductive Representation Learning on Temporal Graphs Da Xu Chuanwei Ruan Evren Körpeoglu Sushant Kumar Kannan Achan AI4CE 85 622 0 19 Feb 2020
Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks Srijan Kumar Xikun Zhang J. Leskovec AI4TS 66 732 0 03 Aug 2019
Fast Haar Transforms for Graph Neural Networks Ming Li Zheng Ma Yu Guang Wang Xiaosheng Zhuang 73 75 0 10 Jul 2019
Graph Wavelet Neural Network Bingbing Xu Huawei Shen Qi Cao Yunqi Qiu Xueqi Cheng GNN 63 330 0 12 Apr 2019
EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs A. Pareja Giacomo Domeniconi Jie Chen Tengfei Ma Toyotaro Suzumura H. Kanezashi Tim Kaler Tao B. Schardl Charles E. Leisersen GNN 111 1,064 0 26 Feb 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 577 8,496 0 03 Jan 2019
Efficient Attention: Attention with Linear Complexities Zhuoran Shen Mingyuan Zhang Haiyu Zhao Shuai Yi Hongsheng Li 89 527 0 04 Dec 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 214 7,623 0 01 Oct 2018
Adaptive Sampling Towards Fast Graph Representation Learning Wen-bing Huang Tong Zhang Yu Rong Junzhou Huang GNN 75 490 0 14 Sep 2018
Hierarchical Graph Representation Learning with Differentiable Pooling Rex Ying Jiaxuan You Christopher Morris Xiang Ren William L. Hamilton J. Leskovec GNN 265 2,140 0 22 Jun 2018
GeniePath: Graph Neural Networks with Adaptive Receptive Paths Ziqi Liu Chaochao Chen Longfei Li Jun Zhou Xiaolong Li Le Song Yuan Qi GNN 88 310 0 03 Feb 2018
Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning Qimai Li Zhichao Han Xiao-Ming Wu GNN SSL 178 2,820 0 22 Jan 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 628 130,942 0 12 Jun 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 452 15,179 0 07 Jun 2017
CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filters Ron Levie Federico Monti Xavier Bresson M. Bronstein GNN 167 659 0 22 May 2017
Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphs Rakshit S. Trivedi H. Dai Yichen Wang Le Song BDL 58 477 0 16 May 2017
Dynamic Graph Convolutional Networks Franco Manessi A. Rozza M. Manzo GNN 79 373 0 20 Apr 2017
Neural Message Passing for Quantum Chemistry Justin Gilmer S. Schoenholz Patrick F. Riley Oriol Vinyals George E. Dahl 466 7,431 0 04 Apr 2017
Structured Sequence Modeling with Graph Convolutional Recurrent Networks Youngjoo Seo M. Defferrard P. Vandergheynst Xavier Bresson GNN 125 768 0 22 Dec 2016
Geometric deep learning on graphs and manifolds using mixture model CNNs Federico Monti Davide Boscaini Jonathan Masci Emanuele Rodolà Jan Svoboda M. Bronstein GNN 392 1,819 0 25 Nov 2016
Geometric deep learning: going beyond Euclidean data M. Bronstein Joan Bruna Yann LeCun Arthur Szlam P. Vandergheynst GNN 697 3,274 0 24 Nov 2016
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 577 28,999 0 09 Sep 2016
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering M. Defferrard Xavier Bresson P. Vandergheynst GNN 310 7,646 0 30 Jun 2016
Stacked Attention Networks for Image Question Answering Zichao Yang Xiaodong He Jianfeng Gao Li Deng Alex Smola BDL 103 1,877 0 07 Nov 2015
Diffusion-Convolutional Neural Networks James Atwood Don Towsley GNN DiffM 177 1,251 0 06 Nov 2015
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing A. Kumar Ozan Irsoy Peter Ondruska Mohit Iyyer James Bradbury Ishaan Gulrajani Victor Zhong Romain Paulus R. Socher 108 1,179 0 24 Jun 2015
Deep Convolutional Networks on Graph-Structured Data Mikael Henaff Joan Bruna Yann LeCun GNN 150 1,586 0 16 Jun 2015
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 476 12,692 0 11 Dec 2014
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 217 6,772 0 03 Sep 2014
Spectral Networks and Locally Connected Networks on Graphs Joan Bruna Wojciech Zaremba Arthur Szlam Yann LeCun GNN 189 4,870 0 21 Dec 2013
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 196 8,507 0 22 Mar 2013
Sequence Transduction with Recurrent Neural Networks Alex Graves 171 1,866 0 14 Nov 2012
The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains D. Shuman S. K. Narang P. Frossard Antonio Ortega P. Vandergheynst 120 3,972 0 31 Oct 2012