Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2009.14794
Cited By
Rethinking Attention with Performers
30 September 2020
K. Choromanski
Valerii Likhosherstov
David Dohan
Xingyou Song
Andreea Gane
Tamás Sarlós
Peter Hawkins
Jared Davis
Afroz Mohiuddin
Lukasz Kaiser
David Belanger
Lucy J. Colwell
Adrian Weller
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Rethinking Attention with Performers"
50 / 1,019 papers shown
Title
You Only Segment Once: Towards Real-Time Panoptic Segmentation
Jie Hu
Linyan Huang
Tianhe Ren
Shengchuan Zhang
Rongrong Ji
Liujuan Cao
SSeg
46
55
0
26 Mar 2023
Selective Structured State-Spaces for Long-Form Video Understanding
Jue Wang
Wenjie Zhu
Pichao Wang
Xiang Yu
Linda Liu
Mohamed Omar
Raffay Hamid
41
95
0
25 Mar 2023
3Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognition
Lei Wang
Piotr Koniusz
ViT
28
45
0
25 Mar 2023
Towards Accurate Post-Training Quantization for Vision Transformer
Yifu Ding
Haotong Qin
Qing-Yu Yan
Z. Chai
Junjie Liu
Xiaolin K. Wei
Xianglong Liu
MQ
54
69
0
25 Mar 2023
Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers
Cong Wei
Brendan Duke
R. Jiang
P. Aarabi
Graham W. Taylor
Florian Shkurti
ViT
46
14
0
24 Mar 2023
Top-Down Visual Attention from Analysis by Synthesis
Baifeng Shi
Trevor Darrell
Xin Eric Wang
25
29
0
23 Mar 2023
OcTr: Octree-based Transformer for 3D Object Detection
Chao Zhou
Yanan Zhang
Jiaxin Chen
Di Huang
3DPC
ViT
27
42
0
22 Mar 2023
Transformers in Speech Processing: A Survey
S. Latif
Aun Zaidi
Heriberto Cuayáhuitl
Fahad Shamshad
Moazzam Shoukat
Junaid Qadir
46
47
0
21 Mar 2023
Convolutions, Transformers, and their Ensembles for the Segmentation of Organs at Risk in Radiation Treatment of Cervical Cancer
Vangelis Kostoulas
Peter A. N. Bosman
Tanja Alderliesten
UQCV
28
1
0
20 Mar 2023
Effectively Modeling Time Series with Simple Discrete State Spaces
Michael Zhang
Khaled Kamal Saab
Michael Poli
Tri Dao
Karan Goel
Christopher Ré
AI4TS
30
45
0
16 Mar 2023
HYBRIDFORMER: improving SqueezeFormer with hybrid attention and NSR mechanism
Yuguang Yang
Yu Pan
Jingjing Yin
Jiangyu Han
Lei Ma
Heng Lu
31
8
0
15 Mar 2023
Rediscovery of CNN's Versatility for Text-based Encoding of Raw Electronic Health Records
Eunbyeol Cho
Min Jae Lee
Kyunghoon Hur
Jiyoun Kim
Jinsung Yoon
Edward Choi
19
0
0
15 Mar 2023
Exphormer: Sparse Transformers for Graphs
Hamed Shirzad
A. Velingker
B. Venkatachalam
Danica J. Sutherland
A. Sinop
11
99
0
10 Mar 2023
Efficient and Explicit Modelling of Image Hierarchies for Image Restoration
Yawei Li
Yuchen Fan
Xiaoyu Xiang
D. Demandolx
Rakesh Ranjan
Radu Timofte
Luc Van Gool
35
173
0
01 Mar 2023
Single-Cell Multimodal Prediction via Transformers
Wenzhuo Tang
Haifang Wen
Renming Liu
Jiayuan Ding
Wei Jin
Yuying Xie
Hui Liu
Jiliang Tang
AI4CE
24
11
0
01 Mar 2023
A Survey on Long Text Modeling with Transformers
Zican Dong
Tianyi Tang
Lunyi Li
Wayne Xin Zhao
VLM
26
54
0
28 Feb 2023
GNOT: A General Neural Operator Transformer for Operator Learning
Zhongkai Hao
Zhengyi Wang
Hang Su
Chengyang Ying
Yinpeng Dong
Songming Liu
Ze Cheng
Jian Song
Jun Zhu
AI4CE
19
165
0
28 Feb 2023
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
Rui-Jie Zhu
Qihang Zhao
Guoqi Li
Jason Eshraghian
BDL
VLM
31
84
0
27 Feb 2023
Vision-Language Generative Model for View-Specific Chest X-ray Generation
HyunGyung Lee
Dayun Lee
Wonjae Kim
Jin-Hwa Kim
Tackeun Kim
Jihang Kim
Leonard Sunwoo
Edward Choi
LM&MA
MedIm
24
7
0
23 Feb 2023
AttentionMixer: An Accurate and Interpretable Framework for Process Monitoring
Hao Wang
Zhiyu Wang
Yunlong Niu
Zhaoran Liu
Haozhe Li
Yilin Liao
Yuxin Huang
Xinggao Liu
28
0
0
21 Feb 2023
Neural Attention Memory
Hyoungwook Nam
S. Seo
HAI
27
0
0
18 Feb 2023
Efficiency 360: Efficient Vision Transformers
Badri N. Patro
Vijay Srinivas Agneeswaran
28
6
0
16 Feb 2023
A Unified View of Long-Sequence Models towards Modeling Million-Scale Dependencies
Hongyu Hè
Marko Kabić
30
2
0
13 Feb 2023
DNArch: Learning Convolutional Neural Architectures by Backpropagation
David W. Romero
Neil Zeghidour
AI4CE
27
4
0
10 Feb 2023
In-Context Learning with Many Demonstration Examples
Mukai Li
Shansan Gong
Jiangtao Feng
Yiheng Xu
Jinchao Zhang
Zhiyong Wu
Lingpeng Kong
40
31
0
09 Feb 2023
Generating a Structured Summary of Numerous Academic Papers: Dataset and Method
Shuaiqi Liu
Jiannong Cao
Ruosong Yang
Zhiyuan Wen
51
16
0
09 Feb 2023
Efficient Attention via Control Variates
Lin Zheng
Jianbo Yuan
Chong-Jun Wang
Lingpeng Kong
34
18
0
09 Feb 2023
Attending to Graph Transformers
Luis Muller
Mikhail Galkin
Christopher Morris
Ladislav Rampášek
52
86
0
08 Feb 2023
Long Text and Multi-Table Summarization: Dataset and Method
Shuaiqi Liu
Jiannong Cao
Ruosong Yang
Zhiyuan Wen
RALM
24
21
0
08 Feb 2023
Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation
Haifang Wen
Wenzhuo Tang
Wei Jin
Jiayuan Ding
Renming Liu
Xinnan Dai
Feng Shi
Lulu Shang
Jiliang Tang
Yuying Xie
29
9
0
06 Feb 2023
KDEformer: Accelerating Transformers via Kernel Density Estimation
A. Zandieh
Insu Han
Majid Daliri
Amin Karbasi
41
37
0
05 Feb 2023
Towards energy-efficient Deep Learning: An overview of energy-efficient approaches along the Deep Learning Lifecycle
Vanessa Mehlin
Sigurd Schacht
Carsten Lanquillon
HAI
MedIm
33
19
0
05 Feb 2023
TAP: The Attention Patch for Cross-Modal Knowledge Transfer from Unlabeled Modality
Yinsong Wang
Shahin Shahrampour
16
0
0
04 Feb 2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
K. Choromanski
Shanda Li
Valerii Likhosherstov
Kumar Avinava Dubey
Shengjie Luo
Di He
Yiming Yang
Tamás Sarlós
Thomas Weingarten
Adrian Weller
37
8
0
03 Feb 2023
Mnemosyne: Learning to Train Transformers with Transformers
Deepali Jain
K. Choromanski
Kumar Avinava Dubey
Sumeet Singh
Vikas Sindhwani
Tingnan Zhang
Jie Tan
OffRL
39
9
0
02 Feb 2023
Efficient Graph Field Integrators Meet Point Clouds
K. Choromanski
Arijit Sehanobish
Han Lin
Yunfan Zhao
Eli Berger
...
Kumar Avinava Dubey
Deepali Jain
Tamás Sarlós
Snigdha Chaturvedi
Adrian Weller
20
5
0
02 Feb 2023
Development of deep biological ages aware of morbidity and mortality based on unsupervised and semi-supervised deep learning approaches
Seong-Eun Moon
J. Yoon
Shinyoung Joo
Yoo-Jin Kim
J. Bae
Seokho Yoon
Haanju Yoo
Young Min Cho
24
1
0
01 Feb 2023
Transformers Meet Directed Graphs
Simon Geisler
Yujia Li
D. Mankowitz
A. Cemgil
Stephan Günnemann
Cosmin Paduraru
27
35
0
31 Jan 2023
Simplex Random Features
Isaac Reid
K. Choromanski
Valerii Likhosherstov
Adrian Weller
39
7
0
31 Jan 2023
Inference Time Evidences of Adversarial Attacks for Forensic on Transformers
Hugo Lemarchant
Liang Li
Yiming Qian
Yuta Nakashima
Hajime Nagahara
ViT
AAML
43
0
0
31 Jan 2023
Continuous Spatiotemporal Transformers
Antonio H. O. Fonseca
E. Zappala
J. O. Caro
David van Dijk
26
7
0
31 Jan 2023
Alternating Updates for Efficient Transformers
Cenk Baykal
D. Cutler
Nishanth Dikkala
Nikhil Ghosh
Rina Panigrahy
Xin Wang
MoE
48
5
0
30 Jan 2023
Exploring Attention Map Reuse for Efficient Transformer Neural Networks
Kyuhong Shim
Jungwook Choi
Wonyong Sung
ViT
26
3
0
29 Jan 2023
On the Connection Between MPNN and Graph Transformer
Chen Cai
Truong-Son Hy
Rose Yu
Yusu Wang
44
52
0
27 Jan 2023
Open Problems in Applied Deep Learning
M. Raissi
AI4CE
42
2
0
26 Jan 2023
DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion
Qitian Wu
Chenxiao Yang
Wen-Long Zhao
Yixuan He
David Wipf
Junchi Yan
DiffM
32
83
0
23 Jan 2023
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
Haoxin Li
Phillip Keung
Daniel Cheng
Jungo Kasai
Noah A. Smith
25
3
0
11 Jan 2023
Dynamic Grained Encoder for Vision Transformers
Lin Song
Songyang Zhang
Songtao Liu
Zeming Li
Xuming He
Hongbin Sun
Jian Sun
Nanning Zheng
ViT
26
34
0
10 Jan 2023
Rethinking Mobile Block for Efficient Attention-based Models
Jiangning Zhang
Xiangtai Li
Jian Li
Liang Liu
Zhucun Xue
Boshen Zhang
Zhe Jiang
Tianxin Huang
Yabiao Wang
Chengjie Wang
MQ
44
91
0
03 Jan 2023
Black-box language model explanation by context length probing
Ondřej Cífka
Antoine Liutkus
MILM
LRM
24
6
0
30 Dec 2022
Previous
1
2
3
...
10
11
12
...
19
20
21
Next