Title
Multimodal Learning with Transformers: A Survey Peng Xu Xiatian Zhu David Clifton ViT 213 569 0 13 Jun 2022
High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Jeffrey Tsaw Yudong Liu Shentong Mo Dani Yogatama Louis-Philippe Morency Ruslan Salakhutdinov 82 32 0 02 Mar 2022
Graph-Guided Network for Irregularly Sampled Multivariate Time Series Xiang Zhang M. Zeman Theodoros Tsiligkaridis Marinka Zitnik MLAU AI4TS 92 113 0 11 Oct 2021
Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records Yikuan Li M. Mamouei G. Salimi-Khorshidi Shishir Rao A. Hassaine D. Canoy Thomas Lukasiewicz K. Rahimi 90 81 0 21 Jun 2021
Position Information in Transformers: An Overview Philipp Dufter Martin Schmitt Hinrich Schütze 93 148 0 22 Feb 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 582 2,105 0 28 Jul 2020
Dynamic Predictions of Postoperative Complications from Explainable, Uncertainty-Aware, and Multi-Task Deep Neural Networks B. Shickel Tyler J. Loftus M. Ruppert Gilbert R. Upchurch T. Ozrazgat-Baslanti Parisa Rashidi A. Bihorac UQCV AI4CE 29 17 0 27 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 187 4,105 0 10 Apr 2020
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu Dhruv Batra Devi Parikh Stefan Lee SSL VLM 261 3,699 0 06 Aug 2019
BEHRT: Transformer for Electronic Health Records Yikuan Li Shishir Rao J. R. A. Solares A. Hassaine D. Canoy Yajie Zhu K. Rahimi G. Salimi-Khorshidi OOD 117 465 0 22 Jul 2019
Time2Vec: Learning a Vector Representation of Time Seyed Mehran Kazemi Rishab Goel Sepehr Eghbali J. Ramanan Jaspreet Sahota Sanjay Thakur Stella Wu Cathal Smyth Pascal Poupart Marcus A. Brubaker AI4TS 82 349 0 11 Jul 2019
1D Convolutional Neural Networks and Applications: A Survey S. Kiranyaz Onur Avcı Osama Abdeljaber T. Ince Moncef Gabbouj D. Inman 3DV 90 1,943 0 09 May 2019
Self-Attention with Relative Position Representations Peter Shaw Jakob Uszkoreit Ashish Vaswani 190 2,304 0 06 Mar 2018
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 610 12,760 0 11 Dec 2014