A Survey of Transformers

8 June 2021

Tianyang Lin

Yuxin Wang

Xiangyang Liu

Xipeng Qiu

ViT

ArXiv PDF HTML

Papers citing "A Survey of Transformers"

50 / 347 papers shown

Title
NetSight: Graph Attention Based Traffic Forecasting in Computer Networks Jinming Xing Guoheng Sun Hui Sun Linchao Pan Shakir Mahmood Xuanhao Luo Muhammad Shahzad 28 0 0 11 May 2025
Natural Language Generation in Healthcare: A Review of Methods and Applications Mengxian Lyu Xiaohan Li Ziyi Chen Jinqian Pan Cheng Peng Sankalp Talankar Yonghui Wu LM&MA 44 0 0 07 May 2025
Retrieval Augmented Generation Evaluation for Health Documents Mario Ceresa Lorenzo Bertolini Valentin Comte Nicholas Spadaro Barbara Raffael ... Sergio Consoli Amalia Muñoz Piñeiro Alex Patak Maddalena Querci Tobias Wiesenthal RALM 3DV 39 0 1 07 May 2025
A Method for Handling Negative Similarities in Explainable Graph Spectral Clustering of Text Documents -- Extended Version Mieczysław A. Kłopotek Sławomir T. Wierzchoń B. Starosta Dariusz Czerski P. Borkowski 29 0 0 16 Apr 2025
Integrating Vision and Location with Transformers: A Multimodal Deep Learning Framework for Medical Wound Analysis Ramin Mousa Hadis Taherinia Khabiba Abdiyeva Amir Ali Bengari Mohammadmahdi Vahediahmar 32 1 0 14 Apr 2025
Vision-Language Model for Object Detection and Segmentation: A Review and Evaluation Yongchao Feng Yajie Liu Shuai Yang Wenrui Cai J. Zhang ... Jiahui Lv Z. Liu Tengyuan Shi Qingjie Liu Y. Wang MLLM VLM 63 1 0 13 Apr 2025
Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion Qisai Liu Zhanhong Jiang Joshua R. Waite Chao Liu Aditya Balu S. Sarkar AI4TS 24 0 0 11 Apr 2025
Genetic Programming with Reinforcement Learning Trained Transformer for Real-World Dynamic Scheduling Problems Xian Chen R. Qu Jing Dong Ruibin Bai Yaochu Jin OffRL 32 0 0 10 Apr 2025
Engineering Artificial Intelligence: Framework, Challenges, and Future Direction Jay Lee Hanqi Su Dai-Yan Ji Takanobu Minami AI4CE 48 0 0 03 Apr 2025
SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving Akshat Ghiya Ali AlShami Jugal Kalita 39 0 0 11 Mar 2025
Evaluating open-source Large Language Models for automated fact-checking Nicoló Fontana Francesco Corso Enrico Zuccolotto Francesco Pierri HILM 57 0 0 07 Mar 2025
Deep Causal Behavioral Policy Learning: Applications to Healthcare Jonas Knecht Anna Zink Jonathan Kolstad Maya Petersen CML 83 0 0 05 Mar 2025
Transformer-Based Power Optimization for Max-Min Fairness in Cell-Free Massive MIMO Irched Chafaa Giacomo Bacci Luca Sanguinetti 57 0 0 05 Mar 2025
CrystalFramer: Rethinking the Role of Frames for SE(3)-Invariant Crystal Structure Modeling Yusei Ito Tatsunori Taniai Ryo Igarashi Yoshitaka Ushiku K. Ono 60 0 0 04 Mar 2025
Attention Condensation via Sparsity Induced Regularized Training Eli Sason Darya Frolova Boris Nazarov Felix Goldberd 175 0 0 03 Mar 2025
Transformer Meets Twicing: Harnessing Unattended Residual Information Laziz U. Abdullaev Tan M. Nguyen 41 2 0 02 Mar 2025
ColorDynamic: Generalizable, Scalable, Real-time, End-to-end Local Planner for Unstructured and Dynamic Environments Jinghao Xin Zhichao Liang Zihuan Zhang Peng Wang Ning Li 62 0 0 27 Feb 2025
Revisiting Kernel Attention with Correlated Gaussian Process Representation Long Minh Bui Tho Tran Huu Duy-Tung Dinh T. Nguyen Trong Nghia Hoang 44 2 0 27 Feb 2025
Integrating Biological and Machine Intelligence: Attention Mechanisms in Brain-Computer Interfaces J. Wang Weishan Ye Jialin He Li Zhang G. Huang Zhuliang Yu Zhen Liang 75 0 0 26 Feb 2025
On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis Junyi Guan Abhijith Sharma Chong Tian Salem Lahlou AAML 49 1 0 18 Feb 2025
Personalizing Education through an Adaptive LMS with Integrated LLMs Kyle Spriggs Meng Cheng Lau Kalpdrum Passi AI4Ed 50 0 0 24 Jan 2025
Tracking UWB Devices Through Radio Frequency Fingerprinting Is Possible Thibaud Ardoin Niklas Pauli Benedikt Groß Mahsa Kholghi K. Reaz Gerhard Wunder 31 1 0 08 Jan 2025
Comprehensive Review of EEG-to-Output Research: Decoding Neural Signals into Images, Videos, and Audio Yashvir Sabharwal Balaji Rama 29 1 0 31 Dec 2024
Advances in Transformers for Robotic Applications: A Review Nikunj Sanghai Nik Bear Brown AI4CE 75 0 0 13 Dec 2024
A Decade of Deep Learning: A Survey on The Magnificent Seven Dilshod Azizov Muhammad Arslan Manzoor Velibor Bojkovic Yingxu Wang Z. Wang ... Liang Li Siwei Liu Yu Zhong Wei Liu Shangsong Liang OOD AI4TS MedIm 118 0 0 13 Dec 2024
Optimising TinyML with Quantization and Distillation of Transformer and Mamba Models for Indoor Localisation on Edge Devices Thanaphon Suwannaphong Ferdian Jovan I. Craddock Ryan McConville Mamba 68 1 0 12 Dec 2024
KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately predicting Drug-Drug Interaction Events from Drug SMILES and Biomedical Knowledge Graph Azwad Tamir Jiann-Shiun Yuan 68 0 0 08 Dec 2024
Joint Combinatorial Node Selection and Resource Allocations in the Lightning Network using Attention-based Reinforcement Learning Mahdi Salahshour Amirahmad Shafiee Mojtaba Tefagh 66 0 0 26 Nov 2024
Beyond adaptive gradient: Fast-Controlled Minibatch Algorithm for large-scale optimization Corrado Coppola Lorenzo Papa Irene Amerini L. Palagi ODL 73 0 0 24 Nov 2024
Bio-inspired AI: Integrating Biological Complexity into Artificial Intelligence Nima Dehghani Michael Levin 69 0 0 22 Nov 2024
UnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction Kehua Qu Rui Ding Jin Tang 3DH 31 0 0 06 Nov 2024
Relation Learning and Aggregate-attention for Multi-person Motion Prediction Kehua Qu Rui Ding Jin Tang 3DH 40 0 0 06 Nov 2024
The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare Souren Pashangpour Goldie Nejat LM&MA 42 7 0 05 Nov 2024
Silver medal Solution for Image Matching Challenge 2024 Yian Wang 3DV 3DPC 34 0 0 04 Nov 2024
Machine Learning Innovations in CPR: A Comprehensive Survey on Enhanced Resuscitation Techniques Saidul Islam Gaith Rjoub Hanae Elmekki Jamal Bentahar Witold Pedrycz R. Cohen 31 0 0 03 Nov 2024
Learning local discrete features in explainable-by-design convolutional neural networks Pantelis I. Kaplanoglou Konstantinos Diamantaras FAtt 44 1 0 31 Oct 2024
ProTransformer: Robustify Transformers via Plug-and-Play Paradigm Zhichao Hou Weizhi Gao Yuchen Shen Feiyi Wang Xiaorui Liu VLM 28 2 0 30 Oct 2024
A Temporal Linear Network for Time Series Forecasting Remi Genet Hugo Inzirillo AI4TS 24 3 0 28 Oct 2024
Deep Insights into Cognitive Decline: A Survey of Leveraging Non-Intrusive Modalities with Deep Learning Techniques David Ortiz-Perez Manuel Benavent-Lledo José García Rodríguez David Tomás M. Flores Vizcaya-Moreno 34 0 0 24 Oct 2024
Causality for Large Language Models Anpeng Wu Kun Kuang Minqin Zhu Yingrong Wang Yujia Zheng Kairong Han B. Li Guangyi Chen Fei Wu Kun Zhang LRM 46 7 0 20 Oct 2024
LLM-Rank: A Graph Theoretical Approach to Pruning Large Language Models David Hoffmann Kailash Budhathoki Matthaeus Kleindessner 32 0 0 17 Oct 2024
UMambaAdj: Advancing GTV Segmentation for Head and Neck Cancer in MRI-Guided RT with UMamba and nnU-Net ResEnc Planner Jintao Ren Kim Hochreuter Jesper Folsted Kallehauge Stine Korreman Mamba 24 1 0 16 Oct 2024
Cooperative and Asynchronous Transformer-based Mission Planning for Heterogeneous Teams of Mobile Robots Milad Farjadnasab Shahin Sirouspour 33 0 0 08 Oct 2024
Computational design of target-specific linear peptide binders with TransformerBeta Haowen Zhao Francesco A. Aprile Barbara Bravi 29 0 0 07 Oct 2024
Attention layers provably solve single-location regression P. Marion Raphael Berthier Gérard Biau Claire Boyer 122 2 0 02 Oct 2024
Analog In-Memory Computing Attention Mechanism for Fast and Energy-Efficient Large Language Models Nathan Leroux Paul-Philipp Manea Chirag Sudarshan Jan Finkbeiner Sebastian Siegel J. Strachan Emre Neftci 26 1 0 28 Sep 2024
Generative AI-driven forecasting of oil production Yash Gandhi Kexin Zheng Birendra Jha K. Nomura A. Nakano P. Vashishta R. Kalia 16 0 0 24 Sep 2024
Efficiently Dispatching Flash Attention For Partially Filled Attention Masks Agniv Sharma Jonas Geiping 24 0 0 23 Sep 2024
Sparse Low-Ranked Self-Attention Transformer for Remaining Useful Lifetime Prediction of Optical Fiber Amplifiers Dominic Schneider Lutz Rapp 27 0 0 22 Sep 2024
DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention Boxun Xu Hejia Geng Yuxuan Yin Peng Li AI4TS 26 0 0 20 Sep 2024