A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks

11 June 2023

Witold Pedrycz

Papers citing "A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks"

31 / 31 papers shown

Title
Leveraging Natural Language Processing to Unravel the Mystery of Life: A Review of NLP Approaches in Genomics, Transcriptomics, and Proteomics Ella Rannon David Burstein AI4TS 29 0 0 02 Jun 2025
SUS backprop: linear backpropagation algorithm for long inputs in transformers Sergey Pankov Georges Harik 112 0 0 21 May 2025
DynaNoise: Dynamic Probabilistic Noise Injection for Defending Against Membership Inference Attacks Javad Forough Hamed Haddadi AAML 92 0 0 19 May 2025
Natural Language Generation in Healthcare: A Review of Methods and Applications Mengxian Lyu Xiaohan Li Ziyi Chen Jinqian Pan Cheng Peng Sankalp Talankar Yonghui Wu LM&MA 96 0 0 07 May 2025
Transformer-Empowered Actor-Critic Reinforcement Learning for Sequence-Aware Service Function Chain Partitioning Cyril Shih-Huan Hsu Anestis Dalgkitsis Chrysa Papagianni Paola Grosso 98 0 0 26 Apr 2025
Towards Assessing Deep Learning Test Input Generators Seif Mzoughi Ahmed Hajyahmed Mohamed Elshafei Foutse Khomh anb Diego Elias Costa D. Costa AAML 94 0 0 03 Apr 2025
Shape Modeling of Longitudinal Medical Images: From Diffeomorphic Metric Mapping to Deep Learning Edwin Tay Nazli Tümer Amir A. Zadpoor MedIm 264 0 0 27 Mar 2025
On the Limits of Applying Graph Transformers for Brain Connectome Classification Jose Lara-Rangel Clare Heinbaugh 101 0 0 20 Mar 2025
Deep Causal Behavioral Policy Learning: Applications to Healthcare Jonas Knecht Anna Zink Jonathan Kolstad Maya Petersen CML 121 0 0 05 Mar 2025
Integrating Biological and Machine Intelligence: Attention Mechanisms in Brain-Computer Interfaces Jing Wang Weishan Ye Jialin He Li Zhang G. Huang Zhuliang Yu Zhen Liang 112 0 0 26 Feb 2025
ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognition Muhammad Waseem Akram Stefano Dettori V. Colla Giorgio Buttazzo 90 0 0 17 Feb 2025
A Hybrid Swarm Intelligence Approach for Optimizing Multimodal Large Language Models Deployment in Edge-Cloud-based Federated Learning Environments Gaith Rjouba Hanae Elmekki Saidul Islam Jamal Bentahar Rachida Dssouli 96 1 0 04 Feb 2025
Automatic selection of the best neural architecture for time series forecasting via multi-objective optimization and Pareto optimality conditions Qianying Cao Shanqing Liu Alan John Varghese Jérome Darbon M. Triantafyllou George Karniadakis AI4TS 509 0 0 21 Jan 2025
Advances in Transformers for Robotic Applications: A Review Nikunj Sanghai Nik Bear Brown AI4CE 148 0 0 13 Dec 2024
Text Generation Models for Luxembourgish with Limited Data: A Balanced Multilingual Strategy Alistair Plum Tharindu Ranasinghe Christoph Purschke 126 3 0 12 Dec 2024
One-Stage-TFS: Thai One-Stage Fingerspelling Dataset for Fingerspelling Recognition Frameworks Siriwiwat Lata Sirawan Phiphitphatphaisit Emmanuel Okafor Olarik Surinta 122 0 0 05 Nov 2024
Machine Learning Innovations in CPR: A Comprehensive Survey on Enhanced Resuscitation Techniques Saidul Islam Gaith Rjoub Hanae Elmekki Jamal Bentahar Witold Pedrycz R. Cohen 92 0 0 03 Nov 2024
Performance Evaluation of Tokenizers in Large Language Models for the Assamese Language Sagar Tamang Dibya Jyoti Bora 66 4 0 28 Sep 2024
Macformer: Transformer with Random Maclaurin Feature Attention Yuhan Guo Lizhong Ding Ye Yuan Guoren Wang 122 0 0 21 Aug 2024
Optimizing Vision Transformers with Data-Free Knowledge Transfer Gousia Habib Damandeep Singh I. Malik Brejesh Lall 70 1 0 12 Aug 2024
Classification, Regression and Segmentation directly from k-Space in Cardiac MRI Ruochen Li Jiazhen Pan Youxiang Zhu Juncheng Ni Daniel Rueckert 71 2 0 29 Jul 2024
Survey and Taxonomy: The Role of Data-Centric AI in Transformer-Based Time Series Forecasting Jingjing Xu Caesar Wu Yuan-Fang Li Grégoire Danoy Pascal Bouvry AI4TS 109 1 0 29 Jul 2024
Attention as an RNN Leo Feng Frederick Tung Hossein Hajimirsadeghi Mohamed Osama Ahmed Yoshua Bengio Greg Mori GNN AI4TS 98 8 0 22 May 2024
Your Transformer is Secretly Linear Anton Razzhigaev Matvey Mikhalchuk Elizaveta Goncharova Nikolai Gerasimenko Ivan Oseledets Denis Dimitrov Andrey Kuznetsov 81 6 0 19 May 2024
PagPassGPT: Pattern Guided Password Guessing via Generative Pretrained Transformer Xingyu Su Xiaojie Zhu Yang Li Yong Li Chi Chen Paulo Esteves-Verissimo 91 3 0 07 Apr 2024
Enhancing IoT Intelligence: A Transformer-based Reinforcement Learning Methodology Gaith Rjoub Saidul Islam Jamal Bentahar M. Almaiah Rana Alrawashdeh OffRL 76 1 0 05 Apr 2024
FViT: A Focal Vision Transformer with Gabor Filter Yulong Shi Mingwei Sun Yongshuai Wang Rui Wang 153 4 0 17 Feb 2024
Model Compression and Efficient Inference for Large Language Models: A Survey Wenxiao Wang Wei Chen Yicong Luo Yongliu Long Zhengkai Lin Liye Zhang Binbin Lin Deng Cai Xiaofei He MQ 116 58 0 15 Feb 2024
The last Dance : Robust backdoor attack via diffusion models and bayesian approach Orson Mengara DiffM 97 4 0 05 Feb 2024
Adaptive Point Transformer Alessandro Baiocchi Indro Spinelli Alessandro Nicolosi Simone Scardapane 63 0 0 26 Jan 2024
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders Andy T. Liu Shu-Wen Yang Po-Han Chi Po-Chun Hsu Hung-yi Lee SSL 163 374 0 25 Oct 2019