Integration of TinyML and LargeML: A Survey of 6G and Beyond

20 May 2025

Papers citing "Integration of TinyML and LargeML: A Survey of 6G and Beyond"

45 / 45 papers shown

Title
PGAD: Prototype-Guided Adaptive Distillation for Multi-Modal Learning in AD Diagnosis Yanfei Li Teng Yin Wenyi Shang Jing Liu Xi Wang Kaiyang Zhao MedIm 72 1 0 05 Mar 2025
Towards Zero Touch Networks: Cross-Layer Automated Security Solutions for 6G Wireless Networks Li Yang Shimaa A. Naser Abdallah Shami Sami Muhaidat Lyndon Ong Merouane Debbah 82 2 0 28 Feb 2025
Encrypted Large Model Inference: The Equivariant Encryption Paradigm James Buban Hongyang Zhang Claudio Angione Harry Yang Ahmad Farhan ... Ziyi Wang Yue Zhao Arria Owlia Fielding Johnston Patrick Colangelo FedML BDL 78 3 0 03 Feb 2025
Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices Kilian Pfeiffer Mohamed Aboelenien Ahmed R. Khalili J. Henkel 61 1 0 12 Nov 2024
MAPO: Boosting Large Language Model Performance with Model-Adaptive Prompt Optimization Yuyan Chen Zhihao Wen Ge Fan Zhengyu Chen Wei Wu Dayiheng Liu Zhixu Li Bang Liu Yanghua Xiao 77 19 0 04 Jul 2024
Tiny Machine Learning: Progress and Futures Ji Lin Ligeng Zhu Wei-Ming Chen Wei-Chen Wang Song Han 74 55 0 28 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 233 395 0 21 Mar 2024
AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networks Zhengyi Lin Guanqiao Qu Wei Wei Xianhao Chen Kin K. Leung 97 51 0 19 Mar 2024
Adaptive Split Learning over Energy-Constrained Wireless Edge Networks Zuguang Li Wen Wu Shaohua Wu Wei Wang 69 2 0 08 Mar 2024
ESFL: Efficient Split Federated Learning over Resource-Constrained Heterogeneous Wireless Devices Guangyu Zhu Yiqin Deng Xianhao Chen Haixia Zhang Yuguang Fang Tan F. Wong FedML 49 8 0 24 Feb 2024
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models Yae Jee Cho Luyang Liu Zheng Xu Aldi Fahrezi Gauri Joshi 60 65 0 12 Jan 2024
Understanding LLMs: A Comprehensive Overview from Training to Inference Yi-Hsueh Liu Haoyang He Tianle Han Xu-Yao Zhang Mengyuan Liu ... Xintao Hu Tuo Zhang Ning Qiang Tianming Liu Bao Ge SyDa 123 73 0 04 Jan 2024
When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions Weiming Zhuang Chen Chen Lingjuan Lyu Chong Chen Yaochu Jin Lingjuan Lyu AIFin AI4CE 175 96 0 27 Jun 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 158 25 0 19 Jun 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 63 45 0 10 Mar 2023
Federated Learning and Meta Learning: Approaches, Applications, and Directions Xiaonan Liu Yansha Deng Arumugam Nallanathan M. Bennis 116 38 0 24 Oct 2022
A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image Classification Babak Rokh A. Azarpeyvand Alireza Khanteymoori MQ 77 98 0 14 May 2022
Intelligence at the Extreme Edge: A Survey on Reformable TinyML Visal Rajapakse Ishan Karunanayake Nadeem Ahmed SyDa 75 56 0 02 Apr 2022
Examining Scaling and Transfer of Language Model Architectures for Machine Translation Biao Zhang Behrooz Ghorbani Ankur Bapna Yong Cheng Xavier Garcia Jonathan Shen Orhan Firat 61 23 0 01 Feb 2022
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts Nan Du Yanping Huang Andrew M. Dai Simon Tong Dmitry Lepikhin ... Kun Zhang Quoc V. Le Yonghui Wu Zhiwen Chen Claire Cui ALM MoE 216 819 0 13 Dec 2021
Applications of Explainable AI for 6G: Technical Aspects, Use Cases, and Research Challenges Shen Wang M. Qureshi Luis Miralles-Pechuán Thien Huynh-The Thippa Reddy Gadekallu Madhusanka Liyanage 58 24 0 09 Dec 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 156 1,080 0 01 Nov 2021
Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu Karan Goel Christopher Ré 215 1,814 0 31 Oct 2021
Splitfed learning without client-side synchronization: Analyzing client-side split network portion size to overall performance Praveen Joshi Chandra Thapa S. Çamtepe M. Hasanuzzamana T. Scully Haithem Afli FedML 86 25 0 19 Sep 2021
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting Xiang Chen Lei Li Shumin Deng Chuanqi Tan Changliang Xu Fei Huang Luo Si Huajun Chen Ningyu Zhang VLM 93 71 0 31 Aug 2021
Security and privacy for 6G: A survey on prospective technologies and challenges V. Nguyen Po-Ching Lin Bo-Chao Cheng Ren-Hung Hwang Ying-Dar Lin AILaw 52 293 0 26 Aug 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 477 10,367 0 17 Jun 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning Zhuangdi Zhu Junyuan Hong Jiayu Zhou FedML 80 659 0 20 May 2021
Wireless Federated Learning (WFL) for 6G Networks -- Part I: Research Challenges and Future Trends Pavlos S. Bouzinis P. Diamantoulakis G. Karagiannidis 59 50 0 24 Apr 2021
Advancements of federated learning towards privacy preservation: from federated learning to split learning Chandra Thapa Pathum Chamikara Mahawaga Arachchige S. Çamtepe FedML 62 87 0 25 Nov 2020
TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems R. David Jared Duke Advait Jain Vijay Janapa Reddi Nat Jeffries ... Meghna Natraj Shlomi Regev Rocky Rhodes Tiezhen Wang Pete Warden 237 481 0 17 Oct 2020
A Survey on Large-scale Machine Learning Meng Wang Weijie Fu Xiangnan He Shijie Hao Xindong Wu 63 112 0 10 Aug 2020
SplitFed: When Federated Learning Meets Split Learning Chandra Thapa Pathum Chamikara Mahawaga Arachchige S. Çamtepe Lichao Sun FedML 90 581 0 25 Apr 2020
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare Yiqiang Chen Jindong Wang Chaohui Yu Wen Gao Xin Qin FedML 77 718 0 22 Jul 2019
Learning What and Where to Transfer Yunhun Jang Hankook Lee Sung Ju Hwang Jinwoo Shin 68 150 0 15 May 2019
Split learning for health: Distributed deep learning without sharing raw patient data Praneeth Vepakomma O. Gupta Tristan Swedish Ramesh Raskar FedML 118 707 0 03 Dec 2018
Artificial Intelligence Enabled Software Defined Networking: A Comprehensive Overview Majd Latah Levent Toker AI4CE 49 101 0 19 Mar 2018
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 194 1,278 0 05 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 722 132,199 0 12 Jun 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,937 0 09 Mar 2017
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 266 4,152 0 18 Oct 2016
Deep CORAL: Correlation Alignment for Deep Domain Adaptation Baochen Sun Kate Saenko OOD 105 3,161 0 06 Jul 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 406 17,486 0 17 Feb 2016
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,328 0 11 Feb 2015
Domain Adaptive Neural Networks for Object Recognition Muhammad Ghifary W. Kleijn Mengjie Zhang OOD 106 420 0 21 Sep 2014