v1v2v3v4v5v6v7 (latest)

Knowledge Distillation: A Survey

9 June 2020

Papers citing "Knowledge Distillation: A Survey"

50 / 328 papers shown

Title
Dynamic Dual Buffer with Divide-and-Conquer Strategy for Online Continual Learning Congren Dai Huichi Zhou Jiahao Huang Zhenxuan Zhang Fanwen Wang Guang Yang Fei Ye 201 0 0 23 May 2025
VERDI: VLM-Embedded Reasoning for Autonomous Driving Bowen Feng Zhiting Mei Baiang Li Julian Ost Roger Girgis Anirudha Majumdar Felix Heide VLM LRM 225 0 0 21 May 2025
PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement ZhanFeng Feng Long Peng Xin Di Yong Guo Wenbo Li Yulun Zhang Renjing Pei Yang Wang Yang Cao Zheng-Jun Zha MQ 96 0 0 18 May 2025
MoL for LLMs: Dual-Loss Optimization to Enhance Domain Expertise While Preserving General Capabilities Jingxue Chen Qingkun Tang Qianchun Lu Siyuan Fang 83 0 0 17 May 2025
Model-Distributed Inference for Large Language Models at the Edge Davide Macario H. Seferoglu Erdem Koyuncu 45 0 0 13 May 2025
KDH-MLTC: Knowledge Distillation for Healthcare Multi-Label Text Classification Hajar Sakai Sarah Lam VLM 93 0 0 12 May 2025
A systematic review of challenges and proposed solutions in modeling multimodal data Maryam Farhadizadeh Maria Weymann Michael Blaß Johann Kraus Christopher Gundler Sebastian Walter Noah Hempen Harald Binde Nadine Binder 66 0 0 11 May 2025
Image Recognition with Online Lightweight Vision Transformer: A Survey Zherui Zhang Rongtao Xu Jie Zhou Changwei Wang Xingtian Pei ... Jiguang Zhang Li Guo Longxiang Gao Wenyuan Xu Shibiao Xu ViT 490 0 0 06 May 2025
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques Sanjay Surendranath Girija Shashank Kapoor Lakshit Arora Dipen Pradhan Aman Raj Ankit Shetgaonkar 128 0 0 05 May 2025
Efficient Multivariate Time Series Forecasting via Calibrated Language Models with Privileged Knowledge Distillation Chenxi Liu Hao Miao Qianxiong Xu Shaowen Zhou Cheng Long Yan Zhao Ziyue Li Rui Zhao AI4TS 144 7 0 04 May 2025
Pack-PTQ: Advancing Post-training Quantization of Neural Networks by Pack-wise Reconstruction Changjun Li Runqing Jiang Zhuo Song Pengpeng Yu Ye Zhang Yulan Guo MQ 114 0 0 01 May 2025
Aerial Image Classification in Scarce and Unconstrained Environments via Conformal Prediction Farhad Pourkamali-Anaraki 217 0 0 24 Apr 2025
HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation Tran Quoc Khanh Le Nguyen Lan Vi Vu Ha-Hieu Pham Xuan-Loc Huynh T. Nguyen Minh Huu Nhat Le Quan Nguyen Hien Nguyen 66 0 0 14 Apr 2025
Rethinking industrial artificial intelligence: a unified foundation framework Jay Lee Hanqi Su AI4CE 94 2 0 02 Apr 2025
Rolling Forward: Enhancing LightGCN with Causal Graph Convolution for Credit Bond Recommendation Ashraf Ghiye Baptiste Barreau Laurent Carlier Michalis Vazirgiannis 117 6 0 18 Mar 2025
Semantic-Supervised Spatial-Temporal Fusion for LiDAR-based 3D Object Detection Chaoqun Wang Xiaobin Hong Wenzhong Li Ruimao Zhang 3DPC 442 0 0 13 Mar 2025
Moss: Proxy Model-based Full-Weight Aggregation in Federated Learning with Heterogeneous Models Y. Cai Ziqi Zhang Ding Li Yao Guo Xiangqun Chen 159 0 0 13 Mar 2025
StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition Yanqing Shen Sanping Zhou Jingwen Fu Ke Xu Shitao Chen N. Zheng 207 0 0 09 Mar 2025
SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting Linqi Yang Xiongwei Zhao Qihao Sun Ke Wang Ao Chen Peng Kang 3DGS 127 6 0 07 Mar 2025
Multi-agent Auto-Bidding with Latent Graph Diffusion Models Dom Huh P. Mohapatra DiffM AI4CE 94 0 0 04 Mar 2025
CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation Zhenyi Shen Hanqi Yan Linhai Zhang Zhanghao Hu Yali Du Yulan He LRM 155 27 0 28 Feb 2025
Are Neuromorphic Architectures Inherently Privacy-preserving? An Exploratory Study Ayana Moshruba Ihsen Alouani Maryam Parsa AAML 119 3 0 24 Feb 2025
I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation Ayoub Karine Thibault Napoléon M. Jridi VLM 275 0 0 24 Feb 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 268 17 0 20 Feb 2025
External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation Mingfu Liang Xi Liu Rong Jin B. Liu Qiuling Suo ... Bo Long Wenlin Chen Rocky Liu Santanu Kolay Haoyang Li 83 2 0 20 Feb 2025
Towards Active Participant Centric Vertical Federated Learning: Some Representations May Be All You Need Jon Irureta Jon Imaz Aizea Lojo Javier Fernandez-Marques Marco González Iñigo Perona FedML 123 1 0 20 Feb 2025
PTQ1.61: Push the Real Limit of Extremely Low-Bit Post-Training Quantization Methods for Large Language Models Jiaqi Zhao Miao Zhang Ming Wang Yuzhang Shang Kaihao Zhang Weili Guan Yaowei Wang Min Zhang MQ 102 1 0 18 Feb 2025
Cross-Domain Continual Learning for Edge Intelligence in Wireless ISAC Networks Jingzhi Hu Xin Li Zhou Su Jun Luo 171 0 0 18 Feb 2025
Benchmarking Post-Training Quantization in LLMs: Comprehensive Taxonomy, Unified Evaluation, and Comparative Analysis Jiaqi Zhao Ming Wang Miao Zhang Yuzhang Shang Xuebo Liu Yaowei Wang Min Zhang Liqiang Nie MQ 169 2 0 18 Feb 2025
Forget the Data and Fine-Tuning! Just Fold the Network to Compress Dong Wang Haris Šikić Lothar Thiele O. Saukh 129 1 0 17 Feb 2025
Towards Reasoning Ability of Small Language Models Gaurav Srivastava Shuxiang Cao Xuan Wang ReLM LRM 128 11 0 17 Feb 2025
Foundation Model-Based Apple Ripeness and Size Estimation for Selective Harvesting Keyi Zhu Jiajia Li Kaixiang Zhang Chaaran Arunachalam Siddhartha Bhattacharya R. Lu Zhaojian Li 148 0 0 03 Feb 2025
Large Language Model Distilling Medication Recommendation Model Qidong Liu Xian Wu Xiangyu Zhao Yuanshao Zhu Zijian Zhang Feng Tian Yefeng Zheng LM&MA 125 20 0 28 Jan 2025
Channel-wise Parallelizable Spiking Neuron with Multiplication-free Dynamics and Large Temporal Receptive Fields Peng Xue Wei Fang Zhengyu Ma Zihan Huang Zhaokun Zhou Yonghong Tian T. Masquelier Huihui Zhou 151 1 0 24 Jan 2025
Unlearning Clients, Features and Samples in Vertical Federated Learning Ayush K. Varshney Konstantinos Vandikas V. Torra MU 75 1 0 23 Jan 2025
Elucidating the Design Space of Dataset Condensation Shitong Shao Zikai Zhou Huanran Chen Zhiqiang Shen DD 132 10 0 20 Jan 2025
Blockchain-assisted Demonstration Cloning for Multi-Agent Deep Reinforcement Learning Ahmed Alagha Jamal Bentahar Hadi Otrok Shakti Singh R. Mizouni 101 3 0 19 Jan 2025
Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation Han Zhang Yifei Yao Zixuan Wang Jiayuan Su Mengxuan Li Peng Peng Hongwei Wang CLL 143 0 0 16 Jan 2025
Incrementally Learning Multiple Diverse Data Domains via Multi-Source Dynamic Expansion Model RunQing Wu Fei Ye QiHe Liu Guoxi Huang Jinyu Guo Rongyao Hu CLL 416 0 0 15 Jan 2025
HAAQI-Net: A Non-intrusive Neural Music Audio Quality Assessment Model for Hearing Aids Dyah A. M. G. Wisnu Stefano Rini Ryandhimas E. Zezario Hsin-Min Wang Yu Tsao 134 0 0 10 Jan 2025
Enhancing Scene Classification in Cloudy Image Scenarios: A Collaborative Transfer Method with Information Regulation Mechanism using Optical Cloud-Covered and SAR Remote Sensing Images Yuze Wang Rong Xiao Haifeng Li Mariana Belgiu Chao Tao 88 0 0 08 Jan 2025
Sample Correlation for Fingerprinting Deep Face Recognition Jiyang Guan Jian Liang Yanbo Wang Ran He AAML 145 0 0 31 Dec 2024
Invariant debiasing learning for recommendation via biased imputation Ting Bai Weijie Chen Cheng Yang C. Shi 488 2 0 28 Dec 2024
Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes Aodi Li Liansheng Zhuang Xiao Long Minghong Yao Shafei Wang 483 1 0 18 Dec 2024
Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey Hong-Hanh Nguyen-Le Van-Tuan Tran Dinh-Thuc Nguyen Nhien-An Le-Khac AAML 168 2 0 26 Nov 2024
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective Zhangchi Zhu Wei Zhang 145 0 0 16 Nov 2024
Quantifying Knowledge Distillation Using Partial Information Decomposition Pasan Dissanayake Faisal Hamman Barproda Halder Ilia Sucholutsky Qiuyi Zhang Sanghamitra Dutta 79 1 0 12 Nov 2024
On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance Jaskirat Singh Bram Adams Ahmed E. Hassan VLM 108 0 0 01 Nov 2024
Future-Guided Learning: A Predictive Approach To Enhance Time-Series Forecasting Skye Gunasekaran Assel Kembay Hugo J. Ladret Rui-Jie Zhu Laurent Udo Perrinet Omid Kavehei Jason K. Eshraghian AI4TS 82 1 0 19 Oct 2024
Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both Abhijnan Nath Changsoo Jung Ethan Seefried Nikhil Krishnaswamy 464 4 0 11 Oct 2024