Predictive Exit: Prediction of Fine-Grained Early Exits for Computation-
and Energy-Efficient Inference

v1v2 (latest)

Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inference

9 June 2022

Yingtao Shen

ArXiv (abs)PDF HTML

Papers citing "Predictive Exit: Prediction of Fine-Grained Early Exits for Computation- and Energy-Efficient Inference"

5 / 5 papers shown

Title
Onboard Optimization and Learning: A Survey Monirul Islam Pavel Siyi Hu Mahardhika Pratama Ryszard Kowalczyk 70 0 0 07 May 2025
HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Serving Avinash Kumar Shashank Nag Jason Clemons L. John Poulami Das 109 0 0 14 Apr 2025
AgroLLM: Connecting Farmers and Agricultural Practices through Large Language Models for Enhanced Knowledge Transfer and Practical Application Dinesh Jackson Samuel Inna Skarga-Bandurova David Sikolia Muhammad Awais 82 0 0 28 Feb 2025
M2R2: Mixture of Multi-Rate Residuals for Efficient Transformer Inference Nikhil Bhendawade Mahyar Najibi Devang Naik Irina Belousova MoE 134 0 0 04 Feb 2025
HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling Halima Bouzidi Mohanad Odema Hamza Ouarnoughi Mohammad Abdullah Al Faruque Smail Niar 82 19 0 06 Dec 2022