Where to Pay Attention in Sparse Training for Feature Selection?

26 November 2022

Ghada Sokar

Zahra Atashgahi

Mykola Pechenizkiy

Decebal Constantin Mocanu

ArXiv PDF HTML

Papers citing "Where to Pay Attention in Sparse Training for Feature Selection?"

23 / 23 papers shown

Title
E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation Boqian Wu Q. Xiao Shiwei Liu Lu Yin Mykola Pechenizkiy Decebal Constantin Mocanu M. V. Keulen Elena Mocanu MedIm 114 5 0 20 Feb 2025
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness Boqian Wu Q. Xiao Shunxin Wang N. Strisciuglio Mykola Pechenizkiy M. V. Keulen Decebal Constantin Mocanu Elena Mocanu OOD 3DH 179 3 0 03 Oct 2024
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 56 93 0 26 Oct 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu OOD 51 52 0 28 Jun 2021
Dynamic Sparse Training for Deep Reinforcement Learning Ghada Sokar Elena Mocanu Decebal Constantin Mocanu Mykola Pechenizkiy Peter Stone 62 57 0 08 Jun 2021
Top-KAST: Top-K Always Sparse Training Siddhant M. Jayakumar Razvan Pascanu Jack W. Rae Simon Osindero Erich Elsen 138 97 0 07 Jun 2021
Sparse Training Theory for Scalable and Efficient Agents Decebal Constantin Mocanu Elena Mocanu T. Pinto Selima Curci Phuong H. Nguyen M. Gibescu D. Ernst Z. Vale 62 17 0 02 Mar 2021
Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch Aojun Zhou Yukun Ma Junnan Zhu Jianbo Liu Zhijie Zhang Kun Yuan Wenxiu Sun Hongsheng Li 196 247 0 08 Feb 2021
Truly Sparse Neural Networks at Scale Selima Curci Decebal Constantin Mocanu Mykola Pechenizkiy 92 21 0 02 Feb 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 309 717 0 31 Jan 2021
The Hardware Lottery Sara Hooker 63 211 0 14 Sep 2020
SpaceNet: Make Free Space For Continual Learning Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 53 80 0 15 Jul 2020
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 184 600 0 25 Nov 2019
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 276 8,878 0 25 Aug 2017
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 170 629 0 15 Jul 2017
FMA: A Dataset For Music Analysis M. Defferrard Kirell Benzi P. Vandergheynst Xavier Bresson 106 440 0 06 Dec 2016
Survey on Feature Selection T. Abdallah B. Iglesia 92 232 0 10 Oct 2015
Feature selection with test cost constraint Fan Min Q. Hu William Zhu 381 161 0 25 Sep 2012
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 253 12,431 0 24 Jun 2012
Multi-Task Feature Learning Via Efficient l2,1-Norm Minimization Jun Liu Shuiwang Ji Jieping Ye 157 732 0 09 May 2012
Generalized Fisher Score for Feature Selection Quanquan Gu Z. Li Jiawei Han 66 761 0 14 Feb 2012
High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso M. Yamada Wittawat Jitkrittum Leonid Sigal Eric Xing Masashi Sugiyama 192 300 0 02 Feb 2012
Feature Hashing for Large Scale Multitask Learning Kilian Q. Weinberger A. Dasgupta Josh Attenberg John Langford Alex Smola 116 1,023 0 12 Feb 2009