Not All Samples Are Created Equal: Deep Learning with Importance Sampling

2 March 2018

Papers citing "Not All Samples Are Created Equal: Deep Learning with Importance Sampling"

50 / 106 papers shown

Title
Efficient NLP Model Finetuning via Multistage Data Filtering Ouyang Xu S. Ansari F. Lin Yangfeng Ji 40 2 0 28 Jul 2022
Rank-based Decomposable Losses in Machine Learning: A Survey Shu Hu Xin Wang Siwei Lyu 40 32 0 18 Jul 2022
Knowledge Condensation Distillation Chenxin Li Mingbao Lin Zhiyuan Ding Nie Lin Yihong Zhuang Yue Huang Xinghao Ding Liujuan Cao 42 28 0 12 Jul 2022
Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt Sören Mindermann J. Brauner Muhammed Razzak Mrinank Sharma Andreas Kirsch ... Benedikt Höltgen Aidan Gomez Adrien Morisot Sebastian Farquhar Y. Gal 64 150 0 14 Jun 2022
The Environmental Discontinuity Hypothesis for Down-Sampled Lexicase Selection Ryan Boldi Thomas Helmuth Lee Spector 35 5 0 31 May 2022
DELTA: Diverse Client Sampling for Fasting Federated Learning Lung-Chuang Wang Yongxin Guo Tao R. Lin Xiaoying Tang FedML 23 23 0 27 May 2022
The Effect of Task Ordering in Continual Learning Samuel J. Bell Neil D. Lawrence CLL 48 17 0 26 May 2022
Data Distributional Properties Drive Emergent In-Context Learning in Transformers Stephanie C. Y. Chan Adam Santoro Andrew Kyle Lampinen Jane X. Wang Aaditya K. Singh Pierre Harvey Richemond J. Mcclelland Felix Hill 79 247 0 22 Apr 2022
The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalization Zeyi Huang Haohan Wang Dong Huang Yong Jae Lee Eric P. Xing 21 22 0 09 Apr 2022
Less is More: Proxy Datasets in NAS approaches Brian B. Moser Federico Raue Jörn Hees Andreas Dengel DD 24 6 0 14 Mar 2022
Tricks and Plugins to GBM on Images and Sequences Biyi Fang J. Utke Diego Klabjan 30 0 0 01 Mar 2022
A Unified Prediction Framework for Signal Maps Emmanouil Alimpertis A. Markopoulou C. Butts Evita Bakopoulou Konstantinos Psounis 23 3 0 08 Feb 2022
Characterizing & Finding Good Data Orderings for Fast Convergence of Sequential Gradient Methods Amirkeivan Mohtashami Sebastian U. Stich Martin Jaggi 26 13 0 03 Feb 2022
FedBalancer: Data and Pace Control for Efficient Federated Learning on Heterogeneous Clients Jaemin Shin Yuanchun Li Yunxin Liu Sung-Ju Lee FedML 17 74 0 05 Jan 2022
$$\ell_\infty$-Robustness and Beyond: Unleashing Efficient Adversarial Training$ $\ell_\infty$ -Robustness and Beyond: Unleashing Efficient Adversarial Training H. M. Dolatabadi S. Erfani C. Leckie OOD AAML 24 11 0 01 Dec 2021
The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning Raed Al Kontar Naichen Shi Xubo Yue Seokhyun Chung E. Byon ... Chinedum Okwudire Garvesh Raskutti R. Saigal Karandeep Singh Ye Zhisheng FedML 49 51 0 09 Nov 2021
Adaptive Importance Sampling meets Mirror Descent: a Bias-variance tradeoff Anna Korba Franccois Portier 31 12 0 29 Oct 2021
Chaos as an interpretable benchmark for forecasting and data-driven modelling W. Gilpin AI4TS 27 76 0 11 Oct 2021
Which Samples Should be Learned First: Easy or Hard? Xiaoling Zhou Ou Wu 29 17 0 11 Oct 2021
Observations on K-image Expansion of Image-Mixing Augmentation for Classification Joonhyun Jeong Sungmin Cha Jongwon Choi Sangdoo Yun Taesup Moon Y. Yoo VLM 23 6 0 08 Oct 2021
Large Batch Experience Replay Thibault Lahire M. Geist Emmanuel Rachelson OffRL 56 13 0 04 Oct 2021
BulletTrain: Accelerating Robust Neural Network Training via Boundary Example Mining Weizhe Hua Yichi Zhang Chuan Guo Zhiru Zhang G. E. Suh OOD 39 15 0 29 Sep 2021
Improved Soft Actor-Critic: Mixing Prioritized Off-Policy Samples with On-Policy Experience C. Banerjee Zhiyong Chen N. Noman 19 30 0 24 Sep 2021
ALLWAS: Active Learning on Language models in WASserstein space Anson Bastos Manohar Kaul MedIm 26 1 0 03 Sep 2021
Aggregation Delayed Federated Learning Ye Xue Diego Klabjan Yuan Luo FedML OOD 28 5 0 17 Aug 2021
Unified Regularity Measures for Sample-wise Learning and Generalization Chi Zhang Xiaoning Ma Yu Liu Le Wang Yuanqi Su Yuehu Liu 39 1 0 09 Aug 2021
Taxonomy of Machine Learning Safety: A Survey and Primer Sina Mohseni Haotao Wang Zhiding Yu Chaowei Xiao Zhangyang Wang J. Yadawa 26 31 0 09 Jun 2021
Efficient Lottery Ticket Finding: Less Data is More Zhenyu Zhang Xuxi Chen Tianlong Chen Zhangyang Wang 19 54 0 06 Jun 2021
One Backward from Ten Forward, Subsampling for Large-Scale Deep Learning Chaosheng Dong Xiaojie Jin Weihao Gao Yijia Wang Hongyi Zhang Xiang Wu Jianchao Yang Xiaobing Liu 28 5 0 27 Apr 2021
Efficient training of physics-informed neural networks via importance sampling M. A. Nabian R. J. Gladstone Hadi Meidani DiffM PINN 71 223 0 26 Apr 2021
Reweighting Augmented Samples by Minimizing the Maximal Expected Loss Mingyang Yi Lu Hou Lifeng Shang Xin Jiang Qun Liu Zhi-Ming Ma 12 19 0 16 Mar 2021
Estimating informativeness of samples with Smooth Unique Information Hrayr Harutyunyan Alessandro Achille Giovanni Paolini Orchid Majumder Avinash Ravichandran Rahul Bhotika Stefano Soatto 27 24 0 17 Jan 2021
Learning to Automate Chart Layout Configurations Using Crowdsourced Paired Comparison Aoyu Wu Liwenhan Xie Bongshin Lee Yun Wang Weiwei Cui Huamin Qu 46 33 0 11 Jan 2021
Computation-Efficient Knowledge Distillation via Uncertainty-Aware Mixup Guodong Xu Ziwei Liu Chen Change Loy UQCV 21 39 0 17 Dec 2020
FairBatch: Batch Selection for Model Fairness Yuji Roh Kangwook Lee Steven Euijong Whang Changho Suh VLM 14 128 0 03 Dec 2020
Temporal Stochastic Softmax for 3D CNNs: An Application in Facial Expression Recognition T. Ayral M. Pedersoli Simon L Bacon Eric Granger CVBM 3DH 13 11 0 10 Nov 2020
Optimal Client Sampling for Federated Learning Wenlin Chen Samuel Horváth Peter Richtárik FedML 42 192 0 26 Oct 2020
Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies Yae Jee Cho Jianyu Wang Gauri Joshi FedML 47 401 0 03 Oct 2020
Impact of base dataset design on few-shot image classification Othman Sbai Camille Couprie Mathieu Aubry VLM 20 22 0 17 Jul 2020
Adaptive Task Sampling for Meta-Learning Chenghao Liu Zhihao Wang Doyen Sahoo Yuan Fang Kun Zhang Guosheng Lin 30 54 0 17 Jul 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 22 1,181 0 01 Jul 2020
Suggestive Annotation of Brain Tumour Images with Gradient-guided Sampling Chengliang Dai Shuo Wang Yuanhan Mo Kaichen Zhou Elsa D. Angelini Yike Guo Wenjia Bai MedIm 27 33 0 26 Jun 2020
Multi-Precision Policy Enforced Training (MuPPET): A precision-switching strategy for quantised fixed-point training of CNNs A. Rajagopal D. A. Vink Stylianos I. Venieris C. Bouganis MQ 16 14 0 16 Jun 2020
ResKD: Residual-Guided Knowledge Distillation Xuewei Li Songyuan Li Bourahla Omar Fei Wu Xi Li 21 47 0 08 Jun 2020
Adaptive Sampling Distributed Stochastic Variance Reduced Gradient for Heterogeneous Distributed Datasets Ilqar Ramazanli Han Nguyen Hai Pham Sashank J. Reddi Barnabás Póczós 23 11 0 20 Feb 2020
Angular Visual Hardness Beidi Chen Weiyang Liu Zhiding Yu Jan Kautz Anshumali Shrivastava Animesh Garg Anima Anandkumar AAML 43 51 0 04 Dec 2019
Carpe Diem, Seize the Samples Uncertain "At the Moment" for Adaptive Batch Selection Hwanjun Song Minseok Kim Sundong Kim Jae-Gil Lee 27 15 0 19 Nov 2019
Dice Loss for Data-imbalanced NLP Tasks Xiaoya Li Xiaofei Sun Yuxian Meng Junjun Liang Fei Wu Jiwei Li 50 567 0 07 Nov 2019
Learning Data Manipulation for Augmentation and Weighting Zhiting Hu Bowen Tan Ruslan Salakhutdinov Tom Michael Mitchell Eric Xing 29 116 0 28 Oct 2019
FIS-GAN: GAN with Flow-based Importance Sampling Shiyu Yi Donglin Zhan Wenqing Zhang Zhengyang Geng Kang An Hao Wang GAN 27 3 0 06 Oct 2019