v1v2 (latest)

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

8 June 2017

Piotr Dollár

Papers citing "Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour"

50 / 2,054 papers shown

Title
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification Xudong Tian Zhizhong Zhang Shaohui Lin Yanyun Qu Yuan Xie Lizhuang Ma 76 115 0 07 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 185 1,875 0 05 Apr 2021
Beyond Short Clips: End-to-End Video-Level Learning with Collaborative Memories Xitong Yang Haoqi Fan Lorenzo Torresani L. Davis Heng Wang VLM 84 21 0 02 Apr 2021
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference Ben Graham Alaaeldin El-Nouby Hugo Touvron Pierre Stock Armand Joulin Hervé Jégou Matthijs Douze ViT 110 798 0 02 Apr 2021
Defending Against Image Corruptions Through Adversarial Augmentations D. A. Calian Florian Stimberg Olivia Wiles Sylvestre-Alvise Rebuffi András Gyorgy Timothy A. Mann Sven Gowal AAML 84 41 0 02 Apr 2021
Self-supervised Video Representation Learning by Context and Motion Decoupling Lianghua Huang Yu Liu Bin Wang Pan Pan Yinghui Xu Rong Jin SSL 111 51 0 02 Apr 2021
Multiview Pseudo-Labeling for Semi-supervised Learning from Video Bo Xiong Haoqi Fan Kristen Grauman Christoph Feichtenhofer SSL 70 51 0 01 Apr 2021
Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study Zhiqiang Shen Zechun Liu Dejia Xu Zitian Chen Kwang-Ting Cheng Marios Savvides 84 76 0 01 Apr 2021
Self-supervised Motion Learning from Static Images Ziyuan Huang Shiwei Zhang Jianwen Jiang Mingqian Tang Rong Jin M. Ang SSL 59 29 0 01 Apr 2021
RetrievalFuse: Neural 3D Scene Reconstruction with a Database Yawar Siddiqui Justus Thies Fangchang Ma Qi Shan Matthias Nießner Pawan Goyal 3DV 73 37 0 31 Mar 2021
Learning with Memory-based Virtual Classes for Deep Metric Learning ByungSoo Ko Geonmo Gu Han-Gyu Kim VLM 86 28 0 31 Mar 2021
Exploiting Invariance in Training Deep Neural Networks Chengxi Ye Xiong Zhou Tristan McKinney Yanfeng Liu Qinggang Zhou Fedor Zhdanov 27 4 0 30 Mar 2021
Improving robustness against common corruptions with frequency biased models Tonmoy Saikia Cordelia Schmid Thomas Brox OOD 84 41 0 30 Mar 2021
[Reproducibility Report] Rigging the Lottery: Making All Tickets Winners Varun Sundar Rajat Vadiraj Dwaraknath 53 5 0 29 Mar 2021
FixNorm: Dissecting Weight Decay for Training Deep Neural Networks Yucong Zhou Yunxiao Sun Zhaobai Zhong 91 6 0 29 Mar 2021
Distilling Virtual Examples for Long-tailed Recognition Yingying He Jianxin Wu Xiu-Shen Wei 105 102 0 28 Mar 2021
USB: Universal-Scale Object Detection Benchmark Yosuke Shinya ObjD 113 13 0 25 Mar 2021
Gaussian Guided IoU: A Better Metric for Balanced Learning on Object Detection Shengkai Wu Jinrong Yang Hangchen Yu L. Gou Xiaoping Li 43 6 0 25 Mar 2021
Dynamic Slimmable Network Changlin Li Guangrun Wang Bing Wang Xiaodan Liang Zhihui Li Xiaojun Chang 91 145 0 24 Mar 2021
The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication Xing Xu Rongpeng Li Zhifeng Zhao Honggang Zhang 84 12 0 24 Mar 2021
MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognition Shuang Li Kaixiong Gong Chi Harold Liu Yulin Wang Feng Qiao Xinjing Cheng 101 155 0 23 Mar 2021
Stochastic Reweighted Gradient Descent Ayoub El Hanchi D. Stephens 45 8 0 23 Mar 2021
PGT: A Progressive Method for Training Models on Long Videos Bo Pang Gao Peng Yizhuo Li Cewu Lu VLM 42 12 0 21 Mar 2021
Attention-Based Multimodal Image Matching Aviad Moreshet Y. Keller ViT 27 0 0 20 Mar 2021
Self-Supervised Classification Network Elad Amrani Leonid Karlinsky A. Bronstein SSL 66 29 0 19 Mar 2021
Sewer-ML: A Multi-Label Sewer Defect Classification Dataset and Benchmark Joakim Bruslund Haurum T. Moeslund 72 65 0 19 Mar 2021
You Only Look One-level Feature Qiang Chen Yingming Wang Tong Yang Xinming Zhang Jian Cheng Jian Sun ObjD 72 525 0 17 Mar 2021
Learned Gradient Compression for Distributed Deep Learning L. Abrahamyan Yiming Chen Giannis Bekoulis Nikos Deligiannis 106 46 0 16 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Nayeon Lee Jonathon Shlens Barret Zoph 98 303 0 13 Mar 2021
Learnable Companding Quantization for Accurate Low-bit Neural Networks Kohei Yamamoto MQ 95 68 0 12 Mar 2021
Large Batch Simulation for Deep Reinforcement Learning Brennan Shacklett Erik Wijmans Aleksei Petrenko Manolis Savva Dhruv Batra V. Koltun Kayvon Fatahalian 3DV OffRL AI4CE 93 26 0 12 Mar 2021
Fast and Accurate Model Scaling Piotr Dollár Mannat Singh Ross B. Girshick 75 98 0 11 Mar 2021
Why flatness does and does not correlate with generalization for deep neural networks Shuo Zhang Isaac Reid Guillermo Valle Pérez A. Louis 77 8 0 10 Mar 2021
Spatially Consistent Representation Learning Byungseok Roh Wuhyun Shin Ildoo Kim Sungwoong Kim SSL 74 90 0 10 Mar 2021
Quality-Aware Network for Human Parsing Lu Yang Q. Song Zhihui Wang Zhiwei Liu Songcen Xu Zhihao Li 64 24 0 10 Mar 2021
ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis Yinan He Bei Gan Siyu Chen Yichun Zhou Guojun Yin Luchuan Song Lu Sheng Jing Shao Ziwei Liu AAML 123 137 0 09 Mar 2021
SimTriplet: Simple Triplet Representation Learning with a Single GPU Quan Liu Peter C. Louis Yuzhe Lu Aadarsh Jha Mengyang Zhao ... Joseph T. Roland Haichun Yang Shilin Zhao L. Wheless Yuankai Huo 72 36 0 09 Mar 2021
Doubly Contrastive Deep Clustering Zhiyuan Dang Cheng Deng Xu Yang Heng-Chiao Huang SSL 78 16 0 09 Mar 2021
Contrastive Semi-supervised Learning for ASR Alex Xiao Christian Fuegen Abdel-rahman Mohamed 85 20 0 09 Mar 2021
WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognition Zheng Zhu Guan Huang Jiankang Deng Yun Ye Junjie Huang ... Jiagang Zhu Tian Yang Jiwen Lu Dalong Du Jie Zhou CVBM 155 262 0 06 Mar 2021
Pufferfish: Communication-efficient Models At No Extra Cost Hongyi Wang Saurabh Agarwal Dimitris Papailiopoulos 85 59 0 05 Mar 2021
Better SGD using Second-order Momentum Hoang Tran Ashok Cutkosky ODL 54 12 0 04 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 133 36 0 04 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 369 2,378 0 04 Mar 2021
Contrastive Learning Meets Transfer Learning: A Case Study In Medical Image Analysis Yuzhe Lu Aadarsh Jha Yuankai Huo MedIm 122 4 0 04 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test Accuracy Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 84 74 0 04 Mar 2021
Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates Sebastian U. Stich Amirkeivan Mohtashami Martin Jaggi 71 22 0 03 Mar 2021
Self-supervised Pretraining of Visual Features in the Wild Priya Goyal Mathilde Caron Benjamin Lefaudeux Min Xu Pengchao Wang ... Mannat Singh Vitaliy Liptchinsky Ishan Misra Armand Joulin Piotr Bojanowski VLM SSL 101 274 0 02 Mar 2021
Fixing Data Augmentation to Improve Adversarial Robustness Sylvestre-Alvise Rebuffi Sven Gowal D. A. Calian Florian Stimberg Olivia Wiles Timothy A. Mann AAML 121 276 0 02 Mar 2021
Coarse-Fine Networks for Temporal Activity Detection in Videos Kumara Kahatapitiya Michael S. Ryoo AI4TS 97 39 0 01 Mar 2021