v1v2 (latest)

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

8 June 2017

Piotr Dollár

Papers citing "Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour"

50 / 2,054 papers shown

Title
ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction Ji Qi Bin Xu Kaisheng Zeng Jinxin Liu Jifan Yu Qifang Gao Juanzi Li Lei Hou GNN 73 1 0 08 Oct 2022
Humans need not label more humans: Occlusion Copy & Paste for Occluded Human Instance Segmentation Evan Ling De-Kai Huang Minhoe Hur 116 5 0 07 Oct 2022
TAN Without a Burn: Scaling Laws of DP-SGD Tom Sander Pierre Stock Alexandre Sablayrolles FedML 86 43 0 07 Oct 2022
Critical Learning Periods for Multisensory Integration in Deep Networks Michael Kleinman Alessandro Achille Stefano Soatto 116 11 0 06 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 90 3 0 06 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 138 79 0 05 Oct 2022
Centralized Feature Pyramid for Object Detection Yu Quan Dong Zhang Liyan Zhang Jinhui Tang ObjD 111 166 0 05 Oct 2022
Exploring The Role of Mean Teachers in Self-supervised Masked Auto-Encoders Youngwan Lee Jeffrey Willette Jonghee Kim Juho Lee Sung Ju Hwang 93 16 0 05 Oct 2022
VICRegL: Self-Supervised Learning of Local Visual Features Adrien Bardes Jean Ponce Yann LeCun SSL 99 127 0 04 Oct 2022
MTSMAE: Masked Autoencoders for Multivariate Time-Series Forecasting Peiwang Tang Xianchao Zhang AI4TS 80 14 0 04 Oct 2022
Introducing Vision Transformer for Alzheimer's Disease classification task with 3D input Zilun Zhang Farzad Khalvati MedIm ViT 47 10 0 03 Oct 2022
Differentially Private Bias-Term Fine-tuning of Foundation Models Zhiqi Bu Yu Wang Sheng Zha George Karypis 135 48 0 30 Sep 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 59 1 0 30 Sep 2022
EF21-P and Friends: Improved Theoretical Communication Complexity for Distributed Optimization with Bidirectional Compression Kaja Gruntkowska Alexander Tyurin Peter Richtárik 152 24 0 30 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 135 32 0 27 Sep 2022
Multi-Task Adversarial Training Algorithm for Multi-Speaker Neural Text-to-Speech Yusuke Nakai Yuki Saito K. Udagawa Hiroshi Saruwatari AAML 85 1 0 26 Sep 2022
Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection Xiang Zhang Huiyuan Yang Taoyue Wang Xiaotian Li L. Yin 111 7 0 25 Sep 2022
Rethinking Performance Gains in Image Dehazing Networks Yuda Song Yang Zhou Hui Qian Xin Du SSeg 79 51 0 23 Sep 2022
Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation Kien Do Hung Le D. Nguyen Dang Nguyen Haripriya Harikumar T. Tran Santu Rana Svetha Venkatesh 68 33 0 21 Sep 2022
Dynamic Graph Message Passing Networks for Visual Recognition Li Zhang Mohan Chen Anurag Arnab Xiangyang Xue Philip Torr GNN 66 1 0 20 Sep 2022
Attentive Symmetric Autoencoder for Brain MRI Segmentation Junjia Huang Haofeng Li Guanbin Li Xiang Wan MedIm 55 17 0 19 Sep 2022
Bootstrap Generalization Ability from Loss Landscape Perspective Huanran Chen Shitong Shao Ziyi Wang Zirui Shang Jin Chen Xiaofeng Ji Xinxiao Wu OOD 134 19 0 18 Sep 2022
PINCH: An Adversarial Extraction Attack Framework for Deep Learning Models William Hackett Stefan Trawicki Zhengxin Yu N. Suri Peter Garraghan MIACV AAML 59 3 0 13 Sep 2022
Exploring Target Representations for Masked Autoencoders Xingbin Liu Jinghao Zhou Tao Kong Xianming Lin Rongrong Ji 197 52 0 08 Sep 2022
EasyScale: Accuracy-consistent Elastic Training for Deep Learning Mingzhen Li Wencong Xiao Biao Sun Hanyu Zhao Hailong Yang ... Xianyan Jia Yi Liu Yong Li Wei Lin D. Qian 67 7 0 30 Aug 2022
Super-model ecosystem: A domain-adaptation perspective Fengxiang He Dacheng Tao DiffM 84 1 0 30 Aug 2022
Lower Difficulty and Better Robustness: A Bregman Divergence Perspective for Adversarial Training Zihui Wu Haichang Gao Bingqian Zhou Xiaoyan Guo Shudong Zhang AAML 69 0 0 26 Aug 2022
Multiple Instance Neuroimage Transformer Ayush Singla Qingyu Zhao Daniel K. Do Yuyin Zhou K. Pohl Ehsan Adeli ViT MedIm 69 11 0 19 Aug 2022
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training Jie You Jaehoon Chung Mosharaf Chowdhury 80 82 0 12 Aug 2022
Semi-supervised Vision Transformers at Scale Zhaowei Cai Avinash Ravichandran Paolo Favaro Manchen Wang Davide Modolo Rahul Bhotika Zhuowen Tu Stefano Soatto ViT 108 58 0 11 Aug 2022
Understanding Masked Image Modeling via Learning Occlusion Invariant Feature Xiangwen Kong Xiangyu Zhang SSL 78 54 0 08 Aug 2022
Sample hardness based gradient loss for long-tailed cervical cell detection Minmin Liu Xuechen Li Xiang Gao Junliang Chen Linlin Shen Huisi Wu MedIm 43 5 0 07 Aug 2022
Class-Incremental Learning with Cross-Space Clustering and Controlled Transfer Arjun Ashok K. J. Joseph V. Balasubramanian CLL 61 29 0 07 Aug 2022
Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search Yu Xue Jiafeng Qin 107 59 0 01 Aug 2022
Revisiting the Critical Factors of Augmentation-Invariant Representation Learning Junqiang Huang Xiangwen Kong Xiangyu Zhang 45 6 0 30 Jul 2022
Global-Local Self-Distillation for Visual Representation Learning Tim Lebailly Tinne Tuytelaars SSL 53 6 0 29 Jul 2022
Training a universal instance segmentation network for live cell images of various cell types and imaging modalities Tianqi Guo Yin Wang Luis Solorio J. Allebach SSeg OOD 57 3 0 28 Jul 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 58 2 0 28 Jul 2022
Contrastive Masked Autoencoders are Stronger Vision Learners Zhicheng Huang Xiaojie Jin Cheng Lu Qibin Hou Mingg-Ming Cheng Dongmei Fu Xiaohui Shen Jiashi Feng 154 155 0 27 Jul 2022
Class-Aware Universum Inspired Re-Balance Learning for Long-Tailed Recognition Enhao Zhang Chuanxing Geng Songcan Chen 118 2 0 26 Jul 2022
Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer Yingyi Chen Xiaoke Shen Yahui Liu Qinghua Tao Johan A. K. Suykens AAML ViT 85 24 0 25 Jul 2022
Analysis and Optimization of GNN-Based Recommender Systems on Persistent Memory Yuwei Hu Jiajie Li Zhongming Yu Zhiru Zhang GNN 81 0 0 25 Jul 2022
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection Gaoang Wang Yibing Zhan Xinchao Wang Min-Gyoo Song Klara Nahrstedt 52 11 0 24 Jul 2022
MAR: Masked Autoencoders for Efficient Action Recognition Zhiwu Qing Shiwei Zhang Ziyuan Huang Xiang Wang Yuehuang Wang Yiliang Lv Changxin Gao Nong Sang 101 47 0 24 Jul 2022
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior Jennifer J. Sun Markus Marks Andrew Ulmer Dipam Chakraborty Brian Geuther ... Joseph Parker Pietro Perona Yisong Yue K. Branson Ann Kennedy 40 9 0 21 Jul 2022
StreamYOLO: Real-time Object Detection for Streaming Perception Jinrong Yang Songtao Liu Zeming Li Xiaoping Li Jian‐Yuan Sun 111 6 0 21 Jul 2022
Negative Samples are at Large: Leveraging Hard-distance Elastic Loss for Re-identification Hyungtae Lee Sungmin Eum H. Kwon VLM 62 4 0 20 Jul 2022
ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale Gopinath Chennupati Milind Rao Gurpreet Chadha Aaron Eakin A. Raju ... Andrew Oberlin Buddha Nandanoor Prahalad Venkataramanan Zheng Wu Pankaj Sitpure CLL 95 8 0 19 Jul 2022
Using Conservation Laws to Infer Deep Learning Model Accuracy of Richtmyer-meshkov Instabilities C. Jekel D. Sterbentz S. Aubry Youngsoo Choi D. White Jonathan Belof AI4CE 17 6 0 19 Jul 2022
Multi-manifold Attention for Vision Transformers D. Konstantinidis Ilias Papastratis K. Dimitropoulos P. Daras ViT 103 16 0 18 Jul 2022