Rethinking ImageNet Pre-training

21 November 2018

Piotr Dollár

Papers citing "Rethinking ImageNet Pre-training"

50 / 507 papers shown

Title
ViM: Vision Middleware for Unified Downstream Transferring Yutong Feng Biao Gong Jianwen Jiang Yiliang Lv Yujun Shen Deli Zhao Jingren Zhou 98 1 0 13 Mar 2023
Three Guidelines You Should Know for Universally Slimmable Self-Supervised Learning Yunhao Cao Peiqin Sun Shuchang Zhou 51 4 0 13 Mar 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 70 33 0 10 Mar 2023
MVImgNet: A Large-scale Dataset of Multi-view Images Xianggang Yu Mutian Xu Yidan Zhang Haolin Liu Chongjie Ye ... Zhangyang Xiong Tianyou Liang Guanying Chen Shuguang Cui Xiaoguang Han 3DV 138 171 0 10 Mar 2023
Adapting Contrastive Language-Image Pretrained (CLIP) Models for Out-of-Distribution Detection Nikolas Adaloglou Félix D. P. Michels Tim Kaiser M. Kollmann VLM 67 0 0 10 Mar 2023
Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation Hongsuk Choi Hyeongjin Nam T. Lee Gyeongsik Moon Kyoung Mu Lee 94 7 0 09 Mar 2023
SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model Gengwei Zhang Liyuan Wang Guoliang Kang Ling-Hao Chen Yunchao Wei CLL 90 119 0 09 Mar 2023
Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners Renrui Zhang Xiangfei Hu Bohao Li Siyuan Huang Hanqiu Deng Hongsheng Li Yu Qiao Peng Gao VLM MLLM 108 181 0 03 Mar 2023
Random Padding Data Augmentation Nan Yang Laicheng Zhong Fan Huang Dong Yuan Wei Bao 45 2 0 17 Feb 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang Euijoon Ahn Da-wei Feng Jinman Kim MedIm 133 29 0 10 Feb 2023
Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy Blake E. Woodworth Konstantin Mishchenko Francis R. Bach 82 6 0 07 Feb 2023
Revisiting Pre-training in Audio-Visual Learning Ruoxuan Feng Wenke Xia Di Hu 65 1 0 07 Feb 2023
On the Ideal Number of Groups for Isometric Gradient Propagation Bum Jun Kim Hyeyeon Choi Hyeonah Jang Sang Woo Kim 61 1 0 07 Feb 2023
Equivariant Differentially Private Deep Learning: Why DP-SGD Needs Sparser Models Florian A. Hölzl Daniel Rueckert Georgios Kaissis 95 4 0 30 Jan 2023
Vision Learners Meet Web Image-Text Pairs Bingchen Zhao Quan Cui Hao Wu Osamu Yoshie Cheng Yang Oisin Mac Aodha VLM 84 5 0 17 Jan 2023
RILS: Masked Visual Reconstruction in Language Semantic Space Shusheng Yang Yixiao Ge Kun Yi Dian Li Ying Shan Xiaohu Qie Xinggang Wang CLIP 95 11 0 17 Jan 2023
Ego-Only: Egocentric Action Detection without Exocentric Transferring Huiyu Wang Mitesh Singh Lorenzo Torresani EgoV 126 26 0 03 Jan 2023
Error-aware Quantization through Noise Tempering Zheng Wang Juncheng Billy Li Shuhui Qu Florian Metze Emma Strubell MQ 48 2 0 11 Dec 2022
SEPT: Towards Scalable and Efficient Visual Pre-Training Yiqi Lin Huabin Zheng Huaping Zhong Jinjing Zhu Weijia Li Conghui He Lin Wang 80 2 0 11 Dec 2022
Benchmarking Self-Supervised Learning on Diverse Pathology Datasets Mingu Kang Heon Song Seonwook Park Donggeun Yoo Sérgio Pereira 63 139 0 09 Dec 2022
Rethinking Two Consensuses of the Transferability in Deep Learning Yixiong Chen Jingxia Li C. Ding Li Liu 76 2 0 01 Dec 2022
Procedural Image Programs for Representation Learning Manel Baradad Chun-Fu Jonas Wulff Tongzhou Wang Rogerio Feris Antonio Torralba Phillip Isola 103 23 0 29 Nov 2022
Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning Ryota Yoshihashi Shuhei Nishimura Dai Yonebayashi Yuya Otsuka Tomohiro Tanaka Takashi Miyazaki SSL 79 2 0 25 Nov 2022
How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning? Thomas M. Hehn Julian F. P. Kooij D. Gavrila SSL 75 0 0 23 Nov 2022
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 118 49 0 15 Nov 2022
Learning from partially labeled data for multi-organ and tumor segmentation Yutong Xie Jianpeng Zhang Yong-quan Xia Chunhua Shen MedIm ViT 83 20 0 13 Nov 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 120 264 0 17 Oct 2022
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations Jong Hak Moon Wonjae Kim Edward Choi 108 3 0 17 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 95 75 0 14 Oct 2022
Composite Learning for Robust and Effective Dense Predictions Menelaos Kanakis Thomas E. Huang David Brüggemann Feng Yu Luc Van Gool SSL 74 4 0 13 Oct 2022
LieGG: Studying Learned Lie Group Generators A. Moskalev A. Sepliarskaia Ivan Sosnovik A. Smeulders 97 27 0 09 Oct 2022
Humans need not label more humans: Occlusion Copy & Paste for Occluded Human Instance Segmentation Evan Ling De-Kai Huang Minhoe Hur 116 5 0 07 Oct 2022
Self-supervised Pre-training for Semantic Segmentation in an Indoor Scene Sulabh Shrestha Yimeng Li Jana Kosecka 3DPC SSL SSeg 93 2 0 04 Oct 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 135 42 0 29 Sep 2022
Collaboration of Pre-trained Models Makes Better Few-shot Learner Renrui Zhang Bohao Li Wei Zhang Hao Dong Hongsheng Li Peng Gao Yu Qiao VLM 114 7 0 25 Sep 2022
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training Rogerio Bonatti Sai H. Vemprala Shuang Ma Felipe Vieira Frujeri Shuhang Chen Ashish Kapoor 94 23 0 22 Sep 2022
Effective Adaptation in Multi-Task Co-Training for Unified Autonomous Driving Xiwen Liang Yangxin Wu Jianhua Han Hang Xu Chunjing Xu Xiaodan Liang 106 37 0 19 Sep 2022
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks Junke Wang Dongdong Chen Zuxuan Wu Chong Luo Luowei Zhou Yucheng Zhao Yujia Xie Ce Liu Yu-Gang Jiang Lu Yuan MLLM VLM 139 153 0 15 Sep 2022
Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipe Hongyang Li Chonghao Sima Jifeng Dai Wenhai Wang Lewei Lu ... Xiaosong Jia Siqian Liu Jianping Shi Dahua Lin Yu Qiao 176 151 0 12 Sep 2022
Multimodal contrastive learning for remote sensing tasks Umang Jain Alex Wilson Varun Gulshan SSL 126 24 0 06 Sep 2022
A comprehensive survey on recent deep learning-based methods applied to surgical data Mansoor Ali Rafael Martinez Garcia Peña Gilberto Ochoa-Ruiz Sharib Ali 136 6 0 03 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 156 114 0 31 Aug 2022
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey Yanbei Chen Massimiliano Mancini Xiatian Zhu Zeynep Akata 157 121 0 24 Aug 2022
Label-Free Synthetic Pretraining of Object Detectors Hei Law Jia Deng 76 4 0 08 Aug 2022
GPPF: A General Perception Pre-training Framework via Sparsely Activated Multi-Task Learning Benyuan Sun Jinqiao Dai Zihao Liang Cong Liu Yi Yang Bo Bai MoE 75 4 0 03 Aug 2022
Neural Contourlet Network for Monocular 360 Depth Estimation Zhijie Shen Chunyu Lin Lang Nie K. Liao Yao Zhao MDE 77 12 0 03 Aug 2022
Deep Clustering with Features from Self-Supervised Pretraining Xingzhi Zhou N. Zhang ViT 3DPC SSL 48 11 0 27 Jul 2022
Boosting Point-BERT by Multi-choice Tokens Kexue Fu Ming-Dong Yuan Manning Wang 3DPC 77 7 0 27 Jul 2022
AMF: Adaptable Weighting Fusion with Multiple Fine-tuning for Image Classification Xuyang Shen J. Plested Sabrina Caldwell Yiran Zhong Tom Gedeon 59 1 0 26 Jul 2022
Hyper-Representations for Pre-Training and Transfer Learning Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 78 11 0 22 Jul 2022