Deep Model Reassembly

24 October 2022

Songhua Liu

Papers citing "Deep Model Reassembly"

50 / 70 papers shown

Title
An Information-Theoretic Approach to Transferability in Task Transfer Learning Yajie Bao Yongni Li Shao-Lun Huang Lin Zhang Lizhong Zheng Amir Zamir Leonidas Guibas 61 121 0 20 Dec 2022
Factorizing Knowledge in Neural Networks Xingyi Yang Jingwen Ye Xinchao Wang MoMe 85 124 0 04 Jul 2022
Transferability Metrics for Selecting Source Model Ensembles A. Agostinelli J. Uijlings Thomas Mensink V. Ferrari 49 24 0 25 Nov 2021
Scalable Diverse Model Selection for Accessible Transfer Learning Daniel Bolya Rohit Mittapalli Judy Hoffman OODD 45 43 0 12 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 460 7,757 0 11 Nov 2021
TorchXRayVision: A library of chest X-ray datasets and models Joseph Paul Cohen J. Viviano Paul Bertin Paul Morrison Parsa Torabian ... M. Lungren Akshay S. Chaudhari Rupert Brooks Mohammad Hashir H. Bertrand VLM MedIm 99 126 0 31 Oct 2021
Generalized Shape Metrics on Neural Representations Alex H. Williams Erin M Kunz Simon Kornblith Scott W. Linderman MedIm 30 102 0 27 Oct 2021
Similarity and Matching of Neural Network Representations Adrián Csiszárik Péter Korösi-Szabó Á. Matszangosz Gergely Papp D. Varga 44 70 0 27 Oct 2021
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer Sachin Mehta Mohammad Rastegari ViT 285 1,271 0 05 Oct 2021
Zoo-Tuning: Adaptive Transfer from a Zoo of Models Yang Shu Zhi Kou Zhangjie Cao Jianmin Wang Mingsheng Long 59 44 0 29 Jun 2021
Early Convolutions Help Transformers See Better Tete Xiao Mannat Singh Eric Mintun Trevor Darrell Piotr Dollár Ross B. Girshick 52 769 0 28 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 107 633 0 18 Jun 2021
Revisiting Model Stitching to Compare Neural Representations Yamini Bansal Preetum Nakkiran Boaz Barak FedML 90 117 0 14 Jun 2021
Quantifying and Improving Transferability in Domain Generalization Guojun Zhang Han Zhao Yaoliang Yu Pascal Poupart 78 39 0 07 Jun 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 294 702 0 22 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 154 1,864 0 05 Apr 2021
Benchmarking Representation Learning for Natural World Image Collections Grant Van Horn Elijah Cole Sara Beery Kimberly Wilber Serge J. Belongie Oisin Mac Aodha SSL VLM 74 173 0 30 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,439 0 25 Mar 2021
DeepViT: Towards Deeper Vision Transformer Daquan Zhou Bingyi Kang Xiaojie Jin Linjie Yang Xiaochen Lian Zihang Jiang Qibin Hou Jiashi Feng ViT 99 522 0 22 Mar 2021
AutoSpace: Neural Architecture Search with Less Human Interference Daquan Zhou Xiaojie Jin Xiaochen Lian Linjie Yang Yujing Xue Qibin Hou Jiashi Feng 48 10 0 22 Mar 2021
Coordinate Attention for Efficient Mobile Network Design Qibin Hou Daquan Zhou Jiashi Feng 83 3,057 0 04 Mar 2021
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Wuyang Chen Xinyu Gong Zhangyang Wang OOD 103 238 0 23 Feb 2021
LogME: Practical Assessment of Pre-trained Models for Transfer Learning Kaichao You Yong Liu Jianmin Wang Mingsheng Long 82 184 0 22 Feb 2021
Zero-Cost Proxies for Lightweight NAS Mohamed S. Abdelfattah Abhinav Mehrotra Łukasz Dudziak Nicholas D. Lane 75 260 0 20 Jan 2021
Overcoming Catastrophic Forgetting in Graph Neural Networks Huihui Liu Yiding Yang Xinchao Wang 210 117 0 10 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 654 41,103 0 22 Oct 2020
Factorizable Graph Convolutional Networks Yiding Yang Zunlei Feng Xiuming Zhang Xinchao Wang GNN 70 147 0 12 Oct 2020
Rethinking Bottleneck Structure for Efficient Mobile Network Design Zhou Daquan Qibin Hou Yunpeng Chen Jiashi Feng Shuicheng Yan 71 201 0 05 Jul 2020
Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms Xingyi Yang Xuehai He Yuxiao Liang Yue Yang Shanghang Zhang P. Xie SSL 60 43 0 19 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,806 0 13 Jun 2020
Neural Architecture Search without Training J. Mellor Jack Turner Amos Storkey Elliot J. Crowley 61 384 0 08 Jun 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 102 1,682 0 30 Mar 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 210 232 0 23 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 481 3,433 0 09 Mar 2020
LEEP: A New Measure to Evaluate Transferability of Learned Representations Cuong V Nguyen Tal Hassner Matthias Seeger Cédric Archambeau 77 217 0 27 Feb 2020
Federated Learning with Matched Averaging Hongyi Wang Mikhail Yurochkin Yuekai Sun Dimitris Papailiopoulos Y. Khazaeni FedML 121 1,124 0 15 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 286 1,205 0 24 Dec 2019
Neural Predictor for Neural Architecture Search W. Wen Hanxiao Liu H. Li Yiran Chen Gabriel Bender Pieter-Jan Kindermans 81 199 0 02 Dec 2019
Model Fusion via Optimal Transport Sidak Pal Singh Martin Jaggi MoMe FedML 106 237 0 12 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 232 7,520 0 02 Oct 2019
RandAugment: Practical automated data augmentation with a reduced search space E. D. Cubuk Barret Zoph Jonathon Shlens Quoc V. Le MQ 229 3,490 0 30 Sep 2019
Deep Model Transferability from Attribution Maps Mingli Song Yixin Chen Xinchao Wang Chengchao Shen Xiuming Zhang 80 54 0 26 Sep 2019
Transferability and Hardness of Supervised Classification Tasks Anh Tran Cuong V Nguyen Tal Hassner 175 167 0 21 Aug 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 619 4,780 0 13 May 2019
Searching for MobileNetV3 Andrew G. Howard Mark Sandler Grace Chu Liang-Chieh Chen Bo Chen ... Yukun Zhu Ruoming Pang Vijay Vasudevan Quoc V. Le Hartwig Adam 348 6,782 0 06 May 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 141 1,418 0 01 May 2019
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More Jingwen Ye Yixin Ji Xinchao Wang Kairi Ou Dapeng Tao Xiuming Zhang MoMe 92 77 0 23 Apr 2019
DELTA: DEep Learning Transfer using Feature Map with Attention for Convolutional Networks Xingjian Li Haoyi Xiong Hanchao Wang Yuxuan Rao Liping Liu Zeyu Chen Jun Huan 53 172 0 26 Jan 2019
Complexity of Linear Regions in Deep Networks Boris Hanin David Rolnick 44 232 0 25 Jan 2019