Generalization in Neural Networks: A Broad Survey

4 September 2022

Papers citing "Generalization in Neural Networks: A Broad Survey"

50 / 61 papers shown

Title
Domain Generalization Using Large Pretrained Models with Mixture-of-Adapters Gyuseong Lee Wooseok Jang Jin Hyeon Kim Jaewoo Jung Seungryong Kim MoE OOD 43 4 0 17 Oct 2023
A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologies Zhuang Qian Kaizhu Huang Qiufeng Wang Xu-Yao Zhang OOD AAML ObjD 93 73 0 26 Mar 2022
Domain Generalization using Pretrained Models without Fine-tuning Ziyue Li Kan Ren Xinyang Jiang Yue Liu Haipeng Zhang Dongsheng Li VLM 62 37 0 09 Mar 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 89 854 0 07 Feb 2022
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks C. F. G. Santos João Paulo Papa 57 225 0 10 Jan 2022
Problem-dependent attention and effort in neural networks with applications to image resolution and model selection Chris Rohlfs 50 4 0 05 Jan 2022
Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning Yuqing Hu Vincent Gripon S. Pateux 64 37 0 18 Oct 2021
Towards Out-Of-Distribution Generalization: A Survey Jiashuo Liu Zheyan Shen Yue He Xingxuan Zhang Renzhe Xu Han Yu Peng Cui CML OOD 129 530 0 31 Aug 2021
D'ya like DAGs? A Survey on Structure Learning and Causal Discovery M. Vowels Necati Cihan Camgöz Richard Bowden CML 104 300 0 03 Mar 2021
Generalizing to Unseen Domains: A Survey on Domain Generalization Jindong Wang Cuiling Lan Chang-Shu Liu Yidong Ouyang Tao Qin Wang Lu Yiqiang Chen Wenjun Zeng Philip S. Yu OOD 196 1,218 0 02 Mar 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 385 4,919 0 24 Feb 2021
SWAD: Domain Generalization by Seeking Flat Minima Junbum Cha Sanghyuk Chun Kyungjae Lee Han-Cheol Cho Seunghyun Park Yunsung Lee Sungrae Park MoMe 275 451 0 17 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 422 3,826 0 11 Feb 2021
Curriculum Learning: A Survey Petru Soviany Radu Tudor Ionescu Paolo Rota N. Sebe ODL 115 354 0 25 Jan 2021
Adversarial Text-to-Image Synthesis: A Review Stanislav Frolov Tobias Hinz Federico Raue Jörn Hees Andreas Dengel EGVM 57 177 0 25 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 274 2,492 0 04 Jan 2021
Single Image Super-Resolution via a Holistic Attention Network Ben Niu Weilei Wen Wenqi Ren Xiangde Zhang Lianping Yang Shuzhen Wang Kaihao Zhang Xiaochun Cao Haifeng Shen SupR 57 627 0 20 Aug 2020
Learning from Extrinsic and Intrinsic Supervisions for Domain Generalization Shujun Wang Lequan Yu Caizi Li Chi-Wing Fu Pheng-Ann Heng OOD 58 193 0 18 Jul 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 76 1,137 0 02 Jul 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 132 2,724 0 05 Jun 2020
A Concise Review of Recent Few-shot Meta-learning Methods Xiaoxu Li Z. Sun Jing-Hao Xue Zhanyu Ma VLM OffRL 93 130 0 22 May 2020
Learning under Concept Drift: A Review Jie Lu Anjin Liu Fan Dong Feng Gu João Gama Guangquan Zhang AI4TS 57 1,278 0 13 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 371 1,967 0 11 Apr 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 96 1,682 0 30 Mar 2020
A Survey on Knowledge Graphs: Representation, Acquisition and Applications Shaoxiong Ji Shirui Pan Min Zhang Pekka Marttinen Philip S. Yu 292 1,980 0 02 Feb 2020
A Comprehensive Survey on Transfer Learning Fuzhen Zhuang Zhiyuan Qi Keyu Duan Dongbo Xi Yongchun Zhu Hengshu Zhu Hui Xiong Qing He 177 4,428 0 07 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 195 6,538 0 05 Nov 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 338 6,441 0 26 Sep 2019
Self-supervised Domain Adaptation for Computer Vision Tasks Jiaolong Xu Liang Xiao Antonio M. López OOD SSL VLM 51 134 0 25 Jul 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 131 18,058 0 28 May 2019
Searching for MobileNetV3 Andrew G. Howard Mark Sandler Grace Chu Liang-Chieh Chen Bo Chen ... Yukun Zhu Ruoming Pang Vijay Vasudevan Quoc V. Le Hartwig Adam 335 6,737 0 06 May 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 252 2,307 0 02 May 2019
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 124 652 0 05 Apr 2019
Machine Learning Methods Economists Should Know About Susan Athey Guido Imbens 79 680 0 24 Mar 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 109 1,714 0 13 Feb 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 221 1,638 0 28 Dec 2018
Meta-learning with differentiable closed-form solvers Luca Bertinetto João F. Henriques Philip Torr Andrea Vedaldi ODL 82 930 0 21 May 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 112 888 0 16 May 2018
Generalizing Across Domains via Cross-Gradient Training Shiv Shankar Vihari Piratla Soumen Chakrabarti S. Chaudhuri Preethi Jyothi Sunita Sarawagi OOD 63 515 0 28 Apr 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.0K 7,152 0 20 Apr 2018
Deep Face Recognition: A Survey Mei Wang Weihong Deng NoLa 128 1,232 0 18 Apr 2018
Regularization for Deep Learning: A Taxonomy J. Kukačka Vladimir Golkov Daniel Cremers 80 335 0 29 Oct 2017
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 86 459 0 16 Oct 2017
A Survey on Multi-Task Learning Yu Zhang Qiang Yang AIMat 579 2,225 0 25 Jul 2017
Deep Hashing Network for Unsupervised Domain Adaptation Hemanth Venkateswara José Eusébio Shayok Chakraborty S. Panchanathan OOD 138 2,041 0 22 Jun 2017
Causal Effect Inference with Deep Latent-Variable Models Christos Louizos Uri Shalit Joris Mooij David Sontag R. Zemel Max Welling CML BDL 194 741 0 24 May 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 806 11,866 0 09 Mar 2017
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks Peter L. Bartlett Nick Harvey Christopher Liaw Abbas Mehrabian 197 431 0 08 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 337 7,498 0 02 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 497 10,305 0 16 Nov 2016