Data-dependent Initializations of Convolutional Neural Networks

21 November 2015

Papers citing "Data-dependent Initializations of Convolutional Neural Networks"

50 / 50 papers shown

Title
Parameter Efficient Fine-tuning via Explained Variance Adaptation Fabian Paischer Lukas Hauzenberger Thomas Schmied Benedikt Alkin Marc Peter Deisenroth Sepp Hochreiter 37 4 0 09 Oct 2024
Initializing Models with Larger Ones Zhiqiu Xu Yanjie Chen Kirill Vishniakov Yida Yin Zhiqiang Shen Trevor Darrell Lingjie Liu Zhuang Liu 38 17 0 30 Nov 2023
Best Practices for 2-Body Pose Forecasting Muhammad Rameez Ur Rahman Luca Scofano Edoardo De Matteis Alessandro Flaborea Alessio Sampieri Fabio Galasso 28 9 0 12 Apr 2023
A Systematic Performance Analysis of Deep Perceptual Loss Networks: Breaking Transfer Learning Conventions G. Pihlgren Konstantina Nikolaidou Prakash Chandra Chhipa Nosheen Abid Rajkumar Saini Fredrik Sandin Marcus Liwicki 29 10 0 08 Feb 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 37 20 0 12 Jan 2023
Exemplar-Based Image Colorization with A Learning Framework Zhenfeng Xue Jian Yang Jie Ren Yong Liu 17 0 0 13 Sep 2022
E-LMC: Extended Linear Model of Coregionalization for Spatial Field Prediction Shihong Wang Xueying Zhang Yichen Meng W. Xing 22 1 0 01 Mar 2022
Learning Enhancement of CNNs via Separation Index Maximizing at the First Convolutional Layer Ali Karimi Ahmad Kalhor SSL 16 0 0 13 Jan 2022
Variance-Aware Weight Initialization for Point Convolutional Neural Networks Pedro Hermosilla Michael Schelling Tobias Ritschel Timo Ropinski 3DPC 29 0 0 07 Dec 2021
Gabor filter incorporated CNN for compression Akihiro Imamura N. Arizumi CVBM 28 2 0 29 Oct 2021
AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks G. Bingham Risto Miikkulainen ODL 24 4 0 18 Sep 2021
Concurrent Discrimination and Alignment for Self-Supervised Feature Learning Anjan Dutta Massimiliano Mancini Zeynep Akata SSL 22 0 0 19 Aug 2021
Data-driven Weight Initialization with Sylvester Solvers Debasmit Das Yash Bhalgat Fatih Porikli ODL 38 3 0 02 May 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 250 114 0 20 Oct 2020
Laplacian Denoising Autoencoder Jianbo Jiao Linchao Bao Yunchao Wei Shengfeng He Humphrey Shi Rynson W. H. Lau Thomas S. Huang SSL 11 2 0 30 Mar 2020
Unsupervised Representation Learning by Discovering Reliable Image Relations Timo Milbich Omair Ghori Ferran Diego Bjorn Ommer OOD SSL 24 9 0 18 Nov 2019
Streaming convolutional neural networks for end-to-end learning with multi-megapixel images H. Pinckaers Bram van Ginneken G. Litjens MedIm 27 94 0 11 Nov 2019
Adversarial Fisher Vectors for Unsupervised Representation Learning Shuangfei Zhai Walter A. Talbott Carlos Guestrin J. Susskind GAN 22 8 0 29 Oct 2019
Uncertainty in Model-Agnostic Meta-Learning using Variational Inference Cuong C. Nguyen Thanh-Toan Do G. Carneiro OOD BDL UQCV 19 54 0 27 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 85 2,367 0 13 Jun 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 24 396 0 03 May 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 44 444 0 29 Mar 2019
AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational Transformations Guo-Jun Qi Liheng Zhang Chang Wen Chen Qi Tian DRL 21 42 0 23 Mar 2019
DistInit: Learning Video Representations Without a Single Labeled Video Rohit Girdhar Du Tran Lorenzo Torresani Deva Ramanan 27 54 0 26 Jan 2019
AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data Liheng Zhang Guo-Jun Qi Liqiang Wang Jiebo Luo 14 202 0 14 Jan 2019
Self-Referenced Deep Learning Xu Lan Xiatian Zhu S. Gong 27 23 0 19 Nov 2018
Unsupervised Learning via Meta-Learning Kyle Hsu Sergey Levine Chelsea Finn SSL OffRL 31 229 0 04 Oct 2018
Overhead Detection: Beyond 8-bits and RGB E. Mace Keith Manville M. Barbu-McInnis Michael Laielli Matthew K. Klaric Samuel Dooley 23 7 0 07 Aug 2018
Self-Supervised Feature Learning by Learning to Spot Artifacts Simon Jenni Paolo Favaro SSL 150 127 0 13 Jun 2018
Unsupervised Meta-Learning for Reinforcement Learning Abhishek Gupta Benjamin Eysenbach Chelsea Finn Sergey Levine SSL OffRL 54 106 0 12 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 64 3,410 0 05 May 2018
Boosting Self-Supervised Learning via Knowledge Transfer M. Noroozi Ananth Vinjimoor Paolo Favaro Hamed Pirsiavash SSL 215 292 0 01 May 2018
Deep Metric Learning with BIER: Boosting Independent Embeddings Robustly M. Opitz Georg Waltner Horst Possegger Horst Bischof FedML OOD 32 166 0 15 Jan 2018
Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning Andrew Owens Jiajun Wu Josh H. McDermott William T. Freeman Antonio Torralba SSL 41 177 0 20 Dec 2017
Historical Document Image Segmentation with LDA-Initialized Deep Neural Networks Michele Alberti Mathias Seuret Vinaychandran Pondenkandath Rolf Ingold Marcus Liwicki 16 17 0 19 Oct 2017
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting Samuel Yeom Irene Giacomelli Matt Fredrikson S. Jha MIACV 18 39 0 05 Sep 2017
Unsupervised Representation Learning by Sorting Sequences Hsin-Ying Lee Jia-Bin Huang Maneesh Kumar Singh Ming-Hsuan Yang SSL DRL 32 533 0 03 Aug 2017
Generalizing the Convolution Operator in Convolutional Neural Networks Kamaledin Ghiasi-Shirazi 21 38 0 14 Jul 2017
Self-supervised learning of visual features through embedding images into text topic spaces L. G. I. Bigorda Yash J. Patel Marçal Rusiñol Dimosthenis Karatzas C. V. Jawahar SSL 16 124 0 24 May 2017
Colorization as a Proxy Task for Visual Understanding Gustav Larsson Michael Maire Gregory Shakhnarovich SSL 65 493 0 11 Mar 2017
All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation Di Xie Jiang Xiong Shiliang Pu 19 181 0 06 Mar 2017
PCA-Initialized Deep Neural Networks Applied To Document Image Analysis Mathias Seuret Michele Alberti Rolf Ingold Marcus Liwicki ODL 22 54 0 01 Feb 2017
Loss is its own Reward: Self-Supervision for Reinforcement Learning Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell SSL 24 186 0 21 Dec 2016
Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale F. Iandola 3DV 26 18 0 20 Dec 2016
Learning Features by Watching Objects Move Deepak Pathak Ross B. Girshick Piotr Dollár Trevor Darrell Bharath Hariharan SSL VOS OCL 36 522 0 19 Dec 2016
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction Richard Y. Zhang Phillip Isola Alexei A. Efros SSL DRL 31 665 0 29 Nov 2016
What makes ImageNet good for transfer learning? Minyoung Huh Pulkit Agrawal Alexei A. Efros OOD SSeg VLM SSL 62 671 0 30 Aug 2016
An Uncertain Future: Forecasting from Static Images using Variational Autoencoders Jacob Walker Carl Doersch Abhinav Gupta M. Hebert VGen 15 512 0 25 Jun 2016
Asynchrony begets Momentum, with an Application to Deep Learning Jeff Donahue Philipp Krahenbuhl Stefan Hadjis Christopher Ré 55 141 0 31 May 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 99 1,924 0 25 Feb 2016