Deep Learning of Representations: Looking Forward

2 May 2013

Papers citing "Deep Learning of Representations: Looking Forward"

39 / 39 papers shown

Title
More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing Sagi Shaier Francisco Pereira Katharina von der Wense Lawrence E Hunter Matt Jones MoE 76 0 0 10 Oct 2024
Memory Mosaics Jianyu Zhang Niklas Nolte Ranajoy Sadhukhan Beidi Chen Léon Bottou VLM 87 4 0 10 May 2024
AI Discovering a Coordinate System of Chemical Elements: Dual Representation by Variational Autoencoders A. Glushkovsky DRL 66 6 0 24 Nov 2020
Deep Generative Stochastic Networks Trainable by Backprop Yoshua Bengio Eric Thibodeau-Laufer Guillaume Alain J. Yosinski BDL 127 396 0 05 Jun 2013
Generalized Denoising Auto-Encoders as Generative Models Yoshua Bengio L. Yao Guillaume Alain Pascal Vincent 101 539 0 29 May 2013
Estimating or Propagating Gradients Through Stochastic Neurons Yoshua Bengio 107 110 0 14 May 2013
Maxout Networks Ian Goodfellow David Warde-Farley M. Berk Mirza Aaron Courville Yoshua Bengio OOD 214 2,177 0 18 Feb 2013
Revisiting Natural Gradient for Deep Networks Razvan Pascanu Yoshua Bengio ODL 122 388 0 16 Jan 2013
Big Neural Networks Waste Capacity Yann N. Dauphin Yoshua Bengio 90 84 0 16 Jan 2013
Joint Training Deep Boltzmann Machines for Classification Ian Goodfellow Aaron Courville Yoshua Bengio 91 23 0 16 Jan 2013
Stochastic Pooling for Regularization of Deep Convolutional Neural Networks Matthew D. Zeiler Rob Fergus 157 989 0 16 Jan 2013
A Semantic Matching Energy Function for Learning with Multi-relational Data Xavier Glorot Antoine Bordes Jason Weston Yoshua Bengio 95 689 0 15 Jan 2013
Joint Training of Deep Boltzmann Machines Ian Goodfellow Aaron Courville Yoshua Bengio FedML 107 28 0 12 Dec 2012
Advances in Optimizing Recurrent Networks Yoshua Bengio Nicolas Boulanger-Lewandowski Razvan Pascanu ODL 89 522 0 04 Dec 2012
Texture Modeling with Convolutional Spike-and-Slab RBMs and Deep Extensions Heng Luo P. Carrier Aaron Courville Yoshua Bengio BDL 71 25 0 24 Nov 2012
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 182 5,334 0 21 Nov 2012
What Regularized Auto-Encoders Learn from the Data Generating Distribution Guillaume Alain Yoshua Bengio OOD DRL 64 501 0 18 Nov 2012
Disentangling Factors of Variation via Generative Entangling Guillaume Desjardins Aaron Courville Yoshua Bengio CoGe CML DRL 79 104 0 19 Oct 2012
Communication/Computation Tradeoffs in Consensus-Based Distributed Optimization Konstantinos I. Tsianos Sean F. Lawlor Michael G. Rabbat 77 81 0 05 Sep 2012
Better Mixing via Deep Representations Yoshua Bengio Grégoire Mesnil Yann N. Dauphin Salah Rifai 81 341 0 18 Jul 2012
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 420 7,658 0 03 Jul 2012
Implicit Density Estimation by Local Moment Matching to Sample from Auto-Encoders Yoshua Bengio Guillaume Alain Salah Rifai 61 12 0 30 Jun 2012
Large-Scale Feature Learning With Spike-and-Slab Sparse Coding Ian Goodfellow Aaron Courville Yoshua Bengio 58 93 0 27 Jun 2012
A Generative Process for Sampling Contractive Auto-Encoders Salah Rifai Yoshua Bengio Yann N. Dauphin Pascal Vincent GAN DRL 84 51 0 27 Jun 2012
Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription Nicolas Boulanger-Lewandowski Yoshua Bengio Pascal Vincent 147 702 0 27 Jun 2012
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 220 12,422 0 24 Jun 2012
Practical recommendations for gradient-based training of deep architectures Yoshua Bengio 3DH ODL 167 2,195 0 24 Jun 2012
Shift-Invariance Sparse Coding for Audio Classification Roger C. Grosse Rajat Raina H. Kwong A. Ng 70 260 0 20 Jun 2012
No More Pesky Learning Rates Tom Schaul Sixin Zhang Yann LeCun 117 477 0 06 Jun 2012
Evolving Culture vs Local Minima Yoshua Bengio 57 29 0 14 Mar 2012
Conditional Restricted Boltzmann Machines for Structured Output Prediction Volodymyr Mnih Hugo Larochelle Geoffrey E. Hinton 68 126 0 14 Feb 2012
Multi-column Deep Neural Networks for Image Classification D. Ciresan U. Meier Jürgen Schmidhuber 137 3,938 0 13 Feb 2012
Spike-and-Slab Sparse Coding for Unsupervised Feature Discovery Ian Goodfellow Aaron Courville Yoshua Bengio 74 61 0 16 Jan 2012
Building high-level features using large scale unsupervised learning Quoc V. Le MarcÁurelio Ranzato R. Monga M. Devin Kai Chen G. Corrado J. Dean A. Ng SSL OffRL CVBM 114 2,271 0 29 Dec 2011
Structured sparsity through convex optimization Francis R. Bach Rodolphe Jenatton Julien Mairal G. Obozinski 200 325 0 12 Sep 2011
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent Feng Niu Benjamin Recht Christopher Ré Stephen J. Wright 165 2,273 0 28 Jun 2011
Natural Language Processing (almost) from Scratch R. Collobert Jason Weston Léon Bottou Michael Karlen Koray Kavukcuoglu Pavel P. Kuksa 155 7,721 0 02 Mar 2011
Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition Koray Kavukcuoglu MarcÁurelio Ranzato Yann LeCun 101 247 0 18 Oct 2010
Structured Variable Selection with Sparsity-Inducing Norms Rodolphe Jenatton Jean-Yves Audibert Francis R. Bach 187 607 0 22 Apr 2009