Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers

27 February 2019

Papers citing "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers"

29 / 29 papers shown

Title
Deep Reinforcement Learning and its Neuroscientific Implications M. Botvinick Jane X. Wang Will Dabney Kevin J. Miller Z. Kurth-Nelson OffRL AI4CE 53 169 0 07 Jul 2020
Biologically Inspired Mechanisms for Adversarial Robustness M. V. Reddy Andrzej Banburski Nishka Pant T. Poggio AAML 43 46 0 29 Jun 2020
Deep Double Descent: Where Bigger Models and More Data Hurt Preetum Nakkiran Gal Kaplun Yamini Bansal Tristan Yang Boaz Barak Ilya Sutskever 117 925 0 04 Dec 2019
Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction Xiangbo Shu Liyan Zhang Guo-Jun Qi Wei Liu Jinhui Tang 3DH HAI 97 205 0 29 Sep 2019
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 509 4,308 0 23 Aug 2019
A Story of Two Streams: Reinforcement Learning Models from Human Behavior and Neuropsychiatry Baihan Lin Guillermo Cecchi Djallel Bouneffouf Jenna M. Reinen Irina Rish OffRL 32 36 0 21 Jun 2019
Split Q Learning: Reinforcement Learning with Two-Stream Rewards Baihan Lin Djallel Bouneffouf Guillermo Cecchi OffRL 36 22 0 21 Jun 2019
The Price of Fair PCA: One Extra Dimension Samira Samadi U. Tantipongpipat Jamie Morgenstern Mohit Singh Santosh Vempala FaML 107 155 0 31 Oct 2018
Dual Attention Network for Scene Segmentation J. Fu Qingbin Liu Haijie Tian Yong Li Yongjun Bao Zhiwei Fang Hanqing Lu SSeg 282 5,079 0 09 Sep 2018
The Roles of Supervised Machine Learning in Systems Neuroscience Joshua I. Glaser Ari S. Benjamin Roozbeh Farhoodi Konrad Paul Kording 43 114 0 21 May 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 191 3,433 0 09 Mar 2018
The Description Length of Deep Learning Models Léonard Blier Yann Ollivier 64 97 0 20 Feb 2018
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 288 18,685 0 20 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 530 129,831 0 12 Jun 2017
Residual Attention Network for Image Classification Fei Wang Mengqing Jiang Chao Qian Shuo Yang Cheng Li Honggang Zhang Xiaogang Wang Xiaoou Tang 109 3,299 0 23 Apr 2017
Opening the Black Box of Deep Neural Networks via Information Ravid Shwartz-Ziv Naftali Tishby AI4CE 94 1,406 0 02 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 302 4,620 0 10 Nov 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 321 10,412 0 21 Jul 2016
OpenAI Gym Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang Wojciech Zaremba OffRL ODL 188 5,056 0 05 Jun 2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex Q. Liao T. Poggio 240 256 0 13 Apr 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 158 1,933 0 25 Feb 2016
Gated Graph Sequence Neural Networks Yujia Li Daniel Tarlow Marc Brockschmidt R. Zemel GNN 301 3,271 0 17 Nov 2015
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 277 6,628 0 08 Jun 2015
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks Jason Weston Antoine Bordes S. Chopra Alexander M. Rush Bart van Merriënboer Armand Joulin Tomas Mikolov LRM ELM 122 1,178 0 19 Feb 2015
DRAW: A Recurrent Neural Network For Image Generation Karol Gregor Ivo Danihelka Alex Graves Danilo Jimenez Rezende Daan Wierstra GAN DRL 157 1,959 0 16 Feb 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 398 43,154 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.3K 149,474 0 22 Dec 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 217 14,861 1 21 Dec 2013
Playing Atari with Deep Reinforcement Learning Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra Martin Riedmiller 112 12,163 0 19 Dec 2013