Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural
Networks with Attention over Modules

Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules

30 June 2020

Vikram S. Voleti

Murray Shanahan

Guillaume Lajoie

Michael C. Mozer

Papers citing "Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules"

15 / 15 papers shown

Title
OverLoCK: An Overview-first-Look-Closely-next ConvNet with Context-Mixing Dynamic Kernels Meng Lou Yizhou Yu 196 1 0 27 Feb 2025
Flexible task abstractions emerge in linear networks with fast and bounded units Kai Sandbrink Jan P. Bauer A. Proca Andrew M. Saxe Christopher Summerfield Ali Hummos 83 2 0 17 Jan 2025
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 101 2 0 09 Sep 2024
Associative Transformer Yuwei Sun H. Ochiai Zhirong Wu Stephen Lin Ryota Kanai ViT 88 0 0 22 Sep 2023
Recurrent Independent Mechanisms Anirudh Goyal Alex Lamb Jordan Hoffmann Shagun Sodhani Sergey Levine Yoshua Bengio Bernhard Schölkopf 63 336 0 24 Sep 2019
Convolutional Bipartite Attractor Networks Michael L. Iuzzolino Y. Singer Michael C. Mozer 34 8 0 08 Jun 2019
Relational recurrent neural networks Adam Santoro Ryan Faulkner David Raposo Jack W. Rae Mike Chrzanowski T. Weber Daan Wierstra Oriol Vinyals Razvan Pascanu Timothy Lillicrap GNN 103 211 0 05 Jun 2018
Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and their Interactions Sjoerd van Steenkiste Michael Chang Klaus Greff Jürgen Schmidhuber BDL OCL DRL 131 290 0 28 Feb 2018
Stochastic Video Generation with a Learned Prior Emily L. Denton Rob Fergus VGen 70 525 0 21 Feb 2018
The Consciousness Prior Yoshua Bengio DRL AI4CE 37 229 0 25 Sep 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 236 18,685 0 20 Jul 2017
Modulating early visual processing by language H. D. Vries Florian Strub Jérémie Mary Hugo Larochelle Olivier Pietquin Aaron Courville 103 484 0 02 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 453 129,831 0 12 Jun 2017
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 73 534 0 06 Sep 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 842 149,474 0 22 Dec 2014