Conditional Computation in Neural Networks for faster models

19 November 2015

Pierre-Luc Bacon

Papers citing "Conditional Computation in Neural Networks for faster models"

24 / 74 papers shown

Title
Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks Róbert Csordás Sjoerd van Steenkiste Jürgen Schmidhuber 53 87 0 05 Oct 2020
Multi-modal Experts Network for Autonomous Driving Shihong Fang A. Choromańska MoE 28 5 0 18 Sep 2020
Biased Mixtures Of Experts: Enabling Computer Vision Inference Under Data Transfer Limitations Alhabib Abbas Y. Andreopoulos MoE 19 18 0 21 Aug 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Z. Chen MoE 43 1,108 0 30 Jun 2020
Which scaling rule applies to Artificial Neural Networks János Végh 37 9 0 15 May 2020
Learning to Continually Learn Shawn L. E. Beaulieu Lapo Frati Thomas Miconi Joel Lehman Kenneth O. Stanley Jeff Clune Nick Cheney KELM CLL 46 146 0 21 Feb 2020
Attention over Parameters for Dialogue Systems Andrea Madotto Zhaojiang Lin Chien-Sheng Wu Jamin Shin Pascale Fung 30 20 0 07 Jan 2020
XNOR-Net++: Improved Binary Neural Networks Adrian Bulat Georgios Tzimiropoulos MQ 39 200 0 30 Sep 2019
A Novel Design of Adaptive and Hierarchical Convolutional Neural Networks using Partial Reconfiguration on FPGA Mohammad Farhadi Mehdi Ghasemi Yezhou Yang 22 27 0 05 Sep 2019
Conditional Computation for Continual Learning Min-Bin Lin Jie Fu Yoshua Bengio CLL 31 10 0 16 Jun 2019
Interpretable Neural Network Decoupling Yuchao Li Rongrong Ji Shaohui Lin Baochang Zhang Chenqian Yan Yongjian Wu Feiyue Huang Ling Shao 37 2 0 04 Jun 2019
Routing Networks and the Challenges of Modular and Compositional Computation Clemens Rosenbaum Ignacio Cases Matthew D Riemer Tim Klinger 40 78 0 29 Apr 2019
Question Guided Modular Routing Networks for Visual Question Answering Yanze Wu Qiang Sun Jianqi Ma Bin Li Yanwei Fu Yao Peng Xiangyang Xue 23 1 0 17 Apr 2019
InstaNAS: Instance-aware Neural Architecture Search A. Cheng Chieh Hubert Lin Da-Cheng Juan Wei Wei Min Sun 30 46 0 26 Nov 2018
SpotTune: Transfer Learning through Adaptive Fine-tuning Yunhui Guo Humphrey Shi Abhishek Kumar Kristen Grauman Tajana Simunic Rogerio Feris 36 445 0 21 Nov 2018
Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference Matthew D Riemer Ignacio Cases R. Ajemian Miao Liu Irina Rish Y. Tu Gerald Tesauro CLL 33 765 0 29 Oct 2018
Mode Normalization Lucas Deecke Iain Murray Hakan Bilen OOD 29 33 0 12 Oct 2018
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 44 382 0 30 Nov 2017
Deep Convolutional Decision Jungle for Image Classification Seungryul Baek K. Kim Tae-Kyun Kim 21 17 0 06 Jun 2017
Metacontrol for Adaptive Imagination-Based Optimization Jessica B. Hamrick A. J. Ballard Razvan Pascanu Oriol Vinyals N. Heess Peter W. Battaglia 24 69 0 07 May 2017
Deciding How to Decide: Dynamic Routing in Artificial Neural Networks Mason McGill Pietro Perona 15 102 0 17 Mar 2017
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 55 2,513 0 23 Jan 2017
Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-offs by Selective Execution Lanlan Liu Jia Deng 24 200 0 02 Jan 2017
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,638 0 03 Jul 2012