Low-Rank Constraints for Fast Inference in Structured Models

8 January 2022

Papers citing "Low-Rank Constraints for Fast Inference in Structured Models"

33 / 33 papers shown

Title
PCFGs Can Do Better: Inducing Probabilistic Context-Free Grammars with Many Symbols Aaron Courville Yanpeng Zhao Kewei Tu 46 23 0 28 Apr 2021
Random Feature Attention Hao Peng Nikolaos Pappas Dani Yogatama Roy Schwartz Noah A. Smith Lingpeng Kong 107 358 0 03 Mar 2021
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps Tri Dao N. Sohoni Albert Gu Matthew Eichhorn Amit Blonder Megan Leszczynski Atri Rudra Christopher Ré 62 49 0 29 Dec 2020
Scaling Hidden Markov Language Models Justin T. Chiu Alexander M. Rush BDL 104 25 0 09 Nov 2020
Factor Graph Grammars David Chiang Darcey Riley LRM 46 10 0 22 Oct 2020
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 184 1,597 0 30 Sep 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 201 1,771 0 29 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 823 42,332 0 28 May 2020
Learning to Segment Actions from Observation and Narration Daniel Fried Jean-Baptiste Alayrac Phil Blunsom Chris Dyer S. Clark Aida Nematzadeh 94 32 0 07 May 2020
Seq-U-Net: A One-Dimensional Causal U-Net for Efficient Sequence Modelling Ruizhe Zhao Brian K. Vogel Tanvir Ahmed Wayne Luk 51 37 0 14 Nov 2019
R-Transformer: Recurrent Neural Network Enhanced Transformer Z. Wang Yao Ma Zitao Liu Jiliang Tang ViT 68 106 0 12 Jul 2019
Compound Probabilistic Context-Free Grammars for Grammar Induction Yoon Kim Chris Dyer Alexander M. Rush 50 152 0 24 Jun 2019
Scaling Autoregressive Video Models Dirk Weissenborn Oscar Täckström Jakob Uszkoreit DiffM VGen 94 203 0 06 Jun 2019
Bivariate Beta-LSTM Kyungwoo Song Joonho Jang Seung-Jae Shin Il-Chul Moon 43 6 0 25 May 2019
Learning higher-order sequential structure with cloned HMMs Antoine Dedieu Nishad Gothoskar Scott Swingle Wolfgang Lehrach Miguel Lazaro-Gredilla Dileep George 55 17 0 01 May 2019
Cross-task weakly supervised learning from instructional videos Dimitri Zhukov Jean-Baptiste Alayrac R. G. Cinbis David Fouhey Ivan Laptev Josef Sivic SSL 124 249 0 19 Mar 2019
Latent Normalizing Flows for Discrete Sequences Zachary M. Ziegler Alexander M. Rush BDL DRL 62 127 0 29 Jan 2019
Interpretable Deep Learning under Fire Xinyang Zhang Ningfei Wang Hua Shen S. Ji Xiapu Luo Ting Wang AAML AI4CE 108 172 0 03 Dec 2018
On a hypergraph probabilistic graphical model Mohammad Ali Javidian Linyuan Lu Marco Valtorta Zhiyu Wang 28 15 0 20 Nov 2018
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 122 324 0 22 Oct 2018
Embedded-State Latent Conditional Random Fields for Sequence Labeling Dung Ngoc Thai Sree Harsha Ramesh Shikhar Murty Luke Vilnis Andrew McCallum BDL 44 5 0 28 Sep 2018
Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review Sergey Levine AI4CE BDL 84 674 0 02 May 2018
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 146 2,142 0 14 Nov 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 60 178 0 02 Nov 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 166 1,096 0 07 Aug 2017
Structured Inference Networks for Nonlinear State Space Models Rahul G. Krishnan Uri Shalit David Sontag BDL 93 457 0 30 Sep 2016
Sequential Neural Models with Stochastic Layers Marco Fraccaro Søren Kaae Sønderby Ulrich Paquet Ole Winther BDL 117 398 0 24 May 2016
Deep Temporal Sigmoid Belief Networks for Sequence Modeling Zhe Gan Chunyuan Li Ricardo Henao David Carlson Lawrence Carin BDL 65 85 0 23 Sep 2015
Neural Adaptive Sequential Monte Carlo S. Gu Zoubin Ghahramani Richard Turner BDL 73 147 0 10 Jun 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.9K 150,260 0 22 Dec 2014
Learning Stochastic Recurrent Networks Justin Bayer Christian Osendorfer BDL 78 274 0 27 Nov 2014
Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription Nicolas Boulanger-Lewandowski Yoshua Bengio Pascal Vincent 179 704 0 27 Jun 2012
Reduced-Rank Hidden Markov Models S. Siddiqi Byron Boots Geoffrey J. Gordon BDL 233 136 0 06 Oct 2009