BP-Transformer: Modelling Long-Range Context via Binary Partitioning

11 November 2019

Qipeng Guo

Xipeng Qiu

Papers citing "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"

27 / 27 papers shown

Title
Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks Minjie Wang Da Zheng Zihao Ye Quan Gan Mufei Li ... Jiaqi Zhao Haotong Zhang Alex Smola Jinyang Li Zheng Zhang AI4CE GNN 293 760 0 03 Sep 2019
Hierarchical Transformers for Multi-Document Summarization Yang Liu Mirella Lapata 124 298 0 30 May 2019
Adaptive Attention Span in Transformers Sainbayar Sukhbaatar Edouard Grave Piotr Bojanowski Armand Joulin 79 286 0 19 May 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 135 1,919 0 23 Apr 2019
Star-Transformer Qipeng Guo Xipeng Qiu Pengfei Liu Yunfan Shao Xiangyang Xue Zheng Zhang 80 263 0 25 Feb 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 260 3,747 0 09 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Document-Level Neural Machine Translation with Hierarchical Attention Networks Lesly Miculicich Dhananjay Ram Nikolaos Pappas James Henderson AIMat 80 269 0 05 Sep 2018
Character-Level Language Modeling with Deeper Self-Attention Rami Al-Rfou Dokook Choe Noah Constant Mandy Guo Llion Jones 154 392 0 09 Aug 2018
Relational inductive biases, deep learning, and graph networks Peter W. Battaglia Jessica B. Hamrick V. Bapst Alvaro Sanchez-Gonzalez V. Zambaldi ... Pushmeet Kohli M. Botvinick Oriol Vinyals Yujia Li Razvan Pascanu AI4CE NAI 769 3,132 0 04 Jun 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 184 2,998 0 23 Apr 2018
Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling Tao Shen Dinesh Manocha Guodong Long Jing Jiang Chengqi Zhang HAI 78 148 0 03 Apr 2018
Self-Attention with Relative Position Representations Peter Shaw Jakob Uszkoreit Ashish Vaswani 182 2,299 0 06 Mar 2018
Generating Wikipedia by Summarizing Long Sequences Peter J. Liu Mohammad Saleh Etienne Pot Ben Goodrich Ryan Sepassi Lukasz Kaiser Noam M. Shazeer CVBM 216 801 0 30 Jan 2018
Learning to Remember Translation History with a Continuous Cache Zhaopeng Tu Yang Liu Shuming Shi Tong Zhang CLL 70 181 0 26 Nov 2017
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 484 20,265 0 30 Oct 2017
Learned in Translation: Contextualized Word Vectors Bryan McCann James Bradbury Caiming Xiong R. Socher 126 910 0 01 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 805 132,725 0 12 Jun 2017
Convolutional Sequence to Sequence Learning Jonas Gehring Michael Auli David Grangier Denis Yarats Yann N. Dauphin AIMat 174 3,290 0 08 May 2017
Quasi-Recurrent Neural Networks James Bradbury Stephen Merity Caiming Xiong R. Socher 193 444 0 05 Nov 2016
Neural Machine Translation in Linear Time Nal Kalchbrenner L. Espeholt Karen Simonyan Aaron van den Oord Alex Graves Koray Kavukcuoglu AIMat 115 553 0 31 Oct 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 914 6,799 0 26 Sep 2016
Multiplicative LSTM for sequence modelling Ben Krause Liang Lu Iain Murray Steve Renals 80 208 0 26 Sep 2016
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 121 538 0 06 Sep 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 435 10,541 0 21 Jul 2016
Recurrent Highway Networks J. Zilly R. Srivastava Jan Koutník Jürgen Schmidhuber 98 418 0 12 Jul 2016
When Are Tree Structures Necessary for Deep Learning of Representations? Jiwei Li Thang Luong Dan Jurafsky Eduard H. Hovy 93 1 0 28 Feb 2015