Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization

20 May 2023

Papers citing "Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization"

32 / 32 papers shown

Title
Layer-wise Representation Fusion for Compositional Generalization Yafang Zheng Lei Lin Shantao Liu Binling Wang Zhaohong Lai Wenhao Rao Biao Fu Yidong Chen Xiaodon Shi AI4CE 68 2 0 20 Jul 2023
LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation Lei Lin Shuangtao Li Xiaodon Shi 57 5 0 21 Mar 2023
Real-World Compositional Generalization with Disentangled Sequence-to-Sequence Learning Hao Zheng Mirella Lapata OOD CoGe DRL 46 5 0 12 Dec 2022
Structural generalization is hard for sequence-to-sequence models Yuekun Yao Alexander Koller 67 22 0 24 Oct 2022
Learning Algebraic Recombination for Compositional Generalization Chenyao Liu Shengnan An Zeqi Lin Qian Liu Bei Chen Jian-Guang Lou Lijie Wen Nanning Zheng Dongmei Zhang CoGe 217 36 0 14 Jul 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 94 75 0 08 Jun 2021
Lexicon Learning for Few-Shot Neural Sequence Modeling Ekin Akyürek Jacob Andreas 70 33 0 07 Jun 2021
Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representations Jonathan Herzig Peter Shaw Ming-Wei Chang Kelvin Guu Panupong Pasupat Yuan Zhang AI4CE 64 69 0 15 Apr 2021
Sequence-Level Mixed Sample Data Augmentation Demi Guo Yoon Kim Alexander M. Rush 63 100 0 18 Nov 2020
Compositional Generalization via Semantic Tagging Hao Zheng Mirella Lapata 66 35 0 22 Oct 2020
Hierarchical Poset Decoding for Compositional Generalization in Language Yinuo Guo Zeqi Lin Jian-Guang Lou Dongmei Zhang AI4CE 112 31 0 15 Oct 2020
Shallow-to-Deep Training for Neural Machine Translation Bei Li Ziyang Wang Hui Liu Yufan Jiang Quan Du Tong Xiao Huizhen Wang Jingbo Zhu 39 49 0 08 Oct 2020
Learning to Recombine and Resample Data for Compositional Generalization Ekin Akyürek Afra Feyza Akyürek Jacob Andreas 64 80 0 08 Oct 2020
Span-based Semantic Parsing for Compositional Generalization Jonathan Herzig Jonathan Berant ReLM LRM 56 102 0 13 Sep 2020
AdvAug: Robust Adversarial Augmentation for Neural Machine Translation Yong Cheng Lu Jiang Wolfgang Macherey Jacob Eisenstein 67 117 0 21 Jun 2020
Learning Compositional Rules via Neural Program Synthesis Maxwell Nye Armando Solar-Lezama J. Tenenbaum Brenden M. Lake NAI LRM 60 118 0 12 Mar 2020
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data Daniel Keysers Nathanael Scharli Nathan Scales Hylke Buisman Daniel Furrer ... Tibor Tihon Dmitry Tsarkov Tianlin Li Marc van Zee Olivier Bousquet CoGe 60 353 0 20 Dec 2019
On Compositionality in Neural Machine Translation Vikas Raunak Vaibhav Kumar Florian Metze 40 17 0 04 Nov 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 275 186 0 03 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 627 24,431 0 26 Jul 2019
Learning Deep Transformer Models for Machine Translation Qiang Wang Bei Li Tong Xiao Jingbo Zhu Changliang Li Derek F. Wong Lidia S. Chao 76 671 0 05 Jun 2019
Compositional generalization in a deep seq2seq model by separating syntax and semantics Jacob Russin Jason Jo R. C. O'Reilly Yoshua Bengio 63 103 0 22 Apr 2019
Good-Enough Compositional Data Augmentation Jacob Andreas 68 234 0 21 Apr 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 105 3,149 0 01 Apr 2019
Dynamic Layer Aggregation for Neural Machine Translation with Routing-by-Agreement Zi-Yi Dou Zhaopeng Tu Xing Wang Longyue Wang Shuming Shi Tong Zhang AI4CE 43 56 0 15 Feb 2019
The Evolved Transformer David R. So Chen Liang Quoc V. Le ViT 103 462 0 30 Jan 2019
Exploiting Deep Representations for Neural Machine Translation Zi-Yi Dou Zhaopeng Tu Xing Wang Shuming Shi Tong Zhang 83 93 0 24 Oct 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 150 2,985 0 23 Apr 2018
Beam Search Strategies for Neural Machine Translation Markus Freitag Yaser Al-Onaizan 75 392 0 06 Feb 2017
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 215 7,735 0 31 Aug 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 434 20,553 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 552 27,300 0 01 Sep 2014