v1v2v3v4 (latest)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

23 October 2019

Sharan Narang

Papers citing "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

50 / 9,866 papers shown

Title
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP Jiaao Chen Derek Tam Colin Raffel Joey Tianyi Zhou Diyi Yang 116 178 0 14 Jun 2021
GitTables: A Large-Scale Corpus of Relational Tables Madelon Hulsebos cCaugatay Demiralp Paul T. Groth LMTD 128 89 0 14 Jun 2021
Automatic Document Sketching: Generating Drafts from Analogous Texts Zeqiu Wu Michel Galley Chris Brockett Yizhe Zhang Bill Dolan 100 5 0 14 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 174 863 0 14 Jun 2021
Why Can You Lay Off Heads? Investigating How BERT Heads Transfer Ting-Rui Chiang Yun-Nung Chen 38 0 0 14 Jun 2021
Memory-efficient Transformers via Top- $k$ Attention Ankit Gupta Guy Dar Shaya Goodman David Ciprut Jonathan Berant MQ 98 60 0 13 Jun 2021
Can Transformer Language Models Predict Psychometric Properties? Antonio Laverghetta Animesh Nighojkar Jamshidbek Mirzakhalov John Licato LM&MA 71 14 0 12 Jun 2021
Prompting Contrastive Explanations for Commonsense Reasoning Tasks Bhargavi Paranjape Julian Michael Marjan Ghazvininejad Luke Zettlemoyer Hannaneh Hajishirzi ReLM LRM 76 68 0 12 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 117 70 0 11 Jun 2021
FedNLP: An interpretable NLP System to Decode Federal Reserve Communications Jean Lee Hoyoul Luis Youn Nicholas Stevens Josiah Poon S. Han 55 10 0 11 Jun 2021
From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing via Synchronous Semantic Decoding Shan Wu Bo Chen Chunlei Xin Xianpei Han Le Sun Weipeng Zhang Jiansong Chen Fan Yang Xunliang Cai OffRL 72 24 0 11 Jun 2021
Generate, Annotate, and Learn: NLP with Synthetic Text Xuanli He Islam Nassar J. Kiros Gholamreza Haffari Mohammad Norouzi 88 53 0 11 Jun 2021
TellMeWhy: A Dataset for Answering Why-Questions in Narratives Yash Kumar Lal Nathanael Chambers Raymond J. Mooney Niranjan Balasubramanian 95 47 0 11 Jun 2021
Space-time Mixing Attention for Video Transformer Adrian Bulat Juan-Manuel Perez-Rua Swathikiran Sudhakaran Brais Martínez Georgios Tzimiropoulos ViT 93 127 0 10 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 140 612 0 10 Jun 2021
Shades of BLEU, Flavours of Success: The Case of MultiWOZ Tomás Nekvinda Ondrej Dusek 74 59 0 10 Jun 2021
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models Tyler A. Chang Yifan Xu Weijian Xu Zhuowen Tu ViT 57 15 0 10 Jun 2021
Investigating Alternatives to the Root Mean Square for Adaptive Gradient Methods Brett Daley Chris Amato ODL 50 0 0 10 Jun 2021
DESCGEN: A Distantly Supervised Dataset for Generating Abstractive Entity Descriptions Weijia Shi Mandar Joshi Luke Zettlemoyer 3DV 50 3 0 09 Jun 2021
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering Devendra Singh Sachan Siva Reddy William L. Hamilton Chris Dyer Dani Yogatama OOD RALM 97 170 0 09 Jun 2021
Do Transformers Really Perform Bad for Graph Representation? Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen Tie-Yan Liu GNN 109 443 0 09 Jun 2021
Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data Moshe Hazoom Vibhor Malik Ben Bogin 81 52 0 09 Jun 2021
Neural Supervised Domain Adaptation by Augmenting Pre-trained Models with Random Units Sara Meftah N. Semmar Y. Tamaazousti H. Essafi F. Sadat 50 3 0 09 Jun 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 151 1,222 0 09 Jun 2021
FastSeq: Make Sequence Generation Faster Yu Yan Fei Hu Jiusheng Chen Nikhil Bhendawade Ting Ye Yeyun Gong Nan Duan Desheng Cui Bingyu Chi Ruifei Zhang VLM 68 15 0 08 Jun 2021
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers Rabeeh Karimi Mahabadi James Henderson Sebastian Ruder MoE 153 494 0 08 Jun 2021
TIMEDIAL: Temporal Commonsense Reasoning in Dialog Lianhui Qin Aditya Gupta Shyam Upadhyay Luheng He Yejin Choi Manaal Faruqui LRM 98 72 0 08 Jun 2021
XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation Subhabrata Mukherjee Ahmed Hassan Awadallah Jianfeng Gao 59 22 0 08 Jun 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 197 1,147 0 08 Jun 2021
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks Rabeeh Karimi Mahabadi Sebastian Ruder Mostafa Dehghani James Henderson MoE 82 313 0 08 Jun 2021
A Unified Generative Framework for Aspect-Based Sentiment Analysis Hang Yan Junqi Dai Tuo Ji Xipeng Qiu Zheng Zhang 86 284 0 08 Jun 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 104 76 0 08 Jun 2021
RewardsOfSum: Exploring Reinforcement Learning Rewards for Summarisation Jacob Parnell Inigo Jauregi Unanue Massimo Piccardi 55 5 0 08 Jun 2021
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering Aditya Gupta Jiacheng Xu Shyam Upadhyay Diyi Yang Manaal Faruqui 90 33 0 08 Jun 2021
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning Piotr Pikekos Henryk Michalewski Mateusz Malinowski 74 28 0 07 Jun 2021
A Simple Recipe for Multilingual Grammatical Error Correction S. Rothe Jonathan Mallinson Eric Malmi Sebastian Krause Aliaksei Severyn 73 169 0 07 Jun 2021
Efficient Training of Visual Transformers with Small Datasets Yahui Liu E. Sangineto Wei Bi N. Sebe Bruno Lepri Marco De Nadai ViT 75 174 0 07 Jun 2021
A Comprehensive Assessment of Dialog Evaluation Metrics Yi-Ting Yeh M. Eskénazi Shikib Mehri 90 109 0 07 Jun 2021
PROST: Physical Reasoning of Objects through Space and Time Stéphane Aroca-Ouellette Cory Paik Alessandro Roncone Katharina Kann LRM 80 49 0 07 Jun 2021
BERTGEN: Multi-task Generation through BERT Faidon Mitzalis Ozan Caglayan Pranava Madhyastha Lucia Specia VLM 48 7 0 07 Jun 2021
Summary Grounded Conversation Generation R. Chulaka Gunasekara Guy Feigenblat Benjamin Sznajder Sachindra Joshi D. Konopnicki 56 8 0 07 Jun 2021
Real-Time Cognitive Evaluation of Online Learners through Automatically Generated Questions Ritu Gala Revathi Vijayaraghavan V. Nikam Arvind W. Kiwelekar 18 4 0 06 Jun 2021
Exploring the Limits of Out-of-Distribution Detection Stanislav Fort Jie Jessie Ren Balaji Lakshminarayanan 103 342 0 06 Jun 2021
BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling Zhaojiang Lin Andrea Madotto Genta Indra Winata Peng Xu Feijun Jiang Yuxiang Hu Chen Shi Pascale Fung 100 62 0 05 Jun 2021
AgreeSum: Agreement-Oriented Multi-Document Summarization Richard Yuanzhe Pang Á. Lelkes Vinh Q. Tran Cong Yu 53 17 0 04 Jun 2021
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression Weiyue Su Xuyi Chen Shi Feng Jiaxiang Liu Weixin Liu Yu Sun Hao Tian Hua Wu Haifeng Wang 81 13 0 04 Jun 2021
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? Mihir Kale Aditya Siddhant Noah Constant Melvin Johnson Rami Al-Rfou Linting Xue LRM 70 25 0 03 Jun 2021
Anticipative Video Transformer Rohit Girdhar Kristen Grauman ViT 73 212 0 03 Jun 2021
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models Ulme Wennberg G. Henter MILM 93 22 0 03 Jun 2021
Defending Against Backdoor Attacks in Natural Language Generation Xiaofei Sun Xiaoya Li Yuxian Meng Xiang Ao Leilei Gan Jiwei Li Tianwei Zhang AAML SILM 103 52 0 03 Jun 2021