v1v2v3v4 (latest)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

23 October 2019

Sharan Narang

Papers citing "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

50 / 9,870 papers shown

Title
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 73 141 0 10 Nov 2020
Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts Hanmeng Liu Leyang Cui Jian Liu Yue Zhang ReLM LRM 78 44 0 10 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 125 129 0 10 Nov 2020
Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT Rik van Noord Antonio Toral Johan Bos 64 4 0 09 Nov 2020
BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention Zhebin Zhang Sai Wu Dawei Jiang Gang Chen 46 0 0 09 Nov 2020
SeqGenSQL -- A Robust Sequence Generation Model for Structured Query Language Ning Li Bethany Keller M. Butler Daniel Cer 59 8 0 07 Nov 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 228 54 0 05 Nov 2020
Language Model is All You Need: Natural Language Understanding as Question Answering Mahdi Namazifar Alexandros Papangelis Gokhan Tur Dilek Z. Hakkani-Tür 48 49 0 05 Nov 2020
Improving Robotic Grasping on Monocular Images Via Multi-Task Learning and Positional Loss William Prew T. Breckon M. Bordewich Ulrik R Beierholm 38 7 0 05 Nov 2020
Optimizing Transformer for Low-Resource Neural Machine Translation Ali Araabi Christof Monz VLM 86 78 0 04 Nov 2020
Data-to-Text Generation with Iterative Text Editing Zdeněk Kasner Ondrej Dusek 40 24 0 03 Nov 2020
Automatic Detection of Machine Generated Text: A Critical Survey Ganesh Jawahar Muhammad Abdul-Mageed L. Lakshmanan DeLMO 81 240 0 02 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li Edoardo Ponti Ivan Vulić Anna Korhonen 106 19 0 02 Nov 2020
ABNIRML: Analyzing the Behavior of Neural IR Models Sean MacAvaney Sergey Feldman Nazli Goharian Doug Downey Arman Cohan 67 49 0 02 Nov 2020
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP Fajri Koto Afshin Rahimi Jey Han Lau Timothy Baldwin 68 263 0 02 Nov 2020
Social Chemistry 101: Learning to Reason about Social and Moral Norms Maxwell Forbes Jena D. Hwang Vered Shwartz Maarten Sap Yejin Choi 69 271 0 01 Nov 2020
Towards A Friendly Online Community: An Unsupervised Style Transfer Framework for Profanity Redaction M. Tran Yipeng Zhang M. Soleymani 65 30 0 01 Nov 2020
SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee Drew A. Hudson Kangwook Lee Christopher D. Manning SSL 119 52 0 30 Oct 2020
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina Alena Fenogenova Anton A. Emelyanov Denis Shevelev Ekaterina Artemova Valentin Malykh Vladislav Mikhailov Maria Tikhonova Andrey Chertok Andrey Evlampiev VLM ELM 89 82 0 29 Oct 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 86 161 0 28 Oct 2020
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus Isaac Caswell Theresa Breiner D. Esch Ankur Bapna 92 90 0 27 Oct 2020
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification Timo Schick Helmut Schmid Hinrich Schütze VLM 98 209 0 26 Oct 2020
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping Minjia Zhang Yuxiong He AI4CE 48 104 0 26 Oct 2020
Pre-trained Summarization Distillation Sam Shleifer Alexander M. Rush 62 103 0 24 Oct 2020
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints Ximing Lu Peter West Rowan Zellers Ronan Le Bras Chandra Bhagavatula Yejin Choi NAI 89 147 0 24 Oct 2020
Learning Contextualized Knowledge Structures for Commonsense Reasoning Jun Yan Mrigank Raman Aaron Chan Tianyu Zhang Ryan Rossi Handong Zhao Sungchul Kim Nedim Lipka Xiang Ren 306 37 0 24 Oct 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 217 170 0 24 Oct 2020
Differentiable Open-Ended Commonsense Reasoning Bill Yuchen Lin Haitian Sun Bhuwan Dhingra Manzil Zaheer Xiang Ren William W. Cohen ReLM LRM 78 43 0 24 Oct 2020
ReadOnce Transformers: Reusable Representations of Text for Transformers Shih-Ting Lin Ashish Sabharwal Tushar Khot 114 3 0 24 Oct 2020
CoCo: Controllable Counterfactuals for Evaluating Dialogue State Trackers Shiyang Li Semih Yavuz Kazuma Hashimoto Jia Li Tong Niu Nazneen Rajani Xifeng Yan Yingbo Zhou Caiming Xiong 111 62 0 24 Oct 2020
GO FIGURE: A Meta Evaluation of Factuality in Summarization Saadia Gabriel Asli Celikyilmaz Rahul Jha Yejin Choi Jianfeng Gao HILM 317 96 0 24 Oct 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 58 6 0 24 Oct 2020
Text Editing by Command Felix Faltings Michel Galley Gerold Hintz Chris Brockett Chris Quirk Jianfeng Gao Bill Dolan KELM 207 38 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 177 143 0 24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 55 72 0 24 Oct 2020
COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval Xinliang Frederick Zhang Heming Sun Xiang Yue Simon M. Lin Huan Sun RALM 117 17 0 24 Oct 2020
Improving Multilingual Models with Language-Clustered Vocabularies Hyung Won Chung Dan Garrette Kiat Chuan Tan Jason Riesa VLM 129 65 0 24 Oct 2020
Measuring Association Between Labels and Free-Text Rationales Sarah Wiegreffe Ana Marasović Noah A. Smith 339 182 0 24 Oct 2020
Temporal Reasoning on Implicit Events from Distant Supervision Ben Zhou Kyle Richardson Qiang Ning Tushar Khot Ashish Sabharwal Dan Roth 270 80 0 24 Oct 2020
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both? Peter Shaw Ming-Wei Chang Panupong Pasupat Kristina Toutanova CoGe 87 187 0 24 Oct 2020
AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization Sayali Kulkarni Sheide Chammas Wan Zhu Fei Sha Eugene Ie RALM 113 53 0 23 Oct 2020
Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training Oshin Agarwal Heming Ge Siamak Shakeri Rami Al-Rfou 75 38 0 23 Oct 2020
Dynamic Contextualized Word Embeddings Valentin Hofmann J. Pierrehumbert Hinrich Schütze 112 52 0 23 Oct 2020
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Arij Riabi Thomas Scialom Rachel Keraron Benoît Sagot Djamé Seddah Jacopo Staiano 218 54 0 23 Oct 2020
Comparative analysis of word embeddings in assessing semantic similarity of complex sentences Dhivya Chandrasekaran Vijay K. Mago 124 8 0 23 Oct 2020
Unsupervised Multi-hop Question Answering by Question Generation Liangming Pan Wenhu Chen Wenhan Xiong Min-Yen Kan William Yang Wang 108 59 0 23 Oct 2020
Answering Open-Domain Questions of Varying Reasoning Steps from Text Peng Qi Haejun Lee OghenetegiriTGSido Christopher D. Manning KELM RALM LRM 250 57 0 23 Oct 2020
Neural Passage Retrieval with Improved Negative Contrast Jing Lu Gustavo Hernández Ábrego Ji Ma Jianmo Ni Yinfei Yang 87 25 0 23 Oct 2020
Pretraining and Fine-Tuning Strategies for Sentiment Analysis of Latvian Tweets Gaurish Thakkar Marcis Pinnis 95 9 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 356 301 0 23 Oct 2020