v1v2v3v4 (latest)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

23 October 2019

Sharan Narang

Papers citing "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

50 / 9,883 papers shown

Title
Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models Made Nindyatama Nityasya Haryo Akbarianto Wibowo Rendi Chevi Radityo Eko Prasojo Alham Fikri Aji 76 6 0 03 Jan 2022
ViNMT: Neural Machine Translation Toolkit Nguyen Hoang Quan N. T. Dat Nguyen Hoang Minh Cong Nguyen Van Vinh Ngo Thi Vinh N. Thai T. Viet 43 2 0 31 Dec 2021
Fine-Tuning Transformers: Vocabulary Transfer Vladislav D. Mosin Igor Samenko Alexey Tikhonov Borislav M. Kozlovskii Ivan P. Yamshchikov 79 20 0 29 Dec 2021
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate Xiaonan Nie Xupeng Miao Shijie Cao Lingxiao Ma Qibin Liu Jilong Xue Youshan Miao Yi Liu Zhi-Xin Yang Tengjiao Wang MoMe MoE 92 24 0 29 Dec 2021
A Survey on Gender Bias in Natural Language Processing Karolina Stañczak Isabelle Augenstein 93 117 0 28 Dec 2021
CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark Yuan Yao Qingxiu Dong Jian Guan Boxi Cao Zhengyan Zhang ... Zhiyuan Liu Xianpei Han Erhong Yang Zhifang Sui Maosong Sun ALM ELM 80 17 0 27 Dec 2021
Multimodal Image Synthesis and Editing: The Generative AI Era Fangneng Zhan Yingchen Yu Rongliang Wu Jiahui Zhang Shijian Lu Lingjie Liu Adam Kortylewski Christian Theobalt Eric Xing EGVM 198 51 0 27 Dec 2021
New Methods & Metrics for LFQA tasks Suchismit Mahapatra V. Blagojević P. Bertorello Prasanna Kumar 64 2 0 26 Dec 2021
Counterfactual Memorization in Neural Language Models Chiyuan Zhang Daphne Ippolito Katherine Lee Matthew Jagielski Florian Tramèr Nicholas Carlini 108 137 0 24 Dec 2021
Measuring Attribution in Natural Language Generation Models Hannah Rashkin Vitaly Nikolaev Matthew Lamm Lora Aroyo Michael Collins Dipanjan Das Slav Petrov Gaurav Singh Tomar Iulia Turc David Reitter 103 184 0 23 Dec 2021
SeMask: Semantically Masked Transformers for Semantic Segmentation Jitesh Jain Anukriti Singh Nikita Orlov Zilong Huang Jiachen Li Steven Walton Humphrey Shi ViT 88 98 0 23 Dec 2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Shuohuan Wang Yu Sun Yang Xiang Zhihua Wu Siyu Ding ... Tian Wu Wei Zeng Ge Li Wen Gao Haifeng Wang ELM 92 78 0 23 Dec 2021
LaTr: Layout-Aware Transformer for Scene-Text VQA Ali Furkan Biten Ron Litman Yusheng Xie Srikar Appalaraju R. Manmatha ViT 125 102 0 23 Dec 2021
Fine-grained Multi-Modal Self-Supervised Learning Duo Wang S. Karout SSL 65 7 0 22 Dec 2021
A Survey of Natural Language Generation Chenhe Dong Hai-Tao Zheng Haifan Gong Mengzhao Chen Junxin Li Ying Shen Min Yang 3DV 85 45 0 22 Dec 2021
Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization Md Tahmid Rahman Laskar Enamul Hoque J. Huang 95 45 0 22 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training? Alaaeldin El-Nouby Gautier Izacard Hugo Touvron Ivan Laptev Hervé Jégou Edouard Grave SSL 106 152 0 20 Dec 2021
Efficient Large Scale Language Modeling with Mixtures of Experts Mikel Artetxe Shruti Bhosale Naman Goyal Todor Mihaylov Myle Ott ... Jeff Wang Luke Zettlemoyer Mona T. Diab Zornitsa Kozareva Ves Stoyanov MoE 239 201 0 20 Dec 2021
Few-shot Learning with Multilingual Language Models Xi Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 153 308 0 20 Dec 2021
Spiral Language Modeling Yong Cao Yukun Feng Shaohui Kuang Gu Xu 149 0 0 20 Dec 2021
ScanQA: 3D Question Answering for Spatial Scene Understanding Daich Azuma Taiki Miyanishi Shuhei Kurita M. Kawanabe 104 208 0 20 Dec 2021
On Efficient Transformer-Based Image Pre-training for Low-Level Vision Wenbo Li Xin Lu Shengju Qian Jiangbo Lu Xinming Zhang Jiaya Jia ViT 140 88 0 19 Dec 2021
Cascading Adaptors to Leverage English Data to Improve Performance of Question Answering for Low-Resource Languages Hariom A. Pandya Bhavik Ardeshna Brijesh S. Bhatt 79 6 0 18 Dec 2021
ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime K. Annervaz Pritam Kumar Nath Ambedkar Dukkipati RALM 52 1 0 17 Dec 2021
An Empirical Investigation of the Role of Pre-training in Lifelong Learning Sanket Vaibhav Mehta Darshan Patil Sarath Chandar Emma Strubell CLL 151 145 0 16 Dec 2021
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability Kyle Richardson Ashish Sabharwal ReLM LRM 88 25 0 16 Dec 2021
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 92 44 0 16 Dec 2021
Self-Supervised Learning for speech recognition with Intermediate layer supervision Chengyi Wang Yu-Huan Wu Sanyuan Chen Shujie Liu Jinyu Li Yao Qian Zhenglu Yang SSL 70 29 0 16 Dec 2021
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning Xiangru Tang Arjun Nair Borui Wang Bingyao Wang Jai Desai Aaron Wade Haoran Li Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 59 63 0 16 Dec 2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models Chia-Hsuan Lee Aditya Siddhant Viresh Ratnakar Melvin Johnson LRM 56 9 0 16 Dec 2021
Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks Akari Asai Matt Gardner Hannaneh Hajishirzi RALM 93 48 0 16 Dec 2021
Reframing Human-AI Collaboration for Generating Free-Text Explanations Sarah Wiegreffe Jack Hessel Swabha Swayamdipta Mark O. Riedl Yejin Choi 77 149 0 16 Dec 2021
DREAM: Improving Situational QA by First Elaborating the Situation Yuling Gu Bhavana Dalvi Peter Clark 119 18 0 16 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 107 799 0 16 Dec 2021
Analyzing the Limits of Self-Supervision in Handling Bias in Language Lisa Bauer Karthik Gopalakrishnan Spandana Gella Yang Liu Joey Tianyi Zhou Dilek Z. Hakkani-Tür ELM 41 1 0 16 Dec 2021
FRUIT: Faithfully Reflecting Updated Information in Text Robert L Logan IV Alexandre Passos Sameer Singh Ming-Wei Chang KELM 112 42 0 16 Dec 2021
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 96 709 0 16 Dec 2021
Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge Yoonna Jang J. Lim Yuna Hur Dongsuk Oh Suhyune Son Yeonsoo Lee Donghoon Shin Seungryong Kim Heuiseok Lim 93 42 0 16 Dec 2021
Knowledge-Augmented Language Models for Cause-Effect Relation Classification Pedram Hosseini David A. Broniatowski Mona T. Diab CML 103 18 0 16 Dec 2021
KAT: A Knowledge Augmented Transformer for Vision-and-Language Liangke Gui Borui Wang Qiuyuan Huang Alexander G. Hauptmann Yonatan Bisk Jianfeng Gao 75 162 0 16 Dec 2021
Idiomatic Expression Paraphrasing without Strong Supervision Jianing Zhou Ziheng Zeng Hongyu Gong S. Bhat 61 10 0 16 Dec 2021
CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning Zeqiu Wu Yi Luan Hannah Rashkin David Reitter Hannaneh Hajishirzi Mari Ostendorf Gaurav Singh Tomar LRM 77 79 0 16 Dec 2021
NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge R. Reddy Sai Chetan Chinthakindi Zhenhailong Wang Yi R. Fung Kathryn Conger ... Martha Palmer Preslav Nakov Eduard H. Hovy Kevin Small Heng Ji VLM 88 29 0 16 Dec 2021
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri Chien-Sheng Wu Wenhao Liu Caiming Xiong HILM 110 218 0 16 Dec 2021
Intelligent Online Selling Point Extraction for E-Commerce Recommendation Xiaojie Guo Shugen Wang Hanqing Zhao Shiliang Diao Jiajia Chen ... Zhen He Yun Xiao Bo Long Han Yu Lingfei Wu 20 16 0 16 Dec 2021
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts Daniel Khashabi Xinxi Lyu Sewon Min Lianhui Qin Kyle Richardson ... Hannaneh Hajishirzi Tushar Khot Ashish Sabharwal Sameer Singh Yejin Choi 114 75 0 15 Dec 2021
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All Lei Zuo Kun Qian Bowen Yang Zhou Yu 106 15 0 15 Dec 2021
KGR^4: Retrieval, Retrospect, Refine and Rethink for Commonsense Generation Xin Liu Dayiheng Liu Baosong Yang Haibo Zhang Junwei Ding Wenqing Yao Weihua Luo Haiying Zhang Jinsong Su LRM 61 8 0 15 Dec 2021
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation Yu Li Baolin Peng Yelong Shen Yi Mao Lars Liden Zhou Yu Jianfeng Gao 80 55 0 15 Dec 2021
LongT5: Efficient Text-To-Text Transformer for Long Sequences Mandy Guo Joshua Ainslie David C. Uthus Santiago Ontanon Jianmo Ni Yun-hsuan Sung Yinfei Yang VLM 92 317 0 15 Dec 2021