ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1910.10683
  4. Cited By
Exploring the Limits of Transfer Learning with a Unified Text-to-Text
  Transformer
v1v2v3v4 (latest)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

23 October 2019
Colin Raffel
Noam M. Shazeer
Adam Roberts
Katherine Lee
Sharan Narang
Michael Matena
Yanqi Zhou
Wei Li
Peter J. Liu
    AIMat
ArXiv (abs)PDFHTML

Papers citing "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

50 / 9,886 papers shown
Title
Does Entity Abstraction Help Generative Transformers Reason?
Does Entity Abstraction Help Generative Transformers Reason?
Nicolas Angelard-Gontier
Siva Reddy
C. Pal
77
5
0
05 Jan 2022
Comparison of biomedical relationship extraction methods and models for
  knowledge graph creation
Comparison of biomedical relationship extraction methods and models for knowledge graph creation
Nikola Milosevic
W. Thielemann
49
32
0
05 Jan 2022
Discrete and continuous representations and processing in deep learning:
  Looking forward
Discrete and continuous representations and processing in deep learning: Looking forward
Ruben Cartuyvels
Graham Spinks
Marie-Francine Moens
OCL
91
20
0
04 Jan 2022
Which Student is Best? A Comprehensive Knowledge Distillation Exam for
  Task-Specific BERT Models
Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models
Made Nindyatama Nityasya
Haryo Akbarianto Wibowo
Rendi Chevi
Radityo Eko Prasojo
Alham Fikri Aji
76
6
0
03 Jan 2022
ViNMT: Neural Machine Translation Toolkit
ViNMT: Neural Machine Translation Toolkit
Nguyen Hoang Quan
N. T. Dat
Nguyen Hoang Minh Cong
Nguyen Van Vinh
Ngo Thi Vinh
N. Thai
T. Viet
43
2
0
31 Dec 2021
Fine-Tuning Transformers: Vocabulary Transfer
Fine-Tuning Transformers: Vocabulary Transfer
Vladislav D. Mosin
Igor Samenko
Alexey Tikhonov
Borislav M. Kozlovskii
Ivan P. Yamshchikov
79
20
0
29 Dec 2021
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via
  Dense-To-Sparse Gate
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate
Xiaonan Nie
Xupeng Miao
Shijie Cao
Lingxiao Ma
Qibin Liu
Jilong Xue
Youshan Miao
Yi Liu
Zhi-Xin Yang
Tengjiao Wang
MoMeMoE
92
24
0
29 Dec 2021
A Survey on Gender Bias in Natural Language Processing
A Survey on Gender Bias in Natural Language Processing
Karolina Stañczak
Isabelle Augenstein
93
117
0
28 Dec 2021
CUGE: A Chinese Language Understanding and Generation Evaluation
  Benchmark
CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark
Yuan Yao
Qingxiu Dong
Jian Guan
Boxi Cao
Zhengyan Zhang
...
Zhiyuan Liu
Xianpei Han
Erhong Yang
Zhifang Sui
Maosong Sun
ALMELM
80
17
0
27 Dec 2021
Multimodal Image Synthesis and Editing: The Generative AI Era
Multimodal Image Synthesis and Editing: The Generative AI Era
Fangneng Zhan
Yingchen Yu
Rongliang Wu
Jiahui Zhang
Shijian Lu
Lingjie Liu
Adam Kortylewski
Christian Theobalt
Eric Xing
EGVM
198
51
0
27 Dec 2021
New Methods & Metrics for LFQA tasks
New Methods & Metrics for LFQA tasks
Suchismit Mahapatra
V. Blagojević
P. Bertorello
Prasanna Kumar
64
2
0
26 Dec 2021
Counterfactual Memorization in Neural Language Models
Counterfactual Memorization in Neural Language Models
Chiyuan Zhang
Daphne Ippolito
Katherine Lee
Matthew Jagielski
Florian Tramèr
Nicholas Carlini
108
137
0
24 Dec 2021
Measuring Attribution in Natural Language Generation Models
Measuring Attribution in Natural Language Generation Models
Hannah Rashkin
Vitaly Nikolaev
Matthew Lamm
Lora Aroyo
Michael Collins
Dipanjan Das
Slav Petrov
Gaurav Singh Tomar
Iulia Turc
David Reitter
103
184
0
23 Dec 2021
SeMask: Semantically Masked Transformers for Semantic Segmentation
SeMask: Semantically Masked Transformers for Semantic Segmentation
Jitesh Jain
Anukriti Singh
Nikita Orlov
Zilong Huang
Jiachen Li
Steven Walton
Humphrey Shi
ViT
88
98
0
23 Dec 2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training
  for Language Understanding and Generation
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Shuohuan Wang
Yu Sun
Yang Xiang
Zhihua Wu
Siyu Ding
...
Tian Wu
Wei Zeng
Ge Li
Wen Gao
Haifeng Wang
ELM
92
78
0
23 Dec 2021
LaTr: Layout-Aware Transformer for Scene-Text VQA
LaTr: Layout-Aware Transformer for Scene-Text VQA
Ali Furkan Biten
Ron Litman
Yusheng Xie
Srikar Appalaraju
R. Manmatha
ViT
125
102
0
23 Dec 2021
Fine-grained Multi-Modal Self-Supervised Learning
Fine-grained Multi-Modal Self-Supervised Learning
Duo Wang
S. Karout
SSL
65
7
0
22 Dec 2021
A Survey of Natural Language Generation
A Survey of Natural Language Generation
Chenhe Dong
Hai-Tao Zheng
Haifan Gong
Mengzhao Chen
Junxin Li
Ying Shen
Min Yang
3DV
85
45
0
22 Dec 2021
Domain Adaptation with Pre-trained Transformers for Query Focused
  Abstractive Text Summarization
Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization
Md Tahmid Rahman Laskar
Enamul Hoque
J. Huang
95
45
0
22 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training?
Are Large-scale Datasets Necessary for Self-Supervised Pre-training?
Alaaeldin El-Nouby
Gautier Izacard
Hugo Touvron
Ivan Laptev
Hervé Jégou
Edouard Grave
SSL
106
152
0
20 Dec 2021
Efficient Large Scale Language Modeling with Mixtures of Experts
Efficient Large Scale Language Modeling with Mixtures of Experts
Mikel Artetxe
Shruti Bhosale
Naman Goyal
Todor Mihaylov
Myle Ott
...
Jeff Wang
Luke Zettlemoyer
Mona T. Diab
Zornitsa Kozareva
Ves Stoyanov
MoE
239
201
0
20 Dec 2021
Few-shot Learning with Multilingual Language Models
Few-shot Learning with Multilingual Language Models
Xi Lin
Todor Mihaylov
Mikel Artetxe
Tianlu Wang
Shuohui Chen
...
Luke Zettlemoyer
Zornitsa Kozareva
Mona T. Diab
Ves Stoyanov
Xian Li
BDLELMLRM
153
308
0
20 Dec 2021
Spiral Language Modeling
Spiral Language Modeling
Yong Cao
Yukun Feng
Shaohui Kuang
Gu Xu
149
0
0
20 Dec 2021
ScanQA: 3D Question Answering for Spatial Scene Understanding
ScanQA: 3D Question Answering for Spatial Scene Understanding
Daich Azuma
Taiki Miyanishi
Shuhei Kurita
M. Kawanabe
104
208
0
20 Dec 2021
On Efficient Transformer-Based Image Pre-training for Low-Level Vision
On Efficient Transformer-Based Image Pre-training for Low-Level Vision
Wenbo Li
Xin Lu
Shengju Qian
Jiangbo Lu
Xinming Zhang
Jiaya Jia
ViT
140
88
0
19 Dec 2021
Cascading Adaptors to Leverage English Data to Improve Performance of
  Question Answering for Low-Resource Languages
Cascading Adaptors to Leverage English Data to Improve Performance of Question Answering for Low-Resource Languages
Hariom A. Pandya
Bhavik Ardeshna
Brijesh S. Bhatt
79
6
0
18 Dec 2021
ActKnow: Active External Knowledge Infusion Learning for Question
  Answering in Low Data Regime
ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime
K. Annervaz
Pritam Kumar Nath
Ambedkar Dukkipati
RALM
52
1
0
17 Dec 2021
An Empirical Investigation of the Role of Pre-training in Lifelong
  Learning
An Empirical Investigation of the Role of Pre-training in Lifelong Learning
Sanket Vaibhav Mehta
Darshan Patil
Sarath Chandar
Emma Strubell
CLL
151
145
0
16 Dec 2021
Pushing the Limits of Rule Reasoning in Transformers through Natural
  Language Satisfiability
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability
Kyle Richardson
Ashish Sabharwal
ReLMLRM
88
25
0
16 Dec 2021
Efficient Hierarchical Domain Adaptation for Pretrained Language Models
Efficient Hierarchical Domain Adaptation for Pretrained Language Models
Alexandra Chronopoulou
Matthew E. Peters
Jesse Dodge
92
44
0
16 Dec 2021
Self-Supervised Learning for speech recognition with Intermediate layer
  supervision
Self-Supervised Learning for speech recognition with Intermediate layer supervision
Chengyi Wang
Yu-Huan Wu
Sanyuan Chen
Shujie Liu
Jinyu Li
Yao Qian
Zhenglu Yang
SSL
70
29
0
16 Dec 2021
CONFIT: Toward Faithful Dialogue Summarization with
  Linguistically-Informed Contrastive Fine-tuning
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning
Xiangru Tang
Arjun Nair
Borui Wang
Bingyao Wang
Jai Desai
Aaron Wade
Haoran Li
Asli Celikyilmaz
Yashar Mehdad
Dragomir R. Radev
HILM
59
63
0
16 Dec 2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models
DOCmT5: Document-Level Pretraining of Multilingual Language Models
Chia-Hsuan Lee
Aditya Siddhant
Viresh Ratnakar
Melvin Johnson
LRM
56
9
0
16 Dec 2021
Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks
Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks
Akari Asai
Matt Gardner
Hannaneh Hajishirzi
RALM
93
48
0
16 Dec 2021
Reframing Human-AI Collaboration for Generating Free-Text Explanations
Reframing Human-AI Collaboration for Generating Free-Text Explanations
Sarah Wiegreffe
Jack Hessel
Swabha Swayamdipta
Mark O. Riedl
Yejin Choi
77
149
0
16 Dec 2021
DREAM: Improving Situational QA by First Elaborating the Situation
DREAM: Improving Situational QA by First Elaborating the Situation
Yuling Gu
Bhavana Dalvi
Peter Clark
119
18
0
16 Dec 2021
Learning to Prompt for Continual Learning
Learning to Prompt for Continual Learning
Zifeng Wang
Zizhao Zhang
Chen-Yu Lee
Han Zhang
Ruoxi Sun
Xiaoqi Ren
Guolong Su
Vincent Perot
Jennifer Dy
Tomas Pfister
CLLVPVLMKELMVLM
107
799
0
16 Dec 2021
Analyzing the Limits of Self-Supervision in Handling Bias in Language
Analyzing the Limits of Self-Supervision in Handling Bias in Language
Lisa Bauer
Karthik Gopalakrishnan
Spandana Gella
Yang Liu
Joey Tianyi Zhou
Dilek Z. Hakkani-Tür
ELM
41
1
0
16 Dec 2021
FRUIT: Faithfully Reflecting Updated Information in Text
FRUIT: Faithfully Reflecting Updated Information in Text
Robert L Logan IV
Alexandre Passos
Sameer Singh
Ming-Wei Chang
KELM
112
42
0
16 Dec 2021
Learning To Retrieve Prompts for In-Context Learning
Learning To Retrieve Prompts for In-Context Learning
Ohad Rubin
Jonathan Herzig
Jonathan Berant
VPVLMRALM
96
709
0
16 Dec 2021
Call for Customized Conversation: Customized Conversation Grounding
  Persona and Knowledge
Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge
Yoonna Jang
J. Lim
Yuna Hur
Dongsuk Oh
Suhyune Son
Yeonsoo Lee
Donghoon Shin
Seungryong Kim
Heuiseok Lim
93
42
0
16 Dec 2021
Knowledge-Augmented Language Models for Cause-Effect Relation
  Classification
Knowledge-Augmented Language Models for Cause-Effect Relation Classification
Pedram Hosseini
David A. Broniatowski
Mona T. Diab
CML
103
18
0
16 Dec 2021
KAT: A Knowledge Augmented Transformer for Vision-and-Language
KAT: A Knowledge Augmented Transformer for Vision-and-Language
Liangke Gui
Borui Wang
Qiuyuan Huang
Alexander G. Hauptmann
Yonatan Bisk
Jianfeng Gao
75
162
0
16 Dec 2021
Idiomatic Expression Paraphrasing without Strong Supervision
Idiomatic Expression Paraphrasing without Strong Supervision
Jianing Zhou
Ziheng Zeng
Hongyu Gong
S. Bhat
61
10
0
16 Dec 2021
CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement
  Learning
CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning
Zeqiu Wu
Yi Luan
Hannah Rashkin
David Reitter
Hannaneh Hajishirzi
Mari Ostendorf
Gaurav Singh Tomar
LRM
77
79
0
16 Dec 2021
NewsClaims: A New Benchmark for Claim Detection from News with Attribute
  Knowledge
NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge
R. Reddy
Sai Chetan Chinthakindi
Zhenhailong Wang
Yi R. Fung
Kathryn Conger
...
Martha Palmer
Preslav Nakov
Eduard H. Hovy
Kevin Small
Heng Ji
VLM
88
29
0
16 Dec 2021
QAFactEval: Improved QA-Based Factual Consistency Evaluation for
  Summarization
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization
Alexander R. Fabbri
Chien-Sheng Wu
Wenhao Liu
Caiming Xiong
HILM
110
219
0
16 Dec 2021
Intelligent Online Selling Point Extraction for E-Commerce
  Recommendation
Intelligent Online Selling Point Extraction for E-Commerce Recommendation
Xiaojie Guo
Shugen Wang
Hanqing Zhao
Shiliang Diao
Jiajia Chen
...
Zhen He
Yun Xiao
Bo Long
Han Yu
Lingfei Wu
20
16
0
16 Dec 2021
Prompt Waywardness: The Curious Case of Discretized Interpretation of
  Continuous Prompts
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts
Daniel Khashabi
Xinxi Lyu
Sewon Min
Lianhui Qin
Kyle Richardson
...
Hannaneh Hajishirzi
Tushar Khot
Ashish Sabharwal
Sameer Singh
Yejin Choi
114
75
0
15 Dec 2021
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All
Lei Zuo
Kun Qian
Bowen Yang
Zhou Yu
106
15
0
15 Dec 2021
Previous
123...169170171...196197198
Next