v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
Channel-aware Decoupling Network for Multi-turn Dialogue Comprehension Zhuosheng Zhang Hai Zhao Longxiang Liu BDL 93 2 0 10 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 124 67 0 04 Jan 2023
Cramming: Training a Language Model on a Single GPU in One Day Jonas Geiping Tom Goldstein MoE 117 91 0 28 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 76 25 0 20 Dec 2022
Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning Yu Wang Hongxia Jin 56 2 0 20 Dec 2022
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English Jianfeng Chi Wasi Uddin Ahmad Yuan Tian Kai-Wei Chang AILaw ELM 51 11 0 20 Dec 2022
Enriching Relation Extraction with OpenIE Alessandro Temperoni M. Biryukov Martin Theobald 51 1 0 19 Dec 2022
Neural Coreference Resolution based on Reinforcement Learning Yu Wang Hongxia Jin 50 0 0 18 Dec 2022
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis Chenyang Lyu Linyi Yang Yue Zhang Yvette Graham Jennifer Foster 56 1 0 17 Dec 2022
Improving self-supervised representation learning via sequential adversarial masking Dylan Sam Min Bai Tristan McKinney Li Erran Li SSL 88 0 0 16 Dec 2022
Saved You A Click: Automatically Answering Clickbait Titles Andrey Kurenkov TA Mentor Yian Zhang O. Johnson 44 5 0 15 Dec 2022
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking Mingyu Lee Jun-Hyung Park Junho Kim Kang-Min Kim SangKeun Lee 69 12 0 15 Dec 2022
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods Chao Zhou Cheng Qiu Daniel Ernesto Acuna 127 26 0 13 Dec 2022
BigText-QA: Question Answering over a Large-Scale Hybrid Knowledge Graph Jingjing Xu M. Biryukov Martin Theobald V. Venugopal 64 0 0 12 Dec 2022
Uniform Masking Prevails in Vision-Language Pretraining Siddharth Verma Yuchen Lu Rui Hou Hanchao Yu Nicolas Ballas Madian Khabsa Amjad Almahairi VLM 50 0 0 10 Dec 2022
From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Reader Weiwen Xu Xin Li Wenxuan Zhang Meng Zhou W. Lam Luo Si Lidong Bing 86 2 0 09 Dec 2022
POQue: Asking Participant-specific Outcome Questions for a Deeper Understanding of Complex Events Sai Vallurupalli Sayontan Ghosh K. Erk Niranjan Balasubramanian Francis Ferraro 61 5 0 05 Dec 2022
Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE Qihuang Zhong Liang Ding Yibing Zhan Yu Qiao Yonggang Wen ... Yixin Chen Xinbo Gao Steven C. H. Hoi Xiaoou Tang Dacheng Tao VLM ELM 124 35 0 04 Dec 2022
MiLMo:Minority Multilingual Pre-trained Language Model Sisi Liu Hanru Shi Xinhe Yu Wugedele Bao Yuan Sun Xiaobing Zhao 81 0 0 04 Dec 2022
CoP: Factual Inconsistency Detection by Controlling the Preference Shuaijie She Xiang Geng Shujian Huang Jiajun Chen 95 5 0 03 Dec 2022
Nonparametric Masked Language Modeling Sewon Min Weijia Shi M. Lewis Xilun Chen Wen-tau Yih Hannaneh Hajishirzi Luke Zettlemoyer RALM 157 50 0 02 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning Shih-Cheng Huang Shi Wang Min-Han Shih Saurav Sahay Hung-yi Lee 99 0 0 02 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 64 2 0 01 Dec 2022
Revisiting text decomposition methods for NLI-based factuality scoring of summaries John Glover Federico Fancellu V. Jagannathan Matthew R. Gormley Thomas Schaaf HILM 87 17 0 30 Nov 2022
Protein Language Models and Structure Prediction: Connection and Progression Bozhen Hu Jun Xia Jiangbin Zheng Cheng Tan Yufei Huang Yongjie Xu Stan Z. Li 70 41 0 30 Nov 2022
End-to-End Neural Discourse Deixis Resolution in Dialogue Shengjie Li Vincent Ng 44 1 0 29 Nov 2022
Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models Albert Xu Xiang Ren Robin Jia OODD 65 2 0 28 Nov 2022
ESIE-BERT: Enriching Sub-words Information Explicitly with BERT for Joint Intent Classification and SlotFilling Yutian Guo Zhilong Xie Xingyan Chen Huangen Chen Leilei Wang Huaming Du Shaopeng Wei Yu Zhao Qing Li Ganglu Wu 98 10 0 27 Nov 2022
A Survey of Text Representation Methods and Their Genealogy Philipp Siebers Christian Janiesch Patrick Zschech AI4TS 33 9 0 26 Nov 2022
Who are you referring to? Coreference resolution in image narrations A. Goel Basura Fernando Frank Keller Hakan Bilen 102 3 0 26 Nov 2022
Make-A-Story: Visual Memory Conditioned Consistent Story Generation Tanzila Rahman Hsin-Ying Lee Jian Ren Sergey Tulyakov Shweta Mahajan Leonid Sigal DiffM 132 71 0 23 Nov 2022
GraphWOZ: Dialogue Management with Conversational Knowledge Graphs Nicholas Walker Stefan Ultes Pierre Lison 53 5 0 23 Nov 2022
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling Zhijun Wang Xuebo Liu Min Zhang 132 11 0 23 Nov 2022
Coreference Resolution through a seq2seq Transition-Based System Bernd Bohnet Chris Alberti Michael Collins 80 40 0 22 Nov 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 63 1 0 21 Nov 2022
UniHPF : Universal Healthcare Predictive Framework with Zero Domain Knowledge Kyunghoon Hur Jungwoo Oh Junu Kim Jiyoun Kim Min Jae Lee Eunbyeol Cho Seong-Eun Moon Young-Hak Kim Edward Choi 85 6 0 15 Nov 2022
A Survey for Efficient Open Domain Question Answering Qin Zhang Shan Chen Dongkuan Xu Qingqing Cao Xiaojun Chen Trevor Cohn Meng Fang 90 36 0 15 Nov 2022
A hybrid entity-centric approach to Persian pronoun resolution Hassan Haji Mohammadi Alireza Talebpour Ahmad Mahmoudi-Aznaveh S. Yazdani 54 1 0 11 Nov 2022
CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification Yongbin Li Canran Xu Guodong Long Tao Shen Chongyang Tao Jing Jiang 73 1 0 11 Nov 2022
FormLM: Recommending Creation Ideas for Online Forms by Modelling Semantic and Structural Information Yijia Shao Mengyu Zhou Yifan Zhong Tao Wu Hongwei Han Shi Han Gideon Huang Dongmei Zhang 3DV 62 2 0 10 Nov 2022
Review of coreference resolution in English and Persian Hassan Haji Mohammadi Alireza Talebpour Ahmad Mahmoudi-Aznaveh S. Yazdani 120 0 0 08 Nov 2022
Multi-Task Learning Framework for Extracting Emotion Cause Span and Entailment in Conversations A. Bhat Ashutosh Modi 57 11 0 07 Nov 2022
Named Entity Recognition in Indian court judgments Prathamesh Kalamkar Astha Agarwal Aman Tiwari Smita Gupta S. Karn Vivek Raghavan AILaw 64 53 0 07 Nov 2022
Open-Vocabulary Argument Role Prediction for Event Extraction Yizhu Jiao Sha Li Yiqing Xie Ming Zhong Heng Ji Jiawei Han 115 17 0 03 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding Dou Hu Xiaolong Hou Xiyang Du Mengyuan Zhou Lian-Xin Jiang Yang Mo Xiaofeng Shi 97 13 0 01 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du Sudheer Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 88 112 0 31 Oct 2022
Leveraging Pre-trained Models for Failure Analysis Triplets Generation Kenneth Ezukwoke Anis Hoayek M. Batton-Hubert Xavier Boucher Pascal Gounet Jerome Adrian 64 1 0 31 Oct 2022
token2vec: A Joint Self-Supervised Pre-training Framework Using Unpaired Speech and Text Xianghu Yue Junyi Ao Xiaoxue Gao Haizhou Li SSL 60 8 0 30 Oct 2022
TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack Yu Cao Dianqi Li Meng Fang Dinesh Manocha Jun Gao Yibing Zhan Dacheng Tao AAML 83 17 0 27 Oct 2022
arXivEdits: Understanding the Human Revision Process in Scientific Writing Chao Jiang Wei Xu Samuel Stevens 65 23 0 26 Oct 2022