v1v2v3 (latest)

SpanBERT: Improving Pre-training by Representing and Predicting Spans

24 July 2019

Luke Zettlemoyer

Papers citing "SpanBERT: Improving Pre-training by Representing and Predicting Spans"

50 / 955 papers shown

Title
FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language Mukul Singh J. Cambronero Sumit Gulwani Vu Le Carina Negreanu Elnaz Nouri Mohammad Raza Gust Verbruggen LMTD 74 9 0 26 Oct 2023
General Point Model with Autoencoding and Autoregressive Zhe Li Zhangyang Gao Cheng Tan Stan Z. Li Laurence T. Yang AI4CE 3DPC 47 4 0 25 Oct 2023
GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding Zekun Li Wenxuan Zhou Yao-Yi Chiang Muhao Chen SyDa 90 31 0 23 Oct 2023
ITEm: Unsupervised Image-Text Embedding Learning for eCommerce Baohao Liao Michael Kozielski Sanjika Hewavitharana Jiangbo Yuan Shahram Khadivi Tomer Lancewicki SSL 25 0 0 22 Oct 2023
A Survey on Semantic Processing Techniques Rui Mao Kai He Xulang Zhang Guanyi Chen Jinjie Ni Zonglin Yang Min Zhang 97 34 0 22 Oct 2023
LLM-Prop: Predicting Physical And Electronic Properties Of Crystalline Solids From Their Text Descriptions Andre Niyongabo Rubungo Craig Arnold Barry P. Rand Adji Bousso Dieng AI4CE 83 31 0 21 Oct 2023
A Unified View of Evaluation Metrics for Structured Prediction Yunmo Chen William Gantt Tongfei Chen Aaron Steven White Benjamin Van Durme 46 7 0 20 Oct 2023
Seq2seq is All You Need for Coreference Resolution Wenzheng Zhang Sam Wiseman K. Stratos 57 13 0 20 Oct 2023
Multi-level Contrastive Learning for Script-based Character Understanding Dawei Li Hengyuan Zhang Yanran Li Shiping Yang 112 17 0 20 Oct 2023
Filling in the Gaps: Efficient Event Coreference Resolution using Graph Autoencoder Networks Loic De Langhe Orphée De Clercq Véronique Hoste 58 2 0 18 Oct 2023
Chain-of-Thought Tuning: Masked Language Models can also Think Step By Step in Natural Language Understanding Caoyun Fan Jidong Tian Yitian Li Wenqing Chen Hao He Yaohui Jin LRM 71 4 0 18 Oct 2023
Rethinking Relation Classification with Graph Meaning Representations Li Zhou Wenyu Chen DingYi Zeng Hong Qu Daniel Hershcovich AI4CE 51 0 0 15 Oct 2023
On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models Thilini Wijesiriwardene Ruwan Wickramarachchi Aishwarya N. Reganti Vinija Jain Aman Chadha Amit P. Sheth Amitava Das 58 1 0 11 Oct 2023
CAW-coref: Conjunction-Aware Word-level Coreference Resolution Karel DÓosterlinck Semere Kiros Bitew Brandon Papineau Christopher Potts Thomas Demeester Chris Develder 64 9 0 09 Oct 2023
Revisiting Large Language Models as Zero-shot Relation Extractors Guozheng Li Peng Wang Wenjun Ke KELM LRM ReLM 148 30 0 08 Oct 2023
MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answering Xiusi Chen Jyun-Yu Jiang Wei-Cheng Chang Cho-Jui Hsieh Hsiang-Fu Yu Wei Wang 95 12 0 08 Oct 2023
Exploring the Usage of Chinese Pinyin in Pretraining Baojun Wang Kun Xu Lifeng Shang AI4CE 32 0 0 08 Oct 2023
ForeSeer: Product Aspect Forecasting Using Temporal Graph Embedding Zixuan Liu Gaurush Hiranandani Kun Qian E-Wen Huang Yi Xu Belinda Zeng Karthik Subbian Sheng Wang AI4TS 82 1 0 07 Oct 2023
Multi-resolution HuBERT: Multi-resolution Speech Self-Supervised Learning with Masked Unit Prediction Jiatong Shi Hirofumi Inaguma Xutai Ma Ilia Kulikov Anna Y. Sun 115 27 0 04 Oct 2023
Augmenting Transformers with Recursively Composed Multi-grained Representations Xiang Hu Qingyang Zhu Kewei Tu Wei Wu 73 4 0 28 Sep 2023
Unsupervised Accent Adaptation Through Masked Language Model Correction Of Discrete Self-Supervised Speech Units Jakob Poncelet Hugo Van hamme 57 3 0 25 Sep 2023
Resolving References in Visually-Grounded Dialogue via Text Generation Bram Willemsen Livia Qian Gabriel Skantze 88 4 0 23 Sep 2023
Incorporating Singletons and Mention-based Features in Coreference Resolution via Multi-task Learning for Better Generalization Yilun Zhu Siyao Peng Sameer Pradhan Amir Zeldes LRM 116 6 0 20 Sep 2023
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation Xinda Wu Zhijie Huang Kejun Zhang Jiaxing Yu Xu Tan Tieyao Zhang Zihao Wang Lingyun Sun 79 5 0 19 Sep 2023
Headless Language Models: Learning without Predicting with Contrastive Weight Tying Nathan Godey Eric Villemonte de la Clergerie Benoît Sagot 60 3 0 15 Sep 2023
AGent: A Novel Pipeline for Automatically Creating Unanswerable Questions Son Quoc Tran Gia-Huy Do Phong Nguyen-Thuan Do Matt Kretchmar Xinya Du 102 0 0 10 Sep 2023
FLM-101B: An Open LLM and How to Train It with $100K Budget$ Xiang Li Yiqun Yao Xin Jiang Xuezhi Fang Xuying Meng ... Li Du Bowen Qin Zheng Zhang Aixin Sun Yequan Wang 147 22 0 07 Sep 2023
Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation Yibo Cui Liang Xie Yakun Zhang Meishan Zhang Ye Yan Erwei Yin LM&Ro 84 17 0 24 Aug 2023
Advancing Relation Extraction through Language Probing with Exemplars from Set Co-Expansion Yerong Li Roxana Girju 60 0 0 18 Aug 2023
You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content Xinlei He Savvas Zannettou Yun Shen Yang Zhang CLL 53 43 0 10 Aug 2023
Bringing order into the realm of Transformer-based language models for artificial intelligence and law C. M. Greco Andrea Tagarelli AILaw 75 20 0 10 Aug 2023
Slot Induction via Pre-trained Language Model Probing and Multi-level Contrastive Learning Hoang Nguyen Chenwei Zhang Ye Liu Philip S. Yu 68 5 0 09 Aug 2023
Single-Sentence Reader: A Novel Approach for Addressing Answer Position Bias Son Quoc Tran Matt Kretchmar 54 0 0 08 Aug 2023
Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition Bobo Li Hao Fei Lizi Liao Yu Zhao Chong Teng Tat-Seng Chua Donghong Ji Fei Li 77 34 0 08 Aug 2023
Detecting Spells in Fantasy Literature with a Transformer Based Artificial Intelligence Marcel Moravek Alexander Zender Andreas Müller 17 0 0 07 Aug 2023
Spanish Pre-trained BERT Model and Evaluation Data J. Cañete Gabriel Chaperon Rodrigo Fuentes Jou-Hui Ho Hojin Kang Jorge Pérez 92 667 0 06 Aug 2023
Athena 2.0: Discourse and User Modeling in Open Domain Dialogue Omkar Patil Lena Reed Kevin K. Bowden Juraj Juraska Wen Cui ... Phillip Lee Jeshwanth Bheemanpally Rohan Pandey A. Ratnaparkhi M. Walker LLMAG 53 7 0 03 Aug 2023
GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning Soumyadeep Roy Jonas Wallat Sowmya S. Sundaram Wolfgang Nejdl Niloy Ganguly 62 3 0 29 Jul 2023
Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems Songbo Hu Han Zhou Mete Hergul Milan Gritta Guchun Zhang Ignacio Iacobacci Ivan Vulić Anna Korhonen 95 12 0 26 Jul 2023
TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition Isabel Funke Dominik Rivoir Stefanie Krell Stefanie Speidel 67 4 0 19 Jul 2023
Representation Learning With Hidden Unit Clustering For Low Resource Speech Applications Varun Krishna T. Sai Sriram Ganapathy SSL 57 2 0 14 Jul 2023
Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords Shahriar Golchin Mihai Surdeanu N. Tavabi A. Kiapour 41 4 0 14 Jul 2023
A Side-by-side Comparison of Transformers for English Implicit Discourse Relation Classification Bruce W. Lee Bongseok Yang J. Lee 76 0 0 07 Jul 2023
Vision Language Transformers: A Survey Clayton Fields C. Kennington VLM 53 5 0 06 Jul 2023
PULSAR at MEDIQA-Sum 2023: Large Language Models Augmented by Synthetic Dialogue Convert Patient Dialogues to Medical Records Viktor Schlegel Hao Li Yuping Wu Anand Subramanian Thanh-Tung Nguyen ... Daniel Beck Xiaojun Zeng Riza Batista-Navarro Stefan Winkler Goran Nenadic LM&MA MedIm 93 12 0 05 Jul 2023
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer Z. Li Shitou Zhang Hai Zhao Yifei Yang Dongjie Yang LM&MA 116 17 0 01 Jul 2023
Knowledge Base Completion for Long-Tail Entities Lihu Chen Simon Razniewski Gerhard Weikum KELM 71 6 0 30 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 110 93 0 20 Jun 2023
Pushing the Limits of ChatGPT on NLP Tasks Xiaofei Sun Linfeng Dong Xiaoya Li Zhen Wan Shuhe Wang ... Jiwei Li Fei Cheng Lingjuan Lyu Leilei Gan Guoyin Wang AI4MH LRM 117 32 0 16 Jun 2023
Wikibio: a Semantic Resource for the Intersectional Analysis of Biographical Events M. Stranisci Rossana Damiano Enrico Mensa V. Patti Daniele P. Radicioni Tommaso Caselli 59 9 0 15 Jun 2023