To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning

2 August 2022

Xiangang Li

Papers citing "To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning"

50 / 50 papers shown

Title
Paradigm Shift in Natural Language Processing Tianxiang Sun Xiangyang Liu Xipeng Qiu Xuanjing Huang 168 82 0 26 Sep 2021
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding Dong Wang Ning Ding Pijian Li Haitao Zheng AAML 57 117 0 01 Jul 2021
A Unified Generative Framework for Various NER Subtasks Hang Yan Tao Gui Junqi Dai Qipeng Guo Zheng Zhang Xipeng Qiu 76 296 0 02 Jun 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Wu Weiran Xu SSL 121 559 0 25 May 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 274 3,407 0 18 Apr 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 88 2,208 0 11 Jan 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 71 323 0 31 Dec 2020
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning Beliz Gunel Jingfei Du Alexis Conneau Ves Stoyanov 60 507 0 03 Nov 2020
CAPT: Contrastive Pre-Training for Learning Denoised Sequence Representations Fuli Luo Pengcheng Yang Shicheng Li Xuancheng Ren Xu Sun VLM SSL 54 16 0 13 Oct 2020
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space Dayiheng Liu Yeyun Gong Jie Fu Yu Yan Jiusheng Chen Jiancheng Lv Nan Duan M. Zhou 36 37 0 04 Oct 2020
Conversational Machine Comprehension: a Literature Review Somil Gupta Bhanu Pratap Singh Rawat Hong Yu 50 22 0 01 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 838 42,332 0 28 May 2020
Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models Dan Iter Kelvin Guu L. Lansing Dan Jurafsky 46 78 0 20 May 2020
An Effective Transition-based Model for Discontinuous NER Xiang Dai Sarvnaz Karimi Ben Hachey Cécile Paris BDL MU MedIm 87 80 0 28 Apr 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 154 4,566 0 23 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,859 0 13 Feb 2020
Retrospective Reader for Machine Reading Comprehension Zhuosheng Zhang Junjie Yang Hai Zhao RALM 74 227 0 27 Jan 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 348 1,617 0 21 Jan 2020
Contrastive Learning of Structured World Models Thomas Kipf Elise van der Pol Max Welling OCL DRL 81 285 0 27 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 207 12,121 0 13 Nov 2019
Improving Machine Reading Comprehension via Adversarial Training Ziqing Yang Yiming Cui Wanxiang Che Ting Liu Shijin Wang Guoping Hu 55 17 0 09 Nov 2019
A Unified MRC Framework for Named Entity Recognition Xiaoya Li Jingrong Feng Yuxian Meng Qinghong Han Leilei Gan Jiwei Li 80 637 0 25 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 371 6,463 0 26 Sep 2019
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 272 442 0 25 Sep 2019
SG-Net: Syntax-Guided Machine Reading Comprehension Zhuosheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui Wang 71 188 0 14 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 674 24,528 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 234 8,444 0 19 Jun 2019
Learning to Ask Unanswerable Questions for Machine Reading Comprehension Haichao Zhu Li Dong Furu Wei Wenhui Wang Bing Qin Ting Liu RALM 57 31 0 14 Jun 2019
Synthetic QA Corpora Generation with Roundtrip Consistency Chris Alberti D. Andor Emily Pitler Jacob Devlin Michael Collins SyDa 70 249 0 12 Jun 2019
Unsupervised Data Augmentation for Consistency Training Qizhe Xie Zihang Dai Eduard H. Hovy Minh-Thang Luong Quoc V. Le 135 2,320 0 29 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,114 0 11 Oct 2018
Stochastic Answer Networks for SQuAD 2.0 Xiaodong Liu Wei Li Yuwei Fang Aerin Kim Kevin Duh Jianfeng Gao RALM 40 23 0 24 Sep 2018
CoQA: A Conversational Question Answering Challenge Siva Reddy Danqi Chen Christopher D. Manning RALM HAI 114 1,209 0 21 Aug 2018
Read + Verify: Machine Reading Comprehension with Unanswerable Questions Minghao Hu Furu Wei Yuxing Peng Zhen Huang Nan Yang Ming Zhou RALM FaML 49 156 0 17 Aug 2018
Know What You Don't Know: Unanswerable Questions for SQuAD Pranav Rajpurkar Robin Jia Percy Liang RALM ELM 290 2,853 0 11 Jun 2018
Simple and Effective Multi-Paragraph Reading Comprehension Christopher Clark Matt Gardner RALM 90 459 0 29 Oct 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 282 9,797 0 25 Oct 2017
Adversarial Examples for Evaluating Reading Comprehension Systems Robin Jia Percy Liang AAML ELM 203 1,608 0 23 Jul 2017
RACE: Large-scale ReAding Comprehension Dataset From Examinations Guokun Lai Qizhe Xie Hanxiao Liu Yiming Yang Eduard H. Hovy ELM 186 1,357 0 15 Apr 2017
Reading Wikipedia to Answer Open-Domain Questions Danqi Chen Adam Fisch Jason Weston Antoine Bordes RALM 118 2,018 0 31 Mar 2017
Making Neural QA as Simple as Possible but not Simpler Dirk Weissenborn Georg Wiese Laura Seiffe 79 210 0 14 Mar 2017
NewsQA: A Machine Comprehension Dataset Adam Trischler Tong Wang Xingdi Yuan Justin Harris Alessandro Sordoni Philip Bachman Kaheer Suleman 106 893 0 29 Nov 2016
Bidirectional Attention Flow for Machine Comprehension Minjoon Seo Aniruddha Kembhavi Ali Farhadi Hannaneh Hajishirzi 133 2,091 0 05 Nov 2016
Attention-over-Attention Neural Networks for Reading Comprehension Yiming Cui Zhongfu Chen Si Wei Shijin Wang Ting Liu Guoping Hu AIMat 66 439 0 15 Jul 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 312 8,160 0 16 Jun 2016
Gated-Attention Readers for Text Comprehension Bhuwan Dhingra Hanxiao Liu Zhilin Yang William W. Cohen Ruslan Salakhutdinov 68 417 0 05 Jun 2016
Text Understanding with the Attention Sum Reader Network Rudolf Kadlec Martin Schmid Ondrej Bajgar Jan Kleindienst AIMat RALM 68 14 0 04 Mar 2016
The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations Felix Hill Antoine Bordes S. Chopra Jason Weston RALM 109 636 0 07 Nov 2015
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 347 3,551 0 10 Jun 2015
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 680 31,538 0 16 Jan 2013