Studying Strategically: Learning to Mask for Closed-book QA

Studying Strategically: Learning to Mask for Closed-book QA

31 December 2020

Sinong Wang

Hao Ma

Xiang Ren

Madian Khabsa

Papers citing "Studying Strategically: Learning to Mask for Closed-book QA"

9 / 9 papers shown

Title
Exploiting Abstract Meaning Representation for Open-Domain Question Answering Cunxiang Wang Zhikun Xu Qipeng Guo Xiangkun Hu Xuefeng Bai Zheng-Wei Zhang Yue Zhang 25 3 0 26 May 2023
Difference-Masking: Choosing What to Mask in Continued Pretraining Alex Wilf Syeda Nahida Akter Leena Mathur Paul Pu Liang Sheryl Mathew Mengrou Shou Eric Nyberg Louis-Philippe Morency CLL SSL 32 4 0 23 May 2023
Salient Span Masking for Temporal Understanding Jeremy R. Cole Aditi Chaudhary Bhuwan Dhingra Partha P. Talukdar 52 11 0 22 Mar 2023
A Unified Encoder-Decoder Framework with Entity Memory Zhihan Zhang Wenhao Yu Chenguang Zhu Meng Jiang 39 11 0 07 Oct 2022
Read before Generate! Faithful Long Form Question Answering with Machine Reading Dan Su Xiaoguang Li Jindi Zhang Lifeng Shang Xin Jiang Qun Liu Pascale Fung HILM 19 59 0 01 Mar 2022
On the Influence of Masking Policies in Intermediate Pre-training Qinyuan Ye Belinda Z. Li Sinong Wang Benjamin Bolte Hao Ma Wen-tau Yih Xiang Ren Madian Khabsa 13 12 0 18 Apr 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 125 203 0 16 Feb 2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them Patrick Lewis Yuxiang Wu Linqing Liu Pasquale Minervini Heinrich Küttler Aleksandra Piktus Pontus Stenetorp Sebastian Riedel RALM 40 229 0 13 Feb 2021
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 454 2,589 0 03 Sep 2019