REALM: Retrieval-Augmented Language Model Pre-Training

10 February 2020

Papers citing "REALM: Retrieval-Augmented Language Model Pre-Training"

50 / 505 papers shown

Title
Large Language Models with Controllable Working Memory Daliang Li A. S. Rawat Manzil Zaheer Xin Wang Michal Lukasik Andreas Veit Felix X. Yu Surinder Kumar KELM 61 154 0 09 Nov 2022
Detecting Euphemisms with Literal Descriptions and Visual Imagery .Ilker Kesen Aykut Erdem Erkut Erdem Iacer Calixto 29 4 0 08 Nov 2022
Suffix Retrieval-Augmented Language Modeling Zecheng Wang Yik-Cheung Tam RALM 13 1 0 06 Nov 2022
Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models Shujian Zhang Chengyue Gong Xingchao Liu RALM 51 6 0 02 Nov 2022
Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidence Hung-Ting Chen Michael J.Q. Zhang Eunsol Choi RALM HILM 47 92 0 25 Oct 2022
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach Wenhao Yu Chenguang Zhu Zhihan Zhang Shuohang Wang Zhuosheng Zhang Yuwei Fang Meng Jiang LRM ReLM 15 19 0 23 Oct 2022
Rescue Implicit and Long-tail Cases: Nearest Neighbor Relation Extraction Zhen Wan Qianying Liu Zhuoyuan Mao Fei Cheng Sadao Kurohashi Jiwei Li 30 8 0 21 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 27 13 0 21 Oct 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 47 11 0 20 Oct 2022
Schema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Construction Yunzhi Yao Shengyu Mao Ningyu Zhang Xiangnan Chen Shumin Deng Xi Chen Huajun Chen 28 9 0 19 Oct 2022
Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking Tim Baumgärtner Leonardo F. R. Ribeiro Nils Reimers Iryna Gurevych 35 6 0 19 Oct 2022
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis Shuai Fan Chen Lin Haonan Li Zheng-Wen Lin Jinsong Su Hang Zhang Yeyun Gong Jian Guo Nan Duan VLM 36 18 0 18 Oct 2022
Deep Bidirectional Language-Knowledge Graph Pretraining Michihiro Yasunaga Antoine Bosselut Hongyu Ren Xikun Zhang Christopher D. Manning Percy Liang J. Leskovec 36 193 0 17 Oct 2022
RARR: Researching and Revising What Language Models Say, Using Language Models Luyu Gao Zhuyun Dai Panupong Pasupat Anthony Chen Arun Tejasvi Chaganty ... Vincent Zhao Ni Lao Hongrae Lee Da-Cheng Juan Kelvin Guu HILM KELM 41 257 0 17 Oct 2022
Self-Adaptive Named Entity Recognition by Retrieving Unstructured Knowledge Kosuke Nishida Naoki Yoshinaga Kyosuke Nishida 30 2 0 14 Oct 2022
Decoupled Context Processing for Context Augmented Language Modeling Zonglin Li Ruiqi Guo Surinder Kumar RALM KELM 21 23 0 11 Oct 2022
Mind's Eye: Grounded Language Model Reasoning through Simulation Ruibo Liu Jason W. Wei S. Gu Te-Yen Wu Soroush Vosoughi Claire Cui Denny Zhou Andrew M. Dai ReLM LRM 118 79 0 11 Oct 2022
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering Hao Cheng Hao Fang Xiaodong Liu Jianfeng Gao RALM 41 5 0 11 Oct 2022
Retrieval Augmentation for T5 Re-ranker using External Sources Kai Hui Tao Chen Zhen Qin Honglei Zhuang Fernando Diaz Michael Bendersky Donald Metzler RALM LRM 31 1 0 11 Oct 2022
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation Tanay Dixit Bhargavi Paranjape Hannaneh Hajishirzi Luke Zettlemoyer SyDa 146 24 0 10 Oct 2022
CrowdChecked: Detecting Previously Fact-Checked Claims in Social Media Momchil Hardalov Anton Chernyavskiy Ivan Koychev Dmitry Ilvovsky Preslav Nakov HAI 35 15 0 10 Oct 2022
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig LRM 35 10 0 09 Oct 2022
Enhanced vectors for top-k document retrieval in Question Answering M. Hammad 21 0 0 08 Oct 2022
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts Nghia T. Le Fan Bai Alan Ritter 37 12 0 07 Oct 2022
Measuring and Narrowing the Compositionality Gap in Language Models Ofir Press Muru Zhang Sewon Min Ludwig Schmidt Noah A. Smith M. Lewis ReLM KELM LRM 54 561 0 07 Oct 2022
A Unified Encoder-Decoder Framework with Entity Memory Zhihan Zhang Wenhao Yu Chenguang Zhu Meng Jiang 39 11 0 07 Oct 2022
Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering Shamane Siriwardhana Rivindu Weerasekera Elliott Wen Tharindu Kaluarachchi R. Rana Suranga Nanayakkara VLM 19 161 0 06 Oct 2022
Memory in humans and deep language models: Linking hypotheses for model augmentation Omri Raccah Pheobe Chen Ted Willke David Poeppel Vy A. Vo RALM 23 1 0 04 Oct 2022
Re-Imagen: Retrieval-Augmented Text-to-Image Generator Wenhu Chen Hexiang Hu Chitwan Saharia William W. Cohen VLM 131 161 0 29 Sep 2022
FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation Sebastian Hofstatter Jiecao Chen K. Raman Hamed Zamani RALM 65 77 0 28 Sep 2022
Variational Open-Domain Question Answering Valentin Liévin Andreas Geert Motzfeldt Ida Riis Jensen Ole Winther OOD BDL 36 8 0 23 Sep 2022
Generate rather than Retrieve: Large Language Models are Strong Context Generators Wenhao Yu Dan Iter Shuohang Wang Yichong Xu Mingxuan Ju Soumya Sanyal Chenguang Zhu Michael Zeng Meng Jiang RALM AIMat 237 322 0 21 Sep 2022
Generating Persuasive Responses to Customer Reviews with Multi-Source Prior Knowledge in E-commerce Bo Chen Jiayi Liu M. Maimaiti Xing Gao Ji Zhang 25 3 0 20 Sep 2022
Incorporating Task-specific Concept Knowledge into Script Learning Chenkai Sun Tie Xu Chengxiang Zhai Heng Ji 34 4 0 31 Aug 2022
Generating Intermediate Steps for NLI with Next-Step Supervision Deepanway Ghosal Somak Aditya Monojit Choudhury LRM 35 1 0 31 Aug 2022
PEER: A Collaborative Language Model Timo Schick Jane Dwivedi-Yu Zhengbao Jiang Fabio Petroni Patrick Lewis Gautier Izacard Qingfei You Christoforos Nalmpantis Edouard Grave Sebastian Riedel ALM 50 93 0 24 Aug 2022
DPTDR: Deep Prompt Tuning for Dense Passage Retrieval Zhen-Quan Tang Benyou Wang Ting Yao VLM 39 14 0 24 Aug 2022
Learning Better Masking for Better Language Model Pre-training Dongjie Yang Zhuosheng Zhang Hai Zhao 37 15 0 23 Aug 2022
Masked Autoencoders As The Unified Learners For Pre-Trained Sentence Representation Alexander H. Liu Samuel J. Yang 32 5 0 30 Jul 2022
RealTime QA: What's the Answer Right Now? Jungo Kasai Keisuke Sakaguchi Yoichi Takahashi Ronan Le Bras Akari Asai Xinyan Velocity Yu Dragomir R. Radev Noah A. Smith Yejin Choi Kentaro Inui KELM 45 167 0 27 Jul 2022
Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models Robin Rombach A. Blattmann Bjorn Ommer DiffM 18 70 0 26 Jul 2022
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 32 10 0 25 Jul 2022
Re2G: Retrieve, Rerank, Generate Michael R. Glass Gaetano Rossiello Md. Faisal Mahbub Chowdhury Ankita Rajaram Naik Pengshan Cai A. Gliozzo RALM 33 83 0 13 Jul 2022
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering Zhengbao Jiang Yi Mao Pengcheng He Graham Neubig Weizhu Chen LMTD 21 36 0 08 Jul 2022
Multi-Task Retrieval-Augmented Text Generation with Relevance Sampling Sebastian Hofstatter Jiecao Chen K. Raman Hamed Zamani RALM 39 11 0 07 Jul 2022
Cross-Lingual QA as a Stepping Stone for Monolingual Open QA in Icelandic Vésteinn Snæbjarnarson H. Einarsson 30 5 0 05 Jul 2022
TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s Felix Chern Blake A. Hechtman Andy Davis Ruiqi Guo David Majnemer Surinder Kumar 102 22 0 28 Jun 2022
An Open-Domain QA System for e-Governance Radu Ion Andrei-Marius Avram Vasile Puaics Maria Mitrofan V. Mititelu Elena Irimia Valentin Badea 11 1 0 16 Jun 2022
Emergent Abilities of Large Language Models Jason W. Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph ... Tatsunori Hashimoto Oriol Vinyals Percy Liang J. Dean W. Fedus ELM ReLM LRM 84 2,354 0 15 Jun 2022
Grounding in social media: An approach to building a chit-chat dialogue model Ritvik Choudhary Daisuke Kawahara 15 4 0 12 Jun 2022