LinkBERT: Pretraining Language Models with Document Links

29 March 2022

Papers citing "LinkBERT: Pretraining Language Models with Document Links"

50 / 164 papers shown

Title
Building a Corpus for Biomedical Relation Extraction of Species Mentions Oumaima El Khettari Solen Quiniou Samuel Chaffron 18 2 0 14 Jun 2023
THiFLY Research at SemEval-2023 Task 7: A Multi-granularity System for CTR-based Textual Entailment and Evidence Retrieval Yuxuan Zhou Ziyun Jin Meiwei Li Miao Li Xien Liu Xinxin You Ji Wu 29 11 0 02 Jun 2023
Comparing and combining some popular NER approaches on Biomedical tasks Harsh Verma S. Bergler Narjes Tahaei 16 3 0 30 May 2023
Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks Minki Kang Seanie Lee Jinheon Baek Kenji Kawaguchi Sung Ju Hwang ALM LRM 52 56 0 28 May 2023
Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering Avi Caciularu Matthew E. Peters Jacob Goldberger Ido Dagan Arman Cohan RALM 29 25 0 24 May 2023
Injecting Knowledge into Biomedical Pre-trained Models via Polymorphism and Synonymous Substitution Hongbo Zhang Xiang Wan Benyou Wang KELM 17 1 0 24 May 2023
Iteratively Improving Biomedical Entity Linking and Event Extraction via Hard Expectation-Maximization Xiaochu Li Minqian Liu Zhiyang Xu Lifu Huang 22 0 0 24 May 2023
From Characters to Words: Hierarchical Pre-trained Language Model for Open-vocabulary Language Understanding Li Sun F. Luisier Kayhan Batmanghelich D. Florêncio Changrong Zhang VLM 20 6 0 23 May 2023
ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings William Brannon Wonjune Kang S. Fulay Hang Jiang Brandon Roy Dwaipayan Roy Jad Kabbara SSL 14 22 0 23 May 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 32 13 0 23 May 2023
Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations Lucy Lu Wang Yulia Otmakhova Jay DeYoung Thinh Hung Truong Bailey Kuehl Erin Bransom Byron C. Wallace 107 20 0 23 May 2023
BioDEX: Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilance Karel DÓosterlinck François Remy Johannes Deleu Thomas Demeester Chris Develder Klim Zaporojets Aneiss Ghodsi Simon Ellershaw Jack R. Collins Christopher Potts 48 10 0 22 May 2023
Enhancing Small Medical Learners with Privacy-preserving Contextual Prompting Xinlu Zhang Shiyang Li Xianjun Yang Chenxin Tian Yao Qin Linda R. Petzold 24 9 0 22 May 2023
Patton: Language Model Pretraining on Text-Rich Networks Bowen Jin Wentao Zhang Yu Zhang Yu Meng Xinyang Zhang Qi Zhu Jiawei Han VLM 42 44 0 20 May 2023
Bi-VLGM : Bi-Level Class-Severity-Aware Vision-Language Graph Matching for Text Guided Medical Image Segmentation Wenting Chen Jie Liu Yixuan Yuan VLM 39 3 0 20 May 2023
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain Mike Zhang Rob van der Goot Barbara Plank 21 14 0 20 May 2023
Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes Maria Mahbub Ian Goethert Ioana Danciu Kathryn Knight Sudarshan Srinivasan ... Hugo Solares Susana Martins Jodie Trafton Edmon Begoli Gregory D. Peterson 13 2 0 15 May 2023
Unsupervised Dense Retrieval Training with Web Anchors Yiqing Xie X. Liu Chenyan Xiong RALM 12 3 0 10 May 2023
ANALOGICAL -- A Novel Benchmark for Long Text Analogy Evaluation in Large Language Models Thilini Wijesiriwardene Ruwan Wickramarachchi Bimal Gajera Shreeyash Mukul Gowaikar Chandan Gupta Aman Chadha Aishwarya N. Reganti Amit P. Sheth Amitava Das ELM 25 13 0 08 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma S. Sarkar Derek Liu VLM KELM 25 0 0 02 May 2023
Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs Costas Mavromatis V. Ioannidis Shen Wang Da Zheng Soji Adeshina Jun Ma Han Zhao Christos Faloutsos George Karypis 15 29 0 20 Apr 2023
A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets I. Bojić Josef Halim Verena Suharman Sreeja Tar Qi Chwen Ong Duy Phung Mathieu Ravaut Shafiq R. Joty Josip Car FedML 32 3 0 02 Apr 2023
Natural language processing to automatically extract the presence and severity of esophagitis in notes of patients undergoing radiotherapy Shan Chen Marco Guevara N. Ramirez Arpi Murray J. Warner Hugo J. W. L. Aerts Timothy A. Miller G. Savova Raymond H. Mak Danielle S. Bitterman 26 12 0 24 Mar 2023
Large AI Models in Health Informatics: Applications, Challenges, and the Future Jianing Qiu Lin Li Jiankai Sun Jiachuan Peng Peilun Shi ... Bo Xiao Wu Yuan Ningli Wang Dong Xu Benny Lo AI4MH LM&MA 42 127 0 21 Mar 2023
Generating multiple-choice questions for medical question answering with distractors and cue-masking Damien Sileo Kanimozhi Uma Marie-Francine Moens 35 5 0 13 Mar 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models Yan Xu Mahdi Namazifar Devamanyu Hazarika Aishwarya Padmakumar Yang Liu Dilek Z. Hakkani-Tür KELM 22 26 0 17 Feb 2023
Entity-Aware Dual Co-Attention Network for Fake News Detection Sin-Han Yang Chung-Chi Chen Hen-Hsen Huang Hsin-Hsi Chen 27 7 0 07 Feb 2023
Zero-shot causal learning H. Nilforoshan Michael Moor Yusuf Roohani Yining Chen Anja vSurina Michihiro Yasunaga Sara Oblak J. Leskovec CML BDL OffRL 16 11 0 28 Jan 2023
CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection Jie Liu Yixiao Zhang Jieneng Chen Junfei Xiao Yongyi Lu Bennett A. Landman Yixuan Yuan Alan Yuille Yucheng Tang Zongwei Zhou VLM MedIm 39 194 0 02 Jan 2023
Large Language Models Encode Clinical Knowledge K. Singhal Shekoofeh Azizi T. Tu S. S. Mahdavi Jason W. Wei ... A. Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam Vivek Natarajan LM&MA ELM AI4MH 19 2,173 0 26 Dec 2022
Can NLI Provide Proper Indirect Supervision for Low-resource Biomedical Relation Extraction? Lyne Tchapmi Mingyu Derek Ma Muhao Chen 33 21 0 21 Dec 2022
Graph Learning and Its Advancements on Large Language Models: A Holistic Survey Shaopeng Wei Yu Zhao Xingyan Chen Qing Li Fuzhen Zhuang Ji Liu Fuji Ren Gang Kou AI4CE 24 5 0 17 Dec 2022
From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Reader Weiwen Xu Xin Li Wenxuan Zhang Meng Zhou W. Lam Luo Si Lidong Bing 27 2 0 09 Dec 2022
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations Amanpreet Singh Mike DÁrcy Arman Cohan Doug Downey Sergey Feldman 22 79 0 23 Nov 2022
Retrieval-Augmented Multimodal Language Modeling Michihiro Yasunaga Armen Aghajanyan Weijia Shi Rich James J. Leskovec Percy Liang M. Lewis Luke Zettlemoyer Wen-tau Yih RALM 16 95 0 22 Nov 2022
Galactica: A Large Language Model for Science Ross Taylor Marcin Kardas Guillem Cucurull Thomas Scialom Anthony Hartshorn Elvis Saravia Andrew Poulton Viktor Kerkez Robert Stojnic ELM ReLM 34 727 0 16 Nov 2022
Toward expanding the scope of radiology report summarization to multiple anatomies and modalities Zhihong Chen M. Varma Xiang Wan C. Langlotz Jean-Benoit Delbrouck 12 18 0 15 Nov 2022
Learning to Navigate Wikipedia by Taking Random Walks Manzil Zaheer Kenneth Marino Will Grathwohl John Schultz Wendy Shang Sheila Babayan Arun Ahuja Ishita Dasgupta Christine Kaeser-Chen Rob Fergus 13 5 0 31 Oct 2022
NTULM: Enriching Social Media Text Representations with Non-Textual Units Jinning Li Shubhanshu Mishra Ahmed El-Kishky Sneha Mehta Vivek Kulkarni 21 4 0 29 Oct 2022
BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples Mohaddeseh Bastan Mihai Surdeanu Niranjan Balasubramanian 23 13 0 26 Oct 2022
Learning on Large-scale Text-attributed Graphs via Variational Inference Jianan Zhao Meng Qu Chaozhuo Li Hao Yan Qian Liu Rui Li Xing Xie Jian Tang VLM 35 131 0 26 Oct 2022
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining Renqian Luo Liai Sun Yingce Xia Tao Qin Sheng Zhang Hoifung Poon Tie-Yan Liu MedIm AI4CE LM&MA 39 787 0 19 Oct 2022
Deep Bidirectional Language-Knowledge Graph Pretraining Michihiro Yasunaga Antoine Bosselut Hongyu Ren Xikun Zhang Christopher D. Manning Percy Liang J. Leskovec 27 193 0 17 Oct 2022
Enriching Biomedical Knowledge for Low-resource Language Through Large-Scale Translation Long Phan Tai Dang H. Tran Trieu H. Trinh Vy Phan Lam D. Chau Minh-Thang Luong 10 8 0 11 Oct 2022
Variational Open-Domain Question Answering Valentin Liévin Andreas Geert Motzfeldt Ida Riis Jensen Ole Winther OOD BDL 36 8 0 23 Sep 2022
LED down the rabbit hole: exploring the potential of global attention for biomedical multi-document summarisation Yulia Otmakhova Thinh Hung Truong Timothy Baldwin Trevor Cohn Karin Verspoor Jey Han Lau 82 6 0 19 Sep 2022
TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twitter Xinyang Zhang Yury Malkov Omar U. Florez Serim Park Brian McWilliams Jiawei Han Ahmed El-Kishky VLM 61 90 0 15 Sep 2022
Pre-training for Information Retrieval: Are Hyperlinks Fully Explored? Jiawen Wu Xinyu Zhang Yutao Zhu Zheng Liu Zikai Guo Zhaoye Fei Ruofei Lai Yongkang Wu Zhao Cao Zhicheng Dou 25 5 0 14 Sep 2022
Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning Sheng Zhang Hao Cheng Jianfeng Gao Hoifung Poon 30 47 0 30 Aug 2022
Can large language models reason about medical questions? Valentin Liévin C. Hother Andreas Geert Motzfeldt Ole Winther ELM LM&MA AI4MH LRM 26 299 0 17 Jul 2022