Pre-training Multi-task Contrastive Learning Models for Scientific
Literature Understanding

Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding

23 May 2023

Yu Zhang

Xiaodong Liu

Papers citing "Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding"

16 / 16 papers shown

Title
Improving Scientific Document Retrieval with Concept Coverage-based Query Set Generation SeongKu Kang Bowen Jin Wonbin Kweon Yu Zhang Dongha Lee J. Han Hwanjo Yu 61 0 0 16 Feb 2025
Taxonomy-guided Semantic Indexing for Academic Paper Search SeongKu Kang Yunyi Zhang Pengcheng Jiang Dongha Lee J. Han Hwanjo Yu 34 3 0 25 Oct 2024
HLM-Cite: Hybrid Language Model Workflow for Text-based Scientific Citation Prediction Qianyue Hao Jingyang Fan Fengli Xu Jian Yuan Yong Li 29 0 0 10 Oct 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 44 27 0 16 Jun 2024
BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers Ran Xu Wenqi Shi Yue Yu Yuchen Zhuang Yanqiao Zhu M. D. Wang Joyce C. Ho Chao Zhang Carl Yang LM&MA 40 19 0 29 Apr 2024
When Large Language Models Meet Citation: A Survey Yang Zhang Yufei Wang Kai Wang Quan Z. Sheng Lina Yao A. Mahmood Wei Emma Zhang Rongying Zhao 50 7 0 18 Sep 2023
Weakly Supervised Multi-Label Classification of Full-Text Scientific Papers Yu Zhang Bowen Jin Xiusi Chen Yan-Jun Shen Yunyi Zhang Yu Meng Jiawei Han 38 13 0 24 Jun 2023
Weakly-Supervised Scientific Document Classification via Retrieval-Augmented Multi-Stage Training Ran Xu Yue Yu Joyce C. Ho Carl Yang 47 21 0 12 Jun 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering Hao Cheng Hao Fang Xiaodong Liu Jianfeng Gao RALM 33 5 0 11 Oct 2022
Are We Really Making Much Progress in Text Classification? A Comparative Review Lukas Galke Andor Diera Bao Xin Lin Bhakti Khera Tim Meuser Tushar Singhal Fabian Karl A. Scherp VLM 29 3 0 08 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
Mixture-of-Experts with Expert Choice Routing Yan-Quan Zhou Tao Lei Han-Chu Liu Nan Du Yanping Huang Vincent Zhao Andrew M. Dai Zhifeng Chen Quoc V. Le James Laudon MoE 160 327 0 18 Feb 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 213 1,657 0 15 Oct 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 231 971 0 17 Apr 2021
PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin Bhuwan Dhingra Zhengping Liu William W. Cohen Xinghua Lu 216 812 0 13 Sep 2019
A Web-scale system for scientific knowledge exploration Zhihong Shen Hao Ma Kuansan Wang 125 120 0 30 May 2018