Clinical Text Deduplication Practices for Efficient Pretraining and
Improved Clinical Tasks

Clinical Text Deduplication Practices for Efficient Pretraining and Improved Clinical Tasks

29 September 2023

Isotta Landi

Alissa A. Valentine

Alexander W. Charney

ArXiv (abs)PDF HTML

Papers citing "Clinical Text Deduplication Practices for Efficient Pretraining and Improved Clinical Tasks"

8 / 8 papers shown

Title
Do We Still Need Clinical Language Models? Eric P. Lehman Evan Hernandez Diwakar Mahajan Jonas Wulff Micah J. Smith Zachary M. Ziegler Daniel Nadler Peter Szolovits Alistair E. W. Johnson Emily Alsentzer LM&MA AI4MH 83 140 0 16 Feb 2023
Learning to Ask Like a Physician Eric P. Lehman Vladislav Lialin K. Y. Legaspi Anne Janelle R. Sy Patricia Therese S. Pile ... Anna Rumshisky Jenifer Liang Preethi Raghavan Leo Anthony Celi Peter Szolovits OOD 73 20 0 06 Jun 2022
OpenPrompt: An Open-source Framework for Prompt-learning Ning Ding Shengding Hu Weilin Zhao Yulin Chen Zhiyuan Liu Haitao Zheng Maosong Sun VLM LLMAG 85 294 0 03 Nov 2021
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 360 634 0 14 Jul 2021
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks Suchin Gururangan Ana Marasović Swabha Swayamdipta Kyle Lo Iz Beltagy Doug Downey Noah A. Smith VLM AI4CE CLL 155 2,434 0 23 Apr 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 348 1,617 0 21 Jan 2020
Publicly Available Clinical BERT Embeddings Emily Alsentzer John R. Murphy Willie Boag W. Weng Di Jin Tristan Naumann Matthew B. A. McDermott AI4MH 158 1,983 0 06 Apr 2019
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 575 27,325 0 01 Sep 2014