Clinical-Longformer and Clinical-BigBird: Transformers for long clinical
sequences

Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences

27 January 2022

Papers citing "Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences"

11 / 11 papers shown

Title
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer Jinghan Yao Sam Ade Jacobs Masahiro Tanaka Olatunji Ruwase A. Shafi D. Panda 28 2 0 30 Aug 2024
Using LLMs to label medical papers according to the CIViC evidence model Markus Hisch Xing David Wang 31 0 0 05 Jul 2024
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision Stephen Obadinma Alia Lachana M. Norman Jocelyn Rankin Joanna Yu Xiaodan Zhu Darren Mastropaolo D. Pandya Roxana Sultan Elham Dolatabadi AI4MH 28 1 0 28 May 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho S. Saria MoE 77 16 0 05 Feb 2024
CPLLM: Clinical Prediction with Large Language Models Ofir Ben Shoham Nadav Rappoport LM&MA 26 24 0 20 Sep 2023
Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain Aryo Pradipta Gema Pasquale Minervini Luke Daines Tom Hope Beatrice Alex LM&MA ALM 32 40 0 06 Jul 2023
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications Adam Ivankay Mattia Rigotti P. Frossard OOD MedIm 21 1 0 05 Jul 2023
BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch? Joel Niklaus Daniele Giofré 25 11 0 30 Nov 2022
Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding Zhichao Yang Shufan Wang Bhanu Pratap Singh Rawat Avijit Mitra Hong-ye Yu 119 49 0 07 Oct 2022
DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing Yanjun Gao Dmitriy Dligach Timothy A. Miller John R. Caskey Brihat Sharma M. Churpek Majid Afshar ELM LRM 34 16 0 29 Sep 2022
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 259 2,013 0 28 Jul 2020