Domain-specific Continued Pretraining of Language Models for Capturing
Long Context in Mental Health

Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health

20 April 2023

Sophia Ananiadou

Jörg Tiedemann

ArXiv (abs)PDF HTML

Papers citing "Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health"

16 / 16 papers shown

Title
ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data Xinzhe Zheng Sijie Ji Jiawei Sun Ruoxin Chen Wei Gao Mani Srivastava AI4MH LRM 56 0 0 20 May 2025
Fine-Tuning LLMs for Report Summarization: Analysis on Supervised and Unsupervised Data Swati Rallapalli Shannon Gallagher Andrew O. Mellinger Jasmine Ratchford Anusha Sinha Tyler Brooks William R. Nichols Nick Winski Bryan Brown 78 0 0 10 Mar 2025
MHQA: A Diverse, Knowledge Intensive Mental Health Question Answering Challenge for Language Models Suraj Racha Prashant Joshi Anshika Raman Nikita Jangid Mridul Sharma Ganesh Ramakrishnan Nirmal Punjabi AI4MH 138 1 0 24 Feb 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 228 176 0 28 Jan 2025
Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis Amey Hengle Atharva Kulkarni Shantanu Patankar Madhumitha Chandrasekaran Sneha D'Silva Jemima Jacob Rashmi Gupta AI4MH 55 4 0 04 Oct 2024
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision Stephen Obadinma Alia Lachana M. Norman Jocelyn Rankin Joanna Yu Xiaodan Zhu Darren Mastropaolo D. Pandya Roxana Sultan Elham Dolatabadi AI4MH 111 1 0 28 May 2024
Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twitter Nuredin Ali Charles Zhang Ned Mayo Stevie Chancellor 79 6 0 01 Apr 2024
Depression Detection on Social Media with Large Language Models Xiaochong Lan Yiming Cheng Li Sheng Chen Gao Yong Li AI4MH 67 15 0 16 Mar 2024
ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes Zhichao Yang Avijit Mitra Sunjae Kwon Hong-ye Yu 75 23 0 09 Mar 2024
SaulLM-7B: A pioneering Large Language Model for Law Pierre Colombo T. Pires Malik Boudiaf Dominic Culver Rui Melo ... Andre F. T. Martins Fabrizio Esposito Vera Lúcia Raposo Sofia Morgado Michael Desa ELM AILaw 106 75 0 06 Mar 2024
Pre-training Differentially Private Models with Limited Public Data Zhiqi Bu Xinwei Zhang Mingyi Hong Sheng Zha George Karypis 114 4 0 28 Feb 2024
Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data Van Minh Nguyen Nasheen Nur William Stern Thomas Mercer Chiradeep Sen S. Bhattacharyya Victor Tumbiolo Seng Jhing Goh 56 3 0 13 Dec 2023
Rethinking Large Language Models in Mental Health Applications Shaoxiong Ji Tianlin Zhang Kailai Yang Sophia Ananiadou Min Zhang LM&MA AI4MH 120 19 0 19 Nov 2023
MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models Kailai Yang Tianlin Zhang Zi-Zhou Kuang Qianqian Xie Jimin Huang Sophia Ananiadou AI4MH 91 58 0 24 Sep 2023
Cordyceps@LT-EDI: Depression Detection with Reddit and Self-training Dean Ninalga 47 0 0 24 Sep 2023
Multimodal Foundation Models For Echocardiogram Interpretation M. Christensen Milos Vukadinovic N. Yuan David Ouyang MedIm 62 8 0 29 Aug 2023

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.