Domain-specific Continued Pretraining of Language Models for Capturing
Long Context in Mental Health

Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health

20 April 2023

Sophia Ananiadou

Jörg Tiedemann

Papers citing "Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health"

19 / 19 papers shown

Title
ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data Xinzhe Zheng Sijie Ji Jiawei Sun Renqi Chen Wei Gao Mani Srivastava AI4MH LRM 32 0 0 20 May 2025
Fine-Tuning LLMs for Report Summarization: Analysis on Supervised and Unsupervised Data Swati Rallapalli Shannon Gallagher Andrew O. Mellinger Jasmine Ratchford Anusha Sinha Tyler Brooks William R. Nichols Nick Winski Bryan Brown 48 0 0 10 Mar 2025
MHQA: A Diverse, Knowledge Intensive Mental Health Question Answering Challenge for Language Models Suraj Racha Prashant Joshi Anshika Raman Nikita Jangid Mridul Sharma Ganesh Ramakrishnan Nirmal Punjabi AI4MH 95 0 0 24 Feb 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Min Zhang LM&MA AILaw 98 154 0 28 Jan 2025
Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis Amey Hengle Atharva Kulkarni Shantanu Patankar Madhumitha Chandrasekaran Sneha D'Silva Jemima Jacob Rashmi Gupta AI4MH 30 1 0 04 Oct 2024
FAIIR: Building Toward A Conversational AI Agent Assistant for Youth Mental Health Service Provision Stephen Obadinma Alia Lachana M. Norman Jocelyn Rankin Joanna Yu Xiaodan Zhu Darren Mastropaolo D. Pandya Roxana Sultan Elham Dolatabadi AI4MH 36 1 0 28 May 2024
Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twitter Nuredin Ali Charles Zhang Ned Mayo Stevie Chancellor 31 2 0 01 Apr 2024
Depression Detection on Social Media with Large Language Models Xiaochong Lan Yiming Cheng Li Sheng Chen Gao Yong Li AI4MH 31 11 0 16 Mar 2024
ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes Zhichao Yang Avijit Mitra Sunjae Kwon Hong-ye Yu 34 20 0 09 Mar 2024
SaulLM-7B: A pioneering Large Language Model for Law Pierre Colombo T. Pires Malik Boudiaf Dominic Culver Rui Melo ... Andre F. T. Martins Fabrizio Esposito Vera Lúcia Raposo Sofia Morgado Michael Desa ELM AILaw 52 66 0 06 Mar 2024
Pre-training Differentially Private Models with Limited Public Data Zhiqi Bu Xinwei Zhang Mingyi Hong Sheng Zha George Karypis 79 3 0 28 Feb 2024
Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data Van Minh Nguyen Nasheen Nur William Stern Thomas Mercer Chiradeep Sen S. Bhattacharyya Victor Tumbiolo Seng Jhing Goh 27 3 0 13 Dec 2023
Rethinking Large Language Models in Mental Health Applications Shaoxiong Ji Tianlin Zhang Kailai Yang Sophia Ananiadou Min Zhang LM&MA AI4MH 37 18 0 19 Nov 2023
MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models Kailai Yang Tianlin Zhang Zi-Zhou Kuang Qianqian Xie Jimin Huang Sophia Ananiadou AI4MH 38 47 0 24 Sep 2023
Cordyceps@LT-EDI: Depression Detection with Reddit and Self-training Dean Ninalga 27 0 0 24 Sep 2023
Multimodal Foundation Models For Echocardiogram Interpretation M. Christensen Milos Vukadinovic N. Yuan David Ouyang MedIm 29 7 0 29 Aug 2023
Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT Mostafa M. Amin Min Zhang Björn W. Schuller AI4MH 54 72 0 03 Mar 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 407 8,559 0 28 Jan 2022
Clinical XLNet: Modeling Sequential Clinical Notes and Predicting Prolonged Mechanical Ventilation Kexin Huang Abhishek Singh Sitong Chen E. Moseley Chih-ying Deng Naomi George C. Lindvall 59 57 0 27 Dec 2019