Towards Efficient Large Language Models for Scientific Text: A Review

20 August 2024

Papers citing "Towards Efficient Large Language Models for Scientific Text: A Review"

11 / 11 papers shown

Title
A Survey of Pre-trained Language Models for Processing Scientific Text Xanh Ho Anh-Khoa Duong Nguyen Tuan-An Dao Junfeng Jiang Yuki Chida Kaito Sugimoto H. To Florian Boudin Akiko Aizawa 11 7 0 31 Jan 2024
ADA-GNN: Atom-Distance-Angle Graph Neural Network for Crystal Material Property Prediction Jiao Huang Qianli Xing Jinglong Ji Bo Yang 41 3 0 22 Jan 2024
Continual Learning with Dirichlet Generative-based Rehearsal Min Zeng Wei Xue Qi-fei Liu Yi-Ting Guo CLL BDL 34 5 0 13 Sep 2023
MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning Xiang Yue Xingwei Qu Ge Zhang Yao Fu Wenhao Huang Huan Sun Yu-Chuan Su Wenhu Chen AIMat LRM 97 391 0 11 Sep 2023
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct Haipeng Luo Qingfeng Sun Can Xu Pu Zhao Jian-Guang Lou ... Xiubo Geng Qingwei Lin Shifeng Chen Yansong Tang Dongmei Zhang LRM OSLM 139 439 0 18 Aug 2023
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 98 186 0 27 May 2023
HuatuoGPT, towards Taming Language Model to Be a Doctor Hongbo Zhang Junying Chen Feng Jiang Fei Yu Zhihong Chen ... Zhiyi Zhang Qingying Xiao Xiang Wan Benyou Wang Haizhou Li LM&MA AI4MH ELM 59 198 0 24 May 2023
Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPT Tong Xie Yuwei Wan Wei-Ping Huang Yufei Zhou Yixuan Liu ... Shaozhou Wang Chunyu Kit Clara Grazian Weinan Zhang Hoex 35 52 0 05 Apr 2023
Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning Elias Frantar Sidak Pal Singh Dan Alistarh MQ 60 226 0 24 Aug 2022
Compression of Generative Pre-trained Language Models via Quantization Chaofan Tao Lu Hou Wei Zhang Lifeng Shang Xin Jiang Qun Liu Ping Luo Ngai Wong MQ 58 104 0 21 Mar 2022
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 49 166 0 11 Oct 2021