GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text

14 August 2023

Papers citing "GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text"

20 / 20 papers shown

Title
Evaluating Effects of Augmented SELFIES for Molecular Understanding Using QK-LSTM Collin Beaudoin Swaroop Ghosh 36 0 0 29 Apr 2025
An Enhanced Large Language Model For Cross Modal Query Understanding System Using DL-KeyBERT Based CAZSSCL-MPGPT Shreya Singh 43 0 0 24 Feb 2025
The Graph's Apprentice: Teaching an LLM Low Level Knowledge for Circuit Quality Estimation Reza Moravej Saurabh Bodhe Zhanguang Zhang Didier Chetelat Dimitrios Tsaras Yingxue Zhang Hui-Ling Zhen Jianye Hao M. Yuan 55 1 0 17 Feb 2025
Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning Yibo Yan Shen Wang Jiahao Huo Jingheng Ye Zhendong Chu Xuming Hu Philip S. Yu Carla P. Gomes B. Selman Qingsong Wen LRM 127 9 0 05 Feb 2025
Mamba-Based Graph Convolutional Networks: Tackling Over-smoothing with Selective State Space Xin He Y. Wang Wenqi Fan Xu Shen Xin Juan Rui Miao Xin Wang 68 0 0 26 Jan 2025
A Comprehensive Survey of Foundation Models in Medicine Wasif Khan Seowung Leem Kyle B. See Joshua K. Wong Shaoting Zhang R. Fang AI4CE LM&MA VLM 105 18 0 17 Jan 2025
Exploring Hierarchical Molecular Graph Representation in Multimodal LLMs Chengxin Hu Hao Li Yihe Yuan Jing Li Ivor Tsang 46 0 0 07 Nov 2024
GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration Xin Sky Li Qizhi Chu Y. Chen Yang Liu Yaoqi Liu Zekai Yu Weize Chen Chen Qian C. Shi Cheng Yang LLMAG 53 2 0 23 Oct 2024
Atomas: Hierarchical Alignment on Molecule-Text for Unified Molecule Understanding and Generation Yikun Zhang Geyan Ye Chaohao Yuan Bo Han Long-Kai Huang Jianhua Yao Wei Liu Yu Rong 29 3 0 23 Apr 2024
A Survey of Graph Meets Large Language Model: Progress and Future Directions Yuhan Li Zhixun Li Peisong Wang Jia Li Xiangguo Sun Hongtao Cheng Jeffrey Xu Yu 38 55 0 21 Nov 2023
One Transformer Fits All Distributions in Multi-Modal Diffusion at Scale Fan Bao Shen Nie Kaiwen Xue Chongxuan Li Shiliang Pu Yaole Wang Gang Yue Yue Cao Hang Su Jun Zhu DiffM 207 148 0 12 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 270 4,244 0 30 Jan 2023
A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language Bing-Huang Su Dazhao Du Zhao-Qing Yang Yujie Zhou Jiangmeng Li Anyi Rao Haoran Sun Zhiwu Lu Ji-Rong Wen 44 107 0 12 Sep 2022
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Zhilong Zhang Yingxia Shao Shenda Hong Runsheng Xu Yue Zhao Wentao Zhang Bin Cui Ming-Hsuan Yang DiffM MedIm 224 1,302 0 02 Sep 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 358 8,495 0 28 Jan 2022
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 120 302 0 07 Oct 2021
From Show to Tell: A Survey on Deep Learning-based Image Captioning Matteo Stefanini Marcella Cornia Lorenzo Baraldi S. Cascianelli G. Fiameni Rita Cucchiara 3DV VLM MLLM 67 254 0 14 Jul 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,848 0 18 Apr 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 298 3,700 0 11 Feb 2021
MoleculeNet: A Benchmark for Molecular Machine Learning Zhenqin Wu Bharath Ramsundar Evan N. Feinberg Joseph Gomes C. Geniesse Aneesh S. Pappu K. Leswing Vijay S. Pande OOD 172 1,778 0 02 Mar 2017