GLM: General Language Model Pretraining with Autoregressive Blank Infilling

18 March 2021

Zhengxiao Du

Yujie Qian

Xiao Liu

Ming Ding

Papers citing "GLM: General Language Model Pretraining with Autoregressive Blank Infilling"

50 / 204 papers shown

Title
VoCo-LLaMA: Towards Vision Compression with Large Language Models Xubing Ye Yukang Gan Xiaoke Huang Yixiao Ge Yansong Tang MLLM VLM 43 23 0 18 Jun 2024
Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent Lin Wang Zhichao Wang Xiaoying Tang 49 1 0 17 Jun 2024
EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems Mohammad Dehghan Mohammad Ali Alomrani Sunyam Bagga David Alfonso-Hermelo Khalil Bibi ... Jimmy Lin Boxing Chen Prasanna Parthasarathi Mahdi Biparva Mehdi Rezagholizadeh RALM 58 5 0 14 Jun 2024
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack Yuri Kuratov Aydar Bulatov Petr Anokhin Ivan Rodkin Dmitry Sorokin Artyom Sorokin Andrey Kravchenko RALM ALM LRM ReLM ELM 51 61 0 14 Jun 2024
A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations Jinqiang Wang Huansheng Ning Yi Peng Qikai Wei Daniel Tesfai Wenwei Mao Tao Zhu Runhe Huang LM&MA AI4MH ELM 49 5 0 14 Jun 2024
SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models Kehua Feng Keyan Ding Weijie Wang Xiang Zhuang Zeyuan Wang Ming Qin Yu Zhao Jianhua Yao Qiang Zhang H. Chen ELM 50 6 0 13 Jun 2024
LVBench: An Extreme Long Video Understanding Benchmark Weihan Wang Zehai He Wenyi Hong Yean Cheng Xiaohan Zhang ... Shiyu Huang Bin Xu Yuxiao Dong Ming Ding Jie Tang ELM VLM 47 67 0 12 Jun 2024
Non-autoregressive Personalized Bundle Generation Wenchuan Yang Cheng Yang Jichao Li Yuejin Tan Xin Lu Chuan Shi 28 0 0 11 Jun 2024
MaLa-ASR: Multimedia-Assisted LLM-Based ASR Guanrou Yang Ziyang Ma Fan Yu Zhifu Gao Shiliang Zhang Xie Chen AuLLM 44 3 0 09 Jun 2024
One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models Hao Fang Jiawei Kong Wenbo Yu Bin Chen Jiawei Li Hao Wu Ke Xu Ke Xu AAML VLM 40 13 0 08 Jun 2024
AICoderEval: Improving AI Domain Code Generation of Large Language Models Yinghui Xia Yuyan Chen Tianyu Shi Jun Wang Jinsong Yang 34 3 0 07 Jun 2024
Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding Kuo Liao Shuang Li Meng Zhao Liqun Liu Mengge Xue Zhenyu Hu Honglin Han Chengguo Yin 42 1 0 30 May 2024
Efficient Indirect LLM Jailbreak via Multimodal-LLM Jailbreak Zhenxing Niu Yuyao Sun Haoxuan Ji Zheng Lin Haichang Gao Xinbo Gao Gang Hua Rong Jin 42 2 0 30 May 2024
DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension Runfeng Lin Dacheng Xu Huijiang Wang Zebiao Chen Yating Wang Shouqiang Liu 44 0 0 29 May 2024
Evaluating the External and Parametric Knowledge Fusion of Large Language Models Hao Zhang Yuyang Zhang Xiaoguang Li Wenxuan Shi Haonan Xu ... Yasheng Wang Lifeng Shang Qun Liu Yong-jin Liu Ruiming Tang KELM 45 4 0 29 May 2024
Empowering Character-level Text Infilling by Eliminating Sub-Tokens Houxing Ren Mingjie Zhan Zhongyuan Wu Hongsheng Li AI4CE 35 1 0 27 May 2024
Detection and Positive Reconstruction of Cognitive Distortion sentences: Mandarin Dataset and Evaluation Shuya Lin Yuxiong Wang Jonathan Dong Shiguang Ni 39 1 0 24 May 2024
M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal Models Hongyu Wang Jiayu Xu Senwei Xie Ruiping Wang Jialin Li Zhaojie Xie Bin Zhang Chuyan Xiong Xilin Chen ELM VLM LRM 94 7 0 24 May 2024
Eliciting Informative Text Evaluations with Large Language Models Yuxuan Lu Shengwei Xu Yichi Zhang Yuqing Kong Grant Schoenebeck 42 5 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 82 45 0 23 May 2024
CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models Haoxiang Shi Jiaan Wang Jiarong Xu Cen Wang Tetsuya Sakai LMTD 28 0 0 20 May 2024
A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks Xuanfan Ni Piji Li ELM LRM 34 8 0 16 May 2024
CPsyExam: A Chinese Benchmark for Evaluating Psychology using Examinations Jiahao Zhao Jingwei Zhu Minghuan Tan Min Yang Di Yang Chenhao Zhang Guancheng Ye Chengming Li Xiping Hu ELM 40 0 0 16 May 2024
LFED: A Literary Fiction Evaluation Dataset for Large Language Models Linhao Yu Qun Liu Deyi Xiong 21 1 0 16 May 2024
DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues Xiang Luo Zhiwen Tang Jin Wang Xuejie Zhang 31 5 0 16 May 2024
Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process Tong Xiao Jia-Yin Liu Zhenya Huang Jinze Wu Jing Sha Shijin Wang Enhong Chen AI4CE 42 3 0 10 May 2024
Redefining Information Retrieval of Structured Database via Large Language Models Mingzhu Wang Yuzhe Zhang Qihang Zhao Juanyi Yang Hong Zhang RALM KELM 35 0 0 09 May 2024
Hallucination of Multimodal Large Language Models: A Survey Zechen Bai Pichao Wang Tianjun Xiao Tong He Zongbo Han Zheng Zhang Mike Zheng Shou VLM LRM 95 145 0 29 Apr 2024
CRE-LLM: A Domain-Specific Chinese Relation Extraction Framework with Fine-tuned Large Language Model Zhengpeng Shi Haoran Luo LRM ALM 38 2 0 28 Apr 2024
Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors Guozheng Li Peng Wang Jiajun Liu Yikai Guo Ke Ji Ziyu Shang Zijie Xu LRM 43 7 0 27 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies Benjue Weng LM&MA 46 8 0 13 Apr 2024
MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking Tianwen Tang Tong Zhu Haodong Liu Yin Bai Jia Cheng Wenliang Chen MoE 29 0 0 12 Apr 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 71 5 0 11 Apr 2024
MOPAR: A Model Partitioning Framework for Deep Learning Inference Services on Serverless Platforms Jiaang Duan Shiyou Qian Dingyu Yang Hanwen Hu Jian Cao Guangtao Xue MoE 45 1 0 03 Apr 2024
ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback Zhenyu Hou Yiin Niu Zhengxiao Du Xiaohan Zhang Xiao Liu ... Qinkai Zheng Minlie Huang Hongning Wang Jie Tang Yuxiao Dong ALM 42 18 0 01 Apr 2024
Large Language Models Are Struggle to Cope with Unreasonability in Math Problems Jingyuan Ma Damai Dai Zihang Yuan Rui Li Weilin Luo Bin Wang Qun Liu Lei Sha Zhifang Sui LRM 81 4 0 28 Mar 2024
DGoT: Dynamic Graph of Thoughts for Scientific Abstract Generation Xinyu Ning Yutong Zhao Yitong Liu Hongwen Yang VLM 32 1 0 26 Mar 2024
Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference Han Zhao Min Zhang Wei Zhao Pengxiang Ding Siteng Huang Donglin Wang Mamba 52 68 0 21 Mar 2024
LHMKE: A Large-scale Holistic Multi-subject Knowledge Evaluation Benchmark for Chinese Large Language Models Chuang Liu Renren Jin Yuqi Ren Deyi Xiong ELM 43 0 0 19 Mar 2024
Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking Ming Dong Yujing Chen Miao Zhang Hao Sun Tingting He 42 4 0 13 Mar 2024
Large Language Models are Contrastive Reasoners Liang Yao ReLM ELM LRM 45 2 0 13 Mar 2024
Beyond Text: Frozen Large Language Models in Visual Signal Comprehension Lei Zhu Fangyun Wei Yanye Lu MLLM VLM 52 18 0 12 Mar 2024
SPAFormer: Sequential 3D Part Assembly with Transformers Boshen Xu Sipeng Zheng Qin Jin 49 2 0 09 Mar 2024
ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Models Jun Xu Mengshu Sun Qing Cui Jun Zhou 46 1 0 08 Mar 2024
On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models Xinpeng Wang Shitong Duan Xiaoyuan Yi Jing Yao Shanlin Zhou Zhihua Wei Peng Zhang Dongkuan Xu Maosong Sun Xing Xie OffRL 41 16 0 07 Mar 2024
Towards Training A Chinese Large Language Model for Anesthesiology Zhonghai Wang Jie Jiang Yibing Zhan Bohao Zhou Yanhong Li ... Liang Ding Hua Jin Jun Peng Xu Lin Weifeng Liu LM&MA 37 3 0 05 Mar 2024
PopALM: Popularity-Aligned Language Models for Social Media Trendy Response Prediction Erxin Yu Jing Li Chunpu Xu 35 3 0 29 Feb 2024
FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systems Junjie Huang Jinyang Liu Zhuangbin Chen Zhihan Jiang Yichen Li Jiazhen Gu Cong Feng Zengyin Yang Yongqiang Yang Michael R. Lyu 35 8 0 27 Feb 2024
GraphEdit: Large Language Models for Graph Structure Learning Zirui Guo Lianghao Xia Yanhua Yu Yuling Wang Zixuan Yang Zhiyong Huang Chao Huang 55 19 0 23 Feb 2024
An LLM-Enhanced Adversarial Editing System for Lexical Simplification Keren Tan Kangyang Luo Yunshi Lan Zheng Yuan Jinlong Shu AAML 28 6 0 22 Feb 2024