Qwen Technical Report

28 September 2023

Jinze Bai

Shuai Bai

Yunfei Chu

Zeyu Cui

Kai Dang

Xiaodong Deng

Yang Fan

Wenbin Ge

Yu Han

Fei Huang

Binyuan Hui

Luo Ji

Mei Li

Junyang Lin

Runji Lin

Dayiheng Liu

Gao Liu

Chengqiang Lu

Keming Lu

Jianxin Ma

Rui Men

Xingzhang Ren

Xuancheng Ren

Chuanqi Tan

Sinan Tan

Jianhong Tu

Peng Wang

Shijie Wang

Wei Wang

Shengguang Wu

Benfeng Xu

Jin Xu

An Yang

Hao Yang

Jian Yang

Shusheng Yang

Yang Yao

Bowen Yu

Hongyi Yuan

Zheng Yuan

Jianwei Zhang

Xinyu Zhang

Yichang Zhang

Zhenru Zhang

Chang Zhou

Jingren Zhou

Xiaohuan Zhou

Tianhang Zhu

OSLM

ArXiv (abs)PDF HTML

Papers citing "Qwen Technical Report"

50 / 1,345 papers shown

Title
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application Chuanpeng Yang Wang Lu Yao Zhu Yidong Wang Qian Chen Chenlong Gao Bingjie Yan Yiqiang Chen ALM KELM 101 32 0 02 Jul 2024
A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understanding Jinghui Lu Haiyang Yu Yanjie Wang Yongjie Ye Jingqun Tang ... Qi Liu Hao Feng Han Wang Hao Liu Can Huang 178 23 0 02 Jul 2024
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches Jiayi Yuan Hongyi Liu Shaochen Zhong Yu-Neng Chuang ... Hongye Jin Vipin Chaudhary Zhaozhuo Xu Zirui Liu Xia Hu 106 24 0 01 Jul 2024
Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs Enshu Liu Junyi Zhu Zinan Lin Xuefei Ning Matthew B. Blaschko Shengen Yan Guohao Dai Huazhong Yang Yu Wang MoE 105 7 0 01 Jul 2024
Eliminating Position Bias of Language Models: A Mechanistic Approach Ziqi Wang Hanlin Zhang Xiner Li Kuan-Hao Huang Chi Han Shuiwang Ji Sham Kakade Hao Peng Heng Ji 159 20 0 01 Jul 2024
Can Small Language Models Learn, Unlearn, and Retain Noise Patterns? Nicy Scaria Silvester John Joseph Kennedy Deepak N. Subramani MU 121 2 0 01 Jul 2024
It's Morphing Time: Unleashing the Potential of Multiple LLMs via Multi-objective Optimization Bingdong Li Zixiang Di Yanting Yang Hong Qian Peng Yang Hao Hao Ke Tang Aimin Zhou MoMe 115 6 0 29 Jun 2024
Segment Anything without Supervision Xudong Wang Jingfeng Yang Trevor Darrell VLM 121 15 0 28 Jun 2024
BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5 Zhehuai Chen He Huang Oleksii Hrinchuk Krishna Puvvada Nithin Rao Koluguri Piotr Żelasko Jagadeesh Balam Boris Ginsburg AuLLM RALM 92 11 0 28 Jun 2024
Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation Chenlong Deng Kelong Mao Zhicheng Dou ELM AILaw 58 5 0 28 Jun 2024
Leveraging Large Language Models for enhanced personalised user experience in Smart Homes Jordan Rey-Jouanchicot André Bottaro Eric Campo J. Bouraoui Nadine Vigouroux F. Vella 28 2 0 28 Jun 2024
Beyond Human Preferences: Exploring Reinforcement Learning Trajectory Evaluation and Improvement through LLMs Zichao Shen Tianchen Zhu Qingyun Sun Shiqi Gao Jianxin Li OffRL 60 1 0 28 Jun 2024
Mixture of In-Context Experts Enhance LLMs' Long Context Awareness Hongzhan Lin Ang Lv Yuhan Chen Chen Zhu Yang Song Hengshu Zhu Rui Yan 72 12 0 28 Jun 2024
Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model Longrong Yang Dong Shen Chaoxiang Cai Fan Yang Size Li Tingting Gao Xi Li MoE 148 2 0 28 Jun 2024
CELLO: Causal Evaluation of Large Vision-Language Models Meiqi Chen Bo Peng Yan Zhang Chaochao Lu LRM ELM 77 0 0 27 Jun 2024
DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming Jiaxin Zhang Wentao Yang Songxuan Lai Zecheng Xie Lianwen Jin 94 21 0 27 Jun 2024
STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysis Wenbin Li Di Yao Ruibo Zhao Wenjie Chen Zijie Xu Chengxue Luo Chang Gong Quanliang Jing Haining Tan Jingping Bi 85 7 0 27 Jun 2024
DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment Ke-Han Lu Zhehuai Chen Szu-Wei Fu He Huang Boris Ginsburg Yu-Chiang Frank Wang Hung-yi Lee VLM AuLLM 99 19 0 27 Jun 2024
Streaming Decoder-Only Automatic Speech Recognition with Discrete Speech Units: A Pilot Study Peikun Chen Sining Sun Changhao Shan Qing Yang Lei Xie 101 3 0 27 Jun 2024
LICO: Large Language Models for In-Context Molecular Optimization Tung Nguyen Aditya Grover 85 10 0 27 Jun 2024
The Remarkable Robustness of LLMs: Stages of Inference? Vedang Lad Wes Gurnee Max Tegmark Max Tegmark 119 53 0 27 Jun 2024
LiveBench: A Challenging, Contamination-Limited LLM Benchmark Colin White Samuel Dooley Manley Roberts Arka Pal Ben Feuer ... Willie Neiswanger Micah Goldblum Tom Goldstein Willie Neiswanger Micah Goldblum ELM 125 20 0 27 Jun 2024
Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation Guanting Dong Yutao Zhu Chenghao Zhang Zechen Wang Zhicheng Dou Ji-Rong Wen RALM 107 13 0 26 Jun 2024
Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs Xin Lai Zhuotao Tian Yukang Chen Senqiao Yang Xiangru Peng Jiaya Jia LRM 175 126 0 26 Jun 2024
A Refer-and-Ground Multimodal Large Language Model for Biomedicine Xiaoshuang Huang Haifeng Huang Lingdong Shen Yehui Yang Fangxin Shang Junwei Liu Jia Liu LM&MA 135 7 0 26 Jun 2024
Poisoned LangChain: Jailbreak LLMs by LangChain Ziqiu Wang Jun Liu Shengkai Zhang Yang Yang 83 7 0 26 Jun 2024
SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance Caishuang Huang Wanxu Zhao Rui Zheng Huijie Lv Shihan Dou ... Junjie Ye Yuming Yang Tao Gui Qi Zhang Xuanjing Huang LLMSV AAML 121 9 0 26 Jun 2024
Large Language Models for Cuffless Blood Pressure Measurement From Wearable Biosignals Zengding Liu Chen Chen Jiannong Cao Minglei Pan Jikui Liu Nan Li F. Miao Ye Li 106 3 0 26 Jun 2024
LLMs for Doctors: Leveraging Medical LLMs to Assist Doctors, Not Replace Them Wenya Xie Qingying Xiao Yu Zheng Xidong Wang Junying Chen Ke Ji Anningzhe Gao Xiang Wan Feng Jiang Benyou Wang LM&MA 54 4 0 26 Jun 2024
MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation Yusheng Liao Shuyang Jiang Yanfeng Wang Yu Wang 105 3 0 25 Jun 2024
TALEC: Teach Your LLM to Evaluate in Specific Domain with In-house Criteria by Criteria Division and Zero-shot Plus Few-shot Kaiqi Zhang Shuai Yuan Honghan Zhao ALM ELM 71 2 0 25 Jun 2024
Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA Minzheng Wang Longze Chen Cheng Fu Shengyi Liao Xinghua Zhang ... Run Luo Yunshui Li Min Yang Fei Huang Yongbin Li RALM 105 60 0 25 Jun 2024
Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels Razvan-Gabriel Dumitru Vikas Yadav Rishabh Maheshwary Paul-Ioan Clotan Sathwik Tejaswi Madhusudhan Mihai Surdeanu MQ 127 2 0 25 Jun 2024
Dual-Space Knowledge Distillation for Large Language Models Songming Zhang Xue Zhang Zengkui Sun Yufeng Chen Jinan Xu 90 9 0 25 Jun 2024
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph Tong Zhou Yubo Chen Kang Liu Jun Zhao HILM RALM 105 2 0 25 Jun 2024
MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs Wenqian Ye Guangtao Zheng Yunsheng Ma Xu Cao Bolin Lai James M. Rehg Aidong Zhang 91 15 0 24 Jun 2024
Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models Jierun Chen Fangyun Wei Jinjing Zhao Sizhe Song Bohuai Wu Zhuoxuan Peng S.-H. Gary Chan Hongyang R. Zhang 103 9 0 24 Jun 2024
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs Shengbang Tong Ellis L Brown Penghao Wu Sanghyun Woo Manoj Middepogu ... Xichen Pan Austin Wang Rob Fergus Yann LeCun Saining Xie 3DV MLLM 166 377 0 24 Jun 2024
C-LLM: Learn to Check Chinese Spelling Errors Character by Character Kunting Li Yong Hu Liang He Fandong Meng Jie Zhou 89 9 0 24 Jun 2024
Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning Ziyu Zhao Leilei Gan Guoyin Wang Yuwei Hu Tao Shen Hongxia Yang Kun Kuang Fei Wu MoE MoMe 83 12 0 24 Jun 2024
M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models Rishabh Maheshwary Vikas Yadav Hoang Nguyen Khyati Mahajan Sathwik Tejaswi Madhusudhan 135 3 0 24 Jun 2024
FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models Junyi Zhu Shuochen Liu Yu Yu Bo Tang Yibo Yan Zhiyu Li Feiyu Xiong Tong Xu Matthew B. Blaschko 86 5 0 23 Jun 2024
Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentary Meiling Tao Xuechen Liang Ziyi Wang Yiling Tao Yiling Tao Jianhui Wang Sun Li Tianyu Shi 126 1 0 23 Jun 2024
The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models Jiajia Li Lu Yang Mingni Tang Cong Chen Zuchao Li Ping Wang Hai Zhao LM&MA 82 6 0 22 Jun 2024
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions Terry Yue Zhuo Minh Chien Vu Jenny Chim Han Hu Wenhao Yu ... David Lo Daniel Fried Xiaoning Du H. D. Vries Leandro von Werra 235 193 0 22 Jun 2024
SAIL: Self-Improving Efficient Online Alignment of Large Language Models Mucong Ding Souradip Chakraborty Vibhu Agrawal Zora Che Alec Koppel Mengdi Wang Amrit Singh Bedi Furong Huang 85 13 0 21 Jun 2024
UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis Yulong Hui Yao Lu Huanchen Zhang RALM 105 13 0 21 Jun 2024
SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation Zeyao Ma Bohan Zhang Jing Zhang Jifan Yu Yanling Wang Xiaohan Zhang Sijia Luo Xi Wang Jie Tang LMTD 104 10 0 21 Jun 2024
Pistis-RAG: A Scalable Cascading Framework Towards Trustworthy Retrieval-Augmented Generation Yu Bai Yukai Miao Li Chen Dan Li Yanyu Ren Hongtao Xie Ce Yang Xuhui Cai 62 2 0 21 Jun 2024
Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation Yuanjie Lyu Zihan Niu Zheyong Xie Chao Zhang Tong Xu Yang Wang Enhong Chen RALM 66 11 0 21 Jun 2024