Qwen Technical Report

28 September 2023

Jinze Bai

Shuai Bai

Yunfei Chu

Zeyu Cui

Kai Dang

Xiaodong Deng

Yang Fan

Wenbin Ge

Yu Han

Fei Huang

Binyuan Hui

Luo Ji

Mei Li

Junyang Lin

Runji Lin

Dayiheng Liu

Gao Liu

Chengqiang Lu

Keming Lu

Jianxin Ma

Rui Men

Xingzhang Ren

Xuancheng Ren

Chuanqi Tan

Sinan Tan

Jianhong Tu

Peng Wang

Shijie Wang

Wei Wang

Shengguang Wu

Benfeng Xu

Jin Xu

An Yang

Hao Yang

Jian Yang

Shusheng Yang

Yang Yao

Bowen Yu

Hongyi Yuan

Zheng Yuan

Jianwei Zhang

Xinyu Zhang

Yichang Zhang

Zhenru Zhang

Chang Zhou

Jingren Zhou

Xiaohuan Zhou

Tianhang Zhu

OSLM

ArXiv (abs)PDF HTML

Papers citing "Qwen Technical Report"

50 / 1,345 papers shown

Title
Towards "Differential AI Psychology" and in-context Value-driven Statement Alignment with Moral Foundations Theory Simon Münker SyDa 96 0 0 21 Aug 2024
MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing Hao Zhou Zhijun Wang Shujian Huang Xin Huang Xue Han Junlan Feng Chao Deng Weihua Luo Jiajun Chen CLL MoE 84 6 0 21 Aug 2024
Making Large Vision Language Models to be Good Few-shot Learners Fan Liu Wenwen Cai Jian Huo Chuanyi Zhang Delong Chen Jun Zhou 89 0 0 21 Aug 2024
Personality Alignment of Large Language Models Minjun Zhu Linyi Yang Yue Zhang Yue Zhang ALM 132 8 0 21 Aug 2024
MegaFake: A Theory-Driven Dataset of Fake News Generated by Large Language Models Lionel Z. Wang Yiming Ma Renfei Gao Beichen Guo Han Zhu Wenqi Fan Zexin Lu Ka Chung Ng SyDa 75 4 0 19 Aug 2024
Minor DPO reject penalty to increase training robustness Shiming Xie Hong Chen Fred Yu Zeye Sun Xiuyu Wu Yingfan Hu 73 4 0 19 Aug 2024
R2GenCSR: Retrieving Context Samples for Large Language Model based X-ray Medical Report Generation Xiao Wang Yuehang Li Fuling Wang Shiao Wang Chuanfu Li Bo Jiang MedIm 79 8 0 19 Aug 2024
A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition Yangze Li Xiong Wang Songjun Cao Yike Zhang Long Ma Lei Xie AuLLM 77 2 0 18 Aug 2024
Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset Renliang Sun Mengyuan Liu Shiping Yang Rui Wang Junqing He Jiaxing Zhang 92 2 0 18 Aug 2024
Beyond the Hype: A dispassionate look at vision-language models in medical scenario Yang Nan Huichi Zhou Xiaodan Xing Guang Yang 105 4 0 16 Aug 2024
Assessing and Enhancing Large Language Models in Rare Disease Question-answering Guanchu Wang Junhao Ran Ruixiang Tang Chia-Yuan Chang Chia-Yuan Chang Yu-Neng Chuang Zirui Liu Vladimir Braverman Zhandong Liu Xia Hu LM&MA 104 7 0 15 Aug 2024
FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models Zhongyu Zhao Menghang Dong Rongyu Zhang Wenzhao Zheng Yunpeng Zhang Huanrui Yang Dalong Du Kurt Keutzer Shanghang Zhang 100 0 0 15 Aug 2024
FuseChat: Knowledge Fusion of Chat Models Fanqi Wan Longguang Zhong Ziyi Yang Ruijun Chen Xiaojun Quan ALM KELM MoMe 87 29 0 15 Aug 2024
Instruct Large Language Models to Generate Scientific Literature Survey Step by Step Yuxuan Lai Yupeng Wu Yidan Wang Wenpeng Hu Chen Zheng 120 3 0 15 Aug 2024
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU Yan Li So-Eon Kim Seong-Bae Park S. Han 96 1 0 15 Aug 2024
ONSEP: A Novel Online Neural-Symbolic Framework for Event Prediction Based on Large Language Model Xuanqing Yu Wangtao Sun Jingwei Li Kang Liu Chengbao Liu Jie Tan OffRL AI4TS 89 4 0 14 Aug 2024
Spoken Stereoset: On Evaluating Social Bias Toward Speaker in Speech Large Language Models Yi-Cheng Lin Wei-Chih Chen Hung-yi Lee 68 5 0 14 Aug 2024
MathScape: Evaluating MLLMs in multimodal Math Scenarios through a Hierarchical Benchmark Minxuan Zhou Hao Liang Tianpeng Li Zhiyu Wu Mingan Lin ... Yujing Qiao Weipeng Chen Bin Cui Wentao Zhang Guosheng Dong 127 5 0 14 Aug 2024
Style-Talker: Finetuning Audio Language Model and Style-Based Text-to-Speech Model for Fast Spoken Dialogue Generation Yinghao Aaron Li Xilin Jiang Jordan Darefsky Ge Zhu N. Mesgarani 92 4 0 13 Aug 2024
MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data Uncertainty Yongjin Yang Haneul Yoo Hwaran Lee 161 4 0 13 Aug 2024
Re-TASK: Revisiting LLM Tasks from Capability, Skill, and Knowledge Perspectives Zhihu Wang Shiwan Zhao Yu Wang Heyuan Huang Sitao Xie Y. Zhang Jiaxin Shi Zhixing Wang H. Li Junchi Yan LRM 124 6 0 13 Aug 2024
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data Haoran Sun Renren Jin Shaoyang Xu Leiyu Pan Supryadi ... Lei Yang Ling Shi Juesi Xiao Shaolin Zhu Deyi Xiong 87 4 0 12 Aug 2024
Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding Yunjia Xi Hangyu Wang Bo Chen Jianghao Lin Menghui Zhu Wen Liu Ruiming Tang Zhewei Wei Weinan Zhang Yong Yu OffRL 158 4 0 11 Aug 2024
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis Weiqing Yang Hanbin Wang Zhenghao Liu Xinze Li Yukun Yan Shuo Wang Yu Gu Minghe Yu Zhiyuan Liu Ge Yu 105 2 0 09 Aug 2024
Enhancing Robustness of Retrieval-Augmented Language Models with In-Context Learning Seong-Il Park Seung-Woo Choi Na-Hyun Kim Jay-Yoon Lee RALM AIFin LRM 80 3 0 08 Aug 2024
Multi-Turn Context Jailbreak Attack on Large Language Models From First Principles Xiongtao Sun Deyue Zhang Dongdong Yang Quanchen Zou Hui Li AAML 71 21 0 08 Aug 2024
BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models Yupeng Chang Yi-Ju Chang Yuan Wu ALM AI4CE 156 0 0 08 Aug 2024
WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language Models Prannaya Gupta Le Qi Yau Hao Han Low I-Shiang Lee Hugo Maximus Lim ... Jia Hng Koh Dar Win Liew Rishabh Bhardwaj Rajat Bhardwaj Soujanya Poria ELM LM&MA 102 6 0 07 Aug 2024
AgentsCoMerge: Large Language Model Empowered Collaborative Decision Making for Ramp Merging Senkang Hu Zhengru Fang Zihan Fang Yiqin Deng Xianhao Chen Yuguang Fang Sam Kwong 162 15 0 07 Aug 2024
Synthesizing Text-to-SQL Data from Weak and Strong LLMs Jiaxi Yang Binyuan Hui Min Yang Jian Yang Junyang Lin Chang Zhou SyDa 99 33 0 06 Aug 2024
Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement Le Yu Bowen Yu Haiyang Yu Fei Huang Yongbin Li MoMe 79 8 0 06 Aug 2024
Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information Yauwai Yim Chunkit Chan Tianyu Shi Zheye Deng Wei Fan Tianshi Zheng Yangqiu Song LLMAG 103 13 0 05 Aug 2024
Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining Dongyang Liu Shitian Zhao Le Zhuo Weifeng Lin Ping Luo Xinyue Li Qi Qin Yu Qiao Hongsheng Li Peng Gao MLLM 164 59 0 05 Aug 2024
Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models Zi Liang Haibo Hu Qingqing Ye Yaxin Xiao Haoyang Li AAML ELM SILM 146 9 0 05 Aug 2024
Self-Introspective Decoding: Alleviating Hallucinations for Large Vision-Language Models Fushuo Huo Wenchao Xu Zhong Zhang Yining Qi Zhicheng Chen Peilin Zhao VLM MLLM 210 31 0 04 Aug 2024
MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models Yunwen Xia Hui Fang Emmanouil Benetos Jie Zhang Chong Long Dmitry Bogdanov AuLLM 101 22 0 02 Aug 2024
Alleviating Hallucination in Large Vision-Language Models with Active Retrieval Augmentation Cephas Mpungu Qiyuan Chen Xiaoye Qu Jiashuo Sun G. Mapp VLM RALM LRM 82 16 0 01 Aug 2024
Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? Richard Ren Steven Basart Adam Khoja Alice Gatti Long Phan ... Alexander Pan Gabriel Mukobi Ryan H. Kim Stephen Fitz Dan Hendrycks ELM 77 25 0 31 Jul 2024
Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agent Shanbo Cheng Zhichao Huang Tom Ko Hang Li Ningxin Peng Lu Xu Qini Zhang 90 6 0 31 Jul 2024
Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation Ziya Zhou Yuhang Wu Zhiyue Wu Xinyue Zhang Ruibin Yuan Yi Ma Lu Wang Emmanouil Benetos Wei Xue Yi-Ting Guo LRM 77 3 0 31 Jul 2024
SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Driving Peiru Zheng Yun Zhao Zhan Gong Hong Zhu Shaohua Wu MLLM 80 8 0 31 Jul 2024
Meltemi: The first open Large Language Model for Greek Leon Voukoutis Dimitris Roussis Georgios Paraskevopoulos Sokratis Sofianopoulos Prokopis Prokopidis Vassilis Papavasileiou Athanasios Katsamanis Stelios Piperidis Vassilis Katsouros VLM 77 9 0 30 Jul 2024
CollectiveSFT: Scaling Large Language Models for Chinese Medical Benchmark with Collective Instructions in Healthcare Jingwei Zhu Minghuan Tan Min Yang Ruixue Li Hamid Alinejad-Rokny ALM LM&MA 78 0 0 29 Jul 2024
Power-LLaVA: Large Language and Vision Assistant for Power Transmission Line Inspection Jiahao Wang Mingxuan Li Haichen Luo Jinguo Zhu A. Yang M. Rong Xiaohua Wang 52 3 0 27 Jul 2024
Multi-label Cluster Discrimination for Visual Representation Learning Xiang An Kaicheng Yang Xiangzi Dai Ziyong Feng Jiankang Deng VLM 96 7 0 24 Jul 2024
Enhancing LLM's Cognition via Structurization Kai-Chun Liu Zhihang Fu Chao Chen Wei Zhang Rongxin Jiang Fan Zhou Yao-Shen Chen Yue-bo Wu Jieping Ye 81 1 0 23 Jul 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models Jiaheng Liu Chenchen Zhang Jinyang Guo Yuanxing Zhang Haoran Que ... Congnan Liu Wenbo Su Jiamang Wang Lin Qu Bo Zheng 102 6 0 23 Jul 2024
OpenHands: An Open Platform for AI Software Developers as Generalist Agents Xingyao Wang Boxuan Li Yufan Song Frank F. Xu Xiangru Tang ... Junyang Lin Robert Brennan Hao Peng Heng Ji Graham Neubig VLM 110 130 0 23 Jul 2024
Structure-aware Domain Knowledge Injection for Large Language Models Kai-Chun Liu Ze Chen Zhihang Fu Rongxin Jiang Fan Zhou Yao-Shen Chen Yue-bo Wu Yue Wu Jieping Ye 81 1 0 23 Jul 2024
Accelerating Pre-training of Multimodal LLMs via Chain-of-Sight Ziyuan Huang Kaixiang Ji Biao Gong Zhiwu Qing Qinglong Zhang Kecheng Zheng Jian Wang Jingdong Chen Ming Yang LRM 70 2 0 22 Jul 2024