Qwen Technical Report

28 September 2023

Jinze Bai

Shuai Bai

Yunfei Chu

Zeyu Cui

Kai Dang

Xiaodong Deng

Yang Fan

Wenbin Ge

Yu Han

Fei Huang

Binyuan Hui

Luo Ji

Mei Li

Junyang Lin

Runji Lin

Dayiheng Liu

Gao Liu

Chengqiang Lu

Keming Lu

Jianxin Ma

Rui Men

Xingzhang Ren

Xuancheng Ren

Chuanqi Tan

Sinan Tan

Jianhong Tu

Peng Wang

Shijie Wang

Wei Wang

Shengguang Wu

Benfeng Xu

Jin Xu

An Yang

Hao Yang

Jian Yang

Shusheng Yang

Yang Yao

Bowen Yu

Hongyi Yuan

Zheng Yuan

Jianwei Zhang

Xinyu Zhang

Yichang Zhang

Zhenru Zhang

Chang Zhou

Jingren Zhou

Xiaohuan Zhou

Tianhang Zhu

OSLM

ArXiv (abs)PDF HTML

Papers citing "Qwen Technical Report"

50 / 1,345 papers shown

Title
Hierarchical Masked Autoregressive Models with Low-Resolution Token Pivots Guangting Zheng Yehao Li Yingwei Pan Jiajun Deng Ting Yao Yanyong Zhang Tao Mei DiffM 36 0 0 26 May 2025
Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models Zihong Zhang Liqi He Zuchao Li Lefei Zhang Hai Zhao Bo Du 15 0 0 26 May 2025
FunReason: Enhancing Large Language Models' Function Calling via Self-Refinement Multiscale Loss and Automated Data Refinement Bingguang Hao Maolin Wang Zengzhuang Xu Cunyin Peng Yicheng Chen Xiangyu Zhao Jinjie Gu Chenyi Zhuang ReLM LRM 104 0 0 26 May 2025
BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models Liulu He Shenli Zhen Karwei Sun Yijiang Liu Yufei Zhao Chongkang Tan Huanrui Yang Yuan Du Li Du MQ 17 0 0 26 May 2025
Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospects Yixin Cui Haotian Lin Shuo Yang Yixiao Wang Yanjun Huang Hong Chen LM&Ro LRM ELM 121 0 0 26 May 2025
DGRAG: Distributed Graph-based Retrieval-Augmented Generation in Edge-Cloud Systems Wenqing Zhou Yuxuan Yan Qianqian Yang 21 0 0 26 May 2025
SCIRGC: Multi-Granularity Citation Recommendation and Citation Sentence Preference Alignment Xiangyu Li Jingqiang Chen 3DV 42 0 0 26 May 2025
Dynamic-I2V: Exploring Image-to-Video Generation Models via Multimodal LLM Peng Liu Xiaoming Ren Fengkai Liu Qingsong Xie Quanlong Zheng Yanhao Zhang Haonan Lu Yujiu Yang EGVM VGen 62 0 0 26 May 2025
What You Perceive Is What You Conceive: A Cognition-Inspired Framework for Open Vocabulary Image Segmentation Jianghang Lin Yue Hu Jiangtao Shen Yunhang Shen Liujuan Cao Shengchuan Zhang Chia-Wen Lin ObjD VLM 206 0 0 26 May 2025
BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMs Guilong Lu Xuntao Guo Rongjunchen Zhang Wenqiao Zhu Ji Liu ELM 49 0 0 26 May 2025
DoctorRAG: Medical RAG Fusing Knowledge with Patient Analogy through Textual Gradients Yuxing Lu Gecheng Fu Wei Wu Xukai Zhao Sin Yee Goi Jinzhuo Wang 123 0 0 26 May 2025
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation Weikang Yuan Kaisong Song Zhuoren Jiang Junjie Cao Y. Zhang Jun Lin Kun Kuang Ji Zhang Xiaozhong Liu AILaw ELM 18 0 0 26 May 2025
Enhancing Visual Reliance in Text Generation: A Bayesian Perspective on Mitigating Hallucination in Large Vision-Language Models Nanxing Hu Xiaoyue Duan Jinchao Zhang Guoliang Kang MLLM 61 0 0 26 May 2025
ResSVD: Residual Compensated SVD for Large Language Model Compression Haolei Bai Siyong Jian Tuo Liang Yu Yin Huan Wang 46 0 0 26 May 2025
MSD-LLM: Predicting Ship Detention in Port State Control Inspections with Large Language Model Jiongchao Jin Xiuju Fu Xiaowei Gao Tao Cheng Ran Yan AI4CE 191 0 0 26 May 2025
Towards Reliable Large Audio Language Model Ziyang Ma Xiquan Li Yakun Song Wenxi Chen Chenpeng Du ... Y. Chen Zhuo Chen Yuping Wang Yuxuan Wang Xie Chen AuLLM 66 0 0 25 May 2025
Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models Ke-Han Lu Chun-Yi Kuan Hung-yi Lee AuLLM ELM 57 3 0 25 May 2025
Delving into Multilingual Ethical Bias: The MSQAD with Statistical Hypothesis Tests for Large Language Models Seunguk Yu Juhwan Choi Youngbin Kim 30 0 0 25 May 2025
Strong Membership Inference Attacks on Massive Datasets and (Moderately) Large Language Models Jamie Hayes Ilia Shumailov Christopher A. Choquette-Choo Matthew Jagielski G. Kaissis ... Matthieu Meeus Yves-Alexandre de Montjoye Franziska Boenisch Adam Dziedzic A. Feder Cooper 58 1 0 24 May 2025
Flex-Judge: Think Once, Judge Anywhere Jongwoo Ko S. Kim Sungwoo Cho Se-Young Yun ELM LRM 216 0 0 24 May 2025
ToDRE: Visual Token Pruning via Diversity and Task Awareness for Efficient Large Vision-Language Models Duo Li Zuhao Yang Shijian Lu VLM 96 0 0 24 May 2025
Decoupled Visual Interpretation and Linguistic Reasoning for Math Problem Solving Zixian Guo Ming-Yu Liu Zhilong Ji Jinfeng Bai Lei Zhang W. Zuo LRM VLM 94 0 0 23 May 2025
SLearnLLM: A Self-Learning Framework for Efficient Domain-Specific Adaptation of Large Language Models Xiang Liu Zhaoxiang Liu Peng Wang Kohou Wang Huan Hu Kai Wang Shiguo Lian 201 0 0 23 May 2025
The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contexts Yuchen Zhang Yaxiong Wang Yujiao Wu Lianwei Wu Li Zhu AAML 105 0 0 23 May 2025
AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasoners Woosung Koh Wonbeen Oh Jaein Jang MinHyung Lee Hyeongjin Kim Ah Yeon Kim Joonkee Kim Junghyun Lee Taehyeon Kim Se-Young Yun LRM TTA 117 0 0 22 May 2025
MixAT: Combining Continuous and Discrete Adversarial Training for LLMs Csaba Dékány Stefan Balauca Robin Staab Dimitar I. Dimitrov Martin Vechev AAML 50 0 0 22 May 2025
Selective Invocation for Multilingual ASR: A Cost-effective Approach Adapting to Speech Recognition Difficulty Hongfei Xue Yufeng Tang Jun Zhang Xuelong Geng Lei Xie 55 0 0 22 May 2025
Dynamic Sampling that Adapts: Iterative DPO for Self-Aware Mathematical Reasoning Jun Rao Xuebo Liu Hexuan Deng Zepeng Lin Zixiong Yu Jiansheng Wei Xiaojun Meng Min Zhang LRM 213 0 0 22 May 2025
Understanding Differential Transformer Unchains Pretrained Self-Attentions Chaerin Kong Jiho Jang Nojun Kwak 82 0 0 22 May 2025
Training-Free Reasoning and Reflection in MLLMs Hongchen Wei Zhenzhong Chen OffRL VLM LRM 111 0 0 22 May 2025
Mitigating Fine-tuning Risks in LLMs via Safety-Aware Probing Optimization Chengcan Wu Zhixin Zhang Zeming Wei Yihao Zhang Meng Sun AAML 59 1 0 22 May 2025
R1-ShareVL: Incentivizing Reasoning Capability of Multimodal Large Language Models via Share-GRPO Huanjin Yao Qixiang Yin Jingyi Zhang Min Yang Yibo Wang ... Fei Su Li Shen Minghui Qiu Dacheng Tao Jiaxing Huang LRM 72 0 0 22 May 2025
Cog-TiPRO: Iterative Prompt Refinement with LLMs to Detect Cognitive Decline via Longitudinal Voice Assistant Commands Kristin Qi Youxiang Zhu Caroline Summerour J. Batsis Xiaohui Liang 15 0 0 22 May 2025
RBench-V: A Primary Assessment for Visual Reasoning Models with Multi-modal Outputs Meng-Hao Guo Xuanyu Chu Qianrui Yang Zhe-Han Mo Yiqing Shen ... Kiyohiro Nakayama Zhengyang Geng Houwen Peng Han Hu Shi-Min Hu LRM 197 0 0 22 May 2025
KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance Qihuang Zhong Liang Ding Xiantao Cai Juhua Liu Bo Du Dacheng Tao 98 0 0 21 May 2025
Multilingual Test-Time Scaling via Initial Thought Transfer Prasoon Bajpai Tanmoy Chakraborty LRM 64 0 0 21 May 2025
OViP: Online Vision-Language Preference Learning Shujun Liu Siyuan Wang Zejun Li Jianxiang Wang Cheng Zeng Zhongyu Wei MLLM VLM 76 0 0 21 May 2025
Learning to Rank Chain-of-Thought: An Energy-Based Approach with Outcome Supervision Eric Hanchen Jiang Haozheng Luo Shengyuan Pang Xiaomin Li Zhenting Qi ... Zongyu Lin Xinfeng Li Hao Xu Kai-Wei Chang Ying Nian Wu LRM 120 0 0 21 May 2025
From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning Chen Shani Dan Jurafsky Yann LeCun Ravid Shwartz-Ziv 204 0 0 21 May 2025
R-TOFU: Unlearning in Large Reasoning Models Sangyeon Yoon Wonje Jeung Albert No MU LRM 224 1 0 21 May 2025
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval Taiye Chen Zeming Wei Ang Li Yisen Wang AAML 61 2 0 21 May 2025
Meta-Learning an In-Context Transformer Model of Human Higher Visual Cortex Muquan Yu Mu Nan Hossein Adeli Jacob S. Prince John A. Pyles Leila Wehbe Margaret M. Henderson Michael J. Tarr Andrew F. Luo MedIm ViT 88 0 0 21 May 2025
MMaDA: Multimodal Large Diffusion Language Models Ling Yang Ye Tian Bowen Li Xinchen Zhang Ke Shen Yunhai Tong Mengdi Wang VLM LRM 141 6 0 21 May 2025
Tokenization Constraints in LLMs: A Study of Symbolic and Arithmetic Reasoning Limits Xiang Zhang Juntai Cao Jiaqi Wei Yiwei Xu Chenyu You LRM 58 2 0 20 May 2025
Scale-invariant Attention Ben Anson Xi Wang Laurence Aitchison LRM 97 0 0 20 May 2025
SEPS: A Separability Measure for Robust Unlearning in LLMs Wonje Jeung Sangyeon Yoon Albert No MU VLM 228 1 0 20 May 2025
FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoning Zhuozhao Hu Kaishen Yuan Xin Liu Zitong Yu Yuan Zong Jingang Shi Huanjing Yue Jingyu Yang 45 0 0 19 May 2025
Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review Muhammad Monjurul Karim Yan Shi Shucheng Zhang Bingzhang Wang Mehrdad Nasri Yinhai Wang 26 0 0 19 May 2025
An Empirical Study of Many-to-Many Summarization with Large Language Models Jiaan Wang Fandong Meng Zengkui Sun Yunlong Liang Yuxuan Cao Jiarong Xu Haoxiang Shi Jie Zhou 47 0 0 19 May 2025
R1dacted: Investigating Local Censorship in DeepSeek's R1 Language Model Ali Naseh Harsh Chaudhari Jaechul Roh Mingshi Wu Alina Oprea Amir Houmansadr AAML ELM 123 2 0 19 May 2025