D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models
Papers citing "D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models"
22 / 22 papers shown
Title |
|---|
 Dolma: an Open Corpus of Three Trillion Tokens for Language Model
Pretraining Research Luca Soldaini Rodney Michael Kinney Akshita Bhagia Dustin Schwenk David Atkinson ...Hanna Hajishirzi Iz Beltagy Dirk Groeneveld Jesse Dodge Kyle Lo |
 Qwen Technical Report Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang ...Zhenru Zhang Chang Zhou Jingren Zhou Xiaohuan Zhou Tianhang Zhu |
