Scaling Language Models: Methods, Analysis & Insights from Training
Gopher

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

8 December 2021

Sebastian Borgeaud

Jordan Hoffmann

Sarah Henderson

Eliza Rutherford

George van den Driessche

Lisa Anne Hendricks

Sumanth Dathathri

Saffron Huang

John F. J. Mellor

Antonia Creswell

Siddhant M. Jayakumar

Elena Buchatskaya

David Budden

Esme Sutherland

Michela Paganini

Xiang Lorraine Li

Aida Nematzadeh

Angeliki Lazaridou

Jean-Baptiste Lespiau

Maria Tsimpoukelli

Thibault Sottiaux

Mantas Pajarskas

Daniel Toyama

Cyprien de Masson dÁutume

Vladimir Mikulik

Igor Babuschkin

Diego de Las Casas

Matthew J. Johnson

Blake A. Hechtman

Laura Weidinger

Iason Gabriel

William S. Isaac

Edward Lockhart

Kareem W. Ayoub

Koray Kavukcuoglu

Papers citing "Scaling Language Models: Methods, Analysis & Insights from Training Gopher"

4 / 54 papers shown

Title
FLM-101B: An Open LLM and How to Train It with $100K Budget$ Xiang Li Yiqun Yao Xin Jiang Xuezhi Fang Xuying Meng ... Li Du Bowen Qin Zheng Zhang Aixin Sun Yequan Wang 75 22 0 07 Sep 2023
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct Haipeng Luo Qingfeng Sun Can Xu Pu Zhao Jian-Guang Lou ... Xiubo Geng Qingwei Lin Shifeng Chen Yansong Tang Dongmei Zhang LRM OSLM 139 439 0 18 Aug 2023
WizardCoder: Empowering Code Large Language Models with Evol-Instruct Ziyang Luo Can Xu Pu Zhao Qingfeng Sun Xiubo Geng Wenxiang Hu Chongyang Tao Jing Ma Qingwei Lin Daxin Jiang ELM SyDa ALM 68 665 0 14 Jun 2023
On the Creativity of Large Language Models Giorgio Franceschelli Mirco Musolesi 128 55 0 27 Mar 2023