Curriculum Learning with Adam: The Devil Is in the Wrong Details

Curriculum Learning with Adam: The Devil Is in the Wrong Details

23 August 2023

ArXiv (abs)PDF HTML

Papers citing "Curriculum Learning with Adam: The Devil Is in the Wrong Details"

12 / 12 papers shown

Title
Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation JoonHo Lee Jae Oh Woo Juree Seok Parisa Hassanzadeh Wooseok Jang ... Hankyu Moon Wenjun Hu Yeong-Dae Kwon Taehee Lee Seungjai Min 133 2 0 10 May 2024
Curriculum learning for language modeling Daniel Fernando Campos 54 33 0 04 Aug 2021
Curriculum Learning: A Survey Petru Soviany Radu Tudor Ionescu Paolo Rota N. Sebe ODL 169 360 0 25 Jan 2021
Teaching with Commentaries Aniruddh Raghu M. Raghu Simon Kornblith David Duvenaud Geoffrey E. Hinton 90 24 0 05 Nov 2020
Curriculum Learning Strategies for IR: An Empirical Study on Conversation Response Ranking Gustavo Penha C. Hauff 71 24 0 18 Dec 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 700 24,572 0 26 Jul 2019
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives Yi Tay Shuohang Wang Anh Tuan Luu Jie Fu Minh C. Phan Xingdi Yuan J. Rao S. Hui Aston Zhang 93 110 0 26 May 2019
On The Power of Curriculum Learning in Training Deep Networks Guy Hacohen D. Weinshall ODL 82 451 0 07 Apr 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 132 3,159 0 01 Apr 2019
Competence-based Curriculum Learning for Neural Machine Translation Emmanouil Antonios Platanios Otilia Stretcu Graham Neubig Barnabás Póczós Tom Michael Mitchell 91 344 0 23 Mar 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,201 0 20 Apr 2018
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels Lu Jiang Zhengyuan Zhou Thomas Leung Li Li Li Fei-Fei NoLa 133 1,459 0 14 Dec 2017

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.