v1v2v3 (latest)

Optimizing Data Usage via Differentiable Rewards

22 November 2019

Xinyi Wang

Hieu H. Pham

Paul Michel

Antonios Anastasopoulos

J. Carbonell

Graham Neubig

ArXiv (abs)PDF HTML

Papers citing "Optimizing Data Usage via Differentiable Rewards"

40 / 40 papers shown

Title
DataRater: Meta-Learned Dataset Curation Dan A. Calian Gregory Farquhar Iurii Kemaev Luisa M. Zintgraf Matteo Hessel ... András Gyorgy Tom Schaul Jeffrey Dean Hado van Hasselt David Silver 146 1 0 23 May 2025
Upsample or Upweight? Balanced Training on Heavily Imbalanced Datasets Tianjian Li Haoran Xu Weiting Tan Kenton Murray Daniel Khashabi 82 1 0 06 Oct 2024
Dynamically Composing Domain-Data Selection with Clean-Data Selection by "Co-Curricular Learning" for Neural Machine Translation Wei Wang Isaac Caswell Ciprian Chelba 71 59 0 03 Jun 2019
Revisiting Low-Resource Neural Machine Translation: A Case Study Rico Sennrich Biao Zhang 61 223 0 28 May 2019
Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation Xinyi Wang Graham Neubig 57 26 0 20 May 2019
Competence-based Curriculum Learning for Neural Machine Translation Emmanouil Antonios Platanios Otilia Stretcu Graham Neubig Barnabás Póczós Tom Michael Mitchell 86 343 0 23 Mar 2019
Reinforcement Learning based Curriculum Optimization for Neural Machine Translation Manish Kumar George F. Foster Colin Cherry M. Krikun 64 73 0 28 Feb 2019
Multilingual Neural Machine Translation With Soft Decoupled Encoding Xinyi Wang Hieu H. Pham Philip Arthur Graham Neubig 58 61 0 09 Feb 2019
Self-Supervised Generalisation with Meta Auxiliary Learning Shikun Liu Andrew J. Davison Edward Johns SSL OOD 50 163 0 25 Jan 2019
Adapting Auxiliary Losses Using Gradient Similarity Yunshu Du Wojciech M. Czarnecki Siddhant M. Jayakumar Mehrdad Farajtabar Razvan Pascanu Balaji Lakshminarayanan 78 158 0 05 Dec 2018
Domain Adaptive Transfer Learning with Specialist Models Jiquan Ngiam Daiyi Peng Vijay Vasudevan Simon Kornblith Quoc V. Le Ruoming Pang 61 108 0 16 Nov 2018
An Empirical Exploration of Curriculum Learning for Neural Machine Translation Xuan Zhang Manish Kumar Huda Khayrallah Kenton W. Murray Jeremy Gwinnup Marianna J. Martindale Paul McNamee Kevin Duh Marine Carpuat ODL 71 111 0 02 Nov 2018
Rapid Adaptation of Neural Machine Translation to New Languages Graham Neubig Junjie Hu AI4CE 66 209 0 13 Aug 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 199 4,355 0 24 Jun 2018
Do Better ImageNet Models Transfer Better? Simon Kornblith Jonathon Shlens Quoc V. Le OOD MLT 158 1,327 0 23 May 2018
When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation? Ye Qi Devendra Singh Sachan Matthieu Felix Sarguna Padmanabhan Graham Neubig 97 343 0 17 Apr 2018
Reinforced Co-Training Jiawei Wu Lei Li William Yang Wang OffRL 75 51 0 17 Apr 2018
Identifying Semantic Divergences in Parallel Text without Annotations Yogarshi Vyas Xing Niu Marine Carpuat 65 36 0 29 Mar 2018
Learning to Reweight Examples for Robust Deep Learning Mengye Ren Wenyuan Zeng Binh Yang R. Urtasun OOD NoLa 146 1,426 0 24 Mar 2018
Detecting and Correcting for Label Shift with Black Box Predictors Zachary Chase Lipton Yu Wang Alex Smola OOD 66 554 0 12 Feb 2018
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels Lu Jiang Zhengyuan Zhou Thomas Leung Li Li Li Fei-Fei NoLa 98 1,453 0 14 Dec 2017
Learning how to Active Learn: A Deep Reinforcement Learning Approach Meng Fang Yuan Li Trevor Cohn 52 285 0 08 Aug 2017
Dynamic Data Selection for Neural Machine Translation M. V. D. Wees Arianna Bisazza Christof Monz 93 154 0 02 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Automated Curriculum Learning for Neural Networks Alex Graves Marc G. Bellemare Jacob Menick Rémi Munos Koray Kavukcuoglu 77 525 0 10 Apr 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 77 247 0 14 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,909 0 09 Mar 2017
Learning What Data to Learn Yang Fan Fei Tian Tao Qin Jiang Bian Tie-Yan Liu 68 79 0 28 Feb 2017
Boosting Neural Machine Translation Dakun Zhang Jungi Kim Josep Crego Jean Senellart AI4CE 50 26 0 19 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 517 10,330 0 16 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 339 4,629 0 10 Nov 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 333 8,130 0 13 Aug 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 340 7,985 0 23 May 2016
Learning the Curriculum with Bayesian Optimization for Task-Specific Word Representation Learning Yulia Tsvetkov Manaal Faruqui Wang Ling B. MacWhinney Chris Dyer 80 89 0 12 May 2016
Transfer Learning for Low-Resource Neural Machine Translation Barret Zoph Deniz Yuret Jonathan May Kevin Knight 76 857 0 08 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.9K 150,115 0 22 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,547 0 01 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 558 27,311 0 01 Sep 2014