Farzi Data: Autoregressive Data Distillation

15 October 2023

Julian McAuley

Papers citing "Farzi Data: Autoregressive Data Distillation"

21 / 21 papers shown

Title
Data Distillation: A Survey Noveen Sachdeva Julian McAuley DD 79 74 0 11 Jan 2023
Beyond neural scaling laws: beating power law scaling via data pruning Ben Sorscher Robert Geirhos Shashank Shekhar Surya Ganguli Ari S. Morcos 71 436 0 29 Jun 2022
Condensing Graphs via One-Step Gradient Matching Wei Jin Xianfeng Tang Haoming Jiang Zheng Li Danqing Zhang Jiliang Tang Bin Ying DD 67 108 0 15 Jun 2022
Dataset Distillation by Matching Training Trajectories George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu FedML DD 168 381 0 22 Mar 2022
On Sampling Collaborative Filtering Datasets Noveen Sachdeva Carole-Jean Wu Julian McAuley 54 16 0 13 Jan 2022
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts Nan Du Yanping Huang Andrew M. Dai Simon Tong Dmitry Lepikhin ... Kun Zhang Quoc V. Le Yonghui Wu Zhiwen Chen Claire Cui ALM MoE 163 794 0 13 Dec 2021
Improving language models by retrieving from trillions of tokens Sebastian Borgeaud A. Mensch Jordan Hoffmann Trevor Cai Eliza Rutherford ... Simon Osindero Karen Simonyan Jack W. Rae Erich Elsen Laurent Sifre KELM RALM 180 1,069 0 08 Dec 2021
ECLARE: Extreme Classification with Label Graph Correlations Anshul Mittal Noveen Sachdeva Sheshansh Agrawal Sumeet Agarwal Purushottam Kar Manik Varma 48 65 0 31 Jul 2021
Deep Learning on a Data Diet: Finding Important Examples Early in Training Mansheej Paul Surya Ganguli Gintare Karolina Dziugaite 100 446 0 15 Jul 2021
Semi-supervised Batch Active Learning via Bilevel Optimization Zalan Borsos Marco Tagliasacchi Andreas Krause 122 23 0 19 Oct 2020
Efficient computation and analysis of distributional Shapley values Yongchan Kwon Manuel A. Rivas James Zou FAtt TDI 96 61 0 02 Jul 2020
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope Soheil Feizi TDI 88 226 0 25 Jun 2020
Coresets via Bilevel Optimization for Continual Learning and Streaming Zalan Borsos Mojmír Mutný Andreas Krause CLL 66 231 0 06 Jun 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 316 1,950 0 11 Apr 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 478 4,662 0 23 Jan 2020
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 79 2,851 0 10 Dec 2019
Optimizing Millions of Hyperparameters by Implicit Differentiation Jonathan Lorraine Paul Vicol David Duvenaud DD 104 409 0 06 Nov 2019
Accelerating Deep Learning by Focusing on the Biggest Losers Angela H. Jiang Daniel L.-K. Wong Giulio Zhou D. Andersen J. Dean ... Gauri Joshi M. Kaminsky M. Kozuch Zachary Chase Lipton Padmanabhan Pillai 54 120 0 02 Oct 2019
An Empirical Study of Example Forgetting during Deep Neural Network Learning Mariya Toneva Alessandro Sordoni Rémi Tachet des Combes Adam Trischler Yoshua Bengio Geoffrey J. Gordon 107 723 0 12 Dec 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 781 11,793 0 09 Mar 2017
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 219 18,534 0 06 Feb 2015