Blessing of Class Diversity in Pre-training

7 September 2022

Papers citing "Blessing of Class Diversity in Pre-training"

7 / 7 papers shown

Title
Task Diversity Shortens the ICL Plateau Jaeyeon Kim Sehyun Kwon Joo Young Choi Jongho Park Jaewoong Cho Jason D. Lee Ernest K. Ryu MoMe 31 2 0 07 Oct 2024
Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective Yue Xing Xiaofeng Lin Qifan Song Yi Tian Xu Belinda Zeng Guang Cheng SSL 26 0 0 26 Jan 2024
On the Trade-off of Intra-/Inter-class Diversity for Supervised Pre-training Jieyu Zhang Bohan Wang Zhengyu Hu Pang Wei Koh Alexander Ratner 25 10 0 20 May 2023
Downstream Datasets Make Surprisingly Good Pretraining Corpora Kundan Krishna Saurabh Garg Jeffrey P. Bigham Zachary Chase Lipton 48 30 0 28 Sep 2022
Active Multi-Task Representation Learning Yifang Chen S. Du Kevin G. Jamieson 43 12 0 02 Feb 2022
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 58 22 0 16 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018