Pretraining Text Encoders with Adversarial Mixture of Training Signal
Generators

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

7 April 2022

Paul N. Bennett

Xia Song

Papers citing "Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators"

7 / 7 papers shown

Title
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 34 2 0 01 Dec 2022
Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek F. Abdelzaher Jiawei Han VLM 56 47 0 06 Nov 2022
METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals Payal Bajaj Chenyan Xiong Guolin Ke Xiaodong Liu Di He Saurabh Tiwary Tie-Yan Liu Paul N. Bennett Xia Song Jianfeng Gao 50 32 0 13 Apr 2022
Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations Yu Meng Yunyi Zhang Jiaxin Huang Yu Zhang Jiawei Han 56 56 0 09 Feb 2022
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 125 203 0 16 Feb 2021
Language GANs Falling Short Massimo Caccia Lucas Caccia W. Fedus Hugo Larochelle Joelle Pineau Laurent Charlin 127 215 0 06 Nov 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018