v1v2 (latest)

Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation

13 July 2022

Jinyi Hu

Xiaoyuan Yi

Wenhao Li

Maosong Sun

Xing Xie

ArXiv (abs)PDF HTML

Papers citing "Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation"

41 / 41 papers shown

Title
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 121 362 0 02 Feb 2021
Transformer-based Conditional Variational Autoencoder for Controllable Story Generation Le Fang Tao Zeng Chao-Ning Liu Liefeng Bo Wen Dong Changyou Chen DRL 90 61 0 04 Jan 2021
Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images R. Child BDL VLM 186 352 0 20 Nov 2020
NVAE: A Deep Hierarchical Variational Autoencoder Arash Vahdat Jan Kautz BDL 77 915 0 08 Jul 2020
On the Relation between Quality-Diversity Evaluation and Distribution-Fitting Goal in Text Generation Jianing Li Yanyan Lan Jiafeng Guo Xueqi Cheng 25 4 0 03 Jul 2020
A Batch Normalized Inference Network Keeps the KL Vanishing Away Qile Zhu Jianlin Su Wei Bi Xiaojiang Liu Xiyao Ma Xiaolin Li D. Wu BDL DRL 68 62 0 27 Apr 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space Chunyuan Li Xiang Gao Yuan Li Baolin Peng Xiujun Li Yizhe Zhang Jianfeng Gao SSL DRL 84 182 0 05 Apr 2020
Variational Transformers for Diverse Response Generation Zhaojiang Lin Genta Indra Winata Peng Xu Zihan Liu Pascale Fung DRL 60 51 0 28 Mar 2020
MixPoet: Diverse Poetry Generation via Learning Controllable Mixed Latent Space Xiaoyuan Yi Ruoyu Li Cheng Yang Wenhao Li Maosong Sun 34 35 0 13 Mar 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 513 10,591 0 17 Feb 2020
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 264 10,851 0 29 Oct 2019
A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text Bohan Li Junxian He Graham Neubig Taylor Berg-Kirkpatrick Yiming Yang DRL 40 71 0 02 Sep 2019
Variational Pretraining for Semi-supervised Text Classification Suchin Gururangan T. Dang Dallas Card Noah A. Smith VLM 50 112 0 05 Jun 2019
Learning Hierarchical Priors in VAEs Alexej Klushyn Nutan Chen Richard Kurle Botond Cseke Patrick van der Smagt BDL CML DRL 48 100 0 13 May 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 352 5,860 0 21 Apr 2019
Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing Hao Fu Chunyuan Li Xiaodong Liu Jianfeng Gao Asli Celikyilmaz Lawrence Carin ODL 78 367 0 25 Mar 2019
Lagging Inference Networks and Posterior Collapse in Variational Autoencoders Junxian He Daniel M. Spokoyny Graham Neubig Taylor Berg-Kirkpatrick BDL DRL 92 273 0 16 Jan 2019
Preventing Posterior Collapse with delta-VAEs Ali Razavi Aaron van den Oord Ben Poole Oriol Vinyals DRL 92 171 0 10 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Disentangled Representation Learning for Non-Parallel Text Style Transfer V. John Lili Mou Hareesh Bahuleyan Olga Vechtomova DRL 75 302 0 13 Aug 2018
Avoiding Latent Variable Collapse With Generative Skip Models Adji Bousso Dieng Yoon Kim Alexander M. Rush David M. Blei DRL 48 175 0 12 Jul 2018
Efficient Low-rank Multimodal Fusion with Modality-Specific Factors Zhun Liu Ying Shen V. Lakshminarasimhan Paul Pu Liang Amir Zadeh Louis-Philippe Morency 69 648 0 31 May 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 183 1,626 0 13 May 2018
Texygen: A Benchmarking Platform for Text Generation Models Yaoming Zhu Sidi Lu Lei Zheng Jiaxian Guo Weinan Zhang Jun Wang Yong Yu 107 692 0 06 Feb 2018
Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space Liwei Wang Alex Schwing Svetlana Lazebnik CoGe 100 175 0 19 Nov 2017
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 230 5,071 0 02 Nov 2017
A Deep Generative Framework for Paraphrase Generation Ankush Gupta Arvind Agarwal Prawaan Singh Piyush Rai 63 256 0 15 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Get To The Point: Summarization with Pointer-Generator Networks A. See Peter J. Liu Christopher D. Manning 3DPC 311 4,026 0 14 Apr 2017
Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders Tiancheng Zhao Ran Zhao M. Eskénazi 55 756 0 31 Mar 2017
Toward Controlled Generation of Text Zhiting Hu Zichao Yang Xiaodan Liang Ruslan Salakhutdinov Eric Xing 170 990 0 02 Mar 2017
Improved Variational Autoencoders for Text Modeling using Dilated Convolutions Zichao Yang Zhiting Hu Ruslan Salakhutdinov Taylor Berg-Kirkpatrick 101 389 0 27 Feb 2017
A Hybrid Convolutional Variational Autoencoder for Text Generation Stanislau Semeniuta Aliaksei Severyn Erhardt Barth 83 252 0 08 Feb 2017
Deep Variational Information Bottleneck Alexander A. Alemi Ian S. Fischer Joshua V. Dillon Kevin Patrick Murphy 128 1,728 0 01 Dec 2016
Improving Variational Inference with Inverse Autoregressive Flow Diederik P. Kingma Tim Salimans Rafal Jozefowicz Xi Chen Ilya Sutskever Max Welling BDL DRL 150 1,825 0 15 Jun 2016
A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues Iulian Serban Alessandro Sordoni Ryan J. Lowe Laurent Charlin Joelle Pineau Aaron Courville Yoshua Bengio BDL 159 1,107 0 19 May 2016
Ladder Variational Autoencoders C. Sønderby T. Raiko Lars Maaløe Søren Kaae Sønderby Ole Winther BDL DRL 99 915 0 06 Feb 2016
Generating Sentences from a Continuous Space Samuel R. Bowman Luke Vilnis Oriol Vinyals Andrew M. Dai Rafal Jozefowicz Samy Bengio DRL 113 2,364 0 19 Nov 2015
A Diversity-Promoting Objective Function for Neural Conversation Models Jiwei Li Michel Galley Chris Brockett Jianfeng Gao W. Dolan 149 2,402 0 11 Oct 2015
Importance Weighted Autoencoders Yuri Burda Roger C. Grosse Ruslan Salakhutdinov BDL 280 1,246 0 01 Sep 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 326 4,294 0 21 Aug 2015