Lagging Inference Networks and Posterior Collapse in Variational Autoencoders

16 January 2019

Junxian He

Daniel M. Spokoyny

Graham Neubig

Taylor Berg-Kirkpatrick

BDL

DRL

ArXiv PDF HTML

Papers citing "Lagging Inference Networks and Posterior Collapse in Variational Autoencoders"

50 / 54 papers shown

Title
Generative Models for Long Time Series: Approximately Equivariant Recurrent Network Structures for an Adjusted Training Scheme Ruwen Fulek Markus Lange-Hegermann AI4TS 45 0 0 08 May 2025
Embodied Active Learning of Generative Sensor-Object Models Allison Pinosky Todd D. Murphey LM&Ro 34 1 0 14 Oct 2024
Hitchhiker's guide on the relation of Energy-Based Models with other generative models, sampling and statistical physics: a comprehensive review Davide Carbone 38 1 0 19 Jun 2024
Towards Model-Agnostic Posterior Approximation for Fast and Accurate Variational Autoencoders Yaniv Yacoby Weiwei Pan Finale Doshi-Velez DRL 29 0 0 13 Mar 2024
Latent Feature-Guided Diffusion Models for Shadow Removal Kangfu Mei Luis Figueroa Zhe-nan Lin Zhihong Ding Scott D. Cohen Vishal M. Patel DiffM 26 18 0 04 Dec 2023
Boosting Summarization with Normalizing Flows and Aggressive Training Yu Yang Xiaotong Shen AI4CE TPM 24 0 0 01 Nov 2023
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling Jingcheng Deng Liang Pang Huawei Shen Xueqi Cheng RALM 26 10 0 16 Oct 2023
Language Models As Semantic Indexers Bowen Jin Hansi Zeng Guoyin Wang Xiusi Chen Tianxin Wei ... Yang Li Hanqing Lu Suhang Wang Jiawei Han Xianfeng Tang RALM 40 18 0 11 Oct 2023
Unsupervised Denoising for Signal-Dependent and Row-Correlated Imaging Noise Benjamin Salmon Alexander Krull 53 1 0 11 Oct 2023
How good are variational autoencoders at transfer learning? Lisa Bonheme M. Grzes OOD DRL 23 2 0 21 Apr 2023
Discouraging posterior collapse in hierarchical Variational Autoencoders using context Anna Kuzina Jakub M. Tomczak BDL DRL 23 1 0 20 Feb 2023
Masked Vector Quantization David D. Nguyen David Leibowitz Surya Nepal S. Kanhere MQ 21 0 0 16 Jan 2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes Siyuan Huang Zan Wang Puhao Li Baoxiong Jia Tengyu Liu Yixin Zhu Wei Liang Song-Chun Zhu DiffM 64 201 0 15 Jan 2023
Versatile Diffusion: Text, Images and Variations All in One Diffusion Model Xingqian Xu Zhangyang Wang Eric Zhang Kai Wang Humphrey Shi DiffM 41 183 0 15 Nov 2022
Recurrence Boosts Diversity! Revisiting Recurrent Latent Variable in Transformer-Based Variational AutoEncoder for Diverse Text Generation Jinyi Hu Xiaoyuan Yi Wenhao Li Maosong Sun Xingxu Xie DRL 27 0 0 22 Oct 2022
Learning to Drop Out: An Adversarial Approach to Training Sequence VAEs Ðorðe Miladinovic Kumar Shridhar Kushal Kumar Jain Max B. Paulus J. M. Buhmann Mrinmaya Sachan Carl Allen DRL 23 5 0 26 Sep 2022
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation Jinyi Hu Xiaoyuan Yi Wenhao Li Maosong Sun Xing Xie 36 21 0 13 Jul 2022
Identifiability of deep generative models without auxiliary information Bohdan Kivva Goutham Rajendran Pradeep Ravikumar Bryon Aragam DRL 26 49 0 20 Jun 2022
How do Variational Autoencoders Learn? Insights from Representational Similarity Lisa Bonheme M. Grzes CoGe SSL DRL 32 10 0 17 May 2022
Conditional $β$ -VAE for De Novo Molecular Generation Ryan J. Richards A. Groener BDL DRL 24 10 0 01 May 2022
Language modeling via stochastic processes Rose E. Wang Esin Durmus Noah D. Goodman Tatsunori Hashimoto BDL AI4TS 40 24 0 21 Mar 2022
Variational Autoencoders Without the Variation Gregory A. Daly J. Fieldsend G. Tabor 31 2 0 01 Mar 2022
Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction Jing Zhang Jianwen Xie Nick Barnes Ping Li ViT 40 90 0 27 Dec 2021
Variational autoencoders in the presence of low-dimensional data: landscape and implicit bias Frederic Koehler Viraj Mehta Chenghui Zhou Andrej Risteski DRL 36 12 0 13 Dec 2021
Preventing posterior collapse in variational autoencoders for text generation via decoder regularization Alban Petit Caio Corro DRL 21 3 0 28 Oct 2021
Simulated annealing for optimization of graphs and sequences Xianggen Liu Pengyong Li Fandong Meng Hao Zhou Huasong Zhong Jie Zhou Lili Mou Sen Song 49 19 0 01 Oct 2021
Paraphrase Generation as Unsupervised Machine Translation Xiaofei Sun Yufei Tian Yuxian Meng Nanyun Peng Fei Wu Jiwei Li Chun Fan LRM 22 5 0 07 Sep 2021
Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification Bo Pang Ying Nian Wu 24 18 0 26 Aug 2021
Meta-learning Amidst Heterogeneity and Ambiguity Kyeongryeol Go Seyoung Yun 32 1 0 05 Jul 2021
Discrete Auto-regressive Variational Attention Models for Text Modeling Xianghong Fang Haoli Bai Jian Li Zenglin Xu Michael Lyu Irwin King 40 3 0 16 Jun 2021
Generative Text Modeling through Short Run Inference Bo Pang Erik Nijkamp Tian Han Ying Nian Wu SyDa BDL DRL 30 5 0 27 May 2021
CogView: Mastering Text-to-Image Generation via Transformers Ming Ding Zhuoyi Yang Wenyi Hong Wendi Zheng Chang Zhou ... Junyang Lin Xu Zou Zhou Shao Hongxia Yang Jie Tang ViT VLM 24 762 0 26 May 2021
Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models Sam Bond-Taylor Adam Leach Yang Long Chris G. Willcocks VLM TPM 41 481 0 08 Mar 2021
A Critical Look at the Consistency of Causal Estimation With Deep Latent Variable Models Severi Rissanen Pekka Marttinen CML 25 26 0 12 Feb 2021
Neural representation and generation for RNA secondary structures Zichao Yan William L. Hamilton Mathieu Blanchette 40 2 0 01 Feb 2021
Transformer-based Conditional Variational Autoencoder for Controllable Story Generation Le Fang Tao Zeng Chao-Ning Liu Liefeng Bo Wen Dong Changyou Chen DRL 49 59 0 04 Jan 2021
A Correspondence Variational Autoencoder for Unsupervised Acoustic Word Embeddings Puyuan Peng Herman Kamper Karen Livescu DRL SSL 14 14 0 03 Dec 2020
Dirichlet Graph Variational Autoencoder Jia Li Tomas Yu Jiajin Li Honglei Zhang Kangfei Zhao Yu Rong Hong Cheng Junzhou Huang BDL 24 52 0 09 Oct 2020
Variational Disentanglement for Rare Event Modeling Zidi Xiu Chenyang Tao M. Gao Connor Davis B. Goldstein Ricardo Henao CML DRL 32 6 0 17 Sep 2020
Failure Modes of Variational Autoencoders and Their Effects on Downstream Tasks Yaniv Yacoby Weiwei Pan Finale Doshi-Velez CML DRL 27 25 0 14 Jul 2020
Efficient Learning of Generative Models via Finite-Difference Score Matching Tianyu Pang Kun Xu Chongxuan Li Yang Song Stefano Ermon Jun Zhu DiffM 31 53 0 07 Jul 2020
Learning Sparse Prototypes for Text Generation Junxian He Taylor Berg-Kirkpatrick Graham Neubig 27 23 0 29 Jun 2020
A Batch Normalized Inference Network Keeps the KL Vanishing Away Qile Zhu Jianlin Su Wei Bi Xiaojiang Liu Xiyao Ma Xiaolin Li D. Wu BDL DRL 34 61 0 27 Apr 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space Chunyuan Li Xiang Gao Yuan Li Baolin Peng Xiujun Li Yizhe Zhang Jianfeng Gao SSL DRL 32 181 0 05 Apr 2020
Characterizing and Avoiding Problematic Global Optima of Variational Autoencoders Yaniv Yacoby Weiwei Pan Finale Doshi-Velez DRL 21 4 0 17 Mar 2020
Paraphrase Generation with Latent Bag of Words Yao Fu Yansong Feng John P. Cunningham BDL 25 91 0 07 Jan 2020
The Usual Suspects? Reassessing Blame for VAE Posterior Collapse Bin Dai Ziyu Wang David Wipf DRL 18 75 0 23 Dec 2019
Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapse James Lucas George Tucker Roger C. Grosse Mohammad Norouzi CoGe DRL 33 179 0 06 Nov 2019
Wavelets to the Rescue: Improving Sample Quality of Latent Variable Deep Generative Models P. Gyawali Rudra Saha Linwei Wang V. Veeravasarapu M. Singh DiffM DRL 33 0 0 26 Oct 2019
Unsupervised Paraphrasing by Simulated Annealing Xianggen Liu Lili Mou Fandong Meng Hao Zhou Jie Zhou Sen Song 37 77 0 09 Sep 2019