Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models

8 November 2019

Yuge Shi

Siddharth Narayanaswamy

Papers citing "Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models"

50 / 50 papers shown

Title
Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders R. A. Mancisidor Robert Jenssen Shujian Yu Michael C. Kampffmeyer 27 0 0 02 May 2025
STiL: Semi-supervised Tabular-Image Learning for Comprehensive Task-Relevant Information Exploration in Multimodal Classification Siyi Du Xinzhe Luo D. O’Regan Chen Qin 69 0 0 08 Mar 2025
A Markov Random Field Multi-Modal Variational AutoEncoder Fouad Oubari M. Baha Raphael Meunier Rodrigue Décatoire Mathilde Mougeot 36 0 0 18 Aug 2024
Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion Dongyang Li Chen Wei Shiying Li Jiachen Zou Quanying Liu DiffM 37 18 0 12 Mar 2024
A tutorial on multi-view autoencoders using the multi-view-AE library A. L. Aguila André Altmann 49 2 0 12 Mar 2024
Video Relationship Detection Using Mixture of Experts A. Shaabana Zahra Gharaee Paul Fieguth 34 1 0 06 Mar 2024
Improving Variational Autoencoder Estimation from Incomplete Data with Mixture Variational Families Vaidotas Šimkus Michael U. Gutmann 40 2 0 05 Mar 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Erdun Gao Biwei Huang Anton Van Den Hengel Anton van den Hengel Javen Qinfeng Shi Javen Qinfeng Shi 49 7 0 09 Feb 2024
Through-Wall Imaging based on WiFi Channel State Information Julian Strohmayer Rafael Sterzinger Christian Stippel Martin Kampel 24 0 0 30 Jan 2024
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 40 34 0 12 Oct 2023
Learning Representations without Compositional Assumptions Tennison Liu Jeroen Berrevoets Zhaozhi Qian M. Schaar OCL SSL 38 1 0 31 May 2023
Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis Agathe Senellart Clément Chadebec S. Allassonnière DRL 32 1 0 19 May 2023
A multimodal dynamical variational autoencoder for audiovisual speech representation learning Samir Sadok Simon Leglaive Laurent Girin Xavier Alameda-Pineda Renaud Séguier 25 11 0 05 May 2023
TC-VAE: Uncovering Out-of-Distribution Data Generative Factors Cristian Meo Anirudh Goyal Justin Dauwels DRL CoGe CML 27 1 0 08 Apr 2023
Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities A. L. Aguila James Chapman Andre Altmann 21 11 0 16 Mar 2023
Streamlining Multimodal Data Fusion in Wireless Communication and Sensor Networks M. J. Bocus Xiaoyang Wang Robert Piechocki 15 1 0 24 Feb 2023
eVAE: Evolutionary Variational Autoencoder Zhangkai Wu LongBing Cao Lei Qi BDL DRL 33 10 0 01 Jan 2023
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following K. Akuzawa Yusuke Iwasawa Yutaka Matsuo GAN 33 0 0 29 Dec 2022
Integrating Multimodal Data for Joint Generative Modeling of Complex Dynamics Manuela Brenner Florian Hess G. Koppe Daniel Durstewitz 28 9 0 15 Dec 2022
Disentangled Representation Learning Xin Wang Hong Chen Siao Tang Zihao Wu Wenwu Zhu DRL 35 78 0 21 Nov 2022
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments Abhinav Joshi Naman K. Gupta Jinang Shah Binod Bhattarai Ashutosh Modi Danail Stoyanov OffRL 33 2 0 07 Nov 2022
Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features Changde Du Kaicheng Fu Jinpeng Li Huiguang He VLM 42 68 0 13 Oct 2022
Redesigning Multi-Scale Neural Network for Crowd Counting Zhipeng Du Miaojing Shi Jiankang Deng S. Zafeiriou 31 44 0 04 Aug 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 42 32 0 24 Jul 2022
Adaptive Mixture of Experts Learning for Generalizable Face Anti-Spoofing Qianyu Zhou Ke-Yue Zhang Taiping Yao Ran Yi Shouhong Ding Lizhuang Ma OOD CVBM 25 47 0 20 Jul 2022
Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization Adrián Javaloy Maryam Meghdadi Isabel Valera 21 26 0 09 Jun 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 182 132 0 28 May 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 35 265 0 04 Apr 2022
Multi-View Dreaming: Multi-View World Model with Contrastive Learning Akira Kinose Masashi Okada Ryogo Okumura T. Taniguchi OffRL 21 10 0 15 Mar 2022
Multiple Importance Sampling ELBO and Deep Ensembles of Variational Approximations Oskar Kviman Harald Melin Hazal Koptagel Victor Elvira J. Lagergren DRL 71 17 0 22 Feb 2022
Multimodal Adversarially Learned Inference with Factorized Discriminators Wenxue Chen Jianke Zhu 51 3 0 20 Dec 2021
Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classification Junwen Bai Shufeng Kong Carla P. Gomes SSL DRL 30 36 0 02 Dec 2021
Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions Huan Ma Zongbo Han Changqing Zhang Huazhu Fu Qiufeng Wang Q. Hu EDL UQCV 74 42 0 11 Nov 2021
Reconstructing Nonlinear Dynamical Systems from Multi-Modal Time Series Daniel Kramer P. Bommer Carlo Tombolini G. Koppe Daniel Durstewitz BDL AI4TS AI4CE 25 18 0 04 Nov 2021
Discriminative Multimodal Learning via Conditional Priors in Generative Models R. A. Mancisidor Michael C. Kampffmeyer K. Aas Robert Jenssen GAN 22 5 0 09 Oct 2021
How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents Miguel Vasco Hang Yin Francisco S. Melo Ana Paiva 26 7 0 07 Oct 2021
Audio-to-Image Cross-Modal Generation Maciej Żelaszczyk Jacek Mańdziuk DiffM 53 15 0 27 Sep 2021
A Conditional Generative Matching Model for Multi-lingual Reply Suggestion Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah 31 1 0 15 Sep 2021
Lifelong Mixture of Variational Autoencoders Fei Ye A. Bors DRL 11 27 0 09 Jul 2021
Learning Multimodal VAEs through Mutual Supervision Thomas Joy Yuge Shi Philip Torr Tom Rainforth Sebastian M. Schmon N. Siddharth SSL 26 20 0 23 Jun 2021
Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentation Fuping Wu Xiahai Zhuang OOD DRL 28 72 0 16 Jun 2021
Generalized Multimodal ELBO Thomas M. Sutter Imant Daunhawer Julia E. Vogt 16 89 0 06 May 2021
Multimodal VAE Active Inference Controller Cristian Meo Pablo Lanillos 18 24 0 07 Mar 2021
A Variational Information Bottleneck Approach to Multi-Omics Data Integration Changhee Lee M. Schaar DRL 18 74 0 05 Feb 2021
Controlling the Interaction Between Generation and Inference in Semi-Supervised Variational Autoencoders Using Importance Weighting G. Felhi Joseph Leroux Djamé Seddah BDL 21 1 0 13 Oct 2020
Audio- and Gaze-driven Facial Animation of Codec Avatars Alexander Richard Colin S. Lea Shugao Ma Juergen Gall Fernando de la Torre Yaser Sheikh CVBM 21 81 0 11 Aug 2020
Relating by Contrasting: A Data-efficient Framework for Multimodal Generative Models Yuge Shi Brooks Paige Philip Torr N. Siddharth VLM 23 36 0 02 Jul 2020
Capturing Label Characteristics in VAEs Thomas Joy Sebastian M. Schmon Philip Torr N. Siddharth Tom Rainforth CML DRL 24 43 0 17 Jun 2020
Multimodal Generative Learning Utilizing Jensen-Shannon-Divergence Thomas M. Sutter Imant Daunhawer Julia E. Vogt 33 67 0 15 Jun 2020
Structured Disentangled Representations Babak Esmaeili Hao Wu Sarthak Jain Alican Bozkurt N. Siddharth Brooks Paige Dana H. Brooks Jennifer Dy Jan-Willem van de Meent OOD CML BDL DRL 23 165 0 06 Apr 2018