Joint Multimodal Learning with Deep Generative Models

7 November 2016

Papers citing "Joint Multimodal Learning with Deep Generative Models"

38 / 38 papers shown

Title
A Markov Random Field Multi-Modal Variational AutoEncoder Fouad Oubari M. Baha Raphael Meunier Rodrigue Décatoire Mathilde Mougeot 36 0 0 18 Aug 2024
A tutorial on multi-view autoencoders using the multi-view-AE library A. L. Aguila André Altmann 54 2 0 12 Mar 2024
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 40 34 0 12 Oct 2023
Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses Eslam Abdelaleem I. Nemenman K. M. Martini 30 5 0 05 Oct 2023
Learning Representations without Compositional Assumptions Tennison Liu Jeroen Berrevoets Zhaozhi Qian M. Schaar OCL SSL 43 1 0 31 May 2023
Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis Agathe Senellart Clément Chadebec S. Allassonnière DRL 32 1 0 19 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 57 14 0 10 May 2023
A multimodal dynamical variational autoencoder for audiovisual speech representation learning Samir Sadok Simon Leglaive Laurent Girin Xavier Alameda-Pineda Renaud Séguier 33 11 0 05 May 2023
Streamlining Multimodal Data Fusion in Wireless Communication and Sensor Networks M. J. Bocus Xiaoyang Wang Robert Piechocki 15 1 0 24 Feb 2023
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following K. Akuzawa Yusuke Iwasawa Yutaka Matsuo GAN 33 0 0 29 Dec 2022
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments Abhinav Joshi Naman K. Gupta Jinang Shah Binod Bhattarai Ashutosh Modi Danail Stoyanov OffRL 41 2 0 07 Nov 2022
Progressive Fusion for Multimodal Integration Shiv Shankar Laure Thompson M. Fiterau 36 3 0 01 Sep 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 42 32 0 24 Jul 2022
Controllable Data Generation by Deep Learning: A Review Shiyu Wang Yuanqi Du Xiaojie Guo Bo Pan Zhaohui Qin Liang Zhao 33 28 0 19 Jul 2022
Text to Image Synthesis using Stacked Conditional Variational Autoencoders and Conditional Generative Adversarial Networks Haileleol Tibebu Aadin Malik V. D. Silva GAN 20 7 0 06 Jul 2022
Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models T. Taniguchi Yuto Yoshida Akira Taniguchi Y. Hagiwara MLLM 27 22 0 24 May 2022
Multimodal Adversarially Learned Inference with Factorized Discriminators Wenxue Chen Jianke Zhu 54 3 0 20 Dec 2021
Generating Diverse 3D Reconstructions from a Single Occluded Face Image Rahul Dey Vishnu Boddeti CVBM 3DH 29 7 0 01 Dec 2021
Discriminative Multimodal Learning via Conditional Priors in Generative Models R. A. Mancisidor Michael C. Kampffmeyer K. Aas Robert Jenssen GAN 30 5 0 09 Oct 2021
How to Sense the World: Leveraging Hierarchy in Multimodal Perception for Robust Reinforcement Learning Agents Miguel Vasco Hang Yin Francisco S. Melo Ana Paiva 34 7 0 07 Oct 2021
Learning Multimodal VAEs through Mutual Supervision Thomas Joy Yuge Shi Philip Torr Tom Rainforth Sebastian M. Schmon N. Siddharth SSL 42 20 0 23 Jun 2021
Generalized Multimodal ELBO Thomas M. Sutter Imant Daunhawer Julia E. Vogt 24 89 0 06 May 2021
A Whole Brain Probabilistic Generative Model: Toward Realizing Cognitive Architectures for Developmental Robots T. Taniguchi Hiroshi Yamakawa Takayuki Nagai Kenji Doya M. Sakagami Masahiro Suzuki Tomoaki Nakamura Akira Taniguchi 28 23 0 15 Mar 2021
SMIL: Multimodal Learning with Severely Missing Modality Mengmeng Ma Jian Ren Long Zhao Sergey Tulyakov Cathy H. Wu Xi Peng 59 239 0 09 Mar 2021
Relating by Contrasting: A Data-efficient Framework for Multimodal Generative Models Yuge Shi Brooks Paige Philip Torr N. Siddharth VLM 31 36 0 02 Jul 2020
Capturing Label Characteristics in VAEs Thomas Joy Sebastian M. Schmon Philip Torr N. Siddharth Tom Rainforth CML DRL 30 43 0 17 Jun 2020
Multimodal Generative Learning Utilizing Jensen-Shannon-Divergence Thomas M. Sutter Imant Daunhawer Julia E. Vogt 36 67 0 15 Jun 2020
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models Yuge Shi Siddharth Narayanaswamy Brooks Paige Philip Torr DRL 32 266 0 08 Nov 2019
Neuro-SERKET: Development of Integrative Cognitive System through the Composition of Deep Probabilistic Generative Models T. Taniguchi Tomoaki Nakamura Masahiro Suzuki Ryo Kuniyasu Kaede Hayashi Akira Taniguchi Takato Horii Takayuki Nagai BDL DRL 22 48 0 20 Oct 2019
Multi-modal Deep Analysis for Multimedia Wenwu Zhu Xin Wang Hongzhi Li 29 38 0 11 Oct 2019
Multimodal representation models for prediction and control from partial information Martina Zambelli Antoine Cully Y. Demiris 21 27 0 09 Oct 2019
Balancing Reconstruction Quality and Regularisation in ELBO for VAEs Shuyu Lin Stephen J. Roberts Niki Trigoni R. Clark DRL 21 15 0 09 Sep 2019
Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks Michelle A. Lee Yuke Zhu Peter Zachares Matthew Tan K. Srinivasan Silvio Savarese Fei-Fei Li Animesh Garg Jeannette Bohg SSL 23 208 0 28 Jul 2019
Symbol Emergence as an Interpersonal Multimodal Categorization Y. Hagiwara Hiroyoshi Kobayashi Akira Taniguchi T. Taniguchi 16 25 0 31 May 2019
Multi-Source Neural Variational Inference Richard Kurle Stephan Günnemann Patrick van der Smagt BDL SSL DRL 17 25 0 11 Nov 2018
Disentangled VAE Representations for Multi-Aspect and Missing Data Samuel K. Ainsworth N. Foti E. Fox DRL 19 15 0 24 Jun 2018
Learning Factorized Multimodal Representations Yao-Hung Hubert Tsai Paul Pu Liang Amir Zadeh Louis-Philippe Morency Ruslan Salakhutdinov DRL 63 402 0 16 Jun 2018
SCAN: Learning Hierarchical Compositional Visual Concepts I. Higgins Nicolas Sonnerat Loic Matthey Arka Pal Christopher P. Burgess Matko Bosnjak Murray Shanahan M. Botvinick Demis Hassabis Alexander Lerchner OCL DRL CoGe 24 51 0 11 Jul 2017