Multimodal Generative Models for Scalable Weakly-Supervised Learning

14 February 2018

Papers citing "Multimodal Generative Models for Scalable Weakly-Supervised Learning"

50 / 176 papers shown

Title
Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction Kaiqi Chen Jing Yu Lim Kingsley Kuan Harold Soh 27 0 0 12 Aug 2023
Auditory Attention Decoding with Task-Related Multi-View Contrastive Learning Xiaoyu Chen Changde Du Qiongyi Zhou Huiguang He 30 5 0 08 Aug 2023
Treatment Outcome Prediction for Intracerebral Hemorrhage via Generative Prognostic Model with Imaging and Tabular Data Wenao Ma Cheng Chen J. Abrigo C. Mak Yuqi Gong Nga Yan Chan Chu Han Zaiyi Liu Qi Dou 25 7 0 24 Jul 2023
MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning Paul Pu Liang Yiwei Lyu Xiang Fan Arav Agarwal Yun Cheng Louis-Philippe Morency Ruslan Salakhutdinov VLM 44 6 0 28 Jun 2023
Factorized Contrastive Learning: Going Beyond Multi-view Redundancy Paul Pu Liang Zihao Deng Martin Q. Ma James Zou Louis-Philippe Morency Ruslan Salakhutdinov SSL 33 49 0 08 Jun 2023
Multi-modal Latent Diffusion Mustapha Bounoua Giulio Franzese Pietro Michiardi DiffM 27 13 0 07 Jun 2023
Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detection Aixuan Li Yuxin Mao Jing Zhang Yuchao Dai 34 25 0 06 Jun 2023
Towards Anytime Classification in Early-Exit Architectures by Enforcing Conditional Monotonicity Metod Jazbec J. Allingham Dan Zhang Eric T. Nalisnick 26 11 0 05 Jun 2023
Calibrating Multimodal Learning Huanrong Zhang Changqing Zhang Bing Wu Huazhu Fu Qiufeng Wang Q. Hu 62 17 0 02 Jun 2023
Learning Representations without Compositional Assumptions Tennison Liu Jeroen Berrevoets Zhaozhi Qian M. Schaar OCL SSL 43 1 0 31 May 2023
Improving Multimodal Joint Variational Autoencoders through Normalizing Flows and Correlation Analysis Agathe Senellart Clément Chadebec S. Allassonnière DRL 37 1 0 19 May 2023
Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing Elena Shrestha C. Reddy Hanxi Wan Yulun Zhuang Ram Vasudevan 35 1 0 08 May 2023
Robust Multi-agent Communication via Multi-view Message Certification Lei Yuan T. Jiang Lihe Li F. Chen Zongzhang Zhang Yang Yu 42 2 0 07 May 2023
A multimodal dynamical variational autoencoder for audiovisual speech representation learning Samir Sadok Simon Leglaive Laurent Girin Xavier Alameda-Pineda Renaud Séguier 38 11 0 05 May 2023
Exploring and Exploiting Uncertainty for Incomplete Multi-View Classification Mengyao Xie Zongbo Han Changqing Zhang Yichen Bai Qinghua Hu UQCV EDL 163 15 0 11 Apr 2023
PoseFusion: Robust Object-in-Hand Pose Estimation with SelectLSTM Yuyang Tu Junnan Jiang Shuang Li Norman Hendrich Miaopeng Li Jianwei Zhang 31 7 0 10 Apr 2023
Joint fMRI Decoding and Encoding with Latent Embedding Alignment Xuelin Qian Yikai Wang Yanwei Fu Xinwei Sun Xiangyang Xue Jianfeng Feng 60 6 0 26 Mar 2023
Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities A. L. Aguila James Chapman Andre Altmann 26 11 0 16 Mar 2023
Identifiability Results for Multimodal Contrastive Learning Imant Daunhawer Alice Bizeul Emanuele Palumbo Alexander Marx Julia E. Vogt 39 39 0 16 Mar 2023
Class-Guided Image-to-Image Diffusion: Cell Painting from Brightfield Images with Class Labels J. Cross-Zamirski P. Anand Guy B. Williams E. Mouchet Yinhai Wang Carola-Bibiane Schönlieb VLM DiffM MedIm 14 8 0 15 Mar 2023
PARASOL: Parametric Style Control for Diffusion Image Synthesis Gemma Canet Tarrés Dan Ruta Tu Bui John Collomosse DiffM 44 6 0 11 Mar 2023
BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus Decoding Yulong Liu Yongqiang Ma Wei Zhou Guibo Zhu Nanning Zheng VLM 34 35 0 25 Feb 2023
Streamlining Multimodal Data Fusion in Wireless Communication and Sensor Networks M. J. Bocus Xiaoyang Wang Robert Piechocki 23 1 0 24 Feb 2023
Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework Paul Pu Liang Yun Cheng Xiang Fan Chun Kai Ling Suzanne Nie ... Nicholas B. Allen Randy P. Auerbach Faisal Mahmood Ruslan Salakhutdinov Louis-Philippe Morency 43 32 0 23 Feb 2023
Interval Type-2 Fuzzy Neural Networks for Multi-Label Classification Dayong Tian Fei Li Yiwen Wei 40 0 0 21 Feb 2023
Multimodal Sequential Generative Models for Semi-Supervised Language Instruction Following K. Akuzawa Yusuke Iwasawa Yutaka Matsuo GAN 38 0 0 29 Dec 2022
OrthoGAN:High-Precision Image Generation for Teeth Orthodontic Visualization Feihong Shen Jingjing Liu Hai-Zhen Li B. Fang Chenglong Ma Jinxiang Hao Yang Feng Youyi Zheng Youyi Zheng MedIm DiffM 57 0 0 29 Dec 2022
Generalizing Multimodal Variational Methods to Sets Jinzhao Zhou Yiqun Duan Zhihong Chen Yu-Cheng Chang Chin-Teng Lin DRL 50 0 0 19 Dec 2022
Integrating Multimodal Data for Joint Generative Modeling of Complex Dynamics Manuela Brenner Florian Hess G. Koppe Daniel Durstewitz 33 10 0 15 Dec 2022
Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models Nithin Gopalakrishnan Nair W. G. C. Bandara Vishal M. Patel DiffM 11 5 0 01 Dec 2022
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments Abhinav Joshi Naman K. Gupta Jinang Shah Binod Bhattarai Ashutosh Modi Danail Stoyanov OffRL 41 2 0 07 Nov 2022
Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations Sijie Mai Ying Zeng Haifeng Hu 45 68 0 31 Oct 2022
Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity Kaicheng Fu Changde Du Shengpei Wang Huiguang He 19 5 0 26 Oct 2022
Imputation of missing values in multi-view data Wouter van Loon M. Fokkema Frank de Vos Marisa Koini Reinhold Schmidt M. Rooij 25 2 0 26 Oct 2022
Greedy Modality Selection via Approximate Submodular Maximization Runxiang Cheng Gargi Balasubramaniam Yifei He Yao-Hung Hubert Tsai Han Zhao 24 1 0 22 Oct 2022
Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features Changde Du Kaicheng Fu Jinpeng Li Huiguang He VLM 45 68 0 13 Oct 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 63 0 07 Sep 2022
Benchmarking Multimodal Variational Autoencoders: CdSprites+ Dataset and Toolkit G. Sejnova M. Vavrecka Karla Stepanova VGen 28 0 0 07 Sep 2022
Decentralized Coordination in Partially Observable Queueing Networks Jiekai Jia Anam Tahir Heinz Koeppl 39 1 0 29 Aug 2022
A Graphical Model for Fusing Diverse Microbiome Data Mehmet Aktukmak Haonan Zhu M. Chevrette Julia Nepper S. Magesh J. Handelsman Alfred Hero 24 2 0 21 Aug 2022
Multimodal sensor fusion in the latent representation space Robert Piechocki Xiaoyang Wang M. J. Bocus 11 15 0 03 Aug 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 44 32 0 24 Jul 2022
Multimodal hierarchical Variational AutoEncoders with Factor Analysis latent space Alejandro Guerrero-López C. Sevilla-Salcedo Vanessa Gómez-Verdejo Pablo Martínez Olmos DRL 26 1 0 19 Jul 2022
A survey of multimodal deep generative models Masahiro Suzuki Y. Matsuo SyDa DRL 62 76 0 05 Jul 2022
Compositional Mixture Representations for Vision and Text Stephan Alaniz Marco Federici Zeynep Akata CoGe OCL VLM 25 2 0 13 Jun 2022
Image Generation with Multimodal Priors using Denoising Diffusion Probabilistic Models Nithin Gopalakrishnan Nair W. G. C. Bandara Vishal M. Patel DiffM 25 8 0 10 Jun 2022
Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization Adrián Javaloy Maryam Meghdadi Isabel Valera 32 27 0 09 Jun 2022
Scalable Online Disease Diagnosis via Multi-Model-Fused Actor-Critic Reinforcement Learning Weijie He Ting Chen OffRL 18 3 0 08 Jun 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 186 134 0 28 May 2022
Training and Inference on Any-Order Autoregressive Models the Right Way Andy Shih Dorsa Sadigh Stefano Ermon BDL TPM OOD CML 40 23 0 26 May 2022