v1v2v3 (latest)

Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding

13 November 2022

Papers citing "Seeing Beyond the Brain: Conditional Diffusion Model with Sparse Masked Modeling for Vision Decoding"

42 / 42 papers shown

Title
Learning Interpretable Representations Leads to Semantically Faithful EEG-to-Text Generation Xiaozhao Liu Dinggang Shen Xihui Liu 70 0 0 21 May 2025
Dynadiff: Single-stage Decoding of Images from Continuously Evolving fMRI Marlène Careil Yohann Benchetrit Jean-Rémi King 188 0 0 20 May 2025
Probability Distribution Alignment and Low-Rank Weight Decomposition for Source-Free Domain Adaptive Brain Decoding Ganxi Xu Jinyi Long Hanrui Wu 157 0 0 12 Apr 2025
Animate Your Thoughts: Decoupled Reconstruction of Dynamic Natural Vision from Slow Brain Activity Yizhuo Lu Changde Du Chong Wang Xuanliu Zhu Liuyun Jiang Xujin Li Huiguang He VGen 214 4 0 20 Feb 2025
Scaling laws for decoding images from brain activity Hubert J. Banville Yohann Benchetrit Stéphane DÁscoli Jérémy Rapin J. King MedIm 106 0 0 25 Jan 2025
Double-Flow GAN model for the reconstruction of perceived faces from brain activities Zihao Wang Jing Zhao Xuetong Ding Hui Zhang CVBM AI4CE 76 0 0 03 Jan 2025
Guess What I Think: Streamlined EEG-to-Image Generation with Latent Diffusion Models Eleonora Lopez Luigi Sigillo Federica Colonnese Massimo Panella Danilo Comminiello DiffM 146 1 0 17 Sep 2024
Masked Image Modeling: A Survey Vlad Hondru Florinel-Alin Croitoru Shervin Minaee Radu Tudor Ionescu N. Sebe 135 8 0 13 Aug 2024
ClassDiffusion: More Aligned Personalization Tuning with Explicit Class Guidance Jiannan Huang Jun Hao Liew Hanshu Yan Yuyang Yin Yao Zhao Yunchao Wei Yunchao Wei DiffM 154 7 0 27 May 2024
Mind Reader: Reconstructing complex images from brain activities Sikun Lin Thomas C. Sprague Ambuj K. Singh DiffM 155 90 0 30 Sep 2022
The Brain-Inspired Decoder for Natural Visual Image Reconstruction Wenyi Li Shengjie Zheng Yufan Liao Rongqi Hong Weiliang Chen Chenggang He Xiaojian Li 38 4 0 18 Jul 2022
Pretraining is All You Need for Image-to-Image Translation Tengfei Wang Ting Zhang Bo Zhang Hao Ouyang Dong Chen Qifeng Chen Fang Wen DiffM 243 178 0 25 May 2022
Reconstruction of Perceived Images from fMRI Patterns and Semantic Brain Exploration using Instance-Conditioned GANs Furkan Ozcelik Bhavin Choksi Milad Mozafari Leila Reddy Rufin VanRullen GAN 94 70 0 25 Feb 2022
Pseudo Numerical Methods for Diffusion Models on Manifolds Luping Liu Yi Ren Zhijie Lin Zhou Zhao DiffM 97 647 0 20 Feb 2022
How to Understand Masked Autoencoders Shuhao Cao Peng Xu David Clifton 71 41 0 08 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 460 15,665 0 20 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 149 668 0 16 Dec 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 197 1,353 0 18 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 467 7,757 0 11 Nov 2021
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs Christoph Schuhmann Richard Vencu Romain Beaumont R. Kaczmarczyk Clayton Mullis Aarush Katta Theo Coombes J. Jitsev Aran Komatsuzaki VLM MLLM CLIP 240 1,429 0 03 Nov 2021
D2C: Diffusion-Denoising Models for Few-shot Conditional Generation Abhishek Sinha Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 113 121 0 12 Jun 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 241 7,857 0 11 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 964 29,731 0 26 Feb 2021
Reconstructing Perceptive Images from Brain Activity by Shape-Semantic GAN T. Fang Yu Qi Gang Pan GAN 73 50 0 28 Jan 2021
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 131 2,962 0 17 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 664 41,103 0 22 Oct 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 650 18,096 0 19 Jun 2020
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN Milad Mozafari Leila Reddy R. V. Rullen AI4CE 50 70 0 31 Jan 2020
Decoding Neural Responses in Mouse Visual Cortex through a Deep Neural Network Asim Iqbal Phil Dong Christopher M. Kim H. Jang 33 11 0 26 Oct 2019
Generative Modeling by Estimating Gradients of the Data Distribution Yang Song Stefano Ermon SyDa DiffM 258 3,916 0 12 Jul 2019
From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRI Roman Beliy Guy Gaziv A. Hoogi Francesca Strappini Tal Golan Michal Irani 59 118 0 03 Jul 2019
Synaptic Delays for Temporal Feature Detection in Dynamic Neuromorphic Processors Fredrik Sandin Mattias Nilsson 41 10 0 28 Jun 2019
The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale Alina Kuznetsova H. Rom N. Alldrin J. Uijlings Ivan Krasin ... S. Popov Matteo Malloci Alexander Kolesnikov Tom Duerig V. Ferrari ObjD VLM 112 1,348 0 02 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
BOLD5000: A public fMRI dataset of 5000 images Nadine Chang John A. Pyles Abhinav Gupta Michael J. Tarr E. Aminoff 47 160 0 05 Sep 2018
A Connectome Based Hexagonal Lattice Convolutional Network Model of the Drosophila Visual System Fabian Tschopp Michael B. Reiser Srinivas C. Turaga 28 30 0 12 Jun 2018
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 149 3,530 0 28 Mar 2016
Generic decoding of seen and imagined objects using hierarchical visual features T. Horikawa Y. Kamitani 48 446 0 22 Oct 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.8K 77,196 0 18 May 2015
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 303 6,949 0 12 Mar 2015
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 413 43,777 0 01 May 2014
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 452 16,929 0 20 Dec 2013