v1v2v3v4 (latest)

DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models

1 July 2024

Hau-Shiang Shiu

Yu-Lun Liu

VGen

DiffM

ArXiv (abs)PDF HTML

Papers citing "DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models"

50 / 94 papers shown

Title
From Pixels to Graphs: using Scene and Knowledge Graphs for HD-EPIC VQA Challenge Agnese Taluzzi Davide Gesualdi Riccardo Santambrogio Chiara Plizzari Francesca Palermo S. Mentasti Matteo Matteucci GNN 7 2 0 10 Jun 2025
VISION-XL: High Definition Video Inverse Problem Solver using Latent Image Diffusion Models Taesung Kwon Jong Chul Ye 128 0 0 29 Nov 2024
Solving Video Inverse Problems Using Image Diffusion Models Taesung Kwon Jong Chul Ye DiffM 83 2 0 04 Sep 2024
Zero-Shot Video Restoration and Enhancement Using Pre-Trained Image Diffusion Model Cong Cao Huanjing Yue Xin Liu Jingyu Yang DiffM VGen 113 1 0 02 Jul 2024
Towards Real-world Video Face Restoration: A New Benchmark Ziyan Chen Jingwen He Xinqi Lin Yu Qiao Chao Dong 78 4 0 30 Apr 2024
Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution Zhikai Chen Fuchen Long Zhaofan Qiu Ting Yao Wengang Zhou Jiebo Luo Tao Mei DiffM 72 14 0 25 Mar 2024
FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation Shuai Yang Yifan Zhou Ziwei Liu Chen Change Loy VGen DiffM 116 31 0 19 Mar 2024
FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurring Geunhyuk Youk Jihyong Oh Munchurl Kim 68 12 0 08 Jan 2024
VidToMe: Video Token Merging for Zero-Shot Video Editing Xirui Li Chao Ma Xiaokang Yang Ming-Hsuan Yang DiffM VGen 60 46 0 17 Dec 2023
Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution Shangchen Zhou Peiqing Yang Jianyi Wang Yihang Luo Chen Change Loy VGen 137 47 0 11 Dec 2023
RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models Ozgur Kara Barışcan Kurtkaya Hidir Yesiltepe James M. Rehg Pinar Yanardag VGen DiffM 66 53 0 07 Dec 2023
Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation Bingxin Ke Anton Obukhov Shengyu Huang Nando Metzger Rodrigo Caye Daudt Konrad Schindler VLM MDE 112 162 0 04 Dec 2023
Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution Xi Yang Chenhang He Jianqi Ma Lei Zhang DiffM VGen 51 15 0 01 Dec 2023
FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing Yuren Cong Mengmeng Xu Christian Simon Shoufa Chen Jiawei Ren Yanping Xie Juan-Manuel Perez-Rua Bodo Rosenhahn Tao Xiang Sen He DiffM VGen 89 81 0 09 Oct 2023
PGDiff: Guiding Diffusion Models for Versatile Face Restoration via Partial Guidance Peiqing Yang Shangchen Zhou Qingyi Tao Chen Change Loy DiffM 50 33 0 19 Sep 2023
DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior X. Lin Jingwen He Zi-Yuan Chen Zhaoyang Lyu Bo Dai Ben Fei Wanli Ouyang Yu Qiao Chao Dong DiffM 65 207 0 29 Aug 2023
Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization Tao Yang Rongyuan Wu Peiran Ren Xuansong Xie Lei Zhang DiffM 81 146 0 28 Aug 2023
MeDM: Mediating Image Diffusion Models for Video-to-Video Translation with Temporal Correspondence Guidance Ernie Chu Tzu-Hua Huang Shuohao Lin Jun-Cheng Chen DiffM VGen 43 13 0 19 Aug 2023
ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting Zongsheng Yue Jianyi Wang Chen Change Loy DiffM 78 232 0 23 Jul 2023
TokenFlow: Consistent Diffusion Features for Consistent Video Editing Michal Geyer Omer Bar-Tal Shai Bagon Tali Dekel VGen DiffM 86 265 0 19 Jul 2023
Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation Shuai Yang Yifan Zhou Ziwei Liu Chen Change Loy VGen DiffM 78 216 0 13 Jun 2023
Exploiting Diffusion Prior for Real-World Image Super-Resolution Jianyi Wang Zongsheng Yue Shangchen Zhou Kelvin C. K. Chan Chen Change Loy 113 311 0 11 May 2023
Generative Diffusion Prior for Unified Image Restoration and Enhancement Ben Fei Zhaoyang Lyu Liang Pan Junzhe Zhang Weidong Yang Tian-jian Luo Bo Zhang Bo Dai DiffM 95 188 0 03 Apr 2023
Pix2Video: Video Editing using Image Diffusion Duygu Ceylan C. Huang Niloy J. Mitra DiffM VGen 82 257 0 22 Mar 2023
FateZero: Fusing Attentions for Zero-shot Text-based Video Editing Chenyang Qi Xiaodong Cun Yong Zhang Chenyang Lei Xintao Wang Ying Shan Qifeng Chen VGen 82 353 0 16 Mar 2023
DiffIR: Efficient Diffusion Model for Image Restoration Bin Xia Yulun Zhang Shiyin Wang Yitong Wang Xing Wu Yapeng Tian Wenming Yang Luc Van Gool DiffM 63 222 0 16 Mar 2023
VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation Xiaoyu Shi Zhaoyang Huang Weikang Bian Dasong Li Manyuan Zhang Ka Chun Cheung Simon See Hongwei Qin Jifeng Dai Hongsheng Li 122 79 0 15 Mar 2023
VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation Zhengxiong Luo Dayou Chen Yingya Zhang Yan Huang Liangsheng Wang Yujun Shen Deli Zhao Jinren Zhou Tien-Ping Tan DiffM VGen 191 320 0 15 Mar 2023
FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation Xiaoyu Shi Zhaoyang Huang Dasong Li Manyuan Zhang Ka Chun Cheung Simon See Hongwei Qin Jifeng Dai Hongsheng Li 69 88 0 02 Mar 2023
Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models Rinon Gal Moab Arar Yuval Atzmon Amit H. Bermano Gal Chechik Daniel Cohen-Or DiffM 95 200 0 23 Feb 2023
T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models Chong Mou Xintao Wang Liangbin Xie Yanze Wu Shuai Liu Zhongang Qi Ying Shan Xiaohu Qie DiffM 121 1,027 0 16 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models Lvmin Zhang Anyi Rao Maneesh Agrawala AI4CE 173 4,146 1 10 Feb 2023
Structure and Content-Guided Video Synthesis with Diffusion Models Patrick Esser Johnathan Chiu Parmida Atighehchian Jonathan Granskog Anastasis Germanidis DiffM VGen 167 533 0 06 Feb 2023
Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation Jay Zhangjie Wu Yixiao Ge Xintao Wang Weixian Lei Yuchao Gu Yufei Shi Wynne Hsu Ying Shan Xiaohu Qie Mike Zheng Shou VGen 114 737 0 22 Dec 2022
Mitigating Artifacts in Real-World Video Super-Resolution Models Liangbin Xie Xintao Wang Shu Shi Jinjin Gu Chao Dong Ying Shan 72 22 0 14 Dec 2022
Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Model Yinhuai Wang Jiwen Yu Jian Zhang DiffM 109 452 0 01 Dec 2022
VIDM: Video Implicit Diffusion Models Kangfu Mei Vishal M. Patel DiffM VGen 73 81 0 01 Dec 2022
Efficient Frequency Domain-based Transformers for High-Quality Image Deblurring Lingshun Kong Jiangxin Dong Mingqiang Li J. Ge Jin-shan Pan ViT 67 150 0 22 Nov 2022
Token Merging: Your ViT But Faster Daniel Bolya Cheng-Yang Fu Xiaoliang Dai Peizhao Zhang Christoph Feichtenhofer Judy Hoffman MoMe 108 458 0 17 Oct 2022
Imagen Video: High Definition Video Generation with Diffusion Models Jonathan Ho William Chan Chitwan Saharia Jay Whang Ruiqi Gao ... Diederik P. Kingma Ben Poole Mohammad Norouzi David J. Fleet Tim Salimans VGen 162 1,528 0 05 Oct 2022
Make-A-Video: Text-to-Video Generation without Text-Video Data Uriel Singer Adam Polyak Thomas Hayes Xiaoyue Yin Jie An ... Oron Ashual Oran Gafni Devi Parikh Sonal Gupta Yaniv Taigman DiffM VGen 81 1,421 0 29 Sep 2022
Prompt-to-Prompt Image Editing with Cross Attention Control Amir Hertz Ron Mokady J. Tenenbaum Kfir Aberman Yael Pritch Daniel Cohen-Or DiffM 200 1,773 0 02 Aug 2022
A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shift Dasong Li Xiaoyu Shi Yuanhang Zhang Ka Chun Cheung Simon See Xiaogang Wang Hongwei Qin Hongsheng Li VGen 51 64 0 22 Jun 2022
Recurrent Video Restoration Transformer with Guided Deformable Attention Christos Sakaridis Yuchen Fan Xiaoyu Xiang Rakesh Ranjan Eddy Ilg Simon Green Jingyun Liang Peng Sun Radu Timofte Luc Van Gool 112 168 0 05 Jun 2022
Improving Diffusion Models for Inverse Problems using Manifold Constraints Hyungjin Chung Byeongsu Sim Dohoon Ryu J. C. Ye DiffM MedIm 118 464 0 02 Jun 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 437 6,023 0 23 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 407 6,866 0 13 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 204 1,626 0 07 Apr 2022
FlowFormer: A Transformer Architecture for Optical Flow Zhaoyang Huang Xiaoyu Shi Chao Zhang Qiang Wang Ka Chun Cheung Hongwei Qin Jifeng Dai Hongsheng Li ViT 82 284 0 30 Mar 2022
Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priors Chaofeng Chen Xinyu Shi Yipeng Qin Xiaoming Li Xiaoguang Han Taojiannan Yang Shihui Guo 72 116 0 26 Feb 2022