Omnimatte: Associating Objects and Their Effects in Video

14 May 2021

William T. Freeman

Michael Rubinstein

DiffM

VOS

ArXiv PDF HTML

Papers citing "Omnimatte: Associating Objects and Their Effects in Video"

42 / 42 papers shown

Title
Deep Reinforcement Learning via Object-Centric Attention Jannis Blüml Cedric Derstroff Bjarne Gregori Elisabeth Dillies Quentin Delfosse Kristian Kersting OCL 44 0 0 03 Apr 2025
OmnimatteZero: Training-free Real-time Omnimatte with Pre-trained Video Diffusion Models Dvir Samuel Matan Levy N. Darshan Gal Chechik Rami Ben-Ari DiffM 62 0 0 23 Mar 2025
HyperNVD: Accelerating Neural Video Decomposition via Hypernetworks Maria Pilligua Danna Xue Javier Vázquez-Corral 47 0 0 21 Mar 2025
Surface-SOS: Self-Supervised Object Segmentation via Neural Surface Representation Xiaoyun Zheng Liwei Liao Jianbo Jiao Feng Gao Ronggang Wang 80 6 0 20 Jan 2025
InterDyn: Controllable Interactive Dynamics with Video Diffusion Models Rick Akkerman Haiwen Feng M. Black Dimitrios Tzionas Victoria Fernandez-Abrevaya VGen AI4CE 105 3 0 16 Dec 2024
Generative Omnimatte: Learning to Decompose Video into Layers Yao-Chih Lee Erika Lu Sarah Rumbley Michal Geyer Jia-Bin Huang Tali Dekel Forrester Cole DiffM VGen 105 5 0 25 Nov 2024
Fast Sprite Decomposition from Animated Graphics Tomoyuki Suzuki Kotaro Kikuchi Kota Yamaguchi 38 1 0 07 Aug 2024
Segment Anything for Videos: A Systematic Survey Chunhui Zhang Yawen Cui Weilin Lin Guanjie Huang Yan Rong Li Liu Shiguang Shan VLM 44 6 0 31 Jul 2024
V-LASIK: Consistent Glasses-Removal from Videos Using Synthetic Data Rotem Shalev-Arkushin Aharon Azulay Tavi Halperin Eitan Richardson Amit H. Bermano Ohad Fried DiffM 47 0 0 20 Jun 2024
NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing Ting-Hsuan Chen Jiewen Chan Hau-Shiang Shiu Shih-Han Yen Chang-Han Yeh Yu-Lun Liu VGen DiffM 48 3 0 10 Jun 2024
S3R-Net: A Single-Stage Approach to Self-Supervised Shadow Removal Nikolina Kubiak Armin Mustafa Graeme Phillipson Stephen Jolly Simon Hadfield 39 4 0 18 Apr 2024
ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion Daniel Winter Matan Cohen Shlomi Fruchter Yael Pritch Alex Rav Acha Yedid Hoshen DiffM 40 26 0 27 Mar 2024
Neural Spline Fields for Burst Image Fusion and Layer Separation Ilya Chugunov David Shustin Ruyu Yan Chenyang Lei Felix Heide 22 11 0 21 Dec 2023
DiffusionAtlas: High-Fidelity Consistent Diffusion Video Editing Shao-Yu Chang Hwann-Tzong Chen Tyng-Luh Liu DiffM VGen 36 3 0 05 Dec 2023
Fast View Synthesis of Casual Videos with Soup-of-Planes Yao-Chih Lee Zhoutong Zhang Kevin Blackburn-Matzen Simon Niklaus Jianming Zhang Jia-Bin Huang Feng Liu 46 15 0 04 Dec 2023
Editing Motion Graphics Video via Motion Vectorization and Transformation Sharon Zhang Jiaju Ma Jiajun Wu Daniel E. Ritchie Maneesh Agrawala VGen 25 9 0 26 Sep 2023
Hashing Neural Video Decomposition with Multiplicative Residuals in Space-Time Cheng-Hung Chan Chengtao Yuan Cheng Sun Hwann-Tzong Chen 30 5 0 25 Sep 2023
OmnimatteRF: Robust Omnimatte with 3D Background Modeling Geng Lin Chen Gao Jia-Bin Huang Changil Kim Yipeng Wang Matthias Zwicker Ayush Saraf 16 6 0 14 Sep 2023
Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye Poorvi Hebbar Abhinav Gupta Shubham Tulsiani DiffM 29 42 0 11 Sep 2023
Deep Image Matting: A Comprehensive Survey Jizhizi Li Jing Zhang Dacheng Tao VLM 33 14 0 10 Apr 2023
LANe: Lighting-Aware Neural Fields for Compositional Scene Synthesis Akshay Krishnan Amit Raj Xianling Zhang Alexandra Carlson Nathan Tseng Sandhya Sridhar Nikita Jaipuria James Hays AI4CE 38 5 0 06 Apr 2023
Neural Congealing: Aligning Images to a Joint Semantic Atlas Dolev Ofri-Amar Michal Geyer Yoni Kasten Tali Dekel 26 20 0 08 Feb 2023
Shape-aware Text-driven Layered Video Editing Yao-Chih Lee Ji-Ze Jang Yi-Ting Chen Elizabeth Qiu Jia-Bin Huang VGen DiffM 36 53 0 30 Jan 2023
Learning to Learn Better for Video Object Segmentation Meng Lan Jing Zhang Lefei Zhang Dacheng Tao VOS 32 17 0 05 Dec 2022
WALDO: Future Video Synthesis using Object Layer Decomposition and Parametric Flow Prediction G. L. Moing Jean Ponce Cordelia Schmid 19 6 0 25 Nov 2022
PIP: Positional-encoding Image Prior Nimrod Shabtay Eli Schwartz Raja Giryes 20 6 0 25 Nov 2022
DynIBaR: Neural Dynamic Image-Based Rendering Zhengqi Li Qianqian Wang Forrester Cole Richard Tucker Noah Snavely VGen 11 178 0 20 Nov 2022
FactorMatte: Redefining Video Matting for Re-Composition Tasks Zeqi Gu Wenqi Xian Noah Snavely Abe Davis 22 9 0 03 Nov 2022
The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editing Dawit Mureja Argaw Fabian Caba Heilbron Joon-Young Lee Markus Woodson In So Kweon VGen 42 22 0 20 Jul 2022
Segmenting Moving Objects via an Object-Centric Layered Representation Jun Xie Weidi Xie Andrew Zisserman VOS OCL 28 47 0 05 Jul 2022
PVO: Panoptic Visual Odometry Weicai Ye Xinyue Lan Shuo Chen Yuhang Ming Xin-rong Yu Hujun Bao Zhaopeng Cui Guofeng Zhang VGen 48 41 0 04 Jul 2022
Referring Image Matting Jizhizi Li Jing Zhang Dacheng Tao ObjD VLM 23 22 0 10 Jun 2022
D $^2$ NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video Tianhao Wu Fangcheng Zhong Andrea Tagliasacchi Forrester Cole Cengiz Öztireli 9 138 0 31 May 2022
Benchmarking of Deep Learning models on 2D Laminar Flow behind Cylinder Mritunjay Musale Vaibhav Vasani AI4CE 21 0 0 26 May 2022
Simulating Fluids in Real-World Still Images Simin Fan Jingtan Piao Chen Qian Kwan-Yee Lin Hongsheng Li 3DH 11 15 0 24 Apr 2022
Deformable Sprites for Unsupervised Video Decomposition Vickie Ye Zhengqi Li Richard Tucker Angjoo Kanazawa Noah Snavely OCL 21 63 0 14 Apr 2022
Text2LIVE: Text-Driven Layered Image and Video Editing Omer Bar-Tal Dolev Ofri-Amar Rafail Fridman Yoni Kasten Tali Dekel VGen DiffM 16 308 0 05 Apr 2022
Layered Neural Atlases for Consistent Video Editing Yoni Kasten Dolev Ofri-Amar Oliver Wang Tali Dekel VGen 197 160 0 23 Sep 2021
Self-supervised Tumor Segmentation through Layer Decomposition Xiaoman Zhang Weidi Xie Chaoqin Huang Yanfeng Wang Ya-Qin Zhang Xin Chen Qi Tian 29 5 0 07 Sep 2021
Neural Image Representations for Multi-Image Fusion and Layer Separation Seonghyeon Nam Marcus A. Brubaker Michael S. Brown 39 22 0 02 Aug 2021
MarioNette: Self-Supervised Sprite Learning Dmitriy Smirnov Michael Gharbi Matthew Fisher Vitor Campagnolo Guizilini Alexei A. Efros Justin Solomon SSL OCL 74 37 0 29 Apr 2021
Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation Qiqi Hou Feng Liu 30 145 0 20 Sep 2019