v1v2v3 (latest)

AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis

13 June 2024

Swapnil Bhosale

Haosen Yang

Diptesh Kanojia

Jiankang Deng

Xiatian Zhu

ArXiv (abs)PDF HTML

Papers citing "AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis"

34 / 34 papers shown

Title
Differentiable Room Acoustic Rendering with Multi-View Vision Priors Derong Jin Ruohan Gao 72 0 0 30 Apr 2025
Hearing Anywhere in Any Environment Xiulong Liu Anurag Kumar P. Calamia Sebastia V. Amengual Calvin Murdock Ishwarya Ananthabhotla Philip Robinson Eli Shlizerman V. Ithapu Ruohan Gao 56 0 0 14 Apr 2025
LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Models Yu Cheng Fajie Yuan VGen 93 0 0 18 Mar 2025
AV-Surf: Surface-Enhanced Geometry-Aware Novel-View Acoustic Synthesis Hadam Baek Hannie Shin Jiyoung Seo Chanwoo Kim Saerom Kim Hyeongbok Kim Sangpil Kim 79 0 0 17 Mar 2025
Revising Densification in Gaussian Splatting Samuel Rota Buló Lorenzo Porzi Peter Kontschieder 3DGS 50 60 0 09 Apr 2024
Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark Ziyang Chen I. D. Gebru Christian Richardt Anurag Kumar William Laney Andrew Owens Alexander Richard 86 19 0 27 Mar 2024
GaussianPro: 3D Gaussian Splatting with Progressive Propagation Kai-Sheng Cheng Xiaoxiao Long Kaizhi Yang Yao Yao Wei Yin Yuexin Ma Wenping Wang Xuejin Chen 3DGS 92 107 0 22 Feb 2024
Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis Zhan Li Zhang Chen Zhong Li Yinghao Xu 3DGS 101 160 0 28 Dec 2023
Gaussian Splatting SLAM H. Matsuki Riku Murai Paul H. J. Kelly Andrew J. Davison 3DGS 66 262 0 11 Dec 2023
SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM Nikhil Varma Keetha Jay Karhade Krishna Murthy Jatavallabhula Gengshan Yang Sebastian A. Scherer Deva Ramanan Jonathon Luiten 3DGS 97 278 0 04 Dec 2023
AV-RIR: Audio-Visual Room Impulse Response Estimation Anton Ratnarajah Sreyan Ghosh Sonal Kumar Purva Chiniya Dinesh Manocha 61 15 0 30 Nov 2023
Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering Tao Lu Mulin Yu Linning Xu Yuanbo Xiangli Limin Wang Dahua Lin Bo Dai 3DGS 76 292 0 30 Nov 2023
Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting Zeyu Yang Hongye Yang Zijie Pan Li Zhang 3DGS 82 268 0 16 Oct 2023
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering Guanjun Wu Taoran Yi Jiemin Fang Lingxi Xie Xiaopeng Zhang Wei Wei Wenyu Liu Qi Tian Xinggang Wang 3DGS 91 605 0 12 Oct 2023
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation Jiaxiang Tang Jiawei Ren Hang Zhou Ziwei Liu Gang Zeng 3DGS 131 627 0 28 Sep 2023
3D Gaussian Splatting for Real-Time Radiance Field Rendering Bernhard Kerbl Georgios Kopanas Thomas Leimkuehler G. Drettakis 3DGS 224 3,703 0 08 Aug 2023
STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events Kazuki Shimada Archontis Politis Parthasaarathy Sudarsanam D. Krause Kengo Uchida ... Yuichiro Koyama Naoya Takahashi Shusuke Takahashi Tuomas Virtanen Yuki Mitsufuji 85 40 0 15 Jun 2023
AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis Susan Liang Chao Huang Yapeng Tian Anurag Kumar Chenliang Xu VGen 72 36 0 04 Feb 2023
Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes Anton Ratnarajah Tianyi Zhou 72 6 0 02 Feb 2023
Novel-View Acoustic Synthesis Changan Chen Alexander Richard Roman Shapovalov V. Ithapu Natalia Neverova Kristen Grauman Andrea Vedaldi 68 35 0 20 Jan 2023
Few-Shot Audio-Visual Learning of Environment Acoustics Sagnik Majumder Changan Chen Ziad Al-Halah Kristen Grauman 66 55 0 08 Jun 2022
Learning Neural Acoustic Fields Andrew F. Luo Yilun Du Michael J. Tarr J. Tenenbaum Antonio Torralba Chuang Gan AI4CE 55 83 0 04 Apr 2022
Plenoxels: Radiance Fields without Neural Networks Alex Yu Sara Fridovich-Keil Matthew Tancik Qinhong Chen Benjamin Recht Angjoo Kanazawa 272 1,658 0 09 Dec 2021
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields Jonathan T. Barron B. Mildenhall Dor Verbin Pratul P. Srinivasan Peter Hedman 193 1,691 0 23 Nov 2021
Advances in Neural Rendering A. Tewari Justus Thies B. Mildenhall P. Srinivasan E. Tretschk ... S. Fanello Jun Zhu Gordon Wetzstein Michael Zollhoefer D. B. Goldman 3DH AI4CE 122 451 0 10 Nov 2021
FAST-RIR: Fast neural diffuse room impulse response generator Anton Ratnarajah Shi-Xiong Zhang Meng Yu Zhenyu Tang Tianyi Zhou Dong Yu 50 56 0 07 Oct 2021
Binaural Audio Generation via Multi-task Learning Sijia Li Shiguang Liu Tianyi Zhou 43 12 0 02 Sep 2021
Exploiting Audio-Visual Consistency with Partial Supervision for Spatial Audio Generation Yan-Bo Lin Y. Wang 88 21 0 03 May 2021
Points2Sound: From mono to binaural audio using 3D point cloud scenes Francesc Lluís V. Chatziioannou A. Hofmann 3DPC 95 6 0 26 Apr 2021
Visually Informed Binaural Audio Generation without Binaural Audios Xudong Xu Hang Zhou Ziwei Liu Bo Dai Xiaogang Wang Dahua Lin DiffM 46 57 0 13 Apr 2021
Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation Hang Zhou Xudong Xu Dahua Lin Xiaogang Wang Ziwei Liu DiffM 78 82 0 20 Jul 2020
Self-Supervised Generation of Spatial Audio for 360 Video Pedro Morgado Nuno Vasconcelos Timothy R. Langlois Oliver Wang MDE 62 173 0 07 Sep 2018
Open3D: A Modern Library for 3D Data Processing Qian-Yi Zhou Jaesik Park V. Koltun PINN AI4CE 64 1,618 0 30 Jan 2018
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015