3D Concept Learning and Reasoning from Multi-View Images

20 March 2023

Chuang Gan

Papers citing "3D Concept Learning and Reasoning from Multi-View Images"

50 / 60 papers shown

Title
Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understanding Yunze Man Shuhong Zheng Zhipeng Bao M. Hebert Liang-Yan Gui Yu-Xiong Wang 121 23 0 05 Sep 2024
LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control Delin Qu Qizhi Chen Pingrui Zhang Xianqiang Gao Bin Zhao Bin Zhao Dong Wang Xuelong Li AI4CE 101 8 0 23 Jun 2024
3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination Jianing Yang Xuweiyi Chen Nikhil Madaan Madhavan Iyengar Shengyi Qian David Fouhey Joyce Chai 3DV 133 16 0 07 Jun 2024
Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation Mohamed El Amine Boudjoghra Angela Dai Jean Lahoud Hisham Cholakkal Rao Muhammad Anwer Salman Khan Fahad Shahbaz Khan VLM ISeg 164 6 0 04 Jun 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 305 54 0 23 May 2024
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following Mingyu Ding Yan Xu Zhenfang Chen David D. Cox Ping Luo J. Tenenbaum Chuang Gan LM&Ro 86 21 0 07 Apr 2023
See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning Zhenfang Chen Qinhong Zhou Songlin Yang Yining Hong Hao Zhang Chuang Gan LRM VLM 96 41 0 12 Jan 2023
Habitat-Matterport 3D Semantics Dataset Karmesh Yadav Ram Ramrakhya Santhosh Kumar Ramakrishnan Theo Gervet John Turner ... Angel X. Chang Dhruv Batra Manolis Savva Alexander Clegg Devendra Singh Chaplot 3DV MDE 151 92 0 11 Oct 2022
3D Concept Grounding on Neural Fields Yining Hong Yilun Du Chun-Tse Lin J. Tenenbaum Chuang Gan 91 20 0 13 Jul 2022
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation Kai Zheng Xiaotong Chen Odest Chadwicke Jenkins Xinze Wang LM&Ro CoGe 87 63 0 17 Jun 2022
ComPhy: Compositional Physical Reasoning of Objects and Events from Videos Zhenfang Chen Kexin Yi Yunzhu Li Mingyu Ding Antonio Torralba J. Tenenbaum Chuang Gan CoGe OCL 80 53 0 02 May 2022
Learning Neural Acoustic Fields Andrew F. Luo Yilun Du Michael J. Tarr J. Tenenbaum Antonio Torralba Chuang Gan AI4CE 64 84 0 04 Apr 2022
DialFRED: Dialogue-Enabled Agents for Embodied Instruction Following Xiaofeng Gao Qiaozi Gao Ran Gong Kaixiang Lin Govind Thattai Gaurav Sukhatme LM&Ro 137 71 0 27 Feb 2022
One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestones Chan Hee Song Jihyung Kil Tai-Yu Pan Brian M. Sadler Wei-Lun Chao Yu-Chuan Su LRM 65 33 0 14 Feb 2022
Language-driven Semantic Segmentation Boyi Li Kilian Q. Weinberger Serge Belongie V. Koltun René Ranftl VLM 139 627 0 10 Jan 2022
ScanQA: 3D Question Answering for Spatial Scene Understanding Daich Azuma Taiki Miyanishi Shuhei Kurita M. Kawanabe 69 206 0 20 Dec 2021
Align and Prompt: Video-and-Language Pre-training with Entity Prompts Dongxu Li Junnan Li Hongdong Li Juan Carlos Niebles Guosheng Lin 103 194 0 17 Dec 2021
3D Question Answering Shuquan Ye Dongdong Chen Songfang Han Jing Liao ViT 88 49 0 15 Dec 2021
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CLIP 128 386 0 09 Dec 2021
PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning Yining Hong Li Yi J. Tenenbaum Antonio Torralba Chuang Gan 50 40 0 09 Dec 2021
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Anthony Simeonov Yilun Du Andrea Tagliasacchi J. Tenenbaum Alberto Rodriguez Pulkit Agrawal Vincent Sitzmann 122 248 0 09 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 82 568 0 02 Dec 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 130 1,079 0 22 Nov 2021
Learning Signal-Agnostic Manifolds of Neural Fields Yilun Du Katherine M. Collins J. Tenenbaum Vincent Sitzmann MedIm 85 50 0 11 Nov 2021
Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI Santhosh Kumar Ramakrishnan Aaron Gokaslan Erik Wijmans Oleksandr Maksymets Alexander Clegg ... Andrew Westbury Angel X. Chang Manolis Savva Yili Zhao Dhruv Batra 90 393 0 16 Sep 2021
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion Alessandro Suglia Qiaozi Gao Jesse Thomason Govind Thattai Gaurav Sukhatme LM&Ro 112 78 0 10 Aug 2021
Habitat 2.0: Training Home Assistants to Rearrange their Habitat Andrew Szot Alexander Clegg Eric Undersander Erik Wijmans Yili Zhao ... Z. Kira V. Koltun Jitendra Malik Manolis Savva Dhruv Batra LM&Ro 109 527 0 28 Jun 2021
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations Zhenyu Jiang Yifeng Zhu Maxwell Svetlik Kuan Fang Yuke Zhu 73 140 0 04 Apr 2021
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning Zhenfang Chen Jiayuan Mao Jiajun Wu Kwan-Yee K. Wong J. Tenenbaum Chuang Gan VGen 84 94 0 30 Mar 2021
Baking Neural Radiance Fields for Real-Time View Synthesis Peter Hedman Pratul P. Srinivasan B. Mildenhall Jonathan T. Barron P. Debevec 126 578 0 26 Mar 2021
PlenOctrees for Real-time Rendering of Neural Radiance Fields Alex Yu Ruilong Li Matthew Tancik Hao Li Ren Ng Angjoo Kanazawa 93 1,077 0 25 Mar 2021
FastNeRF: High-Fidelity Neural Rendering at 200FPS Stephan J. Garbin Marek Kowalski Matthew W. Johnson Jamie Shotton Julien P. C. Valentin 106 646 0 18 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 999 29,871 0 26 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 420 5,000 0 24 Feb 2021
Neural Radiance Flow for 4D View Synthesis and Video Processing Yilun Du Yinan Zhang Hong-Xing Yu J. Tenenbaum Jiajun Wu AI4CE 92 277 0 17 Dec 2020
Scan2Cap: Context-aware Dense Captioning in RGB-D Scans Dave Zhenyu Chen A. Gholami Matthias Nießner Angel X. Chang 3DPC 154 176 0 03 Dec 2020
Location-aware Graph Convolutional Networks for Video Question Answering Deng Huang Peihao Chen Runhao Zeng Qing Du Mingkui Tan Chuang Gan GNN BDL 99 175 0 07 Aug 2020
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis B. Mildenhall Pratul P. Srinivasan Matthew Tancik Jonathan T. Barron R. Ramamoorthi Ren Ng 131 2,592 0 19 Mar 2020
Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehension Zhenfang Chen Peng Wang Lin Ma Kwan-Yee K. Wong Qi Wu ObjD 97 68 0 01 Mar 2020
ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language Dave Zhenyu Chen Angel X. Chang Matthias Nießner 3DPC 100 378 0 18 Dec 2019
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision Michael Niemeyer L. Mescheder Michael Oechsle Andreas Geiger 3DH 3DV 82 1,000 0 16 Dec 2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 122 781 0 03 Dec 2019
The Replica Dataset: A Digital Replica of Indoor Spaces Julian Straub Thomas Whelan Lingni Ma Yufan Chen Erik Wijmans ... H. Strasdat R. D. Nardi Michael Goesele S. Lovegrove Richard Newcombe 3DV 134 858 0 13 Jun 2019
Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Video Zhenfang Chen Lin Ma Wenhan Luo Kwan-Yee K. Wong 95 103 0 06 Jun 2019
Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations Vincent Sitzmann Michael Zollhoefer Gordon Wetzstein 3DPC 3DV 172 1,282 0 04 Jun 2019
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization Shunsuke Saito Zeng Huang Ryota Natsume Shigeo Morishima Angjoo Kanazawa Hao Li 3DH 167 1,259 0 13 May 2019
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision Jiayuan Mao Chuang Gan Pushmeet Kohli J. Tenenbaum Jiajun Wu NAI 142 703 0 26 Apr 2019
Multi-Target Embodied Question Answering Licheng Yu Xinlei Chen Georgia Gkioxari Joey Tianyi Zhou Tamara L. Berg Dhruv Batra 79 106 0 09 Apr 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 129 1,423 0 02 Apr 2019
Occupancy Networks: Learning 3D Reconstruction in Function Space L. Mescheder Michael Oechsle Michael Niemeyer Sebastian Nowozin Andreas Geiger 3DV 253 2,908 0 10 Dec 2018