Title
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes Ran Gong Jiangyong Huang Yizhou Zhao Haoran Geng Xiaofeng Gao ... Ziheng Zhou D. Terzopoulos Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 42 45 0 09 Apr 2023
Learning Human-to-Robot Handovers from Point Clouds Sammy Christen Wei Yang Claudia Pérez-DÁrpino Otmar Hilliges D. Fox Yu-Wei Chao 18 41 0 30 Mar 2023
Going Beyond Nouns With Vision & Language Models Using Synthetic Data Paola Cascante-Bonilla Khaled Shehada James Smith Sivan Doveh Donghyun Kim ... Gül Varol A. Oliva Vicente Ordonez Rogerio Feris Leonid Karlinsky VLM SyDa 24 40 0 30 Mar 2023
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision Xubo Liu Egor Lakomkin Konstantinos Vougioukas Pingchuan Ma Honglie Chen ... Niko Moritz J. Kolár Stavros Petridis M. Pantic Christian Fuegen 44 19 0 30 Mar 2023
Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos Kun Su Kaizhi Qian Eli Shlizerman Antonio Torralba Chuang Gan VGen AI4CE 35 20 0 29 Mar 2023
Sounding Video Generator: A Unified Framework for Text-guided Sounding Video Generation Jiawei Liu Weining Wang Sihan Chen Xinxin Zhu J. Liu DiffM VGen 20 13 0 29 Mar 2023
Audio Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard VGen 60 33 0 13 Mar 2023
Why is That a Good or Not a Good Frying Pan? -- Knowledge Representation for Functions of Objects and Tools for Design Understanding, Improvement, and Generation Seng-Beng Ho 21 1 0 10 Mar 2023
Comparing Trajectory and Vision Modalities for Verb Representation Dylan Ebert Chen Sun Ellie Pavlick 14 1 0 08 Mar 2023
Decoupling Skill Learning from Robotic Control for Generalizable Object Manipulation Kai Lu Bo Yang Bing Wang Andrew Markham 26 4 0 07 Mar 2023
FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulation Zhou Xian Bo Zhu Zhenjia Xu H. Tung Antonio Torralba Katerina Fragkiadaki Chuang Gan 46 42 0 04 Mar 2023
Alexa Arena: A User-Centric Interactive Platform for Embodied AI Qiaozi Gao Govind Thattai Suhaila Shakiah Xiaofeng Gao Shreyas Pansare ... Michael Johnston R. Ghanadan Arindam Mandal Dilek Z. Hakkani-Tür Premkumar Natarajan 6 25 0 02 Mar 2023
Predicting Motion Plans for Articulating Everyday Objects Arjun Gupta Max E. Shepherd Saurabh Gupta 27 8 0 02 Mar 2023
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills Jiayuan Gu Fanbo Xiang Xuanlin Li Z. Ling Xiqiang Liu ... Xiao Yuan P. Xie Zhiao Huang Rui Chen Hao Su 32 174 0 09 Feb 2023
Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments Mayank Mittal C. Yu Qinxi Yu Jingzhou Liu N. Rudin ... Ajay Mandlekar Buck Babich Gavriel State Marco Hutter Animesh Garg 34 170 0 10 Jan 2023
Chat2Map: Efficient Scene Mapping from Multi-Ego Conversations Sagnik Majumder Hao Jiang Pierre Moulon E. Henderson P. Calamia Kristen Grauman V. Ithapu EgoV 32 7 0 04 Jan 2023
Human-in-the-loop Embodied Intelligence with Interactive Simulation Environment for Surgical Robot Learning Yonghao Long Wang Wei Tao Huang Yuehao Wang Qingxu Dou 29 32 0 01 Jan 2023
Objaverse: A Universe of Annotated 3D Objects Matt Deitke Dustin Schwenk Jordi Salvador Luca Weihs Oscar Michel Eli VanderBilt Ludwig Schmidt Kiana Ehsani Aniruddha Kembhavi Ali Farhadi 22 882 0 15 Dec 2022
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data Roei Herzig Ofir Abramovich Elad Ben-Avraham Assaf Arbelle Leonid Karlinsky Ariel Shamir Trevor Darrell Amir Globerson 36 16 0 08 Dec 2022
See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation Hao Li Yizhi Zhang Junzhe Zhu Shaoxiong Wang Michelle A. Lee Huazhe Xu Edward H. Adelson Li Fei-Fei Ruohan Gao Jiajun Wu 27 58 0 07 Dec 2022
A General Purpose Supervisory Signal for Embodied Agents Kunal Pratap Singh Jordi Salvador Luca Weihs Aniruddha Kembhavi SSL 21 3 0 01 Dec 2022
Geoclidean: Few-Shot Generalization in Euclidean Geometry Joy Hsu Jiajun Wu Noah D. Goodman 19 5 0 30 Nov 2022
Finding Differences Between Transformers and ConvNets Using Counterfactual Simulation Testing Nataniel Ruiz Sarah Adel Bargal Cihang Xie Kate Saenko Stan Sclaroff ViT 36 5 0 29 Nov 2022
Last-Mile Embodied Visual Navigation Justin Wasserman Karmesh Yadav Girish Chowdhary Abhi Gupta Unnat Jain 36 34 0 21 Nov 2022
Ask4Help: Learning to Leverage an Expert for Embodied Tasks Kunal Pratap Singh Luca Weihs Alvaro Herrasti Jonghyun Choi Aniruddha Kemhavi Roozbeh Mottaghi 11 19 0 18 Nov 2022
CRIPP-VQA: Counterfactual Reasoning about Implicit Physical Properties via Video Question Answering Maitreya Patel Tejas Gokhale Chitta Baral Yezhou Yang 46 9 0 07 Nov 2022
Avalon: A Benchmark for RL Generalization Using Procedurally Generated Worlds Joshua Albrecht Abraham J. Fetterman Bryden Fogelman Ellie Kitanidis Bartosz Wróblewski ... Michael Rosenthal Maksis Knutins Zachary Polizzi James B. Simon Kanjun Qiu OffRL 19 23 0 24 Oct 2022
DaXBench: Benchmarking Deformable Object Manipulation with Differentiable Physics Siwei Chen Yiqing Xu Cunjun Yu Linfeng Li Xiao Ma Zhongwen Xu David Hsu AI4CE 20 16 0 24 Oct 2022
RCareWorld: A Human-centric Simulation World for Caregiving Robots Ruolin Ye Wenqiang Xu Haoyuan Fu Rajat Kumar Jenamani V. Nguyen Cewu Lu Katherine Dimitropoulou T. Bhattacharjee LM&Ro 22 39 0 19 Oct 2022
Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation Peihao Chen Dongyu Ji Kun-Li Channing Lin Runhao Zeng Thomas H. Li Mingkui Tan Chuang Gan SSL 31 62 0 14 Oct 2022
Learning Active Camera for Multi-Object Navigation Peihao Chen Dongyu Ji Kun-Li Channing Lin Weiwen Hu Wenbing Huang Thomas H. Li Ming Tan Chuang Gan 30 24 0 14 Oct 2022
Learning Physical Dynamics with Subequivariant Graph Neural Networks Jiaqi Han Wenbing Huang Hengbo Ma Jiachen Li J. Tenenbaum Chuang Gan AI4CE PINN 35 43 0 13 Oct 2022
Retrospectives on the Embodied AI Workshop Matt Deitke Dhruv Batra Yonatan Bisk Tommaso Campari Angel X. Chang ... Jesse Thomason Alexander Toshev Joanne Truong Luca Weihs Jiajun Wu LM&Ro 37 51 0 13 Oct 2022
Exploration via Elliptical Episodic Bonuses Mikael Henaff Roberta Raileanu Minqi Jiang Tim Rocktaschel OffRL 29 39 0 11 Oct 2022
VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement Erik Wijmans Irfan Essa Dhruv Batra OffRL 31 13 0 11 Oct 2022
Impact Makes a Sound and Sound Makes an Impact: Sound Guides Representations and Explorations Xufeng Zhao C. Weber Muhammad Burhan Hafez S. Wermter 18 8 0 04 Aug 2022
Time to augment self-supervised visual representation learning A. Aubret M. Ernst Céline Teulière Jochen Triesch 28 10 0 27 Jul 2022
Rethinking Sim2Real: Lower Fidelity Simulation Leads to Higher Sim2Real Transfer in Navigation Joanne Truong M. Rudolph Naoki Yokoyama Sonia Chernova Dhruv Batra Akshara Rai 29 40 0 21 Jul 2022
TIDEE: Tidying Up Novel Rooms using Visuo-Semantic Commonsense Priors Gabriel H. Sarch Zhaoyuan Fang Adam W. Harley Paul Schydlo Michael J. Tarr Saurabh Gupta Katerina Fragkiadaki LM&Ro 21 44 0 21 Jul 2022
Fine-grained Activities of People Worldwide J. Byrne Greg Castañón Zhongheng Li G. Ettinger 16 3 0 11 Jul 2022
TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphs Christopher Agia Krishna Murthy Jatavallabhula M. Khodeir O. Mikšík Vibhav Vineet Mustafa Mukadam Liam Paull Florian Shkurti 22 67 0 11 Jul 2022
Finding Fallen Objects Via Asynchronous Audio-Visual Integration Chuang Gan Yi Gu Siyuan Zhou Jeremy Schwartz S. Alter James Traer Dan Gutfreund J. Tenenbaum Josh H. McDermott Antonio Torralba 42 19 0 07 Jul 2022
Improving Policy Optimization with Generalist-Specialist Learning Zhiwei Jia Xuanlin Li Z. Ling Shuang Liu Yiran Wu H. Su OffRL 24 24 0 26 Jun 2022
Do Trajectories Encode Verb Meaning? Dylan Ebert Chen Sun Ellie Pavlick 16 2 0 23 Jun 2022
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning Changan Chen Carl Schissler Sanchit Garg Philip Kobernik Alexander William Clegg P. Calamia Dhruv Batra Philip Robinson Kristen Grauman 3DGS 31 79 0 16 Jun 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 33 235 0 14 Jun 2022
BEHAVIOR in Habitat 2.0: Simulator-Independent Logical Task Description for Benchmarking Embodied AI Agents Ziang Liu Roberto Martín-Martín F. Xia Jiajun Wu Li Fei-Fei LM&Ro 10 0 0 13 Jun 2022
ABCDE: An Agent-Based Cognitive Development Environment Jieyi Ye Jiafei Duan Samson Yu B. Wen Cheston Tan 13 1 0 10 Jun 2022
FishGym: A High-Performance Physics-based Simulation Framework for Underwater Robot Learning Wenji Liu Kai-Yi Bai Xuming He Shuran Song Changxi Zheng Xiaopei Liu AI4CE 27 12 0 03 Jun 2022
Understanding Natural Language in Context Avichai Levy E. Karpas LM&Ro 28 1 0 25 May 2022