Shaping embodied agent behavior with activity-context priors from egocentric video

14 October 2021

Papers citing "Shaping embodied agent behavior with activity-context priors from egocentric video"

50 / 59 papers shown

Title
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 399 1,092 0 13 Oct 2021
Visual Room Rearrangement Luca Weihs Matt Deitke Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 62 139 0 30 Mar 2021
Reconstructing Hand-Object Interactions in the Wild Zhe Cao Ilija Radosavovic Angjoo Kanazawa Jitendra Malik 3DH 75 147 0 17 Dec 2020
A Comprehensive Study of Deep Video Action Recognition Yi Zhu Xinyu Li Chunhui Liu Mohammadreza Zolfaghari Yuanjun Xiong Chongruo Wu Zhi-Li Zhang Joseph Tighe R. Manmatha Mu Li VLM AI4TS 76 187 0 11 Dec 2020
Reinforcement Learning with Videos: Combining Offline Observations with Interaction Karl Schmeckpeper Oleh Rybkin Kostas Daniilidis Sergey Levine Chelsea Finn OffRL 72 106 0 12 Nov 2020
Rearrangement: A Challenge for Embodied AI Dhruv Batra Angel X. Chang Sonia Chernova Andrew J. Davison Jia Deng ... Jitendra Malik Igor Mordatch Roozbeh Mottaghi Manolis Savva Hao Su LM&Ro 97 219 0 03 Nov 2020
Learning Affordance Landscapes for Interaction Exploration in 3D Environments Tushar Nagarajan Kristen Grauman LM&Ro 50 73 0 21 Aug 2020
A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Tasks Unnat Jain Luca Weihs Eric Kolve Ali Farhadi Svetlana Lazebnik Aniruddha Kembhavi Alex Schwing 58 56 0 09 Jul 2020
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation Chuang Gan Jeremy Schwartz S. Alter Damian Mrowca Martin Schrimpf ... Antonio Torralba J. DiCarlo J. Tenenbaum Josh H. McDermott Daniel L. K. Yamins VGen 141 314 0 09 Jul 2020
Object Goal Navigation using Goal-Oriented Semantic Exploration Devendra Singh Chaplot Dhiraj Gandhi Abhinav Gupta Ruslan Salakhutdinov 94 516 0 01 Jul 2020
Semantic Visual Navigation by Watching YouTube Videos Matthew Chang Arjun Gupta Saurabh Gupta 40 81 0 17 Jun 2020
Learning About Objects by Learning to Interact with Them Martin Lohmann Jordi Salvador Aniruddha Kembhavi Roozbeh Mottaghi OCL 56 18 0 16 Jun 2020
Understanding Human Hands in Contact at Internet Scale Dandan Shan Jiaqi Geng Michelle Shu David Fouhey 96 324 0 11 Jun 2020
Learning to Explore using Active Neural SLAM Devendra Singh Chaplot Dhiraj Gandhi Saurabh Gupta Abhinav Gupta Ruslan Salakhutdinov 62 514 0 10 Apr 2020
EGO-TOPO: Environment Affordances from Egocentric Video Tushar Nagarajan Yanghao Li Christoph Feichtenhofer Kristen Grauman EgoV 121 123 0 14 Jan 2020
Learning to Move with Affordance Maps William Qi Ravi Teja Mullapudi Saurabh Gupta Deva Ramanan 49 35 0 08 Jan 2020
An Exploration of Embodied Visual Exploration Santhosh Kumar Ramakrishnan Dinesh Jayaraman Kristen Grauman LM&Ro 70 99 0 07 Jan 2020
Learning Predictive Models From Observation and Interaction Karl Schmeckpeper Annie Xie Oleh Rybkin Stephen Tian Kostas Daniilidis Sergey Levine Chelsea Finn DRL 74 60 0 30 Dec 2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks Mohit Shridhar Jesse Thomason Daniel Gordon Yonatan Bisk Winson Han Roozbeh Mottaghi Luke Zettlemoyer Dieter Fox LM&Ro 109 770 0 03 Dec 2019
DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames Erik Wijmans Abhishek Kadian Ari S. Morcos Stefan Lee Irfan Essa Devi Parikh Manolis Savva Dhruv Batra 85 478 0 01 Nov 2019
DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System Ankur Handa Karl Van Wyk Wei Yang Jacky Liang Yu-Wei Chao Qian Wan Stan Birchfield Nathan D. Ratliff Dieter Fox 68 205 0 07 Oct 2019
Self-Supervised Exploration via Disagreement Deepak Pathak Dhiraj Gandhi Abhinav Gupta SSL 81 382 0 10 Jun 2019
What Would You Expect? Anticipating Egocentric Actions with Rolling-Unrolling LSTMs and Modality Attention Antonino Furnari G. Farinella EgoV 115 174 0 22 May 2019
Two Body Problem: Collaborative Visual Task Completion Unnat Jain Luca Weihs Eric Kolve Mohammad Rastegari Svetlana Lazebnik Ali Farhadi Alex Schwing Aniruddha Kembhavi 56 70 0 11 Apr 2019
H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions Bugra Tekin Federica Bogo Marc Pollefeys EgoV 77 253 0 10 Apr 2019
Next-Active-Object prediction from Egocentric Videos Antonino Furnari Sebastiano Battiato Kristen Grauman G. Farinella EgoV 52 97 0 10 Apr 2019
Habitat: A Platform for Embodied AI Research Manolis Savva Abhishek Kadian Oleksandr Maksymets Yili Zhao Erik Wijmans ... Jia-Wei Liu V. Koltun Jitendra Malik Devi Parikh Dhruv Batra LM&Ro 115 1,407 0 02 Apr 2019
VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning Xiaofeng Gao Ran Gong Tianmin Shu Xu Xie Shu Wang Song-Chun Zhu 56 62 0 13 Mar 2019
Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks Kuan Fang Alexander Toshev Li Fei-Fei Silvio Savarese OffRL 121 202 0 09 Mar 2019
Learning Exploration Policies for Navigation Tao Chen Saurabh Gupta Abhinav Gupta EgoV 78 238 0 05 Mar 2019
Grounded Human-Object Interaction Hotspots from Video Tushar Nagarajan Christoph Feichtenhofer Kristen Grauman 73 159 0 11 Dec 2018
SlowFast Networks for Video Recognition Christoph Feichtenhofer Haoqi Fan Jitendra Malik Kaiming He 166 3,274 0 10 Dec 2018
Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation Pratyusha Sharma Lekha Mohan Lerrel Pinto Abhinav Gupta 51 121 0 16 Oct 2018
Visual Semantic Navigation using Scene Priors Wei Yang Xinyu Wang Ali Farhadi Abhinav Gupta Roozbeh Mottaghi LM&Ro 79 325 0 15 Oct 2018
Episodic Curiosity through Reachability Nikolay Savinov Anton Raichuk Raphaël Marinier Damien Vincent Marc Pollefeys Timothy Lillicrap Sylvain Gelly 56 269 0 04 Oct 2018
Learning and Planning with a Semantic Model Yi Wu Yuxin Wu Aviv Tamar Stuart J. Russell Georgia Gkioxari Yuandong Tian 44 17 0 28 Sep 2018
Large-Scale Study of Curiosity-Driven Learning Yuri Burda Harrison Edwards Deepak Pathak Amos Storkey Trevor Darrell Alexei A. Efros LRM 69 704 0 13 Aug 2018
Learning Actionable Representations from Visual Observations Debidatta Dwibedi Jonathan Tompson Corey Lynch P. Sermanet SSL 46 80 0 02 Aug 2018
VirtualHome: Simulating Household Activities via Programs Xavier Puig K. Ra Marko Boben Jiaman Li Tingwu Wang Sanja Fidler Antonio Torralba LM&Ro 93 492 0 19 Jun 2018
Playing hard exploration games by watching YouTube Y. Aytar Tobias Pfaff David Budden T. Paine Ziyun Wang Nando de Freitas 63 271 0 29 May 2018
Zero-Shot Visual Imitation Deepak Pathak Parsa Mahmoudieh Guanghao Luo Pulkit Agrawal Dian Chen Yide Shentu Evan Shelhamer Jitendra Malik Alexei A. Efros Trevor Darrell LM&Ro 114 300 0 23 Apr 2018
Scaling Egocentric Vision: The EPIC-KITCHENS Dataset Dima Damen Hazel Doughty G. Farinella Sanja Fidler Antonino Furnari ... Davide Moltisanti Jonathan Munro Toby Perrett Will Price Michael Wray EgoV 123 1,030 0 08 Apr 2018
Learning to Play with Intrinsically-Motivated Self-Aware Agents Nick Haber Damian Mrowca Li Fei-Fei Daniel L. K. Yamins LRM 63 120 0 21 Feb 2018
One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning Tianhe Yu Chelsea Finn Annie Xie Sudeep Dasari Tianhao Zhang Pieter Abbeel Sergey Levine 67 361 0 05 Feb 2018
AI2-THOR: An Interactive 3D Environment for Visual AI Eric Kolve Roozbeh Mottaghi Winson Han Eli VanderBilt Luca Weihs ... Daniel Gordon Yuke Zhu Aniruddha Kembhavi Abhinav Gupta Ali Farhadi LM&Ro 79 1,101 0 14 Dec 2017
IQA: Visual Question Answering in Interactive Environments Daniel Gordon Aniruddha Kembhavi Mohammad Rastegari Joseph Redmon Dieter Fox Ali Farhadi LM&Ro 91 390 0 09 Dec 2017
Embodied Question Answering Abhishek Das Samyak Datta Georgia Gkioxari Stefan Lee Devi Parikh Dhruv Batra LM&Ro 93 646 0 30 Nov 2017
Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation Tianhao Zhang Zoe McCarthy Owen Jow Dennis Lee Xi Chen Ken Goldberg Pieter Abbeel SSL 91 658 0 12 Oct 2017
Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations Aravind Rajeswaran Vikash Kumar Abhishek Gupta Giulia Vezzani John Schulman E. Todorov Sergey Levine 139 1,100 0 28 Sep 2017
Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation YuXuan Liu Abhishek Gupta Pieter Abbeel Sergey Levine 111 380 0 11 Jul 2017