ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation

30 January 2023

Lise Getoor

Papers citing "ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation"

37 / 87 papers shown

Title
Explore until Confident: Efficient Exploration for Embodied Question Answering Allen Z. Ren Jaden Clark Anushri Dixit Masha Itkina Anirudha Majumdar Dorsa Sadigh 40 28 0 23 Mar 2024
TriHelper: Zero-Shot Object Navigation with Dynamic Assistance Lingfeng Zhang Qiang Zhang Hao Wang Erjia Xiao Zixuan Jiang Honglei Chen Renjing Xu 27 8 0 22 Mar 2024
Leveraging Large Language Model-based Room-Object Relationships Knowledge for Enhancing Multimodal-Input Object Goal Navigation Leyuan Sun Asako Kanezaki Guillaume Caron Yusuke Yoshiyasu LM&Ro 21 2 0 21 Mar 2024
Embedding Pose Graph, Enabling 3D Foundation Model Capabilities with a Compact Representation Hugues Thomas Jian Zhang 38 1 0 20 Mar 2024
Prioritized Semantic Learning for Zero-shot Instance Navigation Xander Sun Louis Lau Hoyard Zhi Ronghe Qiu Junwei Liang 32 8 0 18 Mar 2024
Can LLMs Generate Human-Like Wayfinding Instructions? Towards Platform-Agnostic Embodied Instruction Synthesis Vishnu Sashank Dorbala Sanjoy Chowdhury Dinesh Manocha LM&Ro 35 0 0 18 Mar 2024
Advancing Object Goal Navigation Through LLM-enhanced Object Affinities Transfer Mengying Lin Yaran Chen Dong Zhao Zhaoran Wang 36 2 0 15 Mar 2024
Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulation Daniel Honerkamp Martin Buchner Fabien Despinoy Tim Welschehold Abhinav Valada LM&Ro 32 28 0 13 Mar 2024
RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesis Yao Mu Junting Chen Qinglong Zhang Shoufa Chen Qiaojun Yu ... Wenhai Wang Jifeng Dai Yu Qiao Mingyu Ding Ping Luo 40 21 0 25 Feb 2024
NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation Jiazhao Zhang Kunyu Wang Rongtao Xu Gengze Zhou Yicong Hong Xiaomeng Fang Qi Wu Zhizheng Zhang Wang He LM&Ro 34 45 0 24 Feb 2024
RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation Hanxiao Jiang Binghao Huang Ruihai Wu Zhuoran Li Shubham Garg H. Nayyeri Shenlong Wang Yunzhu Li 36 17 0 23 Feb 2024
OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models Yuxuan Kuang Hai Lin Meng Jiang LM&Ro 31 26 0 16 Feb 2024
The Conversation is the Command: Interacting with Real-World Autonomous Robot Through Natural Language Linus Nwankwo Elmar Rueckert LM&Ro 16 7 0 22 Jan 2024
CLIP feature-based randomized control using images and text for multiple tasks and robots Kazuki Shibata Hideki Deguchi Shun Taguchi 21 1 0 18 Jan 2024
VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Model Pengying Wu Yao Mu Bingxian Wu Yi Hou Ji Ma Shanghang Zhang Chang-rui Liu LM&Ro 27 24 0 05 Jan 2024
ThinkBot: Embodied Instruction Following with Thought Chain Reasoning Guanxing Lu Ziwei Wang Changliu Liu Jiwen Lu Yansong Tang LRM 25 8 0 12 Dec 2023
"What's important here?": Opportunities and Challenges of Using LLMs in Retrieving Information from Web Interfaces Faria Huq Jeffrey P. Bigham Nikolas Martelaro 25 7 0 11 Dec 2023
VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation Naoki Yokoyama Sehoon Ha Dhruv Batra Jiuguang Wang Bernadette Bucher LM&Ro 21 77 0 06 Dec 2023
Advances in Embodied Navigation Using Large Language Models: A Survey Jinzhou Lin Han Gao Xuxiang Feng Rongtao Xu Changwei Wang Man Zhang Li Guo Shibiao Xu LM&Ro LLMAG 66 9 0 01 Nov 2023
Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation Yinpei Dai Run Peng Sikai Li Joyce Chai LM&Ro 32 24 0 12 Oct 2023
LangNav: Language as a Perceptual Representation for Navigation Bowen Pan Rameswar Panda SouYoung Jin Rogerio Feris Aude Oliva Phillip Isola Yoon Kim LM&Ro 28 18 0 11 Oct 2023
Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill Wenzhe Cai Siyuan Huang Guangran Cheng Yuxing Long Peng Gao Changyin Sun Hao Dong LM&Ro 23 41 0 19 Sep 2023
Reasoning about the Unseen for Efficient Outdoor Object Navigation Quanting Xie Tianyi Zhang Kedi Xu Matthew Johnson-Roberson Yonatan Bisk LRM 53 11 0 18 Sep 2023
Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation F. Schmalstieg Daniel Honerkamp Tim Welschehold Abhinav Valada 21 14 0 12 Jul 2023
VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View Raphael Schumann Wanrong Zhu Weixi Feng Tsu-jui Fu Stefan Riezler William Yang Wang LM&Ro 29 63 0 12 Jul 2023
CorNav: Autonomous Agent with Self-Corrected Planning for Zero-Shot Vision-and-Language Navigation Xiwen Liang Liang Ma Shanshan Guo Jianhua Han Hang Xu Shikui Ma Xiaodan Liang LM&Ro LLMAG 83 4 0 17 Jun 2023
NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models Gengze Zhou Yicong Hong Qi Wu ELM LM&Ro LLMAG LRM 23 141 0 26 May 2023
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models Chan Hee Song Jiaman Wu Clay Washington Brian M. Sadler Wei-Lun Chao Yu-Chuan Su LLMAG LM&Ro 22 383 0 08 Dec 2022
Open-vocabulary Queryable Scene Representations for Real World Planning Boyuan Chen F. Xia Brian Ichter Kanishka Rao K. Gopalakrishnan Michael S. Ryoo Austin Stone Daniel Kappler LM&Ro 146 181 0 20 Sep 2022
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action Dhruv Shah B. Osinski Brian Ichter Sergey Levine LM&Ro 150 436 0 10 Jul 2022
ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddings Arjun Majumdar Gunjan Aggarwal Bhavika Devnani Judy Hoffman Dhruv Batra LM&Ro 147 149 0 24 Jun 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 310 4,077 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,915 0 04 Mar 2022
FILM: Following Instructions in Language with Modular Methods So Yeon Min Devendra Singh Chaplot Pradeep Ravikumar Yonatan Bisk Ruslan Salakhutdinov LM&Ro 214 159 0 12 Oct 2021
Skill Induction and Planning with Latent Language Pratyusha Sharma Antonio Torralba Jacob Andreas LM&Ro 199 108 0 04 Oct 2021
How Much Can CLIP Benefit Vision-and-Language Tasks? Sheng Shen Liunian Harold Li Hao Tan Mohit Bansal Anna Rohrbach Kai-Wei Chang Z. Yao Kurt Keutzer CLIP VLM MLLM 196 405 0 13 Jul 2021
A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Execution Valts Blukis Chris Paxton D. Fox Animesh Garg Yoav Artzi LM&Ro 212 133 0 12 Jul 2021