OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigation

20 September 2024

Siddarth Narasimhan

Aaron Hao Tan

Daniel Choi

G. Nejat

LM&Ro

ArXiv PDF HTML

Papers citing "OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigation"

35 / 35 papers shown

Title
AutoSpatial: Visual-Language Reasoning for Social Robot Navigation through Efficient Spatial Reasoning Learning Yangzhe Kong Daeun Song Jing Liang Dinesh Manocha Ziyu Yao Xuesu Xiao LRM 112 1 0 10 Mar 2025
Cleaning Robots in Public Spaces: A Survey and Proposal for Benchmarking Based on Stakeholders Interviews Raphael Memmesheimer Martina Overbeck Bjoern Kral Lea Steffen Sven Behnke Martin Gersch A. Roennau 134 1 0 23 Jul 2024
Online Context Learning for Socially Compliant Navigation Iaroslav Okunevich Alexandre Lombard T. Krajník Yassine Ruichek Zhi Yan 100 1 0 17 Jun 2024
DeTra: A Unified Model for Object Detection and Trajectory Forecasting Sergio Casas Ben Agro Jiageng Mao Thomas Gilles Alexander Cui Thomas Li R. Urtasun 74 5 0 06 Jun 2024
CLIP model is an Efficient Online Lifelong Learner Leyuan Wang Liuyu Xiang Yujie Wei Yunlong Wang Zhaofeng He VLM CLL 65 3 0 24 May 2024
Long-CLIP: Unlocking the Long-Text Capability of CLIP Beichen Zhang Pan Zhang Xiao-wen Dong Yuhang Zang Jiaqi Wang CLIP VLM 76 132 0 22 Mar 2024
SELFI: Autonomous Self-Improvement with Reinforcement Learning for Social Navigation Noriaki Hirose Dhruv Shah Kyle Stachowicz A. Sridhar Sergey Levine 110 5 0 01 Mar 2024
Vision-Language Models Provide Promptable Representations for Reinforcement Learning William Chen Oier Mees Aviral Kumar Sergey Levine VLM LM&Ro 76 25 0 05 Feb 2024
Attention Graph for Multi-Robot Social Navigation with Deep Reinforcement Learning Erwan Escudie L. Matignon Jacques Saraydaryan 72 5 0 31 Jan 2024
A Survey on Socially Aware Robot Navigation: Taxonomy and Future Challenges P. Singamaneni P. Bachiller-Burgos Luis J. Manso A. Garrell Alberto Sanfeliu A. Spalanzani Rachid Alami 63 46 0 12 Nov 2023
Rethinking Social Robot Navigation: Leveraging the Best of Two Worlds Amir Hossain Raj Zichao Hu Haresh Karnan Rohan Chandra Amirreza Payandeh L. Mao Peter Stone Joydeep Biswas Xuesu Xiao 52 16 0 23 Sep 2023
A Study on Learning Social Robot Navigation with Multimodal Perception Bhabaranjan Panigrahi Amir Hossain Raj Mohammad Nazeri Xuesu Xiao 56 5 0 22 Sep 2023
Principles and Guidelines for Evaluating Social Robot Navigation Algorithms Anthony G. Francis Claudia Pérez-DÁrpino Chengshu Li Fei Xia Alexandre Alahi ... Xuesu Xiao Peng Xu Naoki Yokoyama Alexander Toshev Roberto Martin-Martin Logical Robotics 72 72 0 29 Jun 2023
Understanding Social Reasoning in Language Models with Language Models Kanishk Gandhi Jan-Philipp Fränken Tobias Gerstenberg Noah D. Goodman LRM 67 124 0 21 Jun 2023
SACSoN: Scalable Autonomous Control for Social Navigation Noriaki Hirose Dhruv Shah A. Sridhar Sergey Levine 63 30 0 02 Jun 2023
NaviSTAR: Socially Aware Robot Navigation with Hybrid Spatio-Temporal Graph Transformer and Preference Learning Weizheng Wang Ruiqi Wang Le Mao Byung-Cheol Min 54 14 0 12 Apr 2023
Toward Human-Like Social Robot Navigation: A Large-Scale, Multi-Modal, Social Human Navigation Dataset Duc M. Nguyen Mohammad Nazeri Amirreza Payandeh A. Datar Xuesu Xiao 97 30 0 27 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.4K 14,359 0 15 Mar 2023
The Magni Human Motion Dataset: Accurate, Complex, Multi-Modal, Natural, Semantically-Rich and Contextualized Tim Schreiter Tiago Rodrigues de Almeida Yufei Zhu Eduardo Gutiérrez-Maestro L. Morillo-Méndez ... Óscar Martínez Mozos Martin Magnusson Luigi Palmieri Kai O. Arras A. Lilienthal 60 17 0 31 Aug 2022
Diverse Multiple Trajectory Prediction Using a Two-stage Prediction Network Trained with Lane Loss Sanmin Kim Hyeongseok Jeon Junwon Choi Dongsuk Kum 94 21 0 17 Jun 2022
Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation Haresh Karnan Anirudh Nair Xuesu Xiao Garrett A. Warnell S. Pirk Alexander Toshev Justin W. Hart Joydeep Biswas Peter Stone 72 117 0 28 Mar 2022
Metrics for Evaluating Social Conformity of Crowd Navigation Algorithms Junxian Wang Wesley P. Chan Pamela Carreno-Medrano Akansel Cosgun Elizabeth A. Croft 68 14 0 02 Feb 2022
Enhancing Navigational Safety in Crowded Environments using Semantic-Deep-Reinforcement-Learning-based Navigation Linh Kästner Junhui Li Zhengcheng Shen Jens Lambrecht 50 10 0 23 Sep 2021
CoMet: Modeling Group Cohesion for Socially Compliant Robot Navigation in Crowded Scenes A. Sathyamoorthy Utsav Patel Moumita Paul Nithish Kumar Yash Savle Tianyi Zhou 56 18 0 22 Aug 2021
Conflict Avoidance in Social Navigation -- a Survey Reuth Mirsky Xuesu Xiao Justin W. Hart Peter Stone 61 28 0 23 Jun 2021
Core Challenges of Social Robot Navigation: A Survey Christoforos Mavrogiannis Francesca Baldini Allan Wang Dapeng Zhao Pete Trautman Aaron Steinfeld Jean Oh 60 239 0 09 Mar 2021
The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Games Chao Yu Akash Velu Eugene Vinitsky Jiaxuan Gao Yu Wang Alexandre M. Bayen Yi Wu OffRL 134 1,252 0 02 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021
YOLOv3: An Incremental Improvement Joseph Redmon Ali Farhadi ObjD 120 21,447 0 08 Apr 2018
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection Yin Zhou Oncel Tuzel 3DPC 107 3,722 0 17 Nov 2017
Socially Compliant Navigation through Raw Depth Inputs with Generative Adversarial Imitation Learning L. Tai Jingwei Zhang Ming-Yuan Liu Wolfram Burgard GAN 62 178 0 06 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 330 8,130 0 13 Aug 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
A Tutorial on Principal Component Analysis Jonathon Shlens 84 2,495 0 03 Apr 2014