"No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy

6 January 2023

Yuchen Cui

Dorsa Sadigh

Papers citing ""No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy"

50 / 54 papers shown

Title
Guiding Data Collection via Factored Scaling Curves Lihan Zha Apurva Badithela Michael Zhang Justin Lidard Jeremy Bao Emily Zhou David Snyder Allen Z. Ren Dhruv Shah Anirudha Majumdar OffRL 34 0 0 12 May 2025
Shared Autonomy for Proximal Teaching Megha Srivastava Reihaneh Iranmanesh Yuchen Cui Deepak Gopinath Emily S. Sumner Andrew Silva Laporsha Dees Guy Rosman Dorsa Sadigh 73 1 0 27 Feb 2025
Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review Di Wu Xian Wei Guang Chen Hao Shen Xiangfeng Wang Wenhao Li Bo Jin 65 2 0 17 Feb 2025
Temporal Representation Alignment: Successor Features Enable Emergent Compositionality in Robot Instruction Following Vivek Myers Bill Chunyuan Zheng Anca Dragan Kuan Fang Sergey Levine 65 0 0 08 Feb 2025
Giving Sense to Inputs: Toward an Accessible Control Framework for Shared Autonomy Shalutha Rajapakshe J. Odobez Emmanuel Senft 53 1 0 28 Jan 2025
Toward Zero-Shot User Intent Recognition in Shared Autonomy Atharv Belsare Zohre Karimi Connor Mattson Daniel S. Brown LM&Ro 46 0 0 14 Jan 2025
Vocal Sandbox: Continual Learning and Adaptation for Situated Human-Robot Collaboration J. Grannen Siddharth Karamcheti Suvir Mirchandani Percy Liang Dorsa Sadigh 39 0 0 04 Nov 2024
Robot Behavior Personalization from Sparse User Feedback Maithili Patel Sonia Chernova 36 2 0 25 Oct 2024
Skill Generalization with Verbs Rachel Ma Lyndon Lam Benjamin A. Spiegel Aditya Ganeshan Roma Patel Ben Abbatematteo D. Paulius Stefanie Tellex George Konidaris LM&Ro 68 2 0 18 Oct 2024
Trajectory Improvement and Reward Learning from Comparative Language Feedback Zhaojing Yang Miru Jun J. Tien Stuart J. Russell Anca Dragan Erdem Bıyık 34 6 0 08 Oct 2024
Incremental Learning for Robot Shared Autonomy Yiran Tao Guixiu Qiao Dan Ding Zackory Erickson CLL 35 0 0 08 Oct 2024
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress Christopher Agia Rohan Sinha Jingyun Yang Zi-ang Cao Rika Antonova Marco Pavone Jeannette Bohg 28 7 0 06 Oct 2024
RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learning Yinpei Dai Jayjun Lee Nima Fazeli Joyce Chai 41 10 0 23 Sep 2024
P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task Weiye Xu Min Wang Wengang Zhou Houqiang Li LM&Ro 29 3 0 17 Sep 2024
Words2Contact: Identifying Support Contacts from Verbal Instructions Using Foundation Models Dionis Totsila Quentin Rouxel Jean-Baptiste Mouret S. Ivaldi 38 1 0 19 Jul 2024
Safe MPC Alignment with Human Directional Feedback Zhixian Xie Wenlong Zhang Yi Ren Zhaoran Wang George J. Pappas Wanxin Jin 49 0 0 05 Jul 2024
Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models Georgios Tziafas H. Kasaei KELM LM&Ro 47 8 0 26 Jun 2024
LLM Granularity for On-the-Fly Robot Control Peng Wang Mattia Robbiani Zhihao Guo LM&Ro 36 1 0 20 Jun 2024
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought Gabriel H. Sarch Lawrence Jang Michael J. Tarr William W. Cohen Kenneth Marino Katerina Fragkiadaki LLMAG 50 8 0 20 Jun 2024
Enabling robots to follow abstract instructions and complete complex dynamic tasks Ruaridh Mon-Williams Gen Li Ran Long Wenqian Du Chris Lucas LM&Ro 45 3 0 17 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 65 12 0 06 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences Yidong Huang Jacob Sansom Ziqiao Ma Felix Gervits Joyce Chai 44 17 0 05 Jun 2024
TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction Yunfan Jiang Chen Wang Ruohan Zhang Jiajun Wu Fei-Fei Li OnRL 37 26 0 16 May 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Gang Hua Bin Fang AI4CE LM&Ro 72 13 0 28 Apr 2024
GeoSACS: Geometric Shared Autonomy via Canal Surfaces Shalutha Rajapakshe Atharva Dastenavar Michael Hagenow J. Odobez Emmanuel Senft 25 2 0 15 Apr 2024
Aligning Learning with Communication in Shared Autonomy Joshua Hoegerman Shahabedin Sagheb Benjamin A. Christie Dylan P. Losey 33 0 0 18 Mar 2024
RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches Priya Sundaresan Q. Vuong Jiayuan Gu Peng-Tao Xu Ted Xiao ... Ajinkya Jain Karol Hausman Dorsa Sadigh Jeannette Bohg S. Schaal VGen 34 25 0 05 Mar 2024
RT-H: Action Hierarchies Using Language Suneel Belkhale Tianli Ding Ted Xiao P. Sermanet Quon Vuong Jonathan Tompson Yevgen Chebotar Debidatta Dwibedi Dorsa Sadigh LM&Ro 36 76 0 04 Mar 2024
Learning to Learn Faster from Human Feedback with Language Model Predictive Control Jacky Liang Fei Xia Wenhao Yu Andy Zeng Montse Gonzalez Arenas ... N. Heess Kanishka Rao Nik Stewart Jie Tan Carolina Parada LM&Ro 61 34 0 18 Feb 2024
"Task Success" is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors L. Guan Yifan Zhou Denis Liu Yantian Zha H. B. Amor Subbarao Kambhampati LM&Ro 39 16 0 06 Feb 2024
AED: Adaptable Error Detection for Few-shot Imitation Policy Jia-Fong Yeh Kuo-Han Hung Pang-Chi Lo Chi-Ming Chung Tsung-Han Wu Hung-Ting Su Yi-Ting Chen Winston H. Hsu 32 1 0 06 Feb 2024
Fast Explicit-Input Assistance for Teleoperation in Clutter Nick Walker Xuning Yang Animesh Garg Maya Cakmak Dieter Fox Claudia Pérez-DÁrpino 16 0 0 04 Feb 2024
Appropriateness of LLM-equipped Robotic Well-being Coach Language in the Workplace: A Qualitative Evaluation Micol Spitale Minja Axelsson Hatice Gunes 24 10 0 26 Jan 2024
Generative Expressive Robot Behaviors using Large Language Models Karthik Mahadevan Jonathan M. Chien Noah Brown Zhuo Xu Carolina Parada Fei Xia Andy Zeng Leila Takayama Dorsa Sadigh LM&Ro 34 37 0 26 Jan 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu ... Lin Zhao Bao Ge Xiang Li Tianming Liu Shu Zhang LM&Ro 37 61 0 09 Jan 2024
Language-Conditioned Robotic Manipulation with Fast and Slow Thinking Minjie Zhu Yichen Zhu Jinming Li Junjie Wen Zhiyuan Xu ... Chaomin Shen Yaxin Peng Dong Liu Feifei Feng Jian Tang LM&Ro 32 15 0 08 Jan 2024
ExTraCT -- Explainable Trajectory Corrections from language inputs using Textual description of features J-Anne Yow N. P. Garg Manoj Ramanathan Wei Tech Ang 26 5 0 08 Jan 2024
Object-Centric Instruction Augmentation for Robotic Manipulation Junjie Wen Yichen Zhu Minjie Zhu Jinming Li Zhiyuan Xu ... Chaomin Shen Yaxin Peng Dong Liu Feifei Feng Jian Tang LM&Ro 69 16 0 05 Jan 2024
Interactive Planning Using Large Language Models for Partially Observable Robotics Tasks Lingfeng Sun Devesh K. Jha Chiori Hori Siddarth Jain Radu Corcodel Xinghao Zhu Masayoshi Tomizuka Diego Romeres LM&Ro LLMAG 22 20 0 11 Dec 2023
LLF-Bench: Benchmark for Interactive Learning from Language Feedback Ching-An Cheng Andrey Kolobov Dipendra Kumar Misra Allen Nie Adith Swaminathan 29 19 0 11 Dec 2023
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections Lihan Zha Yuchen Cui Li-Heng Lin Minae Kwon Montse Gonzalez Arenas Andy Zeng Fei Xia Dorsa Sadigh 35 36 0 17 Nov 2023
Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework Weiqin Zu Wenbin Song Ruiqing Chen Ze Guo Fanglei Sun Zheng Tian Wei Pan Jun Wang 17 13 0 14 Nov 2023
Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation Yinpei Dai Run Peng Sikai Li Joyce Chai LM&Ro 40 24 0 12 Oct 2023
LAN-grasp: Using Large Language Models for Semantic Object Grasping Reihaneh Mirjalili Michael Krawez Simone Silenzi Yannik Blei Wolfram Burgard VLM 62 27 0 08 Oct 2023
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang Chen Wang Ruohan Zhang Yunzhu Li Jiajun Wu Li Fei-Fei LM&Ro 33 480 0 12 Jul 2023
RoCo: Dialectic Multi-Robot Collaboration with Large Language Models Zhao Mandi Shreeya Jain Shuran Song LM&Ro LLMAG 31 125 0 10 Jul 2023
Language to Rewards for Robotic Skill Synthesis Wenhao Yu Nimrod Gileadi Chuyuan Fu Sean Kirmani Kuang-Huei Lee ... N. Heess Dorsa Sadigh Jie Tan Yuval Tassa F. Xia LM&Ro 39 269 0 14 Jun 2023
Generating Language Corrections for Teaching Physical Control Tasks Megha Srivastava Noah D. Goodman Dorsa Sadigh 26 5 0 12 Jun 2023
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model Siyuan Huang Zhengkai Jiang Hao Dong Yu Qiao Peng Gao Hongsheng Li LM&Ro 22 93 0 18 May 2023
Chat with the Environment: Interactive Multimodal Perception Using Large Language Models Xufeng Zhao Mengdi Li C. Weber Muhammad Burhan Hafez S. Wermter LLMAG LM&Ro LRM 104 47 0 14 Mar 2023