CLIPort: What and Where Pathways for Robotic Manipulation

24 September 2021

Papers citing "CLIPort: What and Where Pathways for Robotic Manipulation"

50 / 477 papers shown

Title
Visually Grounded Continual Language Learning with Selective Specialization Kyra Ahrens Lennart Bengtson Jae Hee Lee Stefan Wermter 29 0 0 24 Oct 2023
Learning Generalizable Manipulation Policies with Object-Centric 3D Representations Yifeng Zhu Zhenyu Jiang Peter Stone Yuke Zhu 3DPC 24 43 0 22 Oct 2023
Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning Juan Rocamonde Victoriano Montesinos Elvis Nava Ethan Perez David Lindner VLM 33 76 0 19 Oct 2023
InViG: Benchmarking Interactive Visual Grounding with 500K Human-Robot Interactions Hanbo Zhang Jie Xu Yuchen Mo Tao Kong 22 1 0 18 Oct 2023
LoHoRavens: A Long-Horizon Language-Conditioned Benchmark for Robotic Tabletop Manipulation Shengqiang Zhang Philipp Wicke Lutfi Kerem Senel Luis F. C. Figueredo Abdeldjallil Naceri Sami Haddadin Barbara Plank Hinrich Schütze LM&Ro 29 10 0 18 Oct 2023
Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models Kevin Black Mitsuhiko Nakamoto P. Atreya Homer Walke Chelsea Finn Aviral Kumar Sergey Levine DiffM LM&Ro 35 132 0 16 Oct 2023
Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planning Dhruv Shah Michael Equi B. Osinski Fei Xia Brian Ichter Sergey Levine 3DV LM&Ro 16 91 0 16 Oct 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 44 464 0 13 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models Zuxin Liu Jesse Zhang Kavosh Asadi Yao Liu Ding Zhao Shoham Sabach Rasool Fakoor ALM AI4CE 23 25 0 09 Oct 2023
OV-PARTS: Towards Open-Vocabulary Part Segmentation Meng Wei Xiaoyu Yue Wenwei Zhang Shu Kong Xihui Liu Jiangmiao Pang VLM 26 24 0 08 Oct 2023
Bridging Low-level Geometry to High-level Concepts in Visual Servoing of Robot Manipulation Task Using Event Knowledge Graphs and Vision-Language Models Chen Jiang Martin Jägersand 37 1 0 05 Oct 2023
Human-oriented Representation Learning for Robotic Manipulation Mingxiao Huo Mingyu Ding Chenfeng Xu Thomas Tian Xinghao Zhu Yao Mu Lingfeng Sun Masayoshi Tomizuka Wei Zhan SSL 50 12 0 04 Oct 2023
How Physics and Background Attributes Impact Video Transformers in Robotic Manipulation: A Case Study on Planar Pushing Shutong Jin Ruiyu Wang Muhammad Zahid Florian T. Pokorny 32 1 0 03 Oct 2023
GenSim: Generating Robotic Simulation Tasks via Large Language Models Lirui Wang Yiyang Ling Zhecheng Yuan Mohit Shridhar Chen Bao Yuzhe Qin Bailin Wang Huazhe Xu Xiaolong Wang LM&Ro 27 76 0 02 Oct 2023
GRID: A Platform for General Robot Intelligence Development Sai H. Vemprala Shuhang Chen Abhinav Shukla Dinesh Narayanan Ashish Kapoor 25 10 0 02 Oct 2023
ConSOR: A Context-Aware Semantic Object Rearrangement Framework for Partially Arranged Scenes Kartik Ramachandruni Max Zuo Sonia Chernova 31 6 0 30 Sep 2023
ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning Yuanyi Zhong Alihusein Kuwajerwala Sacha Morin Krishna Murthy Jatavallabhula Bipasha Sen ... Celso Miguel de Melo Joshua B. Tenenbaum Antonio Torralba Florian Shkurti Liam Paull LM&Ro 36 166 0 28 Sep 2023
LGMCTS: Language-Guided Monte-Carlo Tree Search for Executable Semantic Object Rearrangement Haonan Chang D. K. Bukovšek T. Kosir Alex Lee Blaz Mojskerc Harish Udhaya Kumar M. Omladič Abdeslam Boularias LM&Ro 26 11 0 27 Sep 2023
PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulation Shizhe Chen Ricardo Garcia Pinel Cordelia Schmid Ivan Laptev LM&Ro 3DPC 27 34 0 27 Sep 2023
Lifelong Robot Learning with Human Assisted Language Planners Meenal Parakh Alisha Fong Anthony Simeonov Tao Chen Abhishek Gupta Pulkit Agrawal LM&Ro 39 14 0 25 Sep 2023
ForceSight: Text-Guided Mobile Manipulation with Visual-Force Goals Jeremy Collins C. Houff You Liang Tan Charles C. Kemp 8 4 0 21 Sep 2023
SG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphs Guangyao Zhai Xiaoni Cai Dianye Huang Yan Di Fabian Manhardt Federico Tombari Nassir Navab Benjamin Busam LM&Ro 24 27 0 21 Sep 2023
Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning Jingkai Sun Qiang Zhang Yiqun Duan Xiaoyang Jiang Chong Cheng Renjing Xu LM&Ro 53 23 0 20 Sep 2023
Guide Your Agent with Adaptive Multimodal Rewards Changyeon Kim Younggyo Seo Hao Liu Lisa Lee Jinwoo Shin Honglak Lee Kimin Lee 23 9 0 19 Sep 2023
Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions Yevgen Chebotar Q. Vuong A. Irpan Karol Hausman F. Xia ... Brianna Zitkovich Tomas Jackson Kanishka Rao Chelsea Finn Sergey Levine OffRL 129 81 0 18 Sep 2023
Contrastive Learning for Enhancing Robust Scene Transfer in Vision-based Agile Flight Jiaxu Xing L. Bauersfeld Yunlong Song Chunwei Xing Davide Scaramuzza 20 12 0 18 Sep 2023
CLIPUNetr: Assisting Human-robot Interface for Uncalibrated Visual Servoing Control with CLIP-driven Referring Expression Segmentation Chen Jiang Yuchen Yang Martin Jägersand 29 1 0 17 Sep 2023
Triple Regression for Camera Agnostic Sim2Real Robot Grasping and Manipulation Tasks Yuanhong Zeng Yizhou Zhao Ying Nian Wu 38 0 0 16 Sep 2023
Compositional Foundation Models for Hierarchical Planning Anurag Ajay Seung-Jun Han Yilun Du Shaung Li Abhi Gupta Tommi Jaakkola Josh Tenenbaum L. Kaelbling Akash Srivastava Pulkit Agrawal LRM 27 65 0 15 Sep 2023
Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping Adam Rashid Satvik Sharma C. Kim J. Kerr L. Chen Angjoo Kanazawa Ken Goldberg 62 85 0 14 Sep 2023
GRID: Scene-Graph-based Instruction-driven Robotic Task Planning Zhe Ni Xiao-Xin Deng Cong Tai Xin-Yue Zhu Qinghongbing Xie Yong-Jin Liu Xiang Wu Long Zeng LM&Ro 32 14 0 14 Sep 2023
A Reinforcement Learning Approach for Robotic Unloading from Visual Observations Vittorio Giammarino A. Giammarino Matthew Pearce OffRL SSL 25 2 0 12 Sep 2023
Learning Sequential Acquisition Policies for Robot-Assisted Feeding Priya Sundaresan Jiajun Wu Dorsa Sadigh LM&Ro 18 10 0 11 Sep 2023
RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking Homanga Bharadhwaj Jay Vakil Mohit Sharma Abhi Gupta Shubham Tulsiani Vikash Kumar LM&Ro 21 116 0 05 Sep 2023
Compositional Diffusion-Based Continuous Constraint Solvers Zhutian Yang Jiayuan Mao Yilun Du Jiajun Wu J. Tenenbaum Tomás Lozano-Pérez L. Kaelbling DiffM 78 32 0 02 Sep 2023
Developmental Scaffolding with Large Language Models Batuhan Celik Alper Ahmetoglu Emre Ugur Erhan Öztop LM&Ro LLMAG 33 3 0 02 Sep 2023
Language-Conditioned Path Planning Amber Xie Youngwoon Lee Pieter Abbeel Stephen James LM&Ro 33 14 0 31 Aug 2023
GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields Yanjie Ze Ge Yan Yueh-hua Wu Annabella Macaluso Yuying Ge Jianglong Ye Nicklas Hansen Li Erran Li Xinyu Wang DiffM AI4CE 19 80 0 31 Aug 2023
RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitation Mel Vecerík Carl Doersch Yi Yang Todor Davchev Y. Aytar Guangyao Zhou R. Hadsell Lourdes Agapito Jonathan Scholz 56 47 0 30 Aug 2023
WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Model Tianyu Wang Yifan Li Haitao Lin Xiangyang Xue Yanwei Fu LM&Ro 27 8 0 30 Aug 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 41 86 0 21 Aug 2023
Skill Transformer: A Monolithic Policy for Mobile Manipulation Xiaoyu Huang Dhruv Batra Akshara Rai Andrew Szot LM&Ro 38 21 0 19 Aug 2023
Leveraging Symmetries in Pick and Place Hao-zhe Huang Dian Wang Arsh Tangri Robin G. Walters Robert W. Platt 35 14 0 15 Aug 2023
LEMMA: Learning Language-Conditioned Multi-Robot Manipulation Ran Gong Xiaofeng Gao Qiaozi Gao Suhaila Shakiah Govind Thattai Gaurav Sukhatme LM&Ro 21 8 0 02 Aug 2023
Learning to Model the World with Language Jessy Lin Yuqing Du Olivia Watkins Danijar Hafner Pieter Abbeel Dan Klein Anca Dragan LM&Ro SyDa 31 51 0 31 Jul 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng-Tao Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 30 1,100 0 28 Jul 2023
Primitive Skill-based Robot Learning from Human Evaluative Feedback Ayano Hiranaka Minjune Hwang Sharon Lee Chen Wang Li Fei-Fei Jiajun Wu Ruohan Zhang OffRL 13 11 0 28 Jul 2023
Distilled Feature Fields Enable Few-Shot Language-Guided Manipulation Bokui (William) Shen Ge Yang Alan Yu J. Wong L. Kaelbling Phillip Isola VLM 29 104 0 27 Jul 2023
Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition Huy Ha Peter R. Florence Shuran Song LM&Ro 47 150 0 26 Jul 2023
Waypoint-Based Imitation Learning for Robotic Manipulation Lu Shi Archit Sharma Tony Zhao Chelsea Finn 19 53 0 26 Jul 2023