Title
Towards Generalist Robot Policies: What Matters in Building Vision-Language-Action Models Xinghang Li Peiyan Li Minghuan Liu Dong Wang Jirong Liu Bingyi Kang Xiao Ma Tao Kong Hanbo Zhang Huaping Liu LM&Ro 99 18 0 18 Dec 2024
RoboMM: All-in-One Multimodal Large Model for Robotic Manipulation Feng Yan Fanfan Liu Liming Zheng Yufeng Zhong Yiyang Huang Zechao Guan Chengjian Feng Lin Ma 87 2 0 10 Dec 2024
AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulation Guanxing Lu Tengbo Yu Haoyuan Deng Season Si Chen Yansong Tang Ziwei Wang 85 3 0 09 Dec 2024
Reinforcement Learning from Wild Animal Videos Elliot Chane-Sane Constant Roux O. Stasse Nicolas Mansard 229 0 0 05 Dec 2024
Diffusion-VLA: Scaling Robot Foundation Models via Unified Diffusion and Autoregression Junjie Wen Minjie Zhu Bo Li Zhibin Tang Jinming Li ... Chengmeng Li Xiaoyu Liu Yaxin Peng Chaomin Shen Feifei Feng 93 15 0 04 Dec 2024
Robot Learning with Super-Linear Scaling M. Torné Arhan Jain Jiayi Yuan Vidaaranya Macha Lars L. Ankile Anthony Simeonov Pulkit Agrawal Abhishek Gupta LM&Ro OffRL 72 2 0 02 Dec 2024
Quantization-Aware Imitation-Learning for Resource-Efficient Robotic Control Seongmin Park Hyungmin Kim Wonseok Jeon Juyoung Yang Byeongwook Jeon Yoonseon Oh Jungwook Choi 93 1 0 02 Dec 2024
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation Qixiu Li Yaobo Liang Zeyu Wang Lin Luo Xi Chen ... Jianmin Bao Dong Chen Yuanchun Shi Jiaolong Yang B. Guo LM&Ro 83 23 0 29 Nov 2024
Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation Yueru Jia Jiaming Liu Sixiang Chen Chenyang Gu Zihan Wang ... Lily Lee Pengwei Wang Zhongyuan Wang Renrui Zhang Shanghang Zhang 94 11 0 27 Nov 2024
ShowUI: One Vision-Language-Action Model for GUI Visual Agent Kevin Qinghong Lin Linjie Li Difei Gao Zhiyong Yang Shiwei Wu Zechen Bai Weixian Lei Lijuan Wang Mike Zheng Shou LLMAG 81 14 0 26 Nov 2024
Diffusion Features for Zero-Shot 6DoF Object Pose Estimation Bernd Von Gimborn P. Ausserlechner Markus Vincze S. Thalhammer DiffM 71 0 0 25 Nov 2024
Inference-Time Policy Steering through Human Interactions Yanwei Wang Lirui Wang Yilun Du Balakumar Sundaralingam Xuning Yang Yu-Wei Chao Claudia Pérez-DÁrpino Dieter Fox Julie Shah VGen 112 4 0 25 Nov 2024
RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics Chan Hee Song Valts Blukis Jonathan Tremblay Stephen Tyree Yu-Chuan Su Stan Birchfield 98 8 0 25 Nov 2024
Tra-MoE: Learning Trajectory Prediction Model from Multiple Domains for Adaptive Policy Conditioning Jiange Yang Haoyi Zhu Yanjie Wang Gangshan Wu Tong He Limin Wang 108 2 0 21 Nov 2024
Bimanual Dexterity for Complex Tasks Kenneth Shaw Yulong Li Jiahui Yang Mohan Kumar Srirama Ray Liu Haoyu Xiong Russell Mendonca Deepak Pathak 83 19 0 20 Nov 2024
Metacognition for Unknown Situations and Environments (MUSE) Rodolfo Valiente Praveen K. Pilly 74 0 0 20 Nov 2024
I Can Tell What I am Doing: Toward Real-World Natural Language Grounding of Robot Experiences Zihan Wang Brian Liang Varad Dhat Zander Brumbaugh Nick Walker Ranjay Krishna Maya Cakmak 61 4 0 20 Nov 2024
HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments Shuijing Liu Haochen Xia Fatemeh Cheraghi Pouria Kaiwen Hong Neeloy Chakraborty Katherine Rose Driggs-Campbell Joydeep Biswas Katherine Driggs-Campbell 116 1 0 19 Nov 2024
VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulation Youpeng Wen Junfan Lin Bo Li J. Han Hang Xu Shen Zhao Xiaodan Liang VGen DiffM 43 2 0 14 Nov 2024
ClevrSkills: Compositional Language and Visual Reasoning in Robotics Sanjay Haresh Daniel Dijkman Apratim Bhattacharyya Roland Memisevic CoGe LRM 42 1 0 13 Nov 2024
Few-Shot Task Learning through Inverse Generative Modeling Aviv Netanyahu Yilun Du Antonia Bronars Jyothish Pari J. Tenenbaum Tianmin Shu Pulkit Agrawal 51 1 0 07 Nov 2024
Vision Language Models are In-Context Value Learners Yecheng Jason Ma Joey Hejna Ayzaan Wahid Chuyuan Fu Dhruv Shah ... Dinesh Jayaraman Wenhao Yu Tingnan Zhang Dorsa Sadigh Fei Xia 60 5 0 07 Nov 2024
Scaling Laws for Pre-training Agents and World Models Tim Pearce Tabish Rashid Dave Bignell Raluca Georgescu Sam Devlin Katja Hofmann LM&Ro 42 6 0 07 Nov 2024
vMF-Contact: Uncertainty-aware Evidential Learning for Probabilistic Contact-grasp in Noisy Clutter Yitian Shi Edgar Welte Maximilian Gilles Rania Rayyes 38 3 0 06 Nov 2024
Pre-trained Visual Dynamics Representations for Efficient Policy Learning Hao Luo Bohan Zhou Zongqing Lu 35 1 0 05 Nov 2024
DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution Yang Yue Yulin Wang Bingyi Kang Yizeng Han Shenzhi Wang Shiji Song Jiashi Feng Gao Huang VLM 45 16 0 04 Nov 2024
ManiBox: Enhancing Spatial Grasping Generalization via Scalable Simulation Data Generation Hengkai Tan Xuezhou Xu Chengyang Ying Xinyi Mao Songming Liu Xingxing Zhang Hang Su Jun Zhu 46 4 0 04 Nov 2024
CLIP-RT: Learning Language-Conditioned Robotic Policies from Natural Language Supervision Gi-Cheon Kang Junghyun Kim Kyuhwan Shim Jun Ki Lee Byoung-Tak Zhang LM&Ro 107 1 1 01 Nov 2024
Bridging the Human to Robot Dexterity Gap through Object-Oriented Rewards Irmak Güzey Yinlong Dai Georgy Savva Raunaq M. Bhirangi Lerrel Pinto 46 7 0 30 Oct 2024
Robotic State Recognition with Image-to-Text Retrieval Task of Pre-Trained Vision-Language Model and Black-Box Optimization Kento Kawaharazuka Yoshiki Obinata Naoaki Kanazawa Kei Okada Masayuki Inaba 36 0 0 30 Oct 2024
Multi-Task Interactive Robot Fleet Learning with Visual World Models Huihan Liu Yu Zhang Vaarij Betala Evan Zhang James Liu Crystal Ding Bo Li 55 5 0 30 Oct 2024
Local Policies Enable Zero-shot Long-horizon Manipulation Murtaza Dalal Min Liu Walter Talbott Chen Chen Deepak Pathak Jian Zhang Ruslan Salakhutdinov 46 3 0 29 Oct 2024
VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions Guanyan Chen Ming Wang Te Cui Yao Mu Haoyang Lu ... Mengxiao Hu Haizhou Li Y. Li Yi Yang Yufeng Yue VLM 31 3 0 28 Oct 2024
HOVER: Versatile Neural Whole-Body Controller for Humanoid Robots Tairan He Wenli Xiao Toru Lin Zhengyi Luo Zhenjia Xu ... Changliu Liu Guanya Shi Xiaolong Wang Linxi Fan Yuke Zhu 45 23 0 28 Oct 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert Platt Jan-Willem van de Meent Lawson L. S. Wong OffRL 47 0 0 25 Oct 2024
Diffusion for Multi-Embodiment Grasping Roman Freiberg Alexander Qualmann Ngo Anh Vien Gerhard Neumann 29 3 0 24 Oct 2024
Versatile Demonstration Interface: Toward More Flexible Robot Demonstration Collection Michael Hagenow Dimosthenis Kontogiorgos Yanwei Wang Julie Shah 59 2 0 24 Oct 2024
Foundation Models for Rapid Autonomy Validation Alec Farid Peter Schleede Aaron Huang Christoffer Heckman 43 0 0 22 Oct 2024
MotionGlot: A Multi-Embodied Motion Generation Model Sudarshan Harithas Srinath Sridhar 82 1 0 22 Oct 2024
How to Build a Pre-trained Multimodal model for Simultaneously Chatting and Decision-making? Zuojin Tang Bin-Bin Hu Chenyang Zhao De Ma Gang Pan Bin Liu 23 0 0 21 Oct 2024
Generative AI Agents in Autonomous Machines: A Safety Perspective Jason J. Jabbour Vijay Janapa Reddi AI4CE 46 4 0 20 Oct 2024
EVA: An Embodied World Model for Future Video Anticipation Xiaowei Chi Hengyuan Zhang Chun-Kai Fan Xingqun Qi Rongyu Zhang ... Chi-Min Chan Wei Xue Wenhan Luo Shanghang Zhang Yike Guo VGen 41 5 0 20 Oct 2024
CAGE: Causal Attention Enables Data-Efficient Generalizable Robotic Manipulation Shangning Xia Hongjie Fang Hao-Shu Fang Cewu Lu CML 37 5 0 19 Oct 2024
Offline-to-online Reinforcement Learning for Image-based Grasping with Scarce Demonstrations Bryan Chan Anson Leung James Bergstra OffRL OnRL 62 0 0 19 Oct 2024
Vision-Language-Action Model and Diffusion Policy Switching Enables Dexterous Control of an Anthropomorphic Hand Cheng Pan Kai Junge Josie Hughes 44 5 0 17 Oct 2024
The State of Robot Motion Generation Kostas E. Bekris Joe H. Doerr Patrick Meng Sumanth Tangirala 3DV 36 2 0 16 Oct 2024
In-Context Learning Enables Robot Action Prediction in LLMs Yida Yin Zekai Wang Yuvan Sharma Dantong Niu Trevor Darrell Roei Herzig LM&Ro 120 2 0 16 Oct 2024
Affordance-Centric Policy Learning: Sample Efficient and Generalisable Robot Policy Learning using Affordance-Centric Task Frames Krishan Rana Jad Abou-Chakra Sourav Garg Robert Lee Ian Reid Niko Suenderhauf 24 4 0 15 Oct 2024
VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI Sijie Cheng Kechen Fang Yangyang Yu Sicheng Zhou Yangqiu Song Ye Tian Tingguang Li Lei Han Yang Liu 51 8 0 15 Oct 2024
Latent Action Pretraining from Videos Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 35 28 0 15 Oct 2024