Affordances from Human Videos as a Versatile Representation for Robotics

17 April 2023

Papers citing "Affordances from Human Videos as a Versatile Representation for Robotics"

50 / 135 papers shown

Title
DreamGen: Unlocking Generalization in Robot Learning through Neural Trajectories Joel Jang Seonghyeon Ye Zongyu Lin Jiannan Xiang Johan Bjorck ... D. Fox Jan Kautz Scott Reed Yuke Zhu Linxi Fan VGen OffRL AI4TS 0 0 0 19 May 2025
GLOVER++: Unleashing the Potential of Affordance Learning from Human Behaviors for Robotic Manipulation Teli Ma Jia Zheng Zifan Wang Ziyao Gao Jiaming Zhou Junwei Liang 0 0 0 17 May 2025
ReWiND: Language-Guided Rewards Teach Robot Policies without New Demonstrations Jiahui Zhang Yusen Luo Abrar Anwar S. Sontakke Joseph J. Lim Jesse Thomason Erdem Biyik Jesse Zhang OffRL LM&Ro 17 0 0 16 May 2025
EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video Ryan Hoque Peide Huang David J. Yoon Mouli Sivapurapu Jian Zhang 0 0 0 16 May 2025
DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies Tony Tao Mohan Kumar Srirama Jason Jingzhou Liu Kenneth Shaw Deepak Pathak 31 0 0 12 May 2025
UniDiffGrasp: A Unified Framework Integrating VLM Reasoning and VLM-Guided Part Diffusion for Open-Vocabulary Constrained Grasping with Dual Arms Xueyang Guo Hongwei Hu Chengye Song J. Chen Zilin Zhao Yu Fu Bowen Guan Zhenze Liu 31 0 0 11 May 2025
Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions Hongyi Chen Yunchao Yao Yufei Ye Zhixuan Xu Homanga Bharadhwaj Jiashun Wang Shubham Tulsiani Zackory Erickson Jeffrey Ichnowski 33 0 0 07 May 2025
CrayonRobo: Object-Centric Prompt-Driven Vision-Language-Action Model for Robotic Manipulation Xiaoqi Li Lingyun Xu M. Zhang Jiaming Liu Yan Shen ... Jiahui Xu Liang Heng Siyuan Huang S. Zhang Hao Dong LM&Ro 51 0 0 04 May 2025
Interpretable Affordance Detection on 3D Point Clouds with Probabilistic Prototypes M. Li Korbinian Franz Rudolf Nils Blank Rudolf Lioutikov 3DPC 34 0 0 25 Apr 2025
AffordanceSAM: Segment Anything Once More in Affordance Grounding D. Jiang Mengmeng Wang Teli Ma Hao Li Yong-Jin Liu Guang Dai L. Zhang 32 0 0 22 Apr 2025
A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulation Rongtao Xu J. Zhang Minghao Guo Youpeng Wen H. Yang ... Liqiong Wang Yuxuan Kuang Meng Cao Feng Zheng Xiaodan Liang 47 3 0 17 Apr 2025
RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twins Yao Mu Tianxing Chen Z. Chen Shijia Peng Zhiqian Lan ... Mingkun Xu Lunkai Lin Zhiqiang Xie Mingyu Ding Ping Luo 30 1 0 17 Apr 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 36 0 0 17 Apr 2025
How Do I Do That? Synthesizing 3D Hand Motion and Contacts for Everyday Interactions Aditya Prakash Benjamin Lundell Dmitry Andreychuk David Forsyth Saurabh Gupta H. Sawhney 38 0 0 16 Apr 2025
Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction Junyi Ma Wentao Bao Jingyi Xu Guanzhong Sun Xieyuanli Chen Hesheng Wang 30 0 0 10 Apr 2025
MAPLE: Encoding Dexterous Robotic Manipulation Priors Learned From Egocentric Videos Alexey Gavryushin Xi Wang Robert J. S. Malate Chenyu Yang Xiaojun Jia Shubh Goel Davide Liconti René Zurbrugg Robert K. Katzschmann Marc Pollefeys 39 1 0 08 Apr 2025
Tool-as-Interface: Learning Robot Policies from Human Tool Usage through Imitation Learning Haonan Chen Cheng Zhu Yunzhu Li Katherine Driggs-Campbell 26 0 0 06 Apr 2025
Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets Chuning Zhu Raymond Yu S. Feng Benjamin Burchfiel Paarth Shah Abhishek Gupta VGen 60 1 0 03 Apr 2025
Slot-Level Robotic Placement via Visual Imitation from Single Human Video Dandan Shan Kaichun Mo Wei Yang Yu-Wei Chao David Fouhey Dieter Fox Arsalan Mousavian 36 0 0 02 Apr 2025
ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos Junyao Shi Zhuolun Zhao Tianyou Wang Ian Pedroza Amy Luo Jie Wang Jason Ma Dinesh Jayaraman LM&Ro 50 0 0 31 Mar 2025
2HandedAfforder: Learning Precise Actionable Bimanual Affordances from Human Videos Marvin Heidinger Snehal Jauhri V. Prasad Georgia Chalvatzaki 68 0 0 12 Mar 2025
FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction Dennis Rotondi Fabio Scaparro Hermann Blum Kai O. Arras 46 0 0 10 Mar 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 75 0 0 10 Mar 2025
AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons Hongjie Fang Chenxi Wang Yiming Wang J. Chen Shangning Xia ... Xinyu Zhan Lixin Yang Weiming Wang Cewu Lu Hao-Shu Fang 87 1 0 05 Mar 2025
AffordGrasp: In-Context Affordance Reasoning for Open-Vocabulary Task-Oriented Grasping in Clutter Yingbo Tang S. Zhang Xiaoshuai Hao Pengwei Wang Jianlong Wu Z. Wang Shanghang Zhang 63 6 0 02 Mar 2025
Phantom: Training Robots Without Robots Using Only Human Videos Marion Lepert Jiaying Fang Jeannette Bohg OffRL 42 8 0 02 Mar 2025
Subtask-Aware Visual Reward Learning from Segmented Demonstrations Changyeon Kim Minho Heo Doohyun Lee Jinwoo Shin Honglak Lee Joseph J. Lim Kimin Lee 44 1 0 28 Feb 2025
Multi-Keypoint Affordance Representation for Functional Dexterous Grasping Fan Yang DongSheng Luo Wenrui Chen Jiacheng Lin Junjie Cai Kailun Yang Zehan Li Yaonan Wang 51 0 0 27 Feb 2025
Human2Robot: Learning Robot Actions from Paired Human-Robot Videos Sicheng Xie Haidong Cao Zejia Weng Zhen Xing Shiwei Shen Jiaqi Leng Xipeng Qiu Yanwei Fu Zuxuan Wu Yu Jiang 56 0 0 23 Feb 2025
RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation Kun Wu Chengkai Hou Jiaming Liu Zhengping Che Xiaozhu Ju ... Zhenyu Wang Pengju An Siyuan Qian S. Zhang Jian Tang LM&Ro 113 15 0 17 Feb 2025
Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation Yang Tian Sizhe Yang Jia Zeng P. Wang Dahua Lin Hao Dong Jiangmiao Pang 84 17 0 19 Dec 2024
Learning from Massive Human Videos for Universal Humanoid Pose Control Jiageng Mao Siheng Zhao Siqi Song Tianheng Shi Junjie Ye Mingtong Zhang Haoran Geng Jitendra Malik Vitor Campagnolo Guizilini Yue Wang 93 5 0 18 Dec 2024
HandsOnVLM: Vision-Language Models for Hand-Object Interaction Prediction Chen Bao Jiarui Xu Xiaolong Wang Abhinav Gupta Homanga Bharadhwaj 76 2 0 17 Dec 2024
Reinforcement Learning from Wild Animal Videos Elliot Chane-Sane Constant Roux O. Stasse Nicolas Mansard 178 0 0 05 Dec 2024
Leverage Task Context for Object Affordance Ranking Haojie Huang Hongchen Luo Wei-dong Zhai Yang Cao Zheng-jun Zha 82 0 0 25 Nov 2024
Tra-MoE: Learning Trajectory Prediction Model from Multiple Domains for Adaptive Policy Conditioning Jiange Yang Haoyi Zhu Yunhong Wang Gangshan Wu Tong He Limin Wang 103 2 0 21 Nov 2024
STEER: Flexible Robotic Manipulation via Dense Language Grounding Laura Smith A. Irpan Montserrat Gonzalez Arenas Sean Kirmani Dmitry Kalashnikov Dhruv Shah Ted Xiao LLMSV 42 1 0 05 Nov 2024
Learning Few-Shot Object Placement with Intra-Category Transfer Adrian Rofer Russell Buchanan Max Argus S. Vijayakumar Abhinav Valada 45 0 0 05 Nov 2024
Pre-trained Visual Dynamics Representations for Efficient Policy Learning Hao Luo Bohan Zhou Zongqing Lu 30 1 0 05 Nov 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert Platt Jan-Willem van de Meent Lawson L. S. Wong OffRL 45 0 0 25 Oct 2024
Latent Action Pretraining from Videos Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 35 27 0 15 Oct 2024
EgoOops: A Dataset for Mistake Action Detection from Egocentric Videos Referring to Procedural Texts Yuto Haneji Taichi Nishimura Hirotaka Kameko Keisuke Shirai Tomoya Yoshida Keiya Kajimura Koki Yamamoto Taiyu Cui Tomohiro Nishimoto Shinsuke Mori EgoV 49 0 0 07 Oct 2024
LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videos Noriaki Hirose Catherine Glossop A. Sridhar Dhruv Shah Oier Mees Sergey Levine LM&Ro 34 10 0 04 Oct 2024
Open-World Reinforcement Learning over Long Short-Term Imagination Jiajian Li Q. Wang Yunbo Wang Xin Jin Yang Li Wenjun Zeng Xiaokang Yang OCL VLM 56 1 0 04 Oct 2024
Learning Wheelchair Tennis Navigation from Broadcast Videos with Domain Knowledge Transfer and Diffusion Motion Planning Zixuan Wu Z. Zaidi Adithya Patil Qingyu Xiao Matthew C. Gombolay 72 1 0 29 Sep 2024
Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation Homanga Bharadhwaj Debidatta Dwibedi Abhinav Gupta Shubham Tulsiani Carl Doersch Ted Xiao Dhruv Shah Fei Xia Dorsa Sadigh Sean Kirmani VGen LM&Ro 42 28 0 24 Sep 2024
Skills Made to Order: Efficient Acquisition of Robot Cooking Skills Guided by Multiple Forms of Internet Data Mrinal Verghese C. Atkeson 39 0 0 23 Sep 2024
TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation Junjie Wen Bo Li Jinming Li Minjie Zhu Kun Wu ... Ran Cheng Chaomin Shen Yaxin Peng Feifei Feng Jian Tang LM&Ro 72 41 0 19 Sep 2024
Robot Manipulation in Salient Vision through Referring Image Segmentation and Geometric Constraints Chen Jiang Allie Luo Martin Jägersand 28 0 0 17 Sep 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu M. Tomizuka Mingyu Ding Chi-Wing Fu 50 0 0 16 Sep 2024