Translating Videos to Commands for Robotic Manipulation with Deep Recurrent Neural Networks

1 October 2017

Nikos G. Tsagarakis

Papers citing "Translating Videos to Commands for Robotic Manipulation with Deep Recurrent Neural Networks"

32 / 32 papers shown

Title
Multi-step manipulation task and motion planning guided by video demonstration Kateryna Zorina David Kovar Médéric Fourmy Florent Lamiraux Nicolas Mansard Justin Carpentier Josef Sivic Vladimir Petrik 43 0 0 13 May 2025
Slot-Level Robotic Placement via Visual Imitation from Single Human Video Dandan Shan Kaichun Mo Wei Yang Yu-Wei Chao David Fouhey Dieter Fox Arsalan Mousavian 94 0 0 02 Apr 2025
Capturing Rich Behavior Representations: A Dynamic Action Semantic-Aware Graph Transformer for Video Captioning Caihua Liu Xu Li Wenjing Xue Wei Tang Xia Feng 80 0 0 20 Feb 2025
Exploiting Information Theory for Intuitive Robot Programming of Manual Activities Elena Merlo Marta Lagomarsino Edoardo Lamon Arash Ajoudani 87 1 0 08 Jan 2025
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 88 18 0 12 Sep 2024
Semantically Controllable Augmentations for Generalizable Robot Learning Zoey Chen Zhao Mandi Homanga Bharadhwaj Mohit Sharma Shuran Song Abhishek Gupta Vikash Kumar LM&Ro 105 7 0 02 Sep 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 95 20 0 22 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation Chrisantus Eze Christopher Crick SSL 119 13 0 11 Feb 2024
Multi Sentence Description of Complex Manipulation Action Videos Fatemeh Ziaeetabar Reza Safabakhsh S. Momtazi M. Tamosiunaite Florentin Wörgötter 77 3 0 13 Nov 2023
NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities Ruohan Zhang Sharon Lee Minjune Hwang Ayano Hiranaka Chen Wang ... Gabrael Levine Ruohan Gao Anthony Norcia Fei-Fei Li Jiajun Wu LM&Ro 86 20 0 02 Nov 2023
Bridging Low-level Geometry to High-level Concepts in Visual Servoing of Robot Manipulation Task Using Event Knowledge Graphs and Vision-Language Models Chen Jiang Martin Jägersand 78 1 0 05 Oct 2023
Perception for Humanoid Robots Arindam Roychoudhury Shahram Khorshidi Subham Agrawal Maren Bennewitz 68 6 0 27 Sep 2023
CLIPUNetr: Assisting Human-robot Interface for Uncalibrated Visual Servoing Control with CLIP-driven Referring Expression Segmentation Chen Jiang Yuchen Yang Martin Jägersand 62 1 0 17 Sep 2023
RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking Homanga Bharadhwaj Jay Vakil Mohit Sharma Abhi Gupta Shubham Tulsiani Vikash Kumar LM&Ro 118 132 0 05 Sep 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 65 9 0 12 Jul 2023
Style-transfer based Speech and Audio-visual Scene Understanding for Robot Action Sequence Acquisition from Videos Chiori Hori Puyuan Peng David Harwath Xinyu Liu Keita Ota Siddarth Jain Radu Corcodel Devesh K. Jha Diego Romeres Jonathan Le Roux 53 4 0 27 Jun 2023
One-Shot Transfer of Affordance Regions? AffCorrs! Denis Hadjivelichkov Sicelukwanda Zwane M. Deisenroth Lourdes Agapito Dimitrios Kanoulas 106 39 0 15 Sep 2022
Human-to-Robot Imitation in the Wild Shikhar Bahl Abhi Gupta Deepak Pathak 109 174 0 19 Jul 2022
Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos Annie S. Chen Suraj Nair Chelsea Finn 94 141 0 31 Mar 2021
Understanding Action Sequences based on Video Captioning for Learning-from-Observation Iori Yanokura Naoki Wake Kazuhiro Sasabuchi Katsushi Ikeuchi Masayuki Inaba 65 4 0 09 Dec 2020
Sample-Efficient Training of Robotic Guide Using Human Path Prediction Network Hee-Seung Moon Jiwon Seo 46 3 0 12 Aug 2020
Understanding Contexts Inside Robot and Human Manipulation Tasks through a Vision-Language Model and Ontology System in a Video Stream Chen Jiang Masood Dehghan Martin Jägersand LM&Ro 69 9 0 02 Mar 2020
Zero-Shot Imitating Collaborative Manipulation Plans from YouTube Cooking Videos Hejia Zhang Jie Zhong Stefanos Nikolaidis LM&Ro 393 1 0 25 Nov 2019
Bridging Visual Perception with Contextual Semantics for Understanding Robot Manipulation Tasks Chen Jiang Martin Jägersand 39 3 0 16 Sep 2019
Tactile-Based Insertion for Dense Box-Packing Siyuan Dong Alberto Rodriguez 161 55 0 12 Sep 2019
Learning Actions from Human Demonstration Video for Robotic Manipulation Shuo Yang Wei Zhang Weizhi Lu Hesheng Wang Yibin Li 42 26 0 10 Sep 2019
Scene Understanding for Autonomous Manipulation with Deep Learning A. Nguyen 55 6 0 23 Mar 2019
V2CNet: A Deep Learning Framework to Translate Videos to Commands for Robotic Manipulation A. Nguyen Thanh-Toan Do Ian Reid D. Caldwell Nikos G. Tsagarakis 66 21 0 23 Mar 2019
One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks Tianhe Yu Pieter Abbeel Sergey Levine Chelsea Finn 70 68 0 25 Oct 2018
Object Captioning and Retrieval with Natural Language A. Nguyen Thanh-Toan Do Ian Reid D. Caldwell Nikos G. Tsagarakis 3DV 55 18 0 16 Mar 2018
One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning Tianhe Yu Chelsea Finn Annie Xie Sudeep Dasari Tianhao Zhang Pieter Abbeel Sergey Levine 82 361 0 05 Feb 2018
AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detection Thanh-Toan Do A. Nguyen Ian Reid 96 297 0 21 Sep 2017