Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulation

14 May 2024

Papers citing "Hearing Touch: Audio-Visual Pretraining for Contact-Rich Manipulation"

27 / 27 papers shown

Title
A High-Force Gripper with Embedded Multimodal Sensing for Powerful and Perception Driven Grasping Edoardo Del Bianco Davide Torielli Federico Rollo Damiano Gasperini Arturo Laurenzi Lorenzo Baccelliere L. Muratore Marco Roveri Nikos Tsagarakis 63 2 0 07 Apr 2025
Visual-auditory Extrinsic Contact Estimation Xili Yi Jayjun Lee Nima Fazeli 88 3 0 22 Sep 2024
Train Offline, Test Online: A Real Robot Learning Benchmark G. Zhou Victoria Dean Mohan Kumar Srirama Aravind Rajeswaran Jyothish Pari ... Tianhe Yu Pieter Abbeel Lerrel Pinto Chelsea Finn Abhi Gupta OffRL 119 40 0 01 Jun 2023
Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence? Arjun Majumdar Karmesh Yadav Sergio Arnaud Yecheng Jason Ma Claire Chen ... Dhruv Batra Yixin Lin Oleksandr Maksymets Aravind Rajeswaran Franziska Meier LM&Ro 65 184 0 31 Mar 2023
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion Cheng Chi Zhenjia Xu S. Feng Eric A. Cousineau Yilun Du Benjamin Burchfiel Russ Tedrake Shuran Song 349 1,242 0 07 Mar 2023
Real-World Robot Learning with Masked Visual Pre-training Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 235 254 0 06 Oct 2022
Emergent Abilities of Large Language Models Jason W. Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph ... Tatsunori Hashimoto Oriol Vinyals Percy Liang J. Dean W. Fedus ELM ReLM LRM 292 2,521 0 15 Jun 2022
Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning Maximilian Du Olivia Y. Lee Suraj Nair Chelsea Finn OffRL 106 33 0 30 May 2022
Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation Sridhar Pandian Arunachalam Sneha Silwal Ben Evans Lerrel Pinto 92 107 0 24 Mar 2022
R3M: A Universal Visual Representation for Robot Manipulation Suraj Nair Aravind Rajeswaran Vikash Kumar Chelsea Finn Abhi Gupta LM&Ro 101 588 0 23 Mar 2022
The Surprising Effectiveness of Representation Learning for Visual Imitation Jyothish Pari Nur Muhammad (Mahi) Shafiullah Sridhar Pandian Arunachalam Lerrel Pinto SSL 101 171 0 02 Dec 2021
ReSkin: versatile, replaceable, lasting tactile skins Raunaq M. Bhirangi Tess Hellebrekers Carmel Majidi Abhinav Gupta SyDa 92 77 0 29 Oct 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 410 1,114 0 13 Oct 2021
Localizing Visual Sounds the Hard Way Honglie Chen Weidi Xie Triantafyllos Afouras Arsha Nagrani Andrea Vedaldi Andrew Zisserman ObjD 88 191 0 06 Apr 2021
Robust Audio-Visual Instance Discrimination Pedro Morgado Ishan Misra Nuno Vasconcelos SSL 109 110 0 29 Mar 2021
See, Hear, Explore: Curiosity via Audio-Visual Association Victoria Dean Shubham Tulsiani Abhinav Gupta 100 59 0 07 Jul 2020
Swoosh! Rattle! Thump! -- Actions that Sound Dhiraj Gandhi Abhinav Gupta Lerrel Pinto 119 42 0 03 Jul 2020
Audio-Visual Instance Discrimination with Cross-Modal Agreement Pedro Morgado Nuno Vasconcelos Ishan Misra SSL 82 276 0 27 Apr 2020
Leveraging Multimodal Haptic Sensory Data for Robust Cutting Kevin Zhang Mohit Sharma Manuela Veloso Oliver Kroemer 128 38 0 27 Sep 2019
The Sound of Motions Hang Zhao Chuang Gan Wei-Chiu Ma Antonio Torralba 86 254 0 11 Apr 2019
Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks Michelle A. Lee Yuke Zhu K. Srinivasan Parth Shah Silvio Savarese Li Fei-Fei Animesh Garg Jeannette Bohg SSL 95 370 0 24 Oct 2018
Robust Learning of Tactile Force Estimation through Robot Interaction Balakumar Sundaralingam Alexander Lambert Ankur Handa Byron Boots Tucker Hermans Stan Birchfield Nathan D. Ratliff Dieter Fox OOD 51 60 0 15 Oct 2018
More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch Roberto Calandra Andrew Owens Dinesh Jayaraman Justin Lin Wenzhen Yuan Jitendra Malik Edward H. Adelson Sergey Levine 93 343 0 28 May 2018
Learning to Grasp Without Seeing Adithyavairavan Murali Yin Li Dhiraj Gandhi Abhinav Gupta SSL 92 63 0 10 May 2018
Objects that Sound Relja Arandjelović Andrew Zisserman ObjD VOS 116 530 0 18 Dec 2017
The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? Roberto Calandra Andrew Owens M. Upadhyaya Wenzhen Yuan Justin Lin Edward H. Adelson Sergey Levine 151 200 0 16 Oct 2017
Look, Listen and Learn Relja Arandjelović Andrew Zisserman SSL 127 906 0 23 May 2017