Binding Touch to Everything: Learning Unified Multimodal Tactile Representations

31 January 2024

Ziyang Chen

Papers citing "Binding Touch to Everything: Learning Unified Multimodal Tactile Representations"

32 / 32 papers shown

Title
Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain Trinity Chung Yuchen Shen Nathan C. L. Kong Aran Nayebi 62 0 0 23 May 2025
From Grounding to Manipulation: Case Studies of Foundation Model Integration in Embodied Robotic Systems Xiuchao Sui Daiying Tian Qi Sun Ruirui Chen Dongkyu Choi Kenneth Kwok Soujanya Poria LM&Ro 51 0 0 21 May 2025
ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation Hongyu Li James Akl Srinath Sridhar Tye Brady Taskin Padir 93 0 0 17 Apr 2025
Sensor-Invariant Tactile Representation Harsh Gupta Yuchen Mo Shengmiao Jin Wenzhen Yuan 69 3 0 27 Feb 2025
AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors Ruoxuan Feng Jiangyu Hu Wenke Xia Tianci Gao Ao Shen Yuhao Sun Bin Fang Di Hu 58 6 0 15 Feb 2025
TextToucher: Fine-Grained Text-to-Touch Generation Jiahang Tu Hao Fu Fengyu Yang Hanbin Zhao Chao Zhang Hui Qian VLM DiffM 97 10 0 10 Jan 2025
PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation Ziyao Zeng Jingcheng Ni Daniel Wang Patrick Rim Younjoon Chung Fengyu Yang Byung-Woo Hong A. Wong DiffM MDE 145 2 0 24 Nov 2024
Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting Matthew Strong Boshu Lei Aiden Swann Wen Jiang Kostas Daniilidis Monroe Kennedy III 3DGS 56 3 0 07 Oct 2024
PseudoTouch: Efficiently Imaging the Surface Feel of Objects for Robotic Manipulation Adrian Rofer Nick Heppert Abdallah Ayman Eugenio Chisari Abhinav Valada 47 1 0 22 Mar 2024
Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning Zhiyang Xu Chao Feng Rulin Shao Trevor Ashby Ying Shen dingnan jin Yu Cheng Qifan Wang Lifu Huang MLLM VLM 22 43 0 18 Feb 2024
General In-Hand Object Rotation with Vision and Touch Haozhi Qi Brent Yi Sudharshan Suresh Mike Lambeta Yi Ma Roberto Calandra Jitendra Malik 67 86 0 18 Sep 2023
Investigating Vision Foundational Models for Tactile Representation Learning Ben Zandonati Ruohan Wang Ruihan Gao Yongpeng Wu 67 4 0 30 Apr 2023
From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding Yong-Lu Li Xiaoqian Wu Xinpeng Liu Zehao Wang Yiming Dou ... Junyi Zhang Yixing Li Jingru Tan Xudong Lu Cewu Lu 73 17 0 02 Apr 2023
Vis2Hap: Vision-based Haptic Rendering by Cross-modal Generation G. Cao Jiaqi Jiang N. Mao Danushka Bollegala Min Li Shan Luo 31 16 0 17 Jan 2023
Can Language Understand Depth? Renrui Zhang Ziyao Zeng Ziyu Guo Yafeng Li VLM MDE 61 72 0 03 Jul 2022
Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang Chunyuan Li Pengchuan Zhang Bin Xiao Ce Liu Lu Yuan Jianfeng Gao VLM SSL 98 223 0 07 Apr 2022
ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer Ruohan Gao Zilin Si Yen-Yu Chang Samuel Clarke Jeannette Bohg Li Fei-Fei Wenzhen Yuan Jiajun Wu 39 84 0 05 Apr 2022
Multimodal perception for dexterous manipulation G. Cao Shan Luo 36 2 0 28 Dec 2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding Hu Xu Gargi Ghosh Po-Yao (Bernie) Huang Dmytro Okhonko Armen Aghajanyan Florian Metze Luke Zettlemoyer Florian Metze Luke Zettlemoyer Christoph Feichtenhofer CLIP VLM 281 567 0 28 Sep 2021
ShapeMap 3-D: Efficient shape mapping through dense touch and vision Sudharshan Suresh Zilin Si Joshua G. Mangelson Wenzhen Yuan Michael Kaess 102 58 0 20 Sep 2021
ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations Ruohan Gao Yen-Yu Chang Shivani Mall Li Fei-Fei Jiajun Wu 57 80 0 16 Sep 2021
Taxim: An Example-based Simulation Model for GelSight Tactile Sensors Zilin Si Wenzhen Yuan 33 96 0 09 Sep 2021
AudioCLIP: Extending CLIP to Image, Text and Audio A. Guzhov Federico Raue Jörn Hees Andreas Dengel CLIP VLM 38 362 0 24 Jun 2021
Tactile Sim-to-Real Policy Transfer via Real-to-Sim Image Translation Alex Church John Lloyd R. Hadsell Nathan Lepora 52 50 0 16 Jun 2021
Towards Learning to Play Piano with Dexterous Hands and Touch Huazhe Xu Yuping Luo Shaoxiong Wang Trevor Darrell Roberto Calandra 113 30 0 03 Jun 2021
PyTouch: A Machine Learning Library for Touch Processing Mike Lambeta Huazhe Xu Jingwei Xu Po-wei Chou Shaoxiong Wang Trevor Darrell Roberto Calandra 19 20 0 26 May 2021
Learning rich touch representations through cross-modal self-supervision Martina Zambelli Y. Aytar Francesco Visin Yuxiang Zhou R. Hadsell SSL 41 16 0 21 Jan 2021
Simulation of Vision-based Tactile Sensors using Physics based Rendering A. Agarwal Tim Man Wenzhen Yuan 39 51 0 24 Dec 2020
Audio-Visual Instance Discrimination with Cross-Modal Agreement Pedro Morgado Nuno Vasconcelos Ishan Misra SSL 42 271 0 27 Apr 2020
ViTac: Feature Sharing between Vision and Tactile Sensing for Cloth Texture Recognition Shan Luo Wenzhen Yuan Edward H. Adelson Anthony G. Cohn R. Fuentes 38 133 0 21 Feb 2018
Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning Andrew Owens Jiajun Wu Josh H. McDermott William T. Freeman Antonio Torralba SSL 52 177 0 20 Dec 2017
The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? Roberto Calandra Andrew Owens M. Upadhyaya Wenzhen Yuan Justin Lin Edward H. Adelson Sergey Levine 68 195 0 16 Oct 2017