v1v2 (latest)

TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understanding

16 January 2024

Yuxiang Zhang

Yebin Liu

Li Yi

ArXiv (abs)PDF HTML

Papers citing "TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understanding"

38 / 38 papers shown

Title
ContactGen: Generative Contact Modeling for Grasp Generation Shaowei Liu Yang Zhou Jimei Yang Saurabh Gupta Shenlong Wang 76 31 0 05 Oct 2023
AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Pose Ju Jian Xiuping Liu Manyi Li Ruizhen Hu Jian Liu 36 42 0 16 Sep 2023
Modelling Spatio-Temporal Interactions for Compositional Action Recognition Ramanathan Rajendiran Debaditya Roy Basura Fernando 77 1 0 04 May 2023
A2J-Transformer: Anchor-to-Joint Transformer Network for 3D Interacting Hand Pose Estimation from a Single RGB Image Changlong Jiang Yanghua Xiao Cunlin Wu Mingyang Zhang Jinghong Zheng Z. Cao Qiufeng Wang ViT 41 27 0 07 Apr 2023
Learning Human-to-Robot Handovers from Point Clouds Sammy Christen Wei Yang Claudia Pérez-DÁrpino Otmar Hilliges Dieter Fox Yu-Wei Chao 59 43 0 30 Mar 2023
CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesis Juntian Zheng Qingyuan Zheng Lixing Fang Yun-Hai Liu Li Yi 76 46 0 25 Mar 2023
Affordance Diffusion: Synthesizing Hand-Object Interactions Yufei Ye Xueting Li Abhi Gupta Shalini De Mello Stan Birchfield Jiaming Song Shubham Tulsiani Sifei Liu DiffM 100 79 0 21 Mar 2023
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 270 767 0 29 Sep 2022
It Takes Two: Learning to Plan for Human-Robot Cooperative Carrying Eley Ng Ziang Liu Monroe Kennedy 57 18 0 26 Sep 2022
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation Yuzhe Qin Hao Su Xiaolong Wang 75 105 0 26 Apr 2022
OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction Lixin Yang Kailin Li Xinyu Zhan Fei Wu Anran Xu Liu Liu Cewu Lu 75 98 0 29 Mar 2022
Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities Fadime Sener Dibyadip Chatterjee Daniel Shelepov Kun He Dipika Singhania Robert Y. Wang Angela Yao VGen 81 220 0 28 Mar 2022
Discovering Human-Object Interaction Concepts via Self-Compositional Learning Zhi Hou Baosheng Yu Dacheng Tao 60 19 0 27 Mar 2022
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction Yunze Liu Yun-Hai Liu Chen Jiang Kangbo Lyu Weikang Wan Hao Shen Bo-Hua Liang Zhoujie Fu He Wang Li Yi 110 188 0 03 Mar 2022
MobRecon: Mobile-Friendly Hand Mesh Reconstruction from Monocular Image Xingyu Chen Yufeng Liu Yajiao Dong Xiong Zhang Chongyang Ma Yanmin Xiong Yuan Zhang Xiaoyan Guo 3DH 125 88 0 06 Dec 2021
Revisiting spatio-temporal layouts for compositional action recognition Gorjan Radevski Marie-Francine Moens Tinne Tuytelaars 75 26 0 02 Nov 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 401 1,109 0 13 Oct 2021
A Skeleton-Driven Neural Occupancy Representation for Articulated Hands Korrawe Karunratanakul Adrian Spurr Zicong Fan Otmar Hilliges Siyu Tang 3DH 80 60 0 23 Sep 2021
Resolution-robust Large Mask Inpainting with Fourier Convolutions Roman Suvorov Elizaveta Logacheva Anton Mashikhin Anastasia Remizova Arsenii Ashukha Aleksei Silvestrov Naejin Kong Harshith Goka Kiwoong Park Victor Lempitsky 108 866 0 15 Sep 2021
DexMV: Imitation Learning for Dexterous Manipulation from Human Videos Yuzhe Qin Yueh-hua Wu Shaowei Liu Hanwen Jiang Ruihan Yang Yang Fu Xiaolong Wang 194 200 0 12 Aug 2021
H2O: A Benchmark for Visual Human-human Object Handover Analysis Ruolin Ye Wenqiang Xu Zhendong Xue Tutian Tang Yanfeng Wang Cewu Lu 62 26 0 23 Apr 2021
H2O: Two Hands Manipulating Objects for First Person Interaction Recognition Taein Kwon Bugra Tekin Jan Stühmer Federica Bogo Marc Pollefeys EgoV 87 184 0 22 Apr 2021
DexYCB: A Benchmark for Capturing Hand Grasping of Objects Yu-Wei Chao Wei Yang Yu Xiang Pavlo Molchanov Ankur Handa ... Karl Van Wyk Umar Iqbal Stan Birchfield Jan Kautz Dieter Fox 102 268 0 09 Apr 2021
Affordance Transfer Learning for Human-Object Interaction Detection Zhi Hou Baosheng Yu Yu Qiao Xiaojiang Peng Dacheng Tao 79 106 0 07 Apr 2021
Detecting Human-Object Interaction via Fabricated Compositional Learning Zhi Hou B. Yu Yu Qiao Xiaojiang Peng Dacheng Tao 101 98 0 15 Mar 2021
CPF: Learning a Contact Potential Field to Model the Hand-Object Interaction Lixin Yang Xinyu Zhan Kailin Li Wenqiang Xu Jiefeng Li Cewu Lu 75 128 0 02 Dec 2020
GRAB: A Dataset of Whole-Body Human Grasping of Objects Omid Taheri N. Ghorbani Michael J. Black Dimitrios Tzionas 3DH 75 381 0 25 Aug 2020
Grasping Field: Learning Implicit Representations for Human Grasps Korrawe Karunratanakul Jinlong Yang Yan Zhang Michael J. Black Krikamol Muandet Siyu Tang 3DH 92 211 0 10 Aug 2020
ContactPose: A Dataset of Grasps with Object Contact and Hand Pose Samarth Brahmbhatt Chengcheng Tang Christopher D. Twigg Charles C. Kemp James Hays 80 211 0 19 Jul 2020
Something-Else: Compositional Action Recognition with Spatial-Temporal Interaction Networks Joanna Materzynska Tete Xiao Roei Herzig Huijuan Xu Xiaolong Wang Trevor Darrell CoGe 53 176 0 20 Dec 2019
Learning Object-Action Relations from Bimanual Human Demonstration Using Graph Networks Christian R. G. Dreher Mirko Wächter Tamim Asfour 54 66 0 22 Aug 2019
MediaPipe: A Framework for Building Perception Pipelines C. Lugaresi Jiuqiang Tang Hadon Nash C. McClanahan Esha Uboweja ... Juhyun Lee W. Chang Wei Hua Manfred Georg Matthias Grundmann MoE 74 1,310 0 14 Jun 2019
Learning joint reconstruction of hands and manipulated objects Yana Hasson Gül Varol Dimitrios Tzionas Igor Kalevatykh Michael J. Black Ivan Laptev Cordelia Schmid 3DH 60 530 0 11 Apr 2019
Context-aware Human Motion Prediction Enric Corona Albert Pumarola Guillem Alenyà Francesc Moreno-Noguer 3DH 105 142 0 06 Apr 2019
YOLOv3: An Incremental Improvement Joseph Redmon Ali Farhadi ObjD 130 21,488 0 08 Apr 2018
The "something something" video database for learning and evaluating visual common sense Raghav Goyal Samira Ebrahimi Kahou Vincent Michalski Joanna Materzynska S. Westphal ... Moritz Mueller-Freitag F. Hoppe Christian Thurau Ingo Bax Roland Memisevic VLM 98 1,542 0 13 Jun 2017
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 493 14,360 0 02 Dec 2016
UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild K. Soomro Amir Zamir M. Shah CLIP VGen 160 6,164 0 03 Dec 2012