Humans in 4D: Reconstructing and Tracking Humans with Transformers

31 May 2023

Shubham Goel

Georgios Pavlakos

Jathushan Rajasegaran

Papers citing "Humans in 4D: Reconstructing and Tracking Humans with Transformers"

50 / 56 papers shown

Title
Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On Siqi Wan Jingwen Chen Yingwei Pan Ting Yao Tao Mei DiffM 202 1 0 22 May 2025
ADHMR: Aligning Diffusion-based Human Mesh Recovery via Direct Preference Optimization Wenhao Shen Wanqi Yin Xiaofeng Yang Cheng Chen Chaoyue Song Zhongang Cai Lei Yang Hao Wang Guosheng Lin 89 0 0 15 May 2025
Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understanding Mingxuan Wu Huang Huang Justin Kerr Chung Min Kim Anthony Zhang Brent Yi Angjoo Kanazawa 86 0 0 24 Apr 2025
MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices Vasco Xu Chenfeng Gao Henry Hoffmann Karan Ahuja 3DH 73 5 0 16 Apr 2025
Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates Ren Li Cong Cao Corentin Dumery Yingxuan You Hao Li Pascal Fua DiffM 3DH 72 0 0 11 Apr 2025
PromptHMR: Promptable Human Mesh Recovery Yufu Wang Yu Sun Priyanka Patel Kostas Daniilidis Michael J. Black Muhammed Kocabas 3DH 126 0 0 08 Apr 2025
DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance Yuxuan Luo Zhengkun Rong Lizhen Wang Longhao Zhang Tianshu Hu Yongming Zhu VGen 329 4 0 02 Apr 2025
Semantics-aware Test-time Adaptation for 3D Human Pose Estimation Qiuxia Lin Rongyu Chen Kerui Gu Angela Yao 3DH TTA 103 0 0 15 Feb 2025
BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videos Farnoosh Koleini Muhammad Usama Saleem Pu Wang Hongfei Xue Ahmed Helmy Abbey Fenwick 3DH 98 1 0 14 Jan 2025
WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation Tianjian Jiang Johsan Billingham Sebastian Müksch Juan Jose Zarate Nicolas Evans Martin R. Oswald Marc Polleyfeys Otmar Hilliges Manuel Kaufmann Jie Song 3DH 100 3 0 06 Jan 2025
X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing Xinyan Chen Jianfei Yang 76 2 0 14 Oct 2024
Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes K. Ludwig Julian Lorenz Daniel Kienzle Tuan Bui Rainer Lienhart 3DH 70 1 0 26 Sep 2024
WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild Rolandos Alexandros Potamias Jinglei Zhang Jiankang Deng Stefanos Zafeiriou 3DH 73 12 0 18 Sep 2024
GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Lorenza Prospero Abdullah Hamdi João F. Henriques Christian Rupprecht 3DGS 68 3 0 06 Sep 2024
OmniRe: Omni Urban Scene Reconstruction Ziyu Chen Jiawei Yang Jiahui Huang Riccardo de Lutio Janick Martinez Esturo ... Zan Gojcic Sanja Fidler Marco Pavone Li Song Yue Wang 74 37 0 29 Aug 2024
ExpertAF: Expert Actionable Feedback from Video Kumar Ashutosh Tushar Nagarajan Georgios Pavlakos Kris Kitani Kristen Grauman VGen 96 3 0 01 Aug 2024
Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods Filipe Gama Matej Misar Lukas Navara S. T. Popescu Matej Hoffmann 3DH 70 2 0 25 Jun 2024
Pose Priors from Language Models Sanjay Subramanian Evonne Ng Lea Müller Dan Klein Shiry Ginosar Trevor Darrell 87 4 0 06 May 2024
Spatial Cognition from Egocentric Video: Out of Sight, Not Out of Mind Chiara Plizzari Shubham Goel Toby Perrett Jacob Chalk Angjoo Kanazawa Dima Damen 67 12 0 07 Apr 2024
Multiview Compressive Coding for 3D Reconstruction Chaozheng Wu Justin Johnson Jitendra Malik Christoph Feichtenhofer Georgia Gkioxari 63 73 0 19 Jan 2023
Scalable Diffusion Models with Transformers William S. Peebles Saining Xie GNN 77 2,275 0 19 Dec 2022
CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimation Zhihao Li Jianzhuang Liu Zhensong Zhang Songcen Xu Youliang Yan 3DH 48 222 0 01 Aug 2022
Cross-Attention of Disentangled Modalities for 3D Human Mesh Recovery with Transformers Junhyeong Cho Youwang Kim Tae-Hyun Oh ViT 38 122 0 27 Jul 2022
Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields Garvita Tiwari Dimitrije Antic J. E. Lenssen N. Sarafianos Tony Tung Gerard Pons-Moll 3DH 67 92 0 27 Jul 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation Yufei Xu Jing Zhang Qiming Zhang Dacheng Tao ViT 67 528 0 26 Apr 2022
HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video Chung-Yi Weng Brian L. Curless Pratul P. Srinivasan Jonathan T. Barron Ira Kemelmacher-Shlizerman 3DH 63 469 0 11 Jan 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 427 7,705 0 11 Nov 2021
HuMoR: 3D Human Motion Model for Robust Pose Estimation Davis Rempe Tolga Birdal Aaron Hertzmann Jimei Yang Srinath Sridhar Leonidas Guibas 3DH 72 316 0 10 May 2021
AGORA: Avatars in Geography Optimized for Regression Analysis Priyanka Patel C. Huang J. Tesch David T. Hoffmann Shashank Tripathi Michael J. Black 52 205 0 29 Apr 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 127 1,254 0 22 Apr 2021
Evaluating Neural Word Embeddings for Sanskrit Kevin Qinghong Lin Om Adideva Digumarthi Komal Laxmidhar Behera Pawan Goyal 74 12 0 01 Apr 2021
PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop Hongwen Zhang Yating Tian Xinchi Zhou Wanli Ouyang Yebin Liu Limin Wang Zhenan Sun 3DH 55 300 0 30 Mar 2021
3D Human Pose, Shape and Texture from Low-Resolution Images and Videos Xiangyu Xu Hao Chen Francesc Moreno-Noguer László A. Jeni Fernando de la Torre 3DH 106 35 0 11 Mar 2021
Human Mesh Recovery from Multiple Shots Georgios Pavlakos Jitendra Malik Angjoo Kanazawa 3DH 64 60 0 17 Dec 2020
End-to-End Human Pose and Mesh Reconstruction with Transformers Kevin Qinghong Lin Lijuan Wang Zicheng Liu ViT 65 624 0 17 Dec 2020
SMPLy Benchmarking 3D Human Pose Estimation in the Wild Vincent Leroy Philippe Weinzaepfel Romain Brégier Hadrien Combaluzier Grégory Rogez 3DH 48 21 0 04 Dec 2020
Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Video Hongsuk Choi Gyeongsik Moon Ju Yong Chang Kyoung Mu Lee 3DH 57 206 0 17 Nov 2020
Pose And Joint-Aware Action Recognition Anshul B. Shah Shlok Kumar Mishra Ankan Bansal Jun-Cheng Chen Ramalingam Chellappa Abhinav Shrivastava 59 33 0 16 Oct 2020
HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking Jonathon Luiten Aljosa Osep Patrick Dendorfer Philip Torr Andreas Geiger Laura Leal-Taixe Bastian Leibe VOT 72 904 0 16 Sep 2020
Human Body Model Fitting by Learned Gradient Descent Mingli Song Xu Chen Otmar Hilliges 3DH 47 100 0 19 Aug 2020
I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Image Gyeongsik Moon Kyoung Mu Lee 3DH 80 424 0 09 Aug 2020
Shape and Viewpoint without Keypoints Shubham Goel Angjoo Kanazawa Jitendra Malik 3DV 118 109 0 21 Jul 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 349 12,966 0 26 May 2020
Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimation Hanbyul Joo Natalia Neverova Andrea Vedaldi 3DH 43 155 0 07 Apr 2020
Human Mesh Recovery from Monocular Images via a Skeleton-disentangled Representation Yu Sun Yun Ye Wu Liu Wenpeng Gao Yili Fu Tao Mei 3DH 133 182 0 20 Aug 2019
Predicting 3D Human Dynamics from Video Jason Y. Zhang Panna Felsen Angjoo Kanazawa Jitendra Malik 3DH 45 110 0 13 Aug 2019
Tracking without bells and whistles Philipp Bergmann Tim Meinhardt Laura Leal-Taixe VOT 102 910 0 13 Mar 2019
On the Continuity of Rotation Representations in Neural Networks Yi Zhou Connelly Barnes Jingwan Lu Jimei Yang Hao Li 3DH 57 1,281 0 17 Dec 2018
SlowFast Networks for Video Recognition Christoph Feichtenhofer Haoqi Fan Jitendra Malik Kaiming He 162 3,262 0 10 Dec 2018
Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequences Nikolas Hesse S. Pujades Michael J. Black Michael Arens U. Hofmann A. Schroeder 3DH 49 58 0 17 Oct 2018