Plan, Posture and Go: Towards Open-World Text-to-Motion Generation

22 December 2023

Papers citing "Plan, Posture and Go: Towards Open-World Text-to-Motion Generation"

48 / 48 papers shown

Title
MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model Wen-Dao Dai Ling-Hao Chen Jingbo Wang Jinpeng Liu Bo Dai Yansong Tang 132 62 0 31 Dec 2024
Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset Jing Lin Ailing Zeng Shunlin Lu Yuan-Yuan Cai Ruimao Zhang Haoqian Wang L. Zhang VGen 81 123 0 03 Jul 2023
DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation Susung Hong Junyoung Seo Heeseong Shin Sung‐Jin Hong Seung Wook Kim DiffM VGen 67 36 0 23 May 2023
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face Yongliang Shen Kaitao Song Xu Tan Dongsheng Li Weiming Lu Yueting Zhuang MLLM 122 908 0 30 Mar 2023
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action Zhengyuan Yang Linjie Li Jianfeng Wang Kevin Qinghong Lin E. Azarnasab Faisal Ahmed Zicheng Liu Ce Liu Michael Zeng Lijuan Wang ReLM KELM LRM 105 394 0 20 Mar 2023
FLAG3D: A 3D Fitness Activity Dataset with Language Instruction Yansong Tang Jinpeng Liu Aoyang Liu B. Yang Wen-Dao Dai Yongming Rao Jiwen Lu Jie Zhou Xiu Li 77 25 0 09 Dec 2022
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models Chan Hee Song Jiaman Wu Clay Washington Brian M Sadler Wei-Lun Chao Yu-Chuan Su LLMAG LM&Ro 132 418 0 08 Dec 2022
InstructPix2Pix: Learning to Follow Image Editing Instructions Tim Brooks Aleksander Holynski Alexei A. Efros DiffM 209 1,830 0 17 Nov 2022
Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard LM&Ro 241 367 0 11 Oct 2022
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng Zhang Yuxiao Dong Jie Tang BDL LRM 355 1,094 0 05 Oct 2022
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 270 767 0 29 Sep 2022
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models Ishika Singh Valts Blukis Arsalan Mousavian Ankit Goyal Danfei Xu Jonathan Tremblay Dieter Fox Jesse Thomason Animesh Garg LM&Ro LLMAG 175 656 0 22 Sep 2022
TEACH: Temporal Action Composition for 3D Humans Nikos Athanasiou Mathis Petrovich Michael J. Black Gül Varol 139 147 0 09 Sep 2022
MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model Mingyuan Zhang Zhongang Cai Liang Pan Fangzhou Hong Xinying Guo Lei Yang Ziwei Liu DiffM VGen 112 577 0 31 Aug 2022
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents Kai Zheng KAI-QING Zhou Jing Gu Yue Fan Jialu Wang Zong-xiao Li Xuehai He Xinze Wang LM&Ro 89 40 0 28 Aug 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 196 3,963 0 26 Jul 2022
Real-time Controllable Motion Transition for Characters Xiangjun Tang He Wang Bo Hu Xu Gong Ruifan Yi Qilong Kou Xiaogang Jin 90 55 0 05 May 2022
TEMOS: Generating diverse human motions from textual descriptions Mathis Petrovich Michael J. Black Gül Varol 128 389 0 25 Apr 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 413 6,908 0 13 Apr 2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes ... Ted Xiao Peng Xu Sichun Xu Mengyuan Yan Andy Zeng LM&Ro 192 1,984 0 04 Apr 2022
MotionCLIP: Exposing Human Motion Generation to CLIP Space Guy Tevet Brian Gordon Amir Hertz Amit H. Bermano Daniel Cohen-Or CLIP 125 345 0 15 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 883 13,176 0 04 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 298 30,149 0 01 Mar 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 480 15,734 0 20 Dec 2021
BABEL: Bodies, Action and Behavior with English Labels Abhinanda R. Punnakkal Arjun Chandrasekaran Nikos Athanasiou Alejandra Quiros-Ramirez Michael J. Black Max Planck Institute for Intelligent Systems 69 218 0 17 Jun 2021
Action-Conditioned 3D Human Motion Synthesis with Transformer VAE Mathis Petrovich Michael J. Black Gül Varol ViT 104 505 0 12 Apr 2021
Single-Shot Motion Completion with Transformer Yinglin Duan Tianyang Shi Zhengxia Zou Yenan Lin Zhehui Qian Bohan Zhang U. Michigan ViT 66 76 0 01 Mar 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 352 3,715 0 18 Feb 2021
Convolutional Autoencoders for Human Motion Infilling Manuel Kaufmann Emre Aksan Mingli Song Fabrizio Pece R. Ziegler Otmar Hilliges 3DH 54 101 0 22 Oct 2020
Action2Motion: Conditioned Generation of 3D Human Motions Chuan Guo Wei Ji Sen Wang Shihao Zou Qingyao Sun Annan Deng Minglun Gong Li Cheng 76 420 0 30 Jul 2020
Generative Tweening: Long-term Inbetweening of 3D Human Motions Yi Zhou Jingwan Lu Connelly Barnes Jimei Yang Sitao Xiang Hao li GAN 3DH 64 44 0 18 May 2020
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation Nils Reimers Iryna Gurevych 104 1,030 0 21 Apr 2020
A Spatio-temporal Transformer for 3D Human Motion Prediction Emre Aksan Manuel Kaufmann Peng Cao Otmar Hilliges ViT 72 231 0 18 Apr 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 239 7,547 0 02 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,301 0 27 Aug 2019
Expressive Body Capture: 3D Hands, Face, and Body from a Single Image Georgios Pavlakos Vasileios Choutas N. Ghorbani Timo Bolkart Ahmed A. A. Osman Dimitrios Tzionas Michael J. Black 3DH 55 1,725 0 11 Apr 2019
Composing Text and Image for Image Retrieval - An Empirical Odyssey Nam S. Vo Lu Jiang Chen Sun Kevin Patrick Murphy Li Li Li Fei-Fei James Hays CoGe 56 368 0 18 Dec 2018
On the Continuity of Rotation Representations in Neural Networks Yi Zhou Connelly Barnes Jingwan Lu Jimei Yang Hao Li 3DH 80 1,294 0 17 Dec 2018
Human Motion Prediction via Spatio-Temporal Inpainting Alejandro Hernandez Ruiz Juergen Gall Francesc Moreno-Noguer 3DH 64 212 0 13 Dec 2018
Action-Agnostic Human Pose Forecasting Hsu-kuang Chiu Ehsan Adeli Borui Wang De-An Huang Juan Carlos Niebles 3DH 68 163 0 23 Oct 2018
A Neural Temporal Model for Human Motion Prediction Anand Gopalakrishnan A. Mali Daniel Kifer C. Lee Giles Alexander Ororbia 3DH 74 176 0 09 Sep 2018
QuaterNet: A Quaternion-based Recurrent Model for Human Motion Dario Pavllo David Grangier Michael Auli 3DH 69 263 0 16 May 2018
Human Motion Modeling using DVGANs Xiaoyu Lin Mohamed R. Amer 71 75 0 27 Apr 2018
HP-GAN: Probabilistic 3D human motion prediction via GAN Emad Barsoum J. Kender Zicheng Liu 3DH 86 331 0 27 Nov 2017
The KIT Motion-Language Dataset Matthias Plappert Christian Mandery Tamim Asfour 248 289 0 13 Jul 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 174 5,037 0 27 Jun 2016
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 306 7,016 0 12 Mar 2015
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.1K 23,388 0 03 Jun 2014