MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators

19 June 2023

Di Huang

Qi Chu

Wanli Ouyang

Papers citing "MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators"

38 / 88 papers shown

Title
Generating Human Motion in 3D Scenes from Text Descriptions Zhi Cen Huaijin Pi Sida Peng Zehong Shen Minghui Yang Shuai Zhu Hujun Bao Xiaowei Zhou 50 19 0 13 May 2024
MLP: Motion Label Prior for Temporal Sentence Localization in Untrimmed 3D Human Motions Sheng Yan Mengyuan Liu Yong Wang Yang Liu Chong Chen Hong Liu 46 0 0 21 Apr 2024
Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion Xinghan Wang Zixi Kang Yadong Mu Mamba 36 7 0 17 Apr 2024
Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions Leena Mathur Paul Pu Liang Louis-Philippe Morency LLMAG 38 7 0 17 Apr 2024
Exploring Text-to-Motion Generation with Human Preference Jenny Sheng Matthieu Lin Andrew Zhao Kevin Pruvost Yu-Hui Wen Yangguang Li Gao Huang Yong-Jin Liu VGen 42 1 0 15 Apr 2024
Large Motion Model for Unified Multi-Modal Motion Generation Mingyuan Zhang Daisheng Jin Chenyang Gu Fangzhou Hong Zhongang Cai ... Chongzhi Zhang Xinying Guo Lei Yang Ying He Ziwei Liu VGen 60 25 0 01 Apr 2024
LLMs are Good Action Recognizers Haoxuan Qu Yujun Cai Jun Liu 38 16 0 31 Mar 2024
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction Sirui Xu Ziyin Wang Yu-Xiong Wang Liangyan Gui 45 25 0 28 Mar 2024
GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner Haoxuan Qu Ziyan Guo Jun Liu VGen 51 3 0 22 Mar 2024
CoMo: Controllable Motion Generation through Language Guided Pose Code Editing Yiming Huang Weilin Wan Yue Yang Chris Callison-Burch Mark Yatskar Lingjie Liu 39 22 0 20 Mar 2024
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents Jieming Cui Tengyu Liu Nian Liu Yaodong Yang Yixin Zhu Siyuan Huang 59 21 0 19 Mar 2024
FG-MDM: Towards Zero-Shot Human Motion Generation via Fine-Grained Descriptions Xu Shi Wei Yao Chuanchen Luo Junran Peng Hongwen Zhang Yunlian Sun VGen 36 4 0 05 Dec 2023
EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion Generation Wenyang Zhou Zhiyang Dou Zeyu Cao Zhouyingcheng Liao Jingbo Wang Wenjia Wang Yuan Liu Taku Komura Wenping Wang Lingjie Liu VGen 44 48 0 04 Dec 2023
Hulk: A Universal Knowledge Translator for Human-Centric Tasks Yizhou Wang YiXuan Wu Shixiang Tang Weizhen He Xun Guo ... Lei Bai Rui Zhao Jian Wu Tong He Wanli Ouyang VLM 46 14 0 04 Dec 2023
MoMask: Generative Masked Modeling of 3D Human Motions Chuan Guo Yuxuan Mu Muhammad Gohar Javed Sen Wang Li Cheng VGen 49 121 0 29 Nov 2023
Generative Hierarchical Temporal Transformer for Hand Action Recognition and Motion Prediction Yilin Wen Hao Pan Takehiko Ohkawa Lei Yang Jia Pan Yoichi Sato Taku Komura Wenping Wang 44 0 0 29 Nov 2023
AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond Zixiang Zhou Yu Wan Baoyuan Wang 21 32 0 28 Nov 2023
SemanticBoost: Elevating Motion Generation with Augmented Textual Cues Xin He Shaoli Huang Xiaohang Zhan Chao Wen Ying Shan 31 4 0 31 Oct 2023
Frozen Transformers in Language Models Are Effective Visual Encoder Layers Ziqi Pang Ziyang Xie Yunze Man Yu-xiong Wang 53 25 0 19 Oct 2023
OmniControl: Control Any Joint at Any Time for Human Motion Generation Yiming Xie Varun Jampani Lei Zhong Deqing Sun Huaizu Jiang DiffM 34 109 0 12 Oct 2023
Universal Humanoid Motion Representations for Physics-Based Control Zhengyi Luo Jinkun Cao Josh Merel Alexander W. Winkler Jing Huang Kris Kitani Weipeng Xu 28 50 0 06 Oct 2023
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Fernanda De La Torre Cathy Mengying Fang Han Huang Andrzej Banburski-Fahey Judith Amores Fernandez Jaron Lanier 40 45 0 21 Sep 2023
What is the Best Automated Metric for Text to Motion Generation? Jordan Voas Yili Wang Qixing Huang Raymond Mooney EGVM 33 12 0 19 Sep 2023
Unified Human-Scene Interaction via Prompted Chain-of-Contacts Zeqi Xiao Tai Wang Jingbo Wang Jinkun Cao Wenwei Zhang Bo Dai Dahua Lin Jiangmiao Pang 49 69 0 14 Sep 2023
UbiPhysio: Support Daily Functioning, Fitness, and Rehabilitation with Action Understanding and Feedback in Natural Language Chongyang Wang Yuan Feng L. Zhong Siyi Zhu Chi Zhang ... Chen Liang Yuntao wang Chen-Jun He Chun Yu Yuanchun Shi 30 5 0 21 Aug 2023
Self-Supervised Learning of Gait-Based Biomarkers R. J. Cotton J. D. P. F. er Kunal Shah Allison DeLillo A. Cimorelli Shawana Anarwala Kayan Abdou T. Karakostas SSL 30 6 0 30 Jul 2023
Large Language Models as General Pattern Machines Suvir Mirchandani F. Xia Peter R. Florence Brian Ichter Danny Driess Montse Gonzalez Arenas Kanishka Rao Dorsa Sadigh Andy Zeng LLMAG 59 185 0 10 Jul 2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan ... Junfeng Tian Qiang Qi Ji Zhang Feiyan Huang Jingren Zhou VLM MLLM 210 906 0 27 Apr 2023
InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions Hanming Liang Wenqian Zhang Wenxu Li Jingyi Yu Lan Xu DiffM VGen 26 101 0 12 Apr 2023
Vision-Language Models as Success Detectors Yuqing Du Ksenia Konyushkova Misha Denil A. Raju Jessica Landon Felix Hill Nando de Freitas Serkan Cabi MLLM LRM 91 78 0 13 Mar 2023
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 223 724 0 29 Sep 2022
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Texts Chuan Guo Xinxin Xuo Sen Wang Li Cheng VGen 87 230 0 04 Jul 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 372 12,081 0 04 Mar 2022
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 238 814 0 14 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,872 0 18 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,805 0 24 Feb 2021
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ Ruilong Li Sha Yang David A. Ross Angjoo Kanazawa ViT 219 482 0 21 Jan 2021
The KIT Motion-Language Dataset Matthias Plappert Christian Mandery Tamim Asfour 193 273 0 13 Jul 2016