MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators

19 June 2023

Di Huang

Qi Chu

Wanli Ouyang

Papers citing "MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators"

50 / 88 papers shown

Title
Towards Robust and Controllable Text-to-Motion via Masked Autoregressive Diffusion Zongye Zhang Bohan Kong Qingjie Liu Yanjie Wang DiffM 19 0 0 16 May 2025
Text-driven Motion Generation: Overview, Challenges and Directions Ali Rida Sahili Najett Neji Hedi Tabia VGen 38 0 0 14 May 2025
Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation Lei Zhong Chuan Guo Yiming Xie Jiawei Wang Changjian Li VGen 52 0 0 27 Apr 2025
SocialGen: Modeling Multi-Human Social Interaction with Language Models Heng Yu Juze Zhang Changan Chen Tiange Xiang Yusu Fang Juan Carlos Niebles Ehsan Adeli VGen 49 0 0 28 Mar 2025
HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Models Mingzhen Huang Fu-Jen Chu Bugra Tekin Kevin J Liang Haoyu Ma ... Hongfei Xue Siwei Lyu Kris Kitani Matt Feiszli Hao Tang VLM 65 0 0 24 Mar 2025
MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space Lixing Xiao Shunlin Lu Huaijin Pi Ke Fan Liang Pan Yueer Zhou Ziyong Feng Xiaowei Zhou Sida Peng Jingbo Wang DiffM VGen 53 4 0 19 Mar 2025
MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding S. Han Peng Xia Ruiyi Zhang Tong Sun Yun-Qing Li Hongtu Zhu Huaxiu Yao VLM 103 4 0 18 Mar 2025
SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing Seokhyeon Hong Chaelin Kim Serin Yoon Junghyun Nam Sihun Cha Junyong Noh DiffM VGen 73 1 0 18 Mar 2025
Motion Anything: Any to Motion Generation Zeyu Zhang Yiran Wang Wei Mao Danning Li Rui Zhao Biao Wu Zirui Song Bohan Zhuang Ian Reid Richard I. Hartley DiffM VGen 55 1 0 13 Mar 2025
HERO: Human Reaction Generation from Videos Chengjun Yu Wei-dong Zhai Yuhang Yang Yang Cao Zheng-jun Zha VGen 56 0 0 11 Mar 2025
Multi-granular body modeling with Redundancy-Free Spatiotemporal Fusion for Text-Driven Motion Generation Xingzu Zhan Chen Xie Honghang Chen Haoran Sun Xiaochun Mai Mamba 50 0 0 10 Mar 2025
Unlocking Pretrained LLMs for Motion-Related Multimodal Generation: A Fine-Tuning Approach to Unify Diffusion and Next-Token Prediction Shinichi Tanaka Zhao Wang Yoichi Kato Jun Ohya DiffM 51 0 0 08 Mar 2025
Maximizing Signal in Human-Model Preference Alignment Kelsey Kraus Margaret Kroll ALM 55 0 0 06 Mar 2025
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion Ziyi Yang Fanqi Wan Longguang Zhong Canbin Huang Guosheng Liang Xiaojun Quan MoMe 98 0 0 06 Mar 2025
Mojito: LLM-Aided Motion Instructor with Jitter-Reduced Inertial Tokens Ziwei Shan Yaoyu He Chengfeng Zhao Jiashen Du Jingyan Zhang Qixuan Zhang Jingyi Yu Lan Xu 61 1 0 22 Feb 2025
Human-Centric Foundation Models: Perception, Generation and Agentic Modeling Shixiang Tang Yanjie Wang Lu Chen Yuan Wang Sida Peng Dan Xu W. Ouyang VGen 139 2 0 12 Feb 2025
CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing Yu Yuan Shizhao Sun Qi Liu Jiang Bian 103 0 0 06 Feb 2025
Graph Neural Backdoor: Fundamentals, Methodologies, Applications, and Future Directions Xiao Yang Gaolei Li Jianhua Li AAML AI4CE 51 1 0 08 Jan 2025
The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion Changan Chen Juze Zhang S. K. Lakshmikanth Yusu Fang Ruizhi Shao Gordon Wetzstein L. Fei-Fei Ehsan Adeli VGen 82 3 0 13 Dec 2024
SOLAMI: Social Vision-Language-Action Modeling for Immersive Interaction with 3D Autonomous Characters Jianping Jiang Weiye Xiao Zhengyu Lin H. Zhang Tianxiang Ren Yang Gao Zhiqian Lin Zhongang Cai Lei Yang Ziwei Liu 86 3 0 29 Nov 2024
DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding Jungbin Cho Junwan Kim Jisoo Kim Minseo Kim Mingu Kang S. Hong Tae-Hyun Oh Youngjae Yu VGen 94 1 0 29 Nov 2024
Rethinking Diffusion for Text-Driven Human Motion Generation Zichong Meng Yiming Xie Xiaogang Peng Zeyu Han Huaizu Jiang VGen 77 3 0 25 Nov 2024
DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction Li Zhao Zhengmin Lu VGen 32 0 0 07 Nov 2024
Textual Decomposition Then Sub-motion-space Scattering for Open-Vocabulary Motion Generation Ke Fan Jun Zhang Ran Yi Jingyu Gong Yabiao Wang Yating Wang Xin Tan Chengjie Wang Lizhuang Ma 41 2 0 06 Nov 2024
Spontaneous Emergence of Agent Individuality through Social Interactions in LLM-Based Communities Ryosuke Takata A. Masumori Takashi Ikegami LLMAG 28 1 0 05 Nov 2024
MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding Yuan Wang Di Huang Yaqi Zhang Wanli Ouyang J. Jiao Xuetao Feng Yan Zhou Pengfei Wan Shixiang Tang Dan Xu VGen 36 13 0 29 Oct 2024
MotionBank: A Large-scale Video Motion Benchmark with Disentangled Rule-based Annotations Liang Xu Shaoyang Hua Zili Lin Yifan Liu Feipeng Ma Yichao Yan Xin Jin Xiaokang Yang Wenjun Zeng VGen 39 3 0 17 Oct 2024
Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions Zhenyu Jiang Yuqi Xie Jinhan Li Ye Yuan Yifeng Zhu Yuke Zhu 29 10 0 16 Oct 2024
LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioning Zhe Li Weihao Yuan Yisheng He Lingteng Qiu Shenhao Zhu Xiaodong Gu Weichao Shen Yuan Dong Zilong Dong Laurence T. Yang 29 8 0 09 Oct 2024
Scaling Large Motion Models with Million-Level Human Motions Ye Wang Sipeng Zheng Bin Cao Qianshan Wei Qin Jin Qin Jin Zongqing Lu VGen 42 0 0 04 Oct 2024
COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models Divyanshu Daiya Damon Conover Aniket Bera DiffM 36 0 0 30 Sep 2024
EgoLM: Multi-Modal Language Model of Egocentric Motions Fangzhou Hong Vladimir Guzov Hyo Jin Kim Yuting Ye Richard Newcombe Ziwei Liu Lingni Ma 40 5 0 26 Sep 2024
MoGenTS: Motion Generation based on Spatial-Temporal Joint Modeling Weihao Yuan Weichao Shen Yisheng He Yuan Dong Xiaodong Gu Zilong Dong Liefeng Bo Qixing Huang MQ 31 2 0 26 Sep 2024
Human Motion Synthesis_ A Diffusion Approach for Motion Stitching and In-Betweening Michael Adewole Oluwaseyi Giwa Favour Nerrise Martins Osifeko A. Oyedeji VGen DiffM 26 2 0 10 Sep 2024
Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs Nafis Tanveer Islam Joseph Khoury Andrew Seong E. Bou-Harb Peyman Najafirad AAML 38 3 0 01 Sep 2024
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs Eui Jun Hwang Sukmin Cho Junmyeong Lee Jong C. Park SLR 76 4 0 20 Aug 2024
SMooDi: Stylized Motion Diffusion Model Lei Zhong Yiming Xie Varun Jampani Deqing Sun Huaizu Jiang DiffM 60 15 0 17 Jul 2024
Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation Peng Jin Hao Li Ze-Long Cheng Kehan Li Runyi Yu Chang-Shu Liu Xiangyang Ji Li-ming Yuan Jie Chen DiffM 39 3 0 15 Jul 2024
SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation Jordan Juravsky Yunrong Guo Sanja Fidler Xue Bin Peng AI4CE 39 9 0 15 Jul 2024
Human-Object Interaction from Human-Level Instructions Zhen Wu Jiaman Li Chenxi Liu LM&Ro 42 12 0 25 Jun 2024
YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals Sandeep Mishra Oindrila Saha A. Bovik 39 0 0 24 Jun 2024
Effective Generative AI: The Human-Algorithm Centaur S. Saghafian Lihi Idan 40 7 0 16 Jun 2024
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models Zhikai Zhang Yitang Li Haofeng Huang Mingxian Lin Li Yi 49 2 0 15 Jun 2024
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild Lingni Ma Yuting Ye Fangzhou Hong Vladimir Guzov Yifeng Jiang ... C. Karen Liu Ziwei Liu Jakob Engel R. D. Nardi Richard Newcombe 32 21 0 14 Jun 2024
Situational Awareness Matters in 3D Vision Language Reasoning Yunze Man Liang-Yan Gui Yu-Xiong Wang 43 12 0 11 Jun 2024
Data-Efficient Approach to Humanoid Control via Fine-Tuning a Pre-Trained GPT on Action Data Siddharth Padmanabhan Kazuki Miyazawa Takato Horii Takayuki Nagai 28 0 0 29 May 2024
M $^3$ GPT: An Advanced Multimodal, Multitask Framework for Motion Comprehension and Generation Mingshuang Luo Ruibing Hou Hong Chang Zimo Liu Yaowei Wang Shiguang Shan 40 11 0 25 May 2024
Learning Generalizable Human Motion Generator with Reinforcement Learning Yunyao Mao Xiaoyang Liu Wen-gang Zhou Zhenbo Lu Houqiang Li 38 2 0 24 May 2024
Language-Driven Interactive Traffic Trajectory Generation Junkai Xia Chenxin Xu Qingyao Xu Chen Xie Yanfeng Wang Siheng Chen 32 6 0 24 May 2024
Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor Haoxuan Qu Zhaoyang He Zeyu Hu Yujun Cai Jun Liu 48 1 0 24 May 2024