Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure

23 November 2021

A. Aristidou

Anastasios Yiannakidis

Kfir Aberman

Daniel Cohen-Or

Ariel Shamir

Y. Chrysanthou

ArXiv PDF HTML

Papers citing "Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure"

50 / 51 papers shown

Title
MAGE:A Multi-stage Avatar Generator with Sparse Observations Fangyu Du Yang Yang Xuehao Gao Hongye Hou VGen 26 0 0 09 May 2025
MusicInfuser: Making Video Diffusion Listen and Dance Susung Hong Ira Kemelmacher-Shlizerman Brian L. Curless Steven M. Seitz VGen 52 0 0 18 Mar 2025
HERO: Human Reaction Generation from Videos Chengjun Yu Wei-dong Zhai Yuhang Yang Yang Cao Zheng-jun Zha VGen 56 0 0 11 Mar 2025
SPG: Improving Motion Diffusion by Smooth Perturbation Guidance Boseong Jeon DiffM 50 0 0 04 Mar 2025
Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysis Xuehao Gao Yang Yang Shaoyi Du Guo-Jun Qi Junwei Han 41 1 0 01 Mar 2025
EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning Xuehao Gao Yang Yang Shaoyi Du Yang Wu Y. Liu Guo-Jun Qi 37 1 0 01 Mar 2025
Fatigue-PINN: Physics-Informed Fatigue-Driven Motion Modulation and Synthesis Iliana Loi Konstantinos Moustakas 56 0 0 26 Feb 2025
LEAD: Latent Realignment for Human Motion Diffusion Nefeli Andreou Xi Wang Victoria Fernandez-Abrevaya Marie-Paule Cani Y. Chrysanthou Vicky Kalogeiton VGen DiffM 37 2 0 18 Oct 2024
MotionRL: Align Text-to-Motion Generation to Human Preferences with Multi-Reward Reinforcement Learning Xiaoyang Liu Yunyao Mao Wengang Zhou Houqiang Li 40 2 0 09 Oct 2024
T2M-X: Learning Expressive Text-to-Motion Generation from Partially Annotated Data Mingdian Liu Y. Liu Gurunandan Krishnan Karl S Bayer Bing Zhou VGen 39 0 0 20 Sep 2024
Dynamic Motion Synthesis: Masked Audio-Text Conditioned Spatio-Temporal Transformers Sohan Anisetty James Hays 41 0 0 03 Sep 2024
ViMo: Generating Motions from Casual Videos Liangdong Qiu Chengxing Yu Yanran Li Zhao Wang Haibin Huang Chongyang Ma Di Zhang Pengfei Wan Xiaoguang Han VGen 39 2 0 13 Aug 2024
Learning Generalizable Human Motion Generator with Reinforcement Learning Yunyao Mao Xiaoyang Liu Wen-gang Zhou Zhenbo Lu Houqiang Li 38 2 0 24 May 2024
Music to Dance as Language Translation using Sequence Models André Rosa de Sousa Porfírio Correia Luís A. Alexandre 35 1 0 22 Mar 2024
ReGenNet: Towards Human Action-Reaction Synthesis Liang Xu Yizhou Zhou Yichao Yan Xin Jin Wenhan Zhu Fengyun Rao Xiaokang Yang Wenjun Zeng 38 16 0 18 Mar 2024
Bidirectional Autoregressive Diffusion Model for Dance Generation Canyu Zhang Youbao Tang Ning Zhang Ruei-Sung Lin Mei Han Jing Xiao Song Wang 33 7 0 06 Feb 2024
MotionMix: Weakly-Supervised Diffusion for Controllable Motion Generation Nhat M. Hoang Kehong Gong Chuan Guo Michael Bi Mi DiffM 36 7 0 20 Jan 2024
GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generation Xuehao Gao Yang Yang Zhenyu Xie Shaoyi Du Zhongqian Sun Yang Wu DiffM 37 14 0 04 Jan 2024
Inter-X: Towards Versatile Human-Human Interaction Analysis Liang Xu Xintao Lv Yichao Yan Xin Jin Shuwen Wu ... Fengyun Rao Xingdong Sheng Yunhui Liu Wenjun Zeng Xiaokang Yang 31 26 0 26 Dec 2023
T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representations Congyi Wang 22 4 0 17 Dec 2023
DanceMeld: Unraveling Dance Phrases with Hierarchical Latent Codes for Music-to-Dance Synthesis Xin Gao Liucheng Hu Peng Zhang Bang Zhang Liefeng Bo DiffM 40 4 0 30 Nov 2023
SpeechAct: Towards Generating Whole-body Motion from Speech Jinsong Zhang Minjie Zhu Yuxiang Zhang Yebin Liu Kun Li 28 0 0 29 Nov 2023
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions Anindita Ghosh Rishabh Dabral Vladislav Golyanik Christian Theobalt Philipp Slusallek 23 17 0 28 Nov 2023
SemanticBoost: Elevating Motion Generation with Augmented Textual Cues Xin He Shaoli Huang Xiaohang Zhan Chao Wen Ying Shan 28 4 0 31 Oct 2023
Controllable Group Choreography using Contrastive Diffusion Nhat Le Tuong Khanh Long Do Khoa Do Hien Nguyen Erman Tjiputra Quang-Dieu Tran Anh Nguyen 45 10 0 29 Oct 2023
MOCHA: Real-Time Motion Characterization via Context Matching Deok-Kyeong Jang Yuting Ye Jungdam Won Sung-Hee Lee 24 6 0 16 Oct 2023
LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation Yihao Zhi Xiaodong Cun Xuelin Chen Xi Shen Wen Guo Shaoli Huang Shenghua Gao 32 27 0 17 Sep 2023
MAGMA: Music Aligned Generative Motion Autodecoder Sohan Anisetty Amit Raj James Hays 26 0 0 03 Sep 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Xiaozhong Liu 78 31 0 27 Aug 2023
TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis Zihan Zhang Richard Liu Kfir Aberman Rana Hanocka DiffM 32 26 0 27 Jul 2023
Human Motion Generation: A Survey Wentao Zhu Xiaoxuan Ma Dongwoo Ro Hai Ci Jinlu Zhang Jiaxin Shi Feng Gao Qi Tian Yizhou Wang VGen 47 53 0 20 Jul 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 30 6 0 24 May 2023
Enhanced Fine-grained Motion Diffusion for Text-driven Human Motion Synthesis Dong Wei Xiaoning Sun Huaijiang Sun Bin Li Sheng-liang Hu Weiqing Li Jian-Zhou Lu DiffM 25 10 0 23 May 2023
Robust Dancer: Long-term 3D Dance Synthesis Using Unpaired Data Bin Feng Tenglong Ao Zequn Liu Wei Ju Libin Liu Ming Zhang 22 3 0 29 Mar 2023
Single Motion Diffusion Sigal Raab Inbal Leibovitch Guy Tevet Moab Arar Amit H. Bermano Daniel Cohen-Or DiffM VGen 21 57 0 12 Feb 2023
DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning Aneesh Bhattacharya Manas Paranjape Uttaran Bhattacharya Aniket Bera DiffM 24 2 0 30 Jan 2023
T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations Jianrong Zhang Yangsong Zhang Xiaodong Cun Shaoli Huang Yong Zhang Hongwei Zhao Hongtao Lu Xiaodong Shen 39 331 0 15 Jan 2023
MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis Rishabh Dabral Muhammad Hamza Mughal Vladislav Golyanik Christian Theobalt DiffM VGen 32 172 0 08 Dec 2022
Muscles in Action Mia Chiquier Carl Vondrick 6 1 0 05 Dec 2022
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models Simon Alexanderson Rajmund Nagy Jonas Beskow G. Henter DiffM VGen 24 165 0 17 Nov 2022
Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings Tenglong Ao Qingzhe Gao Yuke Lou Baoquan Chen Libin Liu SLR 27 59 0 04 Oct 2022
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 223 724 0 29 Sep 2022
NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System Weiqiang Wang Xuefei Zhe Huan Chen Di Kang Tingguang Li Ruizhi Chen Linchao Bao 46 5 0 27 Sep 2022
Interaction Mix and Match: Synthesizing Close Interaction using Conditional Hierarchical GAN with Multi-Hot Class Embedding Aman Goel Qianhui Men Edmond S. L. Ho 30 7 0 23 Jul 2022
Music-driven Dance Regeneration with Controllable Key Pose Constraints Junfu Pu Ying Shan 13 4 0 08 Jul 2022
MoDi: Unconditional Motion Synthesis from Diverse Data Sigal Raab Inbal Leibovitch Peizhuo Li Kfir Aberman O. Sorkine-Hornung Daniel Cohen-Or DiffM 19 54 0 16 Jun 2022
GANimator: Neural Motion Synthesis from a Single Sequence Peizhuo Li Kfir Aberman Zihan Zhang Rana Hanocka O. Sorkine-Hornung GAN 11 33 0 05 May 2022
MotionCLIP: Exposing Human Motion Generation to CLIP Space Guy Tevet Brian Gordon Amir Hertz Amit H. Bermano Daniel Cohen-Or CLIP 39 324 0 15 Mar 2022
Pose Representations for Deep Skeletal Animation Nefeli Andreou A. Aristidou Y. Chrysanthou 3DH 21 8 0 27 Nov 2021
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ Ruilong Li Sha Yang David A. Ross Angjoo Kanazawa ViT 219 479 0 21 Jan 2021