Neural animation layering for synthesizing martial arts movements

Starke, Sebastian; Zhao, Yiwei; Zinno, Fabio; Komura, Taku

doi:10.1145/3476576.3476651

Cited by 5 publications

(1 citation statement)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recent studies developed regression‐based deep learning models to learn the relationship between the control inputs and their corresponding motions in a deterministic way [HKS17, SZKS19, BBKK17, FNM19, FLFM15, MBR17]. These models can generate high‐quality motions that satisfy the control inputs encoded by neural encoder networks [ZSKS18,SZKS19,SZKZ20,SZZK21, CGM*20]. However, the regression‐based approach has limited capability to generate diverse poses from the same input.…”

Section: Related Workmentioning

confidence: 99%

DAFNet: Generating Diverse Actions for Furniture Interaction by Learning Conditional Pose Distribution

Jin,

Lee

2023

Computer Graphics Forum

View full text Add to dashboard Cite

We present DAFNet, a novel data‐driven framework capable of generating various actions for indoor environment interactions. By taking desired root and upper‐body poses as control inputs, DAFNet generates whole‐body poses suitable for furniture of various shapes and combinations. To enable the generation of diverse actions, we introduce an action predictor that automatically infers the probabilities of individual action types based on the control input and environment. The action predictor is learned in an unsupervised manner by training Gaussian Mixture Variational Autoencoder (GMVAE). Additionally, we propose a two‐part normalizing flow‐based pose generator that sequentially generates upper and lower body poses. This two‐part model improves motion quality and the accuracy of satisfying conditions over a single model generating the whole body. Our experiments show that DAFNet can create continuous character motion for indoor scene scenarios, and both qualitative and quantitative evaluations demonstrate the effectiveness of our framework.We propose DAFNet, a novel data‐driven framework that can generate various actions for indoor environment interactions. Given the desired root and upper‐body pose as control inputs, DAFNet generates whole‐body poses for a character appropriate for furniture of various shapes and combinations.image

show abstract