Long‐term Motion In‐betweening via Keyframe Prediction

Abstract

Motion in‐betweening has emerged as a promising approach to enhance the efficiency of motion creation due to its flexibility and time performance. However, previous in‐betweening methods are limited to generating short transitions due to growing pose ambiguity when the number of missing frames increases. This length‐related constraint makes the optimization hard and it further causes another constraint on the target pose, limiting the degrees of freedom for artists to use. In this paper, we introduce a keyframe‐driven approach that effectively solves the pose ambiguity problem, allowing robust in‐betweening performance on various lengths of missing frames. To incorporate keyframe‐driven motion synthesis, we introduce a keyframe score that measures the likelihood of a frame being used as a keyframe as well as an adaptive keyframe selection method that maintains appropriate temporal distances between resulting keyframes. Additionally, we employ phase manifolds to further resolve the pose ambiguity and incorporate trajectory conditions to guide the approximate movement of the character. Comprehensive evaluations, encompassing both quantitative and qualitative analyses, were conducted to compare our method with state‐of‐the‐art in‐betweening approaches across various transition lengths. The code for the paper is available at https://github.com/seokhyeonhong/long-mib