Motion Map Generation for Maintaining the Temporal Coherence of Brush Strokes

State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video

“…Green et al [44] report that over 1000 man-hours of manual correction to optical flow fields were required to produce the short painterly scenes in the movie. Nevertheless, optical flow features as a key component of many video painting algorithms [10], [52], [94], [122], [157].…”

“…Thus, so long as the motion of strong strokes varied smoothly, stroke orientation also varied smoothly. Park and Yoon [122] adopted a similar strong-weak categorization. As with all approaches, the regularization of stroke density must be addressed.…”

Pencil drawing animation from a video

“…Unlike previous methods for painterly animation , where they focus on stroke translations, according to the optical flows at the pixels and constrain stroke rotations, our method considers the volume and shape of a stroke and focuses on the rotation and translation. So thin, narrow, and sharp pencil strokes are rotated coherently, sticking to the objects in the real world and conveying the accurate structure and shape of the underlying objects.…”

“…Therefore, temporally coherent animation must consider the orientation of strokes, as well as the position of strokes. Previous painterly animation methods move strokes according to the object motions but constrain the orientation of strokes during animation. Thus, smooth rotation of strokes sticking to the objects is difficult to achieve, and the results lose the structured shape and motion of objects.…”

“…Recently, many researchers have tried non‐photorealistic rendering from videos based on filtering . Most of them make 3D video cube by putting 2D frames along the time frames and develop a method to extract smooth motion trajectories among 3D video cubes.…”