Data-driven curvature for real-time line drawing of dynamic scenes

Abstract

This article presents a method for real-time line drawing of deforming objects. Object-space line drawing algorithms for many types of curves, including suggestive contours, highlights, ridges, and valleys, rely on surface curvature and curvature derivatives. Unfortunately, these curvatures and their derivatives cannot be computed in real-time for animated, deforming objects. In a preprocessing step, our method learns the mapping from a low-dimensional set of animation parameters (e.g., joint angles) to surface curvatures for a deforming 3D mesh. The learned model can then accurately and efficiently predict curvatures and their derivatives, enabling real-time object-space rendering of suggestive contours and other such curves. This represents an order-of-magnitude speedup over the fastest existing algorithm capable of estimating curvatures and their derivatives accurately enough for many different types of line drawings. The learned model can generalize to novel animation sequences and is also very compact, typically requiring a few megabytes of storage at runtime. We demonstrate our method for various types of animated objects, including skeleton-based characters, cloth simulation, and blend-shape facial animation, using a variety of nonphotorealistic rendering styles.An important component of our system is the use of dimensionality reduction for differential mesh data. We show that Independent Component Analysis (ICA) yields localized basis functions, and gives superior generalization performance to that of Principal Component Analysis (PCA).

Multi-Scale Surface Descriptors

“…Principle curvatures can be used to depict the flow of curvature over the surface [9], and to then place textures along those flows, emphasizing important shape cues [13, 27, 2]. Line drawing techniques also utilize curvature [17, 5]. …”

Efficient and robust 3D line drawings using difference-of-Gaussian

“…They further extended Laplacian lines to illustrate volumetric datasets [5]. Based on a parallel method to compute curvatures and their derivatives on deforming objects with strong temporal coherence, Kalogerakis et al [16] proposed an algorithm to compute apparent ridges on dynamic objects. Cole et al [17] conducted a user study on where do artists draw lines to convey 3D shapes.…”

Feature Enhancement by Vertex Flow for 3D Shapes

“…The dilation and erosion of prong features are one of their applications. Recently, Eigensatz et al [5] provided a shape editing tool based on curvature domain processing. Surface curvature is direct accessed to facilitate shape processing, including filtering, synthesis and feature enhancement algorithms.…”