Temporally Coherent Video Stylization

Bénard, Pierre; Thollot, Joëlle; Collomosse, John

doi:10.1007/978-1-4471-4519-6_13

Cited by 2 publications

(3 citation statements)

References 63 publications

(86 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In comparison, our approach works on already stylized videos and can handle a broad range of stylization techniques. Numerous such specialized video‐based approaches have been discussed by Bénard et al [BTC13]. The above classical IB‐AR techniques approximate rendering primitives by modifying traditional image filters.…”

Section: Background and Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Interactive Control over Temporal Consistency while Stylizing Video Streams

Shekhar

Reimann

Hilscher

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

Image stylization has seen significant advancement and widespread interest over the years, leading to the development of a multitude of techniques. Extending these stylization techniques, such as Neural Style Transfer (NST), to videos is often achieved by applying them on a per‐frame basis. However, per‐frame stylization usually lacks temporal consistency, expressed by undesirable flickering artifacts. Most of the existing approaches for enforcing temporal consistency suffer from one or more of the following drawbacks: They (1) are only suitable for a limited range of techniques, (2) do not support online processing as they require the complete video as input, (3) cannot provide consistency for the task of stylization, or (4) do not provide interactive consistency control. Domain‐agnostic techniques for temporal consistency aim to eradicate flickering completely but typically disregard aesthetic aspects. For stylization tasks, however, consistency control is an essential requirement as a certain amount of flickering adds to the artistic look and feel. Moreover, making this control interactive is paramount from a usability perspective. To achieve the above requirements, we propose an approach that stylizes video streams in real‐time at full HD resolutions while providing interactive consistency control. We develop a lite optical‐flow network that operates at 80 Frames per second (FPS) on desktop systems with sufficient accuracy. Further, we employ an adaptive combination of local and global consistency features and enable interactive selection between them. Objective and subjective evaluations demonstrate that our method is superior to state‐of‐the‐art video consistency approaches. maxreimann.github.io/stream‐consistency

show abstract

Section: Background and Related Workmentioning

confidence: 99%

“…Such methods work effectively for the specific target style, however, do not generalize well. Many of these specialized approaches have been discussed by Bénard et al [BTC13].…”

Section: Introductionmentioning

confidence: 99%

Interactive Control over Temporal Consistency while Stylizing Video Streams

Shekhar

Reimann

Hilscher

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…Our work falls into the broad category of video stylization [KCWI13], where one of the main challenges is temporal coherence. A good overview of the temporal coherence problem in various approaches for video stylization is given in [BTC13]. Several of these stylization techniques address rendering styles of the whole frame such as comic style in [WXSC04, WCH*11] and [WOG06] or painterly rendering in [OH12].…”

Section: Previous Workmentioning

confidence: 99%

Line‐Drawing Video Stylization

Ben-Zvi

Bento

Mahler

et al. 2015

Computer Graphics Forum

View full text Add to dashboard Cite

We present a method to automatically convert videos and CG animations to stylized animated line drawings. Using a data‐driven approach, the animated drawings can follow the sketching style of a specific artist. Given an input video, we first extract edges from the video frames and vectorize them to curves. The curves are matched to strokes from an artist's library, while following the artist's stroke distribution and characteristics. The key challenge in this process is to match the large number of curves in the frames over time, despite topological and geometric changes, allowing to maintain temporal coherence in the output animation. We solve this problem using constrained optimization to build correspondences between tracked points and create smooth sheets over time. These sheets are then replaced with strokes from the artist's database to render the final animation. We evaluate our tracking algorithm on various examples and show stylized animation results based on various artists.

show abstract

Temporally Coherent Video Stylization

Cited by 2 publications

References 63 publications

Interactive Control over Temporal Consistency while Stylizing Video Streams

Interactive Control over Temporal Consistency while Stylizing Video Streams

Line‐Drawing Video Stylization

Contact Info

Product

Resources

About