More of the same: Synthesizing a variety by structural layering

Abstract

Highly detailed natural scenes and objects tend to be perceived as being realistic, while repeated parts and patterns decrease their realism. To avoid scenes with noticeable repeated elements, we introduce the notion of 'more of the same', which focuses on the task of generating additional similar instances from a small set of exemplars. The small number of exemplars, as well as their diversity and detailed structural texture, makes it difficult to apply statistical methods, or other machine learning tools, and thus more specialized tools need to be used. In this paper, we focus on generating a rich variation of highly detailed realistic leaves from just a handful set of examples.The method that we present does use only minimal domain specific knowledge and requires only minimal user assistance applied on a single training leaf exemplar to extract and separate structural layers. The knowledge from one leaf is then transferred to the other exemplars by a novel color/spatial layer inducing algorithm. The premise of structural layering is that each set of layers is simple enough to be synthesized separately and then composed into a novel leaf structural texture. This composition also allows the synthesis of slightly modified layers from the set of examples, which can generate a large set of differently looking leaves. We demonstrate numerous results of realistically looking leaves produced by our method from a small set of leaves.

Color Me Noisy: Example‐based Rendering of Hand‐colored Animations with Temporal Noise Control

“…A different approach to variety synthesis proposed by Assa and Cohen‐Or [ACO12] does not rely on texture synthesis but instead decomposes the exemplar into layers, which are then recombined and the result is randomly warped. In our scenario we would like to conform to the user‐defined shape, and the remaining small number of discrete varying outputs is insufficient to simulate the variety typical for hand‐colored animation.…”