On-the-fly multi-scale infinite texturing from example

Abstract

In computer graphics, rendering visually detailed scenes is often achieved through texturing. We propose a method for on-the-fly non-periodic infinite texturing of surfaces based on a single image. Pattern repetition is avoided by defining patches within each texture whose content can be changed at runtime. In addition, we consistently manage multi-scale using one input image per represented scale. Undersampling artifacts are avoided by accounting for fine-scale features while colors are transferred between scales. Eventually, we allow for relief-enhanced rendering and provide a tool for intuitive creation of height maps. This is done using an adhoc local descriptor that measures feature self-similarity in order to propagate height values provided by the user for a few selected texels only. Thanks to the patch-based system, manipulated data are compact and our texturing approach is easy to implement on GPU. The multi-scale extension is capable of rendering finely detailed textures in real-time.

Repeatable texture sampling with interchangeable patches

“…This paper introduces a method which allows parallel texture synthesis with patches of arbitrary shape, without the necessity of a fixed repeating patch boundary. In previous work [17], selection of interchangeable patches at runtime was also possible, but required a repeating fixed patch boundary. As discussed later, the method presented here has similar pre-processing complexity, memory consumption, and rendering speed, but allows a wider class of interchange types with higher variability, resulting in a higher quality texture.…”

“…Parallel non-constant-time patch replacement methods [5,15,17] perform a non-constant overhead operation while rendering, to address grid artefacts. These methods place patches of precomputed shape on the texture at run-time, according to a run-time computation, but require a fixed patch map whose boundaries cannot be overlaid with a patch.…”

“…These methods place patches of precomputed shape on the texture at run-time, according to a run-time computation, but require a fixed patch map whose boundaries cannot be overlaid with a patch. For example, in the offline step of [17], a fixed repeating patch map is created, along with various interchangeable patches which fit the patch map boundaries ( Figure 5). The texture can then be sampled independently online with a pseudo-random number generator at each repeating patch map.…”

“…A visual comparison of methods which precompute tiles and select placement during rendering is shown for: Wang tiles (Figure 4), fixed map patches of [17] (Figure 5), and patches without map boundaries presented here ( Figure 6). In each figure, the precomputed set of patches or shapes is on the left, with colors corresponding to places of interchangeability.…”

“…A discussion of the benefits of this approach is in the results section. [17]. Precomputed fixed patch map and patches for content exchange on the left, and a synthesised image on the right Fig.…”