Instant texture transmission using bandwidth-optimized progressive interlacing images

Abstract

t t a ) b ) 8 7 ms 8 6 1 ms 3 8 6 ms 8 7 ms 1 3 1 0 ms 3 8 6 msFigure 1: Refinement levels of textured 3D model with (a) our proposed GPUII texture vs. (b) traditional texture (where mesh is transmitted faster, while texture is still loading), both used in combination with X3DOM's progressively streamed geometry (cf. [Limper et al. 2013]). AbstractWe present an adaptive bandwidth-optimized approach for progressive image transmission to allow instant textured rendering in webbased 3D applications. Applications utilizing a lot of image data require an adaptive technology to build responsive user interfaces. This applies especially for the use in mobile networks. While several approaches provide a progressive geometry streaming, they do not focus on a fast and simple texture streaming for 3D web applications. However, standard 2D image transmission technologies are usually inappropriate within a 3D context. In 2D, image size as well as resolution are often set during the authoring phase, whereas in 3D applications size and displayed resolution of textured 3D objects depend on the virtual camera. An adaptive texture transmission mechanism has to consider this as part of its control function. Our approach thus combines progressive texture streaming with an adaptive number of refinement levels without any pixel retransmission. It enables a fast user feedback and reduces the transmitted data to a minimum without loss of visual quality. Moreover, our GPUII approach (GPU-based Image Interlacing) allows an easy integration into existing applications while also reducing the CPU load.

Animation on the web

“…One approach to reduce the vertex buffer switches, is to have all the mesh data in a single image (either a texture atlas or map) and create one VBO on the JavaScript layer and bind it with this single image geometry and have all the other data directly uploaded as textures in the GPU. This is similar to the technique used in [Behr et al 2012], [Schwartz et al 2011], [Englert et al 2014] and [Stein et al 2014]. This allows the GPU to store more mesh data, and calculate all the decoding and vertex coordination on the fly.…”

Efficient Image Distribution on the Web - Instant Texturing for Collaborative Visualization of Virtual Environments

“…The first preview can be displayed directly without any decoding effort. All consecutively loaded n − 1 image levels are integrated into the already existing image, following the algorithm sketched in (Englert et al, 2014) -here, cp. figure 2 for a visualization.…”

“…However, for small models the texture data usually takes more time to transfer and thus the progressive 3D geometry will not have a texture until the transfer is completed. To enhance the quality, GPUII can be combined with the POP approach so that the visual perception is more consistent in that the geometry and texture data build up simultaneously, see (Englert et al, 2014). Note that smaller loading times are possible if for a certain camera distance not the full texture quality is needed.…”