Real-time multi-view rendering architecture for autostereoscopic displays

Chen, Hsin-Jung; Lo, Feng-Hsiang; Jan, Fu-Chiang; Wu, Shengping

doi:10.1109/iscas.2010.5537312

Cited by 12 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, a hybrid rendering method exists that combines a color-coded surface rendering method and a volume rendering method, exploits the advantages of both rendering methods, provides an excellent overview of the tracheobronchial system and allows clear depiction of the complex spatial relationships of anatomical and pathological features [31]. A multiview rendering hardware architecture consisting of hybrid parallel DBIR and pipeline interlacing is proposed to improve the performance in [32]. The proposed multiview rendering architecture can achieve 60 frames per second for processing full HD (1920 × 1080) video in a real-time processing system.…”

Section: B Image-based Rendering Methodsmentioning

confidence: 99%

A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique

et al. 2020

View full text Add to dashboard Cite

Super multiview (SMV) 3D displays with a directional diffuser can provide dense viewpoints, wide viewing angles and high image quality. However, traditional SMV 3D rendering pipelines have many disadvantages, such as high time costs, low image quality, incorrect lighting effects and limited viewing angles. To overcome the abovementioned drawbacks, we propose a new SMV 3D rendering pipeline based on a hybrid rendering technique (HRT) that effectively combines and improves the Turing multiview rendering technique, the multiple view plus depth (MVD) technique and the deferred shading technique, introducing additional normal information, diffuseness information and shininess information into the SMV 3D rendering pipeline. The SMV HRT pipeline can generate SMV 3D images with accurate lighting in real time when the viewpoint number of an SMV 3D display is greater than 50, the viewing angle is greater than 100 degrees, the resolution of a single viewpoint image is more than 512 * 512 and the resolution of the LCD panel is 7680 * 4320; in particular, complex scenes can be generated in real time. The proposed HRT pipeline is the only viable real-time rendering pipeline with accurate lighting effects for super multiview 3D displays with wide viewing angle and high resolution that runs on a common PC with standard graphics hardware. An 8k SMV 3D display with an 80 • viewing angle and 100 viewpoints is applied to demonstrate the validity of the HRT method in experiments. When the number of reference views is four, the experimental results show that the rendering frame rate is more than 35 fps on average for complex virtual scenes, and the peak signal-to-noise ratio (PSNR) value of the HRT is greater than 36 dB, illustrating its high image quality and accurate lighting. Compared with state-of-the-art MVD methods, HRT processes more lighting information and is more suitable for virtual scene rendering. Therefore, the HRT method has advantages regarding the image quality of the reconstructed 3D image and can easily achieve real-time rendering for SMV 3D displays with wide viewing angles.INDEX TERMS 3D display, super multiview display, real-time rendering, wide viewing angle, computer-generated 3D image.

show abstract

Section: B Image-based Rendering Methodsmentioning

confidence: 99%

A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique

et al. 2020

View full text Add to dashboard Cite

show abstract

“…In order to support multi-view VR rendering, we implement the SMP engine in ATTILA-sim based on the state-of-the-art SMP technology [8,9] which re-projects the triangles in left view to right using updated viewport. Figure 5 shows the rendering example of Half-Life 2 after enabling SMP in ATTILA-sim.…”

Section: Experimental Methodologymentioning

confidence: 99%

“…Due to the observation that some objects in the scene (e.g. the robot in Figure 1) are shared by two eyes, mainstream graphics engines such as NVIDIA and UNITY employ simultaneous multi-projection (SMP) to generate the left and right frames simultaneously through single rendering process [8,9,27,35]. This significantly reduces workload redundancy and achieves substantial performance gain.…”

Section: Background and Motivation 21 Multi-view Rendering In Virtuamentioning

confidence: 99%

Oo-Vr

Xie

Chen

et al. 2019

Proceedings of the 46th International Symposium on Computer Architecture

View full text Add to dashboard Cite

With the strong computation capability, NUMA-based multi-GPU system is a promising candidate to provide sustainable and scalable performance for Virtual Reality (VR) applications and deliver the excellent user experience. However, the entire multi-GPU system is viewed as a single GPU under the single programming model which greatly ignores the data locality among VR rendering tasks during the workload distribution, leading to tremendous remote memory accesses among GPU models (GPMs). The limited inter-GPM link bandwidth (e.g., 64GB/s for NVlink) becomes the major obstacle when executing VR applications in the multi-GPU system. By conducting comprehensive characterizations on different kinds of parallel rendering frameworks, we observe that distributing the rendering object along with its required data per GPM can reduce the inter-GPM memory accesses. However, this object-level rendering still faces two major challenges in NUMA-based multi-GPU system: (1) the large data locality between the left and right views of the same object and the data sharing among different objects and (2) the unbalanced workloads induced by the softwarelevel distribution and composition mechanisms.To tackle these challenges, we propose object-oriented VR rendering framework (OO-VR) that conducts the software and hardware co-optimization to provide a NUMA friendly solution for VR multi-view rendering in NUMA-based multi-GPU systems. We first propose an object-oriented VR programming model to exploit the data sharing between two views of the same object and group objects into batches based on their texture sharing levels. Then, we design an object aware runtime batch distribution engine and distributed hardware composition unit to achieve the balanced workloads among GPMs and further improve the performance of VR rendering. Finally, evaluations on our VR featured simulator show that OO-VR provides 1.58x overall performance improvement

show abstract

“…In [2] a rendering hardware architecture based on hybrid parallel depth image based rendering and pipeline interlacing is presented. Fu et al [7] proposed an architecture for image reconstruction based on pixel rearrangement, color space conversion and pixel downsampling.…”

Section: Introductionmentioning

confidence: 99%

Synthetic content generation for auto-stereoscopic displays

Gonzalez

Sotoca

Pla

et al. 2013

Multimed Tools Appl

View full text Add to dashboard Cite

Due to the appearance of auto-stereoscopic visualization as one of the most emerging tendencies used in displays, new content generation techniques for this kind of visualization are required. In this paper we present a study for the generation of multi-view synthetic content, studying several camera setups (planar, cylindrical and hyperbolic) and their configurations. We discuss the different effects obtained varying the parameters of these setups. A study with several users was made to analyze visual perceptions, asking them for their optimal visualization. To create the virtual content, a multiview system has been integrated in a powerful game engine, which allows us to use the latest graphics hardware advances. This integration is detailed and several demos and videos are attached with this paper, which represent a virtual world for auto-stereoscopic displays and the same scenario in a two-view anaglyph representation for being visualized in any conventional display. In all these demos, the parameters studied can be modified offering the possibility of easily appreciate their effects in a virtual scene.

show abstract

Real-time multi-view rendering architecture for autostereoscopic displays

Cited by 12 publications

References 5 publications

A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique

A Real-Time Super Multiview Rendering Pipeline for Wide Viewing-Angle and High-Resolution 3D Displays Based on a Hybrid Rendering Technique

Oo-Vr

Synthetic content generation for auto-stereoscopic displays

Contact Info

Product

Resources

About