Temporally Reliable Motion Vectors for Real‐time Ray Tracing

Zeng, Zheng; Liu, Shiqiu; Yang, Jinglei; Wang, Lu; Yan, Ling‐Qi

doi:10.1111/cgf.142616

Cited by 16 publications

(9 citation statements)

References 41 publications

(52 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Inspired by the successful application of TAA in surface rendering, the real-time volumetric rendering method proposed in this paper also applies the key concept of TAA, namely the reuse of path tracing samples from the previous frame. By calculating the motion vectors between frames and associating the current frame with the previous frame, the historical information related to each pixel is stored in memory, such as moments and variance [31]. This paper also optimizes TAA by reducing or even eliminating calculations for pixels that have accumulated a certain number of samples, while calculating more samples for those with less historical cumulative information.…”

Section: Figure 1: Utilizing the Puncturing Navigation System For Pun...mentioning

confidence: 99%

Real-Time Spatiotemporal Denoising Volumetric Rendering in Three-Dimensional Visualization of Puncturing Navigation

Li,

Zhou,

Shen

et al. 2024

Preprint

View full text Add to dashboard Cite

In medical diagnosis and surgical treatment, particularly in tumor puncturing surgeries, the importance of three-dimensional visualization of medical data is increasingly recognized. Traditional two-dimensional imaging techniques are limited in spatial and depth perception. This study introduces a novel real-time spatiotemporal denoising volumetric rendering technique aimed at enhancing three-dimensional visualization in puncturing navigation systems. By analyzing existing volumetric rendering methods, a spatiotemporal filtering approach is proposed. This approach filters images rendered with one sample per pixel by calculating inter-frame motion vectors in the time domain and utilizing auxiliary features in the spatial domain. It effectively reduces the noise from Monte Carlo estimations and enhances the clarity of three-dimensional organ structures. This technique achieves real-time performance exceeding 30 Hz on commercial-grade Graphics Processing Units (GPUs). The real-time spatiotemporal denoising volumetric rendering significantly enhances the three-dimensional visualization quality in puncturing navigation systems, achieving a balance between high-quality rendering and real-time performance, meeting clinical needs. This technology also has broad application potential in medical training, surgical simulation, and remote collaboration.

show abstract

Section: Figure 1: Utilizing the Puncturing Navigation System For Pun...mentioning

confidence: 99%

Real-Time Spatiotemporal Denoising Volumetric Rendering in Three-Dimensional Visualization of Puncturing Navigation

Li,

Zhou,

Shen

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

“…However, both of them are effective when purely specular. Zeng et al [ZLY*21] sample the reflective positions based on roughness, thus ensuring the accuracy of the motion vectors in case the materials are rougher.…”

Section: Related Workmentioning

confidence: 99%

Stereo‐consistent Screen Space Reflection

Wu,

Xu,

Wang

2024

Computer Graphics Forum

View full text Add to dashboard Cite

Screen Space Reflection (SSR) can reliably achieve highly efficient reflective effects, significantly enhancing users' sense of realism in real‐time applications. However, when directly applied to stereo rendering, popular SSR algorithms lead to inconsistencies due to the differing information between the left and right eyes. This inconsistency, invisible to human vision, results in visual discomfort. This paper analyzes and demonstrates how screen‐space geometries, fade boundaries, and reflection samples introduce inconsistent cues. Considering the complementary nature of screen information, we introduce a stereo‐aware SSR method to alleviate visual discomfort caused by screen space disparities. By contrasting our stereo‐aware SSR with conventional SSR and ray‐traced results, we showcase the effectiveness of our approach in mitigating the inconsistencies stemming from screen space differences while introducing affordable performance overhead for real‐time rendering.

show abstract

“…But, like the spatial super-sampling, this is very time-consuming. A common improvement is to generate a per-pixel motion vector [14][15][16][17] for the historical frame and the current frame, use it to sample the historical frame to obtain samples of the historical pixels, and then perform cumulative blending. The results may be quite reasonable under certain conditions, but in many cases some artifacts are produced due to the lack of sampling points for occluded objects.…”

Section: Related Workmentioning

confidence: 99%

Edge temporal anti-aliasing

Xu,

Luo,

et al. 2023

International Conference on Computer Graphics, Artificial Intelligence, and Data Processing (ICCAID 2022)

View full text Add to dashboard Cite

Temporal Anti-Aliasing (TAA) is a popular method for eliminating temporal aliasing problems. However, the images simply processed by TAA become blurred and lose some details. In this paper, an improved TAA algorithm named Edge Temporal Anti-Aliasing (ETAA), is proposed. A time iterative edge detection method is designed to enhance the detection accuracy of pixels with temporal aliasing and spatial aliasing. These pixels are blurred and blended, and other pixels are replaced with the pixels of the current frame. Furthermore, an approximate minimum filter is used to eliminate the flickering phenomenon of high-energy noise. Compared to TAA, ETAA outperforms TAA in terms of image detail preservation when the rendering camera moves. Meanwhile, the time cost of proposed method also can satisfy the requirement of real-time rendering. Experiment results show that ETAA can effectively and quickly eliminate the time aliasing when the camera moves, and achieves a better trade-off in flicker, ghosting and blurring.

show abstract

Temporally Reliable Motion Vectors for Real‐time Ray Tracing

Cited by 16 publications

References 41 publications

Real-Time Spatiotemporal Denoising Volumetric Rendering in Three-Dimensional Visualization of Puncturing Navigation

Real-Time Spatiotemporal Denoising Volumetric Rendering in Three-Dimensional Visualization of Puncturing Navigation

Stereo‐consistent Screen Space Reflection

Edge temporal anti-aliasing

Contact Info

Product

Resources

About