Vision-Realistic Rendering: Simulation of the Scanned Foveal Image with Elimination of Artifacts due to Occlusion and Discretization

Barsky, Brian A.

doi:10.1007/978-3-642-25382-9_1

Cited by 3 publications

(10 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Instead of using a uniformly distributed disk to approximate the blur kernel, convolution-based vision simulations typically employ a highly detailed version of the optical system's PSF. While such methods have the advantage of not requiring any knowledge about the physical structure of the eye, they are either limited in the supported aberration types [TX15, BP17, CLB18] or have running times not suitable for interactive applications [GSMM95,Bar11].…”

Section: Ray Tracingmentioning

confidence: 99%

“…Due to the sampling ambiguity caused by the finite number of input pixels, we can fill in the gaps in the PSF grid via the linear interpolation of the evaluated kernels without severe visual artefacts. Following Barsky's insights [Bar11], we also sample the focus and the object distances using dioptres. The reason for this is that the PSFs scale linearly with dioptres, but not with meters.…”

Section: Eye Estimationmentioning

confidence: 99%

“…To evaluate the visual quality of our approach, we compare our results with two different convolution-based approaches. First, we implemented Barsky's existing vision simulation algorithm [Bar11], which generates its outputs by splitting up the input images to separate depth slices. The thus computed partial images are convolved with a single PSF corresponding to the centre of the depth regions.…”

Section: Qualitymentioning

confidence: 99%

“…The object distances are 0.2 m (sphere), 0.5 m (cube), and 7.5 m (letter), which leads to different amounts of blurring for each object. The first three rows show, respectively, the outputs of our algorithm, a previous technique [Bar11], and the ground-truth images. A side-by-side comparison of the ground-truth and the other two algorithms is included for a few smaller regions in the fourth and fifth rows.…”

Section: Qualitymentioning

confidence: 99%

“…The last four rows show a visualization of the SSIM and HDR-VDP metrics for the two algorithms, with brighter pixels representing a lower structural similarity and a higher probability of error detection. [Bar11], and the rendering stage of our algorithm, for the same test scenarios and parameter settings that we used to generate the outputs shown in Figure 12 and Figure 13.…”

Section: Qualitymentioning

confidence: 99%

See 4 more Smart Citations

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

Csoba

Kunkli

2021

Computer Graphics Forum

View full text Add to dashboard Cite

Visual aberrations are the imperfections in human vision, which play an important role in our everyday lives. Existing algorithms to simulate such conditions are either not suited for low-latency workloads or limit the kinds of supported aberrations. In this paper, we present a new simulation method that supports arbitrary visual aberrations and runs at interactive, near real-time performance on commodity hardware. Furthermore, our method only requires a single set of on-axis phase aberration coefficients as input and handles the dynamic change of pupil size and focus distance at runtime. We first describe a custom parametric eye model and parameter estimation method to find the physical properties of the simulated eye. Next, we talk about our parameter sampling strategy which we use with the estimated eye model to establish a coarse point-spread function (PSF) grid. We also propose a GPU-based interpolation scheme for the kernel grid which we use at runtime to obtain the final vision simulation by extending an existing tile-based convolution approach. We showcase the capabilities of our eye estimation and rendering processes using several different eye conditions and provide the corresponding performance metrics to demonstrate the applicability of our method for interactive environments.

show abstract

Section: Ray Tracingmentioning

confidence: 99%

Section: Eye Estimationmentioning

confidence: 99%

Section: Qualitymentioning

confidence: 99%

Section: Qualitymentioning

confidence: 99%

Section: Qualitymentioning

confidence: 99%

See 3 more Smart Citations

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

Csoba

Kunkli

2021

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

Fast rendering of central and peripheral human visual aberrations across the entire visual field with interactive personalization

Csoba,

Kunkli

2023

Vis Comput

View full text Add to dashboard Cite

With the recent progress made in areas such as head-mounted displays and vision-correcting devices, there is a growing interest in fast and personalized algorithms for simulating aberrated human vision. Existing vision-simulating approaches are generally hindered by the lack of personalization, computational cost of rendering, and limited types of supported aberrations. This paper presents a fast vision simulation method with interactive personalization capabilities for simulating arbitrary central and peripheral aberrations of the human eye. First, we describe a novel, neural network-based solution for efficiently estimating the physical structure of the simulated eye and calculating the necessary Zernike aberration coefficients for computing the point-spread functions with varying pupil sizes, focus distances, and incidence angles. Our new approach operates in the sub-second regime and produces highly accurate outputs, facilitating the interactive personalization of vision simulation. Next, we present an improved PSF interpolation method for an existing tiled PSF splatting algorithm for rendering. The proposed algorithm significantly improves the computational performance and memory efficiency of the previous approach, allowing the simulation of peripheral vision with arbitrary visual aberrations in low-latency applications. Following the description of our new techniques, we evaluate their performance characteristics and simulation accuracies on several different eye conditions and test scenarios and compare our results to several previous vision simulation algorithms.

show abstract

Rendering algorithms for aberrated human vision simulation

Csoba

Kunkli

2023

Vis. Comput. Ind. Biomed. Art

View full text Add to dashboard Cite

Vision-simulated imagery―the process of generating images that mimic the human visual system―is a valuable tool with a wide spectrum of possible applications, including visual acuity measurements, personalized planning of corrective lenses and surgeries, vision-correcting displays, vision-related hardware development, and extended reality discomfort reduction. A critical property of human vision is that it is imperfect because of the highly influential wavefront aberrations that vary from person to person. This study provides an overview of the existing computational image generation techniques that properly simulate human vision in the presence of wavefront aberrations. These algorithms typically apply ray tracing with a detailed description of the simulated eye or utilize the point-spread function of the eye to perform convolution on the input image. Based on the description of the vision simulation techniques, several of their characteristic features have been evaluated and some potential application areas and research directions have been outlined.

show abstract

Vision-Realistic Rendering: Simulation of the Scanned Foveal Image with Elimination of Artifacts due to Occlusion and Discretization

Cited by 3 publications

References 29 publications

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

Efficient Rendering of Ocular Wavefront Aberrations using Tiled Point‐Spread Function Splatting

Fast rendering of central and peripheral human visual aberrations across the entire visual field with interactive personalization

Rendering algorithms for aberrated human vision simulation

Contact Info

Product

Resources

About