ChromaCorrect: Prescription Correction in Virtual Reality Headsets through Perceptual Guidance

Abstract

A large portion of today's world population suffers from vision impairments and wears prescription eyeglasses. However, prescription glasses causes additional bulk and discomfort when used with Virtual Reality (VR) headsets, negatively impacting the viewer's visual experience. In this work, we remedy the usage of prescription eyeglasses with screens by shifting the optical complexity into the software. Our proposal is a prescription-aware rendering approach for providing sharper and more immersive imagery for screens, including VR headsets. To this end, we develop a differentiable display and visual perception model encapsulating the human visual system's display-specific parameters, color, visual acuity, and user-specific refractive errors. Using this differentiable visual perception model, we optimize the rendered imagery in the display using gradient-descent solvers. This way, we provide prescription glasses-free sharper images for a person with vision impairments. We evaluate our approach and show significant quality and contrast improvements for users with vision impairments.

Flexible modeling of next-generation displays using a differentiable toolkit

“…Odak is a comprehensive library for computational research in the field of optics, computer graphics, and visual perception. [1][2][3] It features modules for simulating optical phenomena such as ray tracing and wave optics, as well as tools for calculating perceptually-informed visual quality metrics. The library also includes functionality for importing and exporting 3-dimensional data in various formats, including point clouds and CAD files, as well as visualization tools for use during the design process.…”