Real-Time Application of Computer Graphics Improvement Techniques Using Hyperspectral Textures in a Virtual Reality System

Díaz‐Barrancas, Francisco; Cwierz, Halina; Fernández, Pedro José Pardo

doi:10.3390/electronics10222852

Cited by 4 publications

(5 citation statements)

References 31 publications

(28 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Universal Render Pipeline is designed to render images on a wide range of platforms, and the High Definition Render Pipeline aims to provide greater physical realism. These alternatives are also worth investigating for VR experiments (e.g., Diaz-Barrancas et al, 2021 ), as they have the potential to provide greater transparency and flexibility and to allow users to create more realistic and precisely controlled virtual environments.…”

Section: Discussionmentioning

confidence: 99%

“…Furthermore, they found that stimulus luminance was proportional to rendered RGB values. Another example of attention to calibration issues is Diaz-Barrancas et al (2021) , who showed that color calibration can be carried out in Unity’s High-Definition Render Pipeline by integrating a standard color calibration model ( Brainard et al, 2002 ), written in custom software, into the render pipeline.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Luminance calibration of virtual reality displays in Unity

2022

View full text Add to dashboard Cite

Virtual reality (VR) displays are an increasingly popular medium for experiments on visual perception. This presents the challenge of showing precisely controlled stimuli on devices that were not primarily designed for research. Here we describe methods for controlling stimulus luminance in VR experiments created in Unity using the Built-in Render Pipeline. We discuss the Gamma/Linear setting, measuring luminance in a VR headset, and using color grading in Unity’s Post-Processing Stack to make stimulus luminance proportional to achromatic RGB value. We provide MATLAB code that uses luminance measurements from a VR headset to generate the lookup table that Unity requires for linearizing luminance. We emphasize that when creating experiments in this complex environment, it is important to experiment with the rendering process to confirm that stimuli are displayed as expected. We show results of several such tests and provide code as a starting point for readers who wish to run further tests related to their own research.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Luminance calibration of virtual reality displays in Unity

2022

View full text Add to dashboard Cite

show abstract

“…Recent work also compares calibrations using different rendering software and shaders ( Murray, Patel, & Wiedenmann, 2022 ; Díaz–Barrancas, Gil Rodríguez, Aizenman, Bayer, & Gegenfurtner, 2023 ). VR techniques have been shown to be suitable in principle for studying color constancy ( Díaz-Barrancas, Cwierz, Gil Rodríguez, & Pardo, 2022 ; Gil Rodríguez et al., 2022 ). Here we use VR to study specific cues for color constancy in indoor and outdoor environments.…”

Section: Methodsmentioning

confidence: 99%

Color constancy mechanisms in virtual reality environments

Gil Rodríguez,

Hedjar,

Toscani

et al. 2024

Journal of Vision

View full text Add to dashboard Cite

Prior research has demonstrated high levels of color constancy in real-world scenarios featuring single light sources, extensive fields of view, and prolonged adaptation periods. However, exploring the specific cues humans rely on becomes challenging, if not unfeasible, with actual objects and lighting conditions. To circumvent these obstacles, we employed virtual reality technology to craft immersive, realistic settings that can be manipulated in real time. We designed forest and office scenes illuminated by five colors. Participants selected a test object most resembling a previously shown achromatic reference. To study color constancy mechanisms, we modified scenes to neutralize three contributors: local surround (placing a uniform-colored leaf under test objects), maximum flux (keeping the brightest object constant), and spatial mean (maintaining a neutral average light reflectance), employing two methods for the latter: changing object reflectances or introducing new elements. We found that color constancy was high in conditions with all cues present, aligning with past research. However, removing individual cues led to varied impacts on constancy. Local surrounds significantly reduced performance, especially under green illumination, showing strong interaction between greenish light and rose-colored contexts. In contrast, the maximum flux mechanism barely affected performance, challenging assumptions used in white balancing algorithms. The spatial mean experiment showed disparate effects: Adding objects slightly impacted performance, while changing reflectances nearly eliminated constancy, suggesting human color constancy relies more on scene interpretation than pixel-based calculations.

show abstract

“…However, it is usually very expensive. Nowadays, the quality improvement of HMD allows better immersive visual experiences [10]. PC-connected HMD devices, such as HTC Vive PRO used in [11], have good computational power drawn from the PC.…”

Section: Related Workmentioning

confidence: 99%

Serious Game for VR Road Crossing in Special Needs Education

Tan

Huang

et al. 2022

Electronics

View full text Add to dashboard Cite

Autism spectrum disorder (ASD) is a developmental disability that can impair communication, social skills, living skills, and learning capabilities. Learning approaches usually differ between mainstream schools and special needs schools, to cater for the different learning processes of children with ASD. Besides the traditional classroom-based education, alternative technology and methods are explored for special needs education. One method is to train children with ASD using Virtual Reality (VR) technologies. Many prior works show the effectiveness of VR-based learning with varying degrees of success. Some children with ASD may face challenges to gain independent living skills. Their parents or guardians have to expend a significant amount of effort in taking care of children with ASD. It will be very helpful if they can have a learning opportunity to gain such living skills. In this research, we develop a VR serious game to train children with ASD one of the basic living skills for road crossing safely. The VR serious game operates on multiple types of platforms, with various user interaction inputs including the Microsoft Kinect sensor, keyboard, mouse, and touch screen. The game design and methodology will be described in this paper. Experiments have been conducted to evaluate the learning effectiveness of the road crossing game, with very positive results achieved in the quiz and survey questionnaire after the gameplay.

show abstract

Real-Time Application of Computer Graphics Improvement Techniques Using Hyperspectral Textures in a Virtual Reality System

Cited by 4 publications

References 31 publications

Luminance calibration of virtual reality displays in Unity

Luminance calibration of virtual reality displays in Unity

Color constancy mechanisms in virtual reality environments

Serious Game for VR Road Crossing in Special Needs Education

Contact Info

Product

Resources

About