The Effects of Object Shape, Fidelity, Color, and Luminance on Depth Perception in Handheld Mobile Augmented Reality

Abstract

Depth perception of objects can greatly affect a user's experience of an augmented reality (AR) application. Many AR applications require depth matching of real and virtual objects and have the possibility to be influenced by depth cues. Color and luminance are depth cues that have been traditionally studied in two-dimensional (2D) objects. However, there is little research investigating how the properties of three-dimensional (3D) virtual objects interact with color and luminance to affect depth perception, despite the substantial use of 3D objects in visual applications. In this paper, we present the results of a paired comparison experiment that investigates the effects of object shape, fidelity, color, and luminance on depth perception of 3D objects in handheld mobile AR. The results of our study indicate that bright colors are perceived as nearer than dark colors for a high-fidelity, simple 3D object, regardless of hue. Additionally, bright red is perceived as nearer than any other color. These effects were not observed for a low-fidelity version of the simple object or for a more-complex 3D object. High-fidelity objects had more perceptual differences than low-fidelity objects, indicating that fidelity interacts with color and luminance to affect depth perception. These findings reveal how the properties of 3D models influence the effects of color and luminance on depth perception in handheld mobile AR and can help developers select colors for their applications.

Stay in Touch! Shape and Shadow Influence Surface Contact in XR Displays

“…They found that the richer geometry cues provided by the icosahedron and apple positively influenced reaching and grasping behaviors. In a similar manner, Do et al [15] evaluated the effect of object color and luminance on objects of different shapes for depth judgments in mobile AR. They found interactions with color and luminance on depth perception.…”

“…In contrast, an anchoring shadow may be more sensitive to mismatches between the contours of a shadow and its associated object [11,37]. However, as noted in Do et al [15], AR depth perception experiments rarely incorporate multiple object shapes. Accordingly, in their mobile AR study they evaluated how color and luminance interacted to affect depth perception across four objects: a cube, a sphere, the Stanford bunny, and a low polygon version of the Stanford bunny.…”

“…H4: In our first experiment, people's surface contact judgements were more accurate for the cube than the sphere across all XR devices. Although the sphere was technically a more complex geometric shape [15,20]-where geometric complexity is defined by the number of polygons used to construct a given object's mesh-the resulting shape was nonetheless a geometric primitive. As such, in our second experiment we evaluated a notably more complex object, the Stanford dragon, which consisted of 113,000 polygons.…”

Geo-Based Mixed Reality Gaming Market Analysis

“…Previously, a global positioning system was mainly utilized to implement geo-based mixed reality games in the early twentieth century. However, more recently, computer vision, deep learning, and big data analytics are great tools for estimating the poses and giving geolocation data to process in the games accurately and quickly [20]. Therefore, for achieving the advancement of these tools, the purpose of geolocation mixed reality games for research should be first encouraged to allow a period of trial and error, even though the research purpose of gaming may not directly and significantly relate to the increasing market trend and popularity of games, in the long run, comparing to the commercial purpose gaming, according to our investigation.…”

Towards future pedestrian-vehicle interactions: Introducing theoretically-supported AR prototypes

“…Although the current implementation was done on an iPad Pro (to make use of its LiDAR), the concepts could be readily exported to the head-mounted displays currently supported by Unity and Unity MARS. In that case, sensor requirements would need to be met, and issues such as outdoor luminance levels that may hinder perception [11], ocular vergence-accommodation conflicts [48,64] and latency issues leading to visually induced motion sickness [4] have to be considered. Sensor requirements vary between concepts according to complexity, as shown in Table 1.…”