Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information

Abstract

One of the unique applications of Mixed and Augmented Reality (MR / AR) MotivationIn Mixed Reality (MR) and Augmented Reality (AR) systems, virtual objects are combined with real images at interactive rates in 3D. Such displays can enhance the user's perception of the real environment by showing information the user cannot directly sense when unaided. For example, in many AR applications we wish to endow the user with "X-ray vision," enabling the user to see through objects to view a fetus inside a womb, to see pipes and conduits behind walls, or to spot the location of a hidden enemy soldier. Being able to see occluded objects is a useful capability in a variety of medical, architectural, inspection, and military applications. This technology is especially useful in urban environments, where broad, angular surfaces (e.g., walls in hallways, buildings on a street, etc.) limit one's field of view of nearby visually-obscured locations.However, displaying such hidden objects in a manner that a user intuitively understands is not always trivial. Take the example of a soldier in one room of a building using an AR system to spot the known location of a 1). The use of transparent overlays (LEFT) conveys depth by letting the viewer see structure not otherwise visible, but while still perceiving the realworld structure. A similar approach (RIGHT) presents normally unseen structure by over-rendering a virtual "cut-away" of the occluding surfaces. This approach more clearly depicts the inside of the room, but at the cost of occluding real-world surfaces.

The effectiveness of an AR-based context-aware assembly support system in object assembly

“…For the former problem, it is well known that AR information with solid rendering appears to be frontmost regardless of its intended depth. To better convey spatial relationships to the real objects, AR information is often rendered with a cut away box or in a semi-transparent manner [8] [5]. A combination of wireframe and semi-transparent rendering is proven to help discern depth ordering [13].…”

Resolving multiple occluded layers in augmented reality

“…Furmanski et al [12] utilized a similar approach in their pilot experiment. Using video AR, they showed users a stimulus which was either behind or at the same distance as an obstructing surface.…”

Survey on Urban Warfare Augmented Reality

“…Gestures have long been considered as an interaction technique that can potentially deliver more natural, creative and intuitive methods for communicating with our computing devices [57]. Recognizing gestures for interaction can help achieve the ease and naturalness desired for human computer interaction.…”