Mid-air interaction with a 3D aerial display

Hunter, Seth; Azuma, Ron; Moisant-Thompson, Jonathan; MacLeod, David; Disanjh, Derek

doi:10.1145/3084822.3084827

Cited by 5 publications

(2 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the principle of optics, mid-air images cannot present a correct occlusion relationship with objects further back than the midair image. Hunter et al [21] addressed this problem by using hand tracking to drill holes in the image where the hand and the mid-air image overlap. Our method can be used to take similar measures when interacting with mid-air images using real objects as well as hands.…”

Section: Discussion and Future Studiesmentioning

confidence: 99%

“…Vermeer [20] enables touch interaction with mid-air images omnidirectionally. Hunter et al [21] and Takazaki et al [22] solved the occlusion problem during touch interaction with mid-air images. Touching the Void [23] projects the shadow of the user's finger detected by an IR camera onto the midair images to clarify where the user is touching.…”

Section: B Interaction With Objects In the Airmentioning

confidence: 99%

See 1 more Smart Citation

An Optical Design for Interaction With Mid-Air Images Using the Shape of Real Objects

Ando,

Koizumi

2024

IEEE Access

View full text Add to dashboard Cite

Mid-air images, which are augmented reality (AR) technologies, enable computer graphics (CG) images to be superimposed on a physical space. The mid-air image can be placed side-by-side with real objects, allowing various interactions, such as directly manipulating them to contact the mid-air image on the same plane. In this case, the measurement of the shape of real objects is necessary to realize geometric consistency between the mid-air image and real objects. However, in mid-air image optics, real objects cannot be placed behind the mid-air image (i.e., at a position where they interrupt the light rays that form the mid-air image). This limits the placement of the sensor and may prevent accurate measurement of the shape of the real objects. Consequently, we proposed an optical system for interaction with mid-air images that virtually measures the shape of real objects from behind the mid-air image. In our system, a virtual infrared (IR) sensor is formed behind the mid-air image using a hot mirror that reflects only IR light. The optical system considers the visible area of the mid-air image and the measurable area of the sensor. We evaluated the sharpness, luminance, and chromaticity to assess whether the hot mirror had changed the appearance of the mid-air image. The results confirmed that there was little impact on user perception. Furthermore, we developed four supporting applications for our system to show its efficacy.

show abstract

Section: Discussion and Future Studiesmentioning

confidence: 99%