vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Li, Nianlong; Zhang, Zhengquan; Liu, Can; Yang, Zengyao; Fu, Yinan; Tian, Feng; Han, Teng; Fan, Mingming

doi:10.1145/3411764.3445537

Cited by 19 publications

(5 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A point of origin and a direction are needed to control the ray [26]. [12] Touch-based pointing with raycasting metaphor Handheld AR ✓ -2021 Li et al [9] Controller-based pointing with mirror metaphor VR ✓ ✓ 2021 Messaci et al [10] Gesture-based with zoom metaphor VR ✓ ✓ 2020 Qian et al [27] Gesture-based metaphor Handheld AR -✓ 2020 Yu et al [28] Controller-based pointing metaphors VR ✓ -2020 Sidenmark et al [29] Controller-based pointing with gaze-assisted metaphor VR ✓ -2019 Yin et al [30] Touch-based pointing metaphors Handheld AR ✓ -2018 Whitlock et al [8] Gesture-based metaphor AR ✓ -2017 Jung and Woo [13] Raycasting with target object duplication metaphor AR -✓ 2017 Bellarbi et al [14] Gesture-based pointing with zooming metaphor AR -✓ 2016 Yu and Kim [31] Finger-pointing metaphor AR -✓…”

Section: Related Workmentioning

confidence: 99%

“…In the case of selection on the occluded object (cluttered scene) either fully or partially occluded, the traditional methods may begin to lose their function in terms of precision and speed [12]. Meanwhile, the occluded target object being in distance from the user increases the difficulty for the target selection task to complete [9], [13], [14].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Target selection method on the occluded and distant object in handheld augmented reality

Ismail

Halim²,

Talib³

et al. 2023

IJEECS

View full text Add to dashboard Cite

<span lang="EN-US">Existing interaction techniques within handheld augmented reality (AR) have frequently used touchscreen input (pure two-dimensional (2D) pointing and clicking) from the handheld device's display for target selection on the virtual object. However, performing accurate target selection on a distant target object becomes challenging as the target object will appear smaller when the distance increases. Aside from that, the difficulty increases in performing target selection when another virtual object obscures the distant virtual object. Therefore, this study aims to present a target selection method to perform the target selection. We enable the raycasting technique with real hand gesture for the target selection method on the occluded and distant object in handheld AR. The leap motion device is mounted at the back of the handheld device to track the real hand gesture. The markerless tracking technology of simultaneous localization and mapping (SLAM) is implemented to enable the AR environment. Based on the results, the aim of this study was achieved.</span>

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Target selection method on the occluded and distant object in handheld augmented reality

Ismail

Halim²,

Talib³

et al. 2023

IJEECS

View full text Add to dashboard Cite

show abstract

“…These numbers do not sum to 97 because, as mentioned, some interaction techniques are multi-purpose. For example, beyond-real techniques that leverage miniature reconstructions of virtual environments allow for both selection and manipulation of occluded objects [89].…”

Section: Interaction Tasksmentioning

confidence: 99%

“…The changes made to the miniature VR space propagate to the full-size virtual environment, enabling users to utilize the proxy to manipulate objects. Another technique, vMirror, uses strategically placed mirrors and their reflections to allow users to manipulate obscured objects [89].…”

Section: Space Transformations Space Transformations Create Remapping...mentioning

confidence: 99%

“…For multiple object selection, researchers have also developed techniques that map the position of users' hands to virtual brushes and lassos [164]. Translation 18 [3, 41-43, 73, 86, 91, 100, 108, 116, 125, 159, 185, 187, 191, 192, 195, 199] Scaling 27 [3, 9, 28, 33, 38, 41-43, 83, 86, 89, 91, 104-106, 120, 121, 159, 161, 170, 185-187, 191, 199, 204, 207] Duplication 18 [7,32,49,89,99,103,106,112,120,121,138,167,180,188,204,204,207,209] Body 55…”

Section: Bodymentioning

confidence: 99%

See 1 more Smart Citation

Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality

Abtahi

Landay

et al. 2022

CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

We can create Virtual Reality (VR) interactions that have no equivalent in the real world by remapping spacetime or altering users' body representation, such as stretching the user's virtual arm for manipulation of distant objects or scaling up the user's avatar to enable rapid locomotion. Prior research has leveraged such approaches, what we call beyond-real techniques, to make interactions in VR more practical, efficient, ergonomic, and accessible. We present a survey categorizing prior movement-based VR interaction literature as reality-based, illusory, or beyond-real interactions. We survey relevant conferences (CHI, IEEE VR, VRST, UIST, and DIS) while focusing on selection, manipulation, locomotion, and navigation in VR. For beyond-real interactions, we describe the transformations that have been used by prior works to create novel remappings. We discuss open research questions through the lens of the human sensorimotor control system and highlight challenges that need to be addressed for effective utilization of beyond-real interactions in future VR applications, including plausibility, control, long-term adaptation, and individual differences. CCS CONCEPTS• Human-centered computing → Virtual reality; Interaction design theory, concepts and paradigms.

show abstract

Intelligent Virtual B-Scan Mirror (IVBM)

Sommersperger,

Dehghani,

Matten

et al. 2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Cited by 19 publications

References 37 publications

Target selection method on the occluded and distant object in handheld augmented reality

Target selection method on the occluded and distant object in handheld augmented reality

Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality

Intelligent Virtual B-Scan Mirror (IVBM)

Contact Info

Product

Resources

About