PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR

Abstract

This study proposes a novel technology as a creative method to interact with an augmented reality (AR) system called PhoneCursor, which is incorporated onto head-mounted displays. PhoneCursor is designed to offer more intuitive, portable and natural interaction. Its technical realization combines the gyroscope and acceleration sensor based on mobile phone. In view of the target selection ability as a base function of PhoneCursor, it also enhances the performance in solving some difficult selection problems in AR, including far and small object selection, 3D occlusion, dense object selection, and batch selection problem. An experiment based on the ISO 9241-9 standard is conducted to investigate this ability, wherein the PhoneCursor technique is compared with the widely used and well-performing head-movementbased selection technique. Results show that PhoneCursor performs better in terms of movement time and throughput than the conventional technique. Some applications are further proposed to showcase the potential of using the PhoneCursor technique in AR scenarios.

Designing Ray-Pointing using Real hand and Touch-based in Handheld Augmented Reality for Object Selection

“…Further research remains to be done to enhance the overall user experience when selecting object on a handheld platform for these technologies. Currently, issues of distant and tiny object selection, occluded object, and object selection in a dense environment are still challenging for AR, MR, and VR [5]. Meanwhile, interaction in handheld environments is always restricted to simple 2D pointing and clicking through device's limited touchscreen [4].…”