Precise Pointing Techniques for Handheld Augmented Reality

Abstract

Abstract. We propose two techniques that improve accuracy of pointing at physical objects for handheld Augmented Reality (AR). In handheld AR, pointing accuracy is limited by both touch input and camera viewpoint instability due to hand jitter. The design of our techniques is based on the relationship between the touch input space and two visual reference frames for on-screen content, namely the screen and the physical object that one is pointing at. The first technique is based on Shift, a touch-based pointing technique, and video freeze, in order to combine the two reference frames for precise pointing. Contrastingly -without freezing the video-, the second technique offers a precise mode with a cursor that is stabilized on the physical object and controlled with relative touch inputs on the screen. Our experimental results show that our techniques are more accurate than the baseline techniques, namely direct touch on the video and screen-centered crosshair pointing.

[Poster] Utilizing contact-view as an augmented reality authoring method for printed document annotation

“…al [6] was the first to propose the freeze-frame interaction paradigm as a method of annotation authoring. User studies conducted in later research confirmed that users perform better in such offline annotation authoring, when compared to online techniques [7,12].…”

“…There is a clear benefit to such interaction, however such interaction introduces the need for precise hand tracking. Another alterative is to improve the stability of the cursor during the online interaction by attaching it to the physical object and using relative pointing as an input method [12]. Even though this improves the stability of interaction, the requirement to point the device at an object during annotation authoring is not optimal for such process.…”

Handheld Augmented Reality

“…Relative Pointing used in this experiment differs from the one described in [16]. In [16], we evaluated Relative Pointing as an interaction technique.…”

“…To improve the user interaction, they used both manual and automatic zooming as well as freeze-frame (i.e., pausing the live camera image). In [16], we proposed two pointing techniques for handheld AR: (1) combining Shift [17], a touchbased handheld device pointing technique, with freezeframe, and (2) extending the crosshair technique with a relative pointing mode where the cursor is stabilized on a physical wall map and controlled with finger strokes on the touch screen. The experiments indicated that those two techniques, Shift&Freeze and Relative Pointing, were preferred by users and were more accurate but longer to operate than both crosshair and direct touch.…”

“…• Using Relative Pointing [16]. The cursor is bound to the physical object rather than to the handheld device screen (Figure 1-C).…”