Virtual object manipulation using a mobile phone

Abstract

Augmented Reality (AR) on mobile phones has reached a level of maturity where it can be used as a tool for 3D object manipulation. In this paper we look at user interface issues where an AR enabled mobile phone acts as an interaction device. We discuss how traditional 3D manipulation techniques apply to this new platform. The high tangibility of the device and its button interface makes it interesting to compare manipulation techniques. We describe AR manipulation techniques we have implemented on a mobile phone and present a small pilot study evaluating these methods.

A study on improving close and distant device movement pose manipulation for hand-held augmented reality

“…This device-based manipulation (DM) was first presented by Henrysson et al [Henrysson et al 2005], allowing movements of the hand-held device to be used to manipulate VOs. In this technique changes in the position and orientation of the device is used to change the pose of the VO.…”

“…The VO is translated with the device and is rotated around the device's center. Henrysson et al [Henrysson et al 2005] implemented fix-DPR hand-held V-AR manipulation for a Symbian mobile phone. The pose of the device was tracked using a fiducial marker that was visible by its camera.…”

“…For hand-held V-AR, where a touch surface is available, a commonly used technique acquires multi-touch gestures to interact with the VOs rendered on the screen [Mossel et al 2013b] [Wagner et al 2005] [Rekimoto 1996] [Jung et al 2012]. However, manipulation by movements of the hand-held device itself [Henrysson et al 2005] [Mossel et al 2013a] is a strong alternative for pose control, primarily because it can provide direct mapping between control and motion, thereby allowing both intuitive and high precision control in 6 degrees-of-freedom (DoF) pose manipulation. Furthermore, it may reduce fatigue, by allowing continuous two handed action, and avoids occlusion during interaction, since no finger is required in front of the screen, or at least not in front of the manipulated VO.…”

Dual-Finger 3D Interaction Techniques for mobile devices

“…This widget is viewed as the object's bounding box and supports rotation by controlling its inertia, translation via sliders on the edges of the widget, and scaling the object through pinch gestures with fingers. Henrysson et al compare using keypad buttons and one-handed physical movement of a phone to move the selected object in an augmented-reality environment [21]. A user experiment reveals that positioning the object is more natural and faster using physical movement than using the buttons.…”

“…In the forms we asked them the following questions [21] and to rate the selection, manipulation and navigation techniques by grading their ease of use and familiarity between 1 and 7 according to how they felt:…”