Figure 1: We present an ownership-preserving direct manipulation technique in augmented reality, which allows interaction with remote devices in a ubicomp environment with the help of a long virtual arm. While the user's real hand is close to the body the virtual arm is of normal length (A) and by simply reaching out the user can make it extend to access remote devices in the room. For instance we allow adjusting the height of a table (B), opening and closing a curtain (C) and adjusting the angle of a tilting surface (D).
ABSTRACTIn this paper, we explore how users can control remote devices with a virtual long arm, while preserving the perception that the artificial arm is actually part of their own body. Instead of using pointing, speech, or a remote control, the users' arm is extended in augmented reality, allowing access to devices that are out of reach. Thus, we allow users to directly manipulate real-world objects from a distance using their bare hands. A core difficulty we focus on is how to maintain ownership for the unnaturally long virtual arm, which is the strong feeling that one's limbs are actually part of the own body. Fortunately, what the human brain experiences as being part of the own body is very malleable and we find that during interaction the user's virtual arm can be stretched to more than twice its real length, without breaking the user's sense of ownership for the virtual limb.