Who’s That Girl? Handheld Augmented Reality for Printed Photo Books

Abstract

Abstract. Augmented reality on mobile phones has recently made major progress. Lightweight, markerless object recognition and tracking makes handheld Augmented Reality feasible for new application domains. As this field is technology driven the interface design has mostly been neglected. In this paper we investigate visualization techniques for augmenting printed documents using handheld Augmented Reality. We selected the augmentation of printed photo books as our application domain because photo books are enduring artefacts that often have online galleries containing further information as digital counterpart. Based on an initial study, we designed two augmentations and three techniques to select regions in photos. In an experiment, we compare an augmentation that is aligned to the phone's display with an augmentation aligned to the physical object. We conclude that an object aligned presentation is more usable. For selecting regions we show that participants are more satisfied using simple touch input compared to Augmented Reality based input techniques.

Precise Pointing Techniques for Handheld Augmented Reality

“…For example, TouchProjector [4] allows users to move pictures on remote screens through direct touch on the live video of a handheld device. Handheld AR systems augmenting different kind of objects such as sights [1], printed conference proceedings [11], photo books [8] or paper maps [16] have been developed. In handheld AR settings, the viewpoint in the augmented scene is usually controlled by the absolute device's pose in space (controlling the back-face camera viewpoint).…”

“…With such settings, pointing is usually performed with either a screen-center crosshair [8,11,[14][15][16] or by direct input on the screen, using a pen or bare fingers [4,[8][9][10][11]18]. Rohs et al [14,15] studied pointing with a screen-centered crosshair on a phone.…”

Enhanced virtual transparency in handheld ar

“…In printed media a large format and high resolution come at affordable prices, however, once printed, the information can not be changed and is limited to showing static visual content. This limitation can be overcome using handheld AR for use cases such as: interactive paper where digital content is merged with printed media [2,4]. However, usability of such a system may be affected by poor scene readability, a consequence of small font size, often encountered in printed media (i.e.…”

[Poster] Utilizing contact-view as an augmented reality authoring method for printed document annotation

“…Real world enhancements are commonly achieved by utilizing augmented annotations. One such example are: (1) world browsing AR applications such as Wikitude and Layer which mark points-of-interest (POI); and (2) AR on printed documents where annotations enhance paper maps [13] or photo albums [7]. These annotations range from primitives, such as labels with text and area highlights to more complex annotation representations such as hand drawn shapes.…”

“…Arguably the most dominant reason, which was also highlighted by participants in the user study conducted by Henze and Bool [7], is that it is difficult to hold the phone sufficiently steady while performing annotations authoring actions. Beside the difficult of holding the phone steady, augmentation jitter, which is a result of camera pose tracking, further contributes to this problem particularly in the case of poor tracking conditions.…”