AR-enhanced Widgets for Smartphone-centric Interaction

Abstract

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. Copyright

Evaluating the Extension of Wall Displays with AR for Collaborative Work

“…Since the early work by Feiner and Shamash [23], AR has been used to extend working surfaces. AR can extend the workspace of desktop computers [23,72,81], smartphones [14,61,83], and even smartwatches [26]. The motivation in these projects is to augment the screen real-estate of "small" screens by simply enlarging the screen, offloading widgets, or providing additional information.…”

SurfAirs: Surface + Mid-air Input for Large Vertical Displays

“…To address issues related to touch input on small-sized screens, several research prototypes (e.g. [6,7,34,38]) augment handheld devices with sensors to track hand input in the air around the device. But the advantages of extending touch to the air around or above the screen are not limited to small devices.…”

Investigating the Use of AR Glasses for Content Annotation on Mobile Devices

“…MultiFi [18] redesigns a series of UI widgets to make them run across a mobile phone and an AR headset in order to take advantage of these devices' respective fidelities. AR-enhanced widgets [7] are traditional UI components designed to be offloaded to the air in order to free space for the content of interest on the phone.…”

“…Layout. Based on findings from previous studies about the layout of AR content relative to handheld devices [7,35], we place annotations on the side corresponding to the user's dominant hand when the device is held in portrait mode (e.g., text documents, maps on smartphones, see Figure 4-a); and above the device's top edge in landscape mode (e.g., videos, Figure 4-b). In-air annotations are displayed on the side opposite to the non-dominant hand -which typically holds the device -thus limiting cases where users would have to cross their arms to access annotations.…”

“…While this might be enough to select an annotation thumbnail, such in-air interaction is typically tiring and lacks precision [6,22]. More elaborate interactions such as navigating the timeline or precisely adjusting the size of an annotation thumbnail would require implementing more advanced input techniques (in the spirit of the high-precision widgets proposed in [7]). Such size adjustments could be performed with bi-manual techniques as well, when the device rests on, e.g., a surface.…”