Mobile device interaction using projector metaphor

Ro, Hyocheol; Park, Yoon Jung; Byun, Jung-Hyun; Han, Tack-Don

doi:10.1145/3308557.3308672

Cited by 2 publications

(4 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To address these challenges in light of recent interest in AR, a large array of new gesture-based and metaphorical approaches for augmented reality have been presented of late [23,51,56,63]. We, instead, suggest that solutions to these challenges may already exist and that close examination and experimentation with historical precedents may ofer valuable strategies for designing interactions for emerging platforms.…”

Section: Re-presencing Original Work Experimentationmentioning

confidence: 99%

“…Henderson and Feiner proposed "opportunistic controls" -that uses the natural afordances of existing tangible objects to facilitate intuitive and improved gestures and interactions in AR [28]. Ro et al enable a smartphone to act as a metaphorical projector to control augmented projections based on how it is positioned and oriented by a user [56]. While most work focuses on proximal interactions with reachable content through mid-air gestures, some exploration of strategies and afordances for far-distance interactions has been conducted.…”

Section: Metaphorical Interactions and Afordancesmentioning

confidence: 99%

See 1 more Smart Citation

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

Byrne

et al. 2022

Designing Interactive Systems Conference

View full text Add to dashboard Cite

Hand-based gestural interaction in augmented reality (AR) is an increasingly popular mechanism for spatial interactions. However, it presents many challenges. For example, most hand gesture interactions work well for interactions with virtual content and interfaces, but seldom work with physical devices and users' environment. To explore this, and rather than inventing new paradigms for AR interactions, this paper revisits Zigelbaum, Kumpf, Vazquez, and Ishii's 2008 project 'Slurp' [72] -a physical eyedropper to interact with digital content from IoT devices. We revive this historical work in a new modality of AR through a fve step process: re-presecencing, design experimentation, scenario making, expansion through generative engagements with designers, and refection. For the designers we engaged, looking back and designing with a restored prototype helped increased understanding of interactive strategies, intentions and rationales of original work. By revisiting Slurp, we also found many new potentials of its metaphorical interactions that could be applied in the context of emerging spatial computing platforms (e.g., smart home devices). In doing so, we discuss the value of mining past works in new domains and demonstrate a new way of thinking about designing interactions in emerging platforms. CCS CONCEPTS• Human-centered computing → User centered design; Interaction design process and methods; Gestural input; Mixed / augmented reality.

show abstract

Section: Re-presencing Original Work Experimentationmentioning

confidence: 99%

Section: Metaphorical Interactions and Afordancesmentioning

confidence: 99%

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

Byrne

et al. 2022

Designing Interactive Systems Conference

View full text Add to dashboard Cite

show abstract

“…When a ray intersects with an object (Figure 3f), the object is selected using a single tap (Figure 3g) and the object manipulation mode is entered, in which various manipulations can be performed. In this mode, core gestures (Figure 3h,i), mainly those used in smartphones, are used similarly to manipulate the 3D object [2,21]. The object control method takes place as follows: a pinch gesture, which places two fingers together, enables the object shrinking operation.…”

Section: User Interaction For Object Manipulationsmentioning

confidence: 99%

“…If a user places the catalog in a location where they want to pre-position the furniture, the mobile device recognizes the marker and augments the furniture. With the development of computer vision technology, the floor and wall can be distinguished by a mobile device with Apple ARKit or Google AR Toolkit [2] and the furniture can be placed in the desired position without markers. However, when using mobile-based AR applications, the user is required to continue to hold the device to superimpose the virtual object, which is the most significant limitation of AR based on mobile devices.…”

Section: Introductionmentioning

confidence: 99%

AR Pointer: Advanced Ray-Casting Interface Using Laser Pointer Metaphor for Object Manipulation in 3D Augmented Reality Environment

Byun

Park

et al. 2019

Applied Sciences

Self Cite

View full text Add to dashboard Cite

In this paper, we propose AR Pointer, a new augmented reality (AR) interface that allows users to manipulate three-dimensional (3D) virtual objects in AR environment. AR Pointer uses a built-in 6-degrees of freedom (DoF) inertial measurement unit (IMU) sensor in an off-the-shelf mobile device to cast a virtual ray that is used to accurately select objects. It is also implemented using simple touch gestures commonly used in smartphones for 3D object manipulation, so users can easily manipulate 3D virtual objects using the AR Pointer, without a long training period. To demonstrate the usefulness of AR Pointer, we introduce two use-cases, constructing an AR furniture layout and AR education. Then, we conducted two experiments, performance tests and usability tests, to represent the excellence of the designed interaction methods using AR Pointer. We found that AR Pointer is more efficient than other interfaces, achieving 39.4% faster task completion time in the object manipulation. In addition, the participants gave an average of 8.61 points (13.4%) on the AR Pointer in the usability test conducted through the system usability scale (SUS) questionnaires and 8.51 points (15.1%) on the AR Pointer in the fatigue test conducted through the NASA task load index (NASA-TLX) questionnaire. Previous AR applications have been implemented in a passive AR environment where users simply check and pop up the AR objects those are prepared in advance. However, if AR Pointer is used for AR object manipulation, it is possible to provide an immersive AR environment for the user who want/wish to actively interact with the AR objects.

show abstract

Mobile device interaction using projector metaphor

Cited by 2 publications

References 3 publications

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

AR Pointer: Advanced Ray-Casting Interface Using Laser Pointer Metaphor for Object Manipulation in 3D Augmented Reality Environment

Contact Info

Product

Resources

About