RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences

Villanueva, Ana; Liu, Ziyi; Zhu, Zhengzhe; Du, Xin; Huang, Joey; Peppler, Kylie; Ramani, Karthik

doi:10.1145/3411764.3445726

Cited by 28 publications

(18 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The superiority of AR-driven learning over conventional textbook-based methodologies is empirically validated [5]. Its efficacy is further reinforced in specialized domains such as medical education, where AR significantly enhanced anatomical comprehension and retention [50] [40,57,96]. However, a conspicuous void exists in the domain of smartphone application exploration for older adults using AR, a research gap that our study endeavors to bridge.…”

Section: Potential Of Ar In Supporting Older Adults Learningmentioning

confidence: 93%

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone Applications

Jin,

Tong,

Wei

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

The global aging trend compels older adults to navigate the evolving digital landscape, presenting a substantial challenge in mastering smartphone applications. While Augmented Reality (AR) holds promise for enhancing learning and user experience, its role in aiding older adults' smartphone app exploration remains insufficiently explored. Therefore, we conducted a two-phase study: (1) a workshop with 18 older adults to identify app exploration challenges and potential AR interventions, and (2) tech-probe participatory design sessions with 15 participants to co-create AR support tools. Our research highlights AR's effectiveness in reducing physical and cognitive strain among older adults during app exploration, especially during multi-app usage and the trial-and-error learning process. We also examined their interactional experiences with AR, yielding design considerations on tailoring AR tools for smartphone app exploration. Ultimately, our study unveils the prospective landscape of AR in supporting the older demographic, both presently and in future scenarios.

show abstract

Section: Potential Of Ar In Supporting Older Adults Learningmentioning

confidence: 93%

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone Applications

Jin,

Tong,

Wei

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Research in remote assistance and telepresence mostly studied camera robots that were manually operated with GUIs by remote users (e.g., [21,31,57,59]). Recent remote assistance camera robots, such as RemoteCoDe [46], can be controlled implicitly by remote helpers' face orientation.…”

Section: Camera Robotsmentioning

confidence: 99%

ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration

Sousa

Chu

et al. 2022

CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

People use how-to videos, both live and pre-recorded, to learn new physical skills [37], ranging from repairing a broken keyboard to learning digital fabrication [42]. In most how-to videos for physical skills, the instructor demonstrates step-by-step how to complete the task [14]. As these steps may involve activities at varying locations in varying levels of detail, a single, fixed camera often cannot record every step with the desired clarity [39]. This necessitates frequent changes to camera parameters, including viewpoints, angles, and zoom levels.Professional video productions, such as cooking and home improvement shows, employ several dedicated camera operators who actively re-position cameras and adjust their parameters in response to the instructor's actions. However, such resources are not available to most instructors; instead, these rely on one or more preconfigured fixed cameras. Although fixed camera setups can be re-configured during recording, instructors need to stop what they are demonstrating (e.g., chopping vegetables) to manipulate the camera. This disrupts the demonstration, increasing the instructor's workload. It also requires more post-processing to combine clips filmed with different camera setups.Both filmmakers and researchers have explored the idea of cameramanipulating robots as an alternative to human operators [1,27]. Recent camera robots (predominantly drones) can autonomously track moving subjects [6,24,41]. However, it remains a challenge for the user being filmed to control the camera robots' behaviors while performing other activities, such as demonstrating a physical process. Conventional interfaces for robot control employ joysticks [52], gestures [49], and speech [16]-all of which require dedicated input actions-that disrupt instruction delivery. If not edited out, such disruptions might split audience's attention and hinder learning [9], but post-processing adds to instructors' efforts. Recent user interface research has explored triggering on-screen visual effects through presenters' gestures and speech [22,32,48] that are part of the presentations. Our approach in this work is to:(1) identify the kinds of camera shots that how-to videos use and (2) direct camera operations in a non-disruptive manner by relying on the communicative signals that instructors already use to address their audience during demonstrations. For instance, an instructor may point to a part of an object to emphasize it, use speech to guide the audience's attention, or wave to introduce themselves.

show abstract

“…When comparing the number of remote studies conducted before and during COVID-19, it becomes clear that a primary tool utilised to continue user studies was online mediums. In response to the pandemic, online tools have recently been developed to consolidate XR study participant recruitment; such as the XR Distributed Research Network [50], which; as well as online communications like audio and video broadcasting platforms [10,62], have been employed to effectively deliver studies remotely. Experiments were delivered both with [14,37] and without [51] AR/VR equipment.…”

Section: Study Type: Remote Vs Localmentioning

confidence: 99%

“…Where adaptations were reported they were predominantly in relation to the participants involved [63,67], the space used [52,62], equipment employed [52,61], the procedure (i.e. the distribution of testing sessions [60] and hygienic practices [18,33] over a specified period of time) and the type of study; whether it was adapted to meet health and safety guidelines in lab [41,60], or altered to be conducted remotely due to COVID-19 [20,64].…”

Section: Covid-19 Considerations: Reported Vs Not Statedmentioning

confidence: 99%

Socially Distanced: Have user evaluation methods for Immersive Technologies changed during the COVID-19 pandemic?

Spittle

Frutos-Pascual

et al. 2021

2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)

View full text Add to dashboard Cite

Since the emergence of COVID-19 in late 2019, there has been a significant disturbance in human-to-human interaction that has changed the way we conduct user studies in the field of Human-Computer Interaction (HCI), especially for extended (augmented, mixed, and virtual) reality (XR). To uncover how XR research has adapted throughout the pandemic, this paper presents a review of user study methodology adaptations from a corpus of 951 papers. This corpus of papers covers CORE 2021 A* published conference submissions, from Q2 2020 through to Q1 2021 (IEEE ISMAR, ACM CHI, IEEE VR). The review highlights how methodologies were changed and reported; sparking discussions surrounding how methods should be conveyed and to what extent research should be contextualised, by drawing on external topical factors such as COVID-19, to maximise usefulness and perspective for future studies. We provide a set of initial guidelines based on our findings, posing key considerations for researchers when reporting on user studies during uncertain and unprecedented times.

show abstract

RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences

Cited by 28 publications

References 41 publications

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone Applications

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone Applications

ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration

Socially Distanced: Have user evaluation methods for Immersive Technologies changed during the COVID-19 pandemic?

Contact Info

Product

Resources

About