Lessons Learned from Human Pose Interaction in an Industrial Spatial Augmented Reality Application

Stübl, Gernot; Heindl, Christoph; Ebenhofer, Gerhard; Bauer, Harald; Pichler, Andreas

doi:10.1016/j.procs.2022.12.288

Cited by 2 publications

(2 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Various investigations have demonstrated that multisensory devices [154] and "fused interfaces" [155] prevent accidents and reduce risks [156]. In the third category, mobile devices, cell phones, tablets or smart glasses, and "Spatial AR" [157], markers are used that display enveloping information that facilitates user tasks. These are tested and implemented in the contexts of the market economy [158], and in education, both in elementary schools [159,160], in universities [161], and also in the industrial sector [162].…”

Section: Discussionmentioning

confidence: 99%

Combined Framework of Multicriteria Methods to Identify Quality Attributes in Augmented Reality Applications

et al. 2023

View full text Add to dashboard Cite

This study proposes a combined framework of multicriteria decision methods to describe, prioritize, and group the quality attributes related to the user experience of augmented reality applications. The attributes were identified based on studies of high-impact repositories. A hierarchy of the identified attributes was built through the multicriteria decision methods Fuzzy Cognitive Maps and DEMATEL. Additionally, a statistical analysis of clusters was developed to determine the most relevant attributes and apply these results in academic and industrial contexts. The main contribution of this study was the categorization of user-experience quality attributes in augmented reality applications, as well as the grouping proposal. Usability, Satisfaction, Stimulation, Engagement, and Aesthetics were found to be among the most relevant attributes. After carrying out the multivariate analysis, two clusters were found with the largest grouping of attributes, oriented to security, representation, social interaction, aesthetics, ergonomics of the application, and its relationship with the user’s emotions. In conclusion, the combination of the three methods helped to identify the importance of the attributes in training processes. The holistic and detailed vision of the causal, impact, and similarity relationships between the 87 attributes analyzed were also considered. This framework will allow the generation of a baseline for the use of multicriteria methods in research into relevant aspects of Augmented Reality.

show abstract

Section: Discussionmentioning

confidence: 99%

Combined Framework of Multicriteria Methods to Identify Quality Attributes in Augmented Reality Applications

et al. 2023

View full text Add to dashboard Cite

show abstract

“…In addition, NiTE2 is a middleware, which has features such as human detection, posture estimation, hand tracking, and gesture detection. For this project, it is used to achieve the Cartesian coordinates of 15 identifiable joints [ 34 ]. Furthermore, it was used with the python bindings because it is easier to program in the ROS environment, which was coded in python in its majority.…”

Section: Preliminariesmentioning

confidence: 99%

A Novel Multi-Modal Teleoperation of a Humanoid Assistive Robot with Real-Time Motion Mimic

et al. 2023

View full text Add to dashboard Cite

This research shows the development of a teleoperation system with an assistive robot (NAO) through a Kinect V2 sensor, a set of Meta Quest virtual reality glasses, and Nintendo Switch controllers (Joycons), with the use of the Robot Operating System (ROS) framework to implement the communication between devices. In this paper, two interchangeable operating models are proposed. An exclusive controller is used to control the robot’s movement to perform assignments that require long-distance travel. Another teleoperation protocol uses the skeleton joints information readings by the Kinect sensor, the orientation of the Meta Quest, and the button press and thumbstick movements of the Joycons to control the arm joints and head of the assistive robot, and its movement in a limited area. They give image feedback to the operator in the VR glasses in a first-person perspective and retrieve the user’s voice to be spoken by the assistive robot. Results are promising and can be used for educational and therapeutic purposes.

show abstract

Lessons Learned from Human Pose Interaction in an Industrial Spatial Augmented Reality Application

Cited by 2 publications

References 7 publications

Combined Framework of Multicriteria Methods to Identify Quality Attributes in Augmented Reality Applications

Combined Framework of Multicriteria Methods to Identify Quality Attributes in Augmented Reality Applications

A Novel Multi-Modal Teleoperation of a Humanoid Assistive Robot with Real-Time Motion Mimic

Contact Info

Product

Resources

About