Development and Evaluation of a System for AR Enabling Realistic Display of Gripping Motions Using Leap Motion Controller

Katahira, Reiji; Soga, Masato

doi:10.1016/j.procs.2015.08.269

Cited by 18 publications

(10 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In the existing study [5], the system used a transparent 3D model and the 3D model followed each fingers of the user. In this way, they performed hidden surface removal based on the depth information of user and 3D model.…”

Section: Introductionmentioning

confidence: 99%

Hidden Surface Removal in Augmented Reality: Hand Region Extraction using PCA

Ishizu*,

Sakamoto*,

Sakoma

2020

IJRTE

View full text Add to dashboard Cite

Recently, augmented Reality (AR) is growing rapidly and much attention has been focused on interaction techniques between users and virtual objects, such as the user directly manipulating virtual objects with his/her bare hands. Therefore, the authors believe that more accurate overlay techniques will be required to interact more seamlessly. On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusion problem). In this study, this system considers the object-context relations between the user's hand and the virtual object by acquiring depth information of the user's finger using a depth sensor. In addition, the system defines the color range of the user's hand by performing principal component analysis (PCA) on the color information near the finger position obtained from the depth sensor and setting a threshold. Then, this system extracts an area of the hand by using the definition of the color range of the user's hand. Furthermore, the fingers are distinguished by using the Canny method. In this way, this system realizes hidden surface removal along the area of the user's hand. In the evaluation experiment, it is confirmed that the hidden surface removal in this study make it possible to distinguish between finger boundaries and to clarify and process finger contours.

show abstract

Section: Introductionmentioning

confidence: 99%

Hidden Surface Removal in Augmented Reality: Hand Region Extraction using PCA

Ishizu*,

Sakamoto*,

Sakoma

2020

IJRTE

View full text Add to dashboard Cite

show abstract

“…However, as any other new technology, rehabilitation robotic systems should be refereed on its efficiency and costeffectiveness and not only on its technical performance. The rehabilitation robotic systems have the potential to stimulate and support the relearning of the functional motor pattern of overground walking in an optimal manner while increasing patient's motivation, which constitutes a crucial element in the subject's cardiac recovery (11).…”

Section: Introductionmentioning

confidence: 99%

Cardiac rehabilitation for older patients with cardiovascular pathology using robotic systems – A survey

Mocan¹,

Pharmacy²,

Mocan³

2019

Balneo

View full text Add to dashboard Cite

In the last decades, we have witnessed a drastic increase in the proportion of elders in the western countries, and more than a third of worldwide population dies because of cardiovascular diseases. The elderly patients with cardiovascular diseases, but not only, are frail and need constant assistance, and so the healthcare system will slowly become incapable of properly address all the patients' medical problems and rehabilitation issues, while aiming towards a continuous increase of the life quality. The rehabilitation robotic systems have the potential to stimulate and support the re-learning of the functional motor pattern of over-ground walking in an optimal manner while increasing patient's motivation, which constitutes a crucial element in the subject's cardiac recovery. Thus, the present article aims at reviewing the robotic systems available for cardiac rehabilitation in elders with cardiac pathology.

show abstract

“…Some studies also focused on the several kinds of applications with LMC. Katahira and Soga proposed a system using LMC to produce a realistic picture of augmented reality [14]. Kincaida et al proposed a system using LMC to measure tremors in clinical settings [15].…”

Section: Introductionmentioning

confidence: 99%

Recognition Characteristics of Interface Designed for Gesture Operations of 3D Objects

Sekine¹

2019

Adv. Sci. Technol. Res. J.

View full text Add to dashboard Cite

This study focuses on the development of an interface for gesture control and Boolean operation of 3D objects in 3D computer-aided design (CAD). Although mouse and keyboard have been mainly used as computer input devices, novel computer interfaces are becoming increasingly popular with rapid development of computer technologies. Among several computer interfaces, the gesture interface is well-known as an system operable through the natural human behavior. However, the application to 3D CAD has been scarcely studied so far. From the backgrounds, a simple gesture interface was developed to operate a 3D object in 3D CAD. Leap Motion Controller (LMC) was used as a motion sensor device. A dialog-based graphical user interface (GUI) was also created for the parameter setting. As a result, several operational functions could be successfully executed through various hand-finger motions. Moreover, the system enabled us to experience an intuitive interaction with 3D CAD. Then, the several demonstrations were performed to identify the recognition characteristics of the gesture interface. The differences in the recognition rate were revealed as the results. Especially, it confirmed that a combination of static and dynamic gestures could help to enhance the recognition rate in the gesture interface using LMC. In accordance with the findings, the functions for Boolean operation were also implemented for the manipulation of a 3D object, such as extrusion and hole making.

show abstract

Development and Evaluation of a System for AR Enabling Realistic Display of Gripping Motions Using Leap Motion Controller

Cited by 18 publications

References 1 publication

Hidden Surface Removal in Augmented Reality: Hand Region Extraction using PCA

Hidden Surface Removal in Augmented Reality: Hand Region Extraction using PCA

Cardiac rehabilitation for older patients with cardiovascular pathology using robotic systems – A survey

Recognition Characteristics of Interface Designed for Gesture Operations of 3D Objects

Contact Info

Product

Resources

About