Detection and Tracking of Fingertips for Geometric Transformation of Objects in Virtual Environment

Alam, Mohammad Mahmudul; Rahman, S. M. Mahbubur

doi:10.1109/aiccsa47632.2019.9035256

Cited by 3 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recognizing hand gestures is equally important to interpret sign language [5,6,7,8,9]. Moreover, in virtual reality (VR) and mixed reality (MR) environments, the recognition of hand gestures, and detection of fingertips are essential to interact with the virtual environment [10,11,12,13,14]. Existing hand gesture recognition and fingertip detection approaches can be broadly classified into two categories -image processing and deep learning-based approaches.…”

Section: Introductionmentioning

confidence: 99%

Unified Learning Approach for Egocentric Hand Gesture Recognition and Fingertip Detection

Alam,

Islam,

Rahman

2021

Preprint

Self Cite

View full text Add to dashboard Cite

In human-computer interaction or sign language interpretation, recognizing hand gestures and detecting fingertips become ubiquitous in computer vision research. In this paper, a unified approach of convolutional neural network for both hand gesture recognition and fingertip detection is introduced. The proposed algorithm uses a single network to predict the probabilities of finger class and positions of fingertips in one forward propagation of the network. Instead of directly regressing the positions of fingertips from the fully connected layer, the ensemble of the position of fingertips is regressed from the fully convolutional network. Subsequently, the ensemble average is taken to regress the final position of fingertips. Since the whole pipeline uses a single network, it is significantly fast in computation. The proposed method results in remarkably less pixel error as compared to that in the direct regression approach and it outperforms the existing fingertip detection approaches including the Heatmap-based framework.

show abstract