Automatic Recognition of ISL Dynamic Signs with Facial Cues

Sruthi, C. J.; Soni, Karan; Lijiya, A

doi:10.1007/978-981-33-6984-9_30

Cited by 4 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Channel attention is used to maximize the information. C.J Shruti et al [14] proposed a dynamic isolated double handed ISL word recognition system where facial expression is utilized with hand gesture. For facial part extraction Viola Jones algorithm is used and HOG is used for hand feature extraction.…”

Section: Related Workmentioning

confidence: 99%

Occlusion Robust Sign Language Recognition System for Indian Sign Language Using CNN and Pose Features

Biswas

Purkayastha

2023

Preprint

View full text Add to dashboard Cite

The Sign Language Recognition System (SLRS) is a cutting-edge technology that aims to enhance communication accessibility for the deaf community in India by replacing the traditional approach of using human interpreters. However, the existing SLRS for Indian Sign Language (ISL) do not focus on some major problems including occlusion, similar hand gesture, multi viewing angle problem and inefficiency due to extracting features from a large sequence of frame that contains redundant and unnecessary information. Therefore, in this research paper an occlusion robust SLRS named Multi Featured Deep Network (MF-DNet) is proposed for recognizing ISL words. The suggested MF-DNet uses a histogram difference based keyframe selection technique to remove redundant frames. To resolve occlusion, similar hand gesture, and multi viewing angle problem the suggested MF-DNet incorporates pose features with Convolution Neural Network (CNN) features. For classification the proposed system uses Bi Directional Long Shor Term Memory (BiLSTM) network, which is compared with different classifier such as LSTM, ConvLSTM and stacked LSTM networks. The proposed SLRS achieved an average classification accuracy of 96.88% on the ISL dataset and 99.06% on the benchmark LSA64 dataset. The results obtained from the MF-DNet is compared with some of the existing SLRS where the proposed method outperformed the existing methods.

show abstract

Section: Related Workmentioning

confidence: 99%