Sign language recognition system classifies signs made by hand gestures. An adequate number of features are required to represent the shape variations of sign language. As compared to individual feature set, a combination of features can be effective due to the fact that a particular feature set represents different shape information. A simple concatenation results in large feature vector size and increases the classification computational complexity. Discriminant correlation analysis (DCA)-based unimodal feature-level fusion has been applied on uniform as well as complex background Indian sign language datasets. DCA is a feature-level fusion technique that takes into account the class associations while combining the feature sets. It maximises the inter-class separability of two feature sets and also minimises the intra-class separability while performing the feature fusion. The objective of DCA-based unimodal feature fusion technique is to combine different feature sets into a single feature vector with more discriminative power. The performance of proposed framework is compared with individual orthogonal moment-based feature sets and canonical correlation analysis (CCA)-based feature fusion technique. Results show that in comparison to individual features and CCA-based fused features, DCA is an effective technique in terms of improved accuracy, reduced feature vector size and smaller classification time.
The capability of lower order Krawtchouk moment-based shape features has been analyzed. The behaviour of 1D and 2D Krawtchouk polynomials at lower orders is observed by varying Region of Interest (ROI). The paper measures the effectiveness of shape recognition capability of 2D Krawtchouk features at lower orders on the basis of Jochen-Triesch’s database and hand gesture database of 10 Indian Sign Language (ISL) alphabets. Comparison of original and reduced feature-set is also done. Experimental results demonstrate that the reduced feature dimensionality gives competent accuracy as compared to the original feature-set for all the proposed classifiers. Thus, the Krawtchouk moment-based features prove to be effective in terms of shape recognition capability at lower orders.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.