Human Action Recognition Based on Transfer Learning Approach

El-Kady

et al. 2022

Multimed Tools Appl

Self Cite

More than 5% of the people around the world are deaf and have severe difficulties in communicating with normal people according to the World Health Organization (WHO). They face a real challenge to express anything without an interpreter for their signs. Nowadays, there are a lot of studies related to Sign Language Recognition (SLR) that aims to reduce this gap between deaf and normal people as it can replace the need for an interpreter. However, there are a lot of challenges facing the sign recognition systems such as low accuracy, complicated gestures, high-level noise, and the ability to operate under variant circumstances with the ability to generalize or to be locked to such limitations. Hence, many researchers proposed different solutions to overcome these problems. Each language has its signs and it can be very challenging to cover all the languages’ signs. The current study objectives: (i) presenting a dataset of 20 Arabic words, and (ii) proposing a deep learning (DL) architecture by combining convolutional neural network (CNN) and recurrent neural network (RNN). The suggested architecture reported 98% accuracy on the presented dataset. It also reported 93.4% and 98.8% for the top-1 and top-5 accuracies on the UCF-101 dataset.

“…Sign language recognition is studied by different researchers in different approaches since 1990 [1,22,62,63]. In this section, the related literature is discussed.…”

Section: Related Workmentioning

confidence: 99%

A vision-based deep learning approach for independent-users Arabic sign language interpretation

El-Kady

et al. 2022

Multimed Tools Appl

Self Cite

“…The TL process is divided into four contexts relying on ''what to transfer'' in learning. They involve approaches of (1) the instance-transfer, (2) the feature-representationtransfer, (3) the parameter-transfer, and (4) the relationalknowledge-transfer [1]. TL uses a previously trained stored model as a starting point for DL.…”

Section: Transfer Learning (Tl)mentioning

confidence: 99%

Skin cancer diagnosis based on deep transfer learning and sparrow search algorithm

Hassan

2022

Neural Comput & Applic

Self Cite

Skin cancer affects the lives of millions of people every year, as it is considered the most popular form of cancer. In the USA alone, approximately three and a half million people are diagnosed with skin cancer annually. The survival rate diminishes steeply as the skin cancer progresses. Despite this, it is an expensive and difficult procedure to discover this cancer type in the early stages. In this study, a threshold-based automatic approach for skin cancer detection, classification, and segmentation utilizing a meta-heuristic optimizer named sparrow search algorithm (SpaSA) is proposed. Five U-Net models (i.e., U-Net, U-Net++, Attention U-Net, V-net, and Swin U-Net) with different configurations are utilized to perform the segmentation process. Besides this, the meta-heuristic SpaSA optimizer is used to perform the optimization of the hyperparameters using eight pre-trained CNN models (i.e., VGG16, VGG19, MobileNet, MobileNetV2, MobileNetV3Large, MobileNetV3Small, NASNetMobile, and NASNetLarge). The dataset is gathered from five public sources in which two types of datasets are generated (i.e., 2-classes and 10-classes). For the segmentation, concerning the “skin cancer segmentation and classification” dataset, the best reported scores by U-Net++ with DenseNet201 as a backbone architecture are 0.104, $$94.16\%$$ 94.16 % , $$91.39\%$$ 91.39 % , $$99.03\%$$ 99.03 % , $$96.08\%$$ 96.08 % , $$96.41\%$$ 96.41 % , $$77.19\%$$ 77.19 % , $$75.47\%$$ 75.47 % in terms of loss, accuracy, F1-score, AUC, IoU, dice, hinge, and squared hinge, respectively, while for the “PH2” dataset, the best reported scores by the Attention U-Net with DenseNet201 as backbone architecture are 0.137, $$94.75\%$$ 94.75 % , $$92.65\%$$ 92.65 % , $$92.56\%$$ 92.56 % , $$92.74\%$$ 92.74 % , $$96.20\%$$ 96.20 % , $$86.30\%$$ 86.30 % , $$92.65\%$$ 92.65 % , $$69.28\%$$ 69.28 % , and $$68.04\%$$ 68.04 % in terms of loss, accuracy, F1-score, precision, sensitivity, specificity, IoU, dice, hinge, and squared hinge, respectively. For the “ISIC 2019 and 2020 Melanoma” dataset, the best reported overall accuracy from the applied CNN experiments is $$98.27\%$$ 98.27 % by the MobileNet pre-trained model. Similarly, for the “Melanoma Classification (HAM10K)” dataset, the best reported overall accuracy from the applied CNN experiments is $$98.83\%$$ 98.83 % by the MobileNet pre-trained model. For the “skin diseases image” dataset, the best reported overall accuracy from the applied CNN experiments is $$85.87\%$$ 85.87 % by the MobileNetV2 pre-trained model. After computing the results, the suggested approach is compared with 13 related studies.

“…Abdulazeem et al [17] devise a structure with three main stages for HCR. The stages are recognition, pretraining, and preprocessing.…”

Section: Related Workmentioning

confidence: 99%

Quantum Water Strider Algorithm with Hybrid-Deep-Learning-Based Activity Recognition for Human–Computer Interaction

et al. 2022

Human action and activity recognition are clues that alleviate human behavior analysis. Human action recognition (HAR) becomes a significant challenge in various applications involving human computer interaction (HCI) and intellectual video surveillance for enhancing security in distinct fields. Precise action recognition is highly challenging because of the variations in clutter, backgrounds, and viewpoint. The evaluation method depends on the proper extraction and learning of data. The achievement of deep learning (DL) models results in effectual performance in several image-related tasks. In this view, this paper presents a new quantum water strider algorithm with hybrid-deep-learning-based activity recognition (QWSA-HDLAR) model for HCI. The proposed QWSA-HDLAR technique mainly aims to recognize the different types of activities. To recognize activities, the QWSA-HDLAR model employs a deep-transfer-learning-based, neural-architectural-search-network (NASNet)-based feature extractor to generate feature vectors. In addition, the presented QWSA-HDLAR model exploits a QWSA-based hyperparameter tuning process to choose the hyperparameter values of the NASNet model optimally. Finally, the classification of human activities is carried out by the use of a hybrid convolutional neural network with a bidirectional recurrent neural network (HCNN-BiRNN) model. The experimental validation of the QWSA-HDLAR model is tested using two datasets, namely KTH and UCF Sports datasets. The experimental values reported the supremacy of the QWSA-HDLAR model over recent DL approaches.