Human action recognition with bag of visual words using different machine learning methods and hyperparameter optimization

Abstract

Human activity recognition (HAR) has quite a wide range of applications. Due to its widespread use, new studies have been developed to improve the HAR performance. In this study, HAR is carried out using the commonly preferred KTH and Weizmann dataset, as well as a dataset which we created. Speeded up robust features (SURF) are used to extract features from these datasets. These features are reinforced with bag of visual words (BoVW). Different from the studies in the literature that use similar methods, SURF descriptors are extracted from binary images as well as grayscale images. Moreover, four different machine learning (ML) methods such as k-nearest neighbors, decision tree, support vector machine and naive Bayes are used for classification of BoVW features. Hyperparameter optimization is used to set the hyperparameters of these ML methods. As a result, ML methods are compared with each other through a comparison with the activity recognition performances of binary and grayscale image features. The results show that if the contrast of the environment decreases when a human enters the frame, the SURF of the binary image are more effective than the SURF of the gray image for HAR. Keywords Human activity recognition Á Image processing Á Speeded up robust features Á Bag of visual words Á Machine learning Á k-Nearest neighbors Á Decision tree Á Support vector machine Á Naive Bayes Á Hyperparameter optimization

Suspicious Activity Recognition Using Proposed Deep L4-Branched-Actionnet With Entropy Coded Ant Colony System Optimization

“…Deep learning is an emerging field, but machine learning can work better than deep learning in some workspace. Machine learning methods with bags of visual words help develop human action recognition applications [34]. Besides these popular techniques, Human action recognition uses other techniques like the LSTM network, Epileptic seizure classification, deep transfer learning approach, and hybrid transfer learning model [35][36][37][38].…”

Solid Domestic Waste classification using Image Processing and Machine Learning

“…A few articles describe the pipeline that the images go through to make the classification. In Liu et al (2018) and in Aslan et al (2020) Speed Up Robust Features (SURF) is used in order to perform the feature extraction. Liu et al (2018) stated that "... SURF has an excellent effect on image recognition and classification with fast processing speed".…”

Human Action Recognition Based on Transfer Learning Approach

“…Sensor-based HAR gets the input from smart sensors such as accelerometers, gyroscopes, and sound. There are hand-crafted directions [8], [9] ,and deep learning methods [10] from the methodology perspective. The main difference between them is in feature learning.…”