A Comprehensive Review on Handcrafted and Learning-Based Action Representation Approaches for Human Activity Recognition

Abstract

Human activity recognition (HAR) is an important research area in the fields of human perception and computer vision due to its wide range of applications. These applications include: intelligent video surveillance, ambient assisted living, human computer interaction, human-robot interaction, entertainment, and intelligent driving. Recently, with the emergence and successful deployment of deep learning techniques for image classification, researchers have migrated from traditional handcrafting to deep learning techniques for HAR. However, handcrafted representation-based approaches are still widely used due to some bottlenecks such as computational complexity of deep learning techniques for activity recognition. However, approaches based on handcrafted representation are not able to handle complex scenarios due to their limitations and incapability; therefore, resorting to deep learning-based techniques is a natural option. This review paper presents a comprehensive survey of both handcrafted and learning-based action representations, offering comparison, analysis, and discussions on these approaches. In addition to this, the well-known public datasets available for experimentations and important applications of HAR are also presented to provide further insight into the field. This is the first review paper of its kind which presents all these aspects of HAR in a single review article with comprehensive coverage of each part. Finally, the paper is concluded with important discussions and research directions in the domain of HAR.

Toward Marker-Free 3D Pose Estimation in Lifting: A Deep Multi-View Solution

“…HOG [13], SIFT [14], etc. Approaches based on the hand crafted image features are not able to handle heterogeneous or complex datasets [15], [16]. With the emergence and advances of deep learning techniques, approaches that employ deep convolutional neural networks to learn the image features [17], have become the standard in the domain of the vision tasks.…”

Active and Assisted Living: A Comprehensive Review of Enabling Technologies and Scenarios

“…Hierarchical approaches represent high-level human activities in terms of simpler activities or actions; therefore, such techniques are appropriate for recognizing more complex activities. A more detailed survey on vision-based approach can be seen in [20] and [21].…”

Rock Classification from Field Image Patches Analyzed Using a Deep Convolutional Neural Network

“…Deep convolutional neural networks (CNNs) are able to automatically learn the features required for image classification from training-image data, thus improving classification accuracy and efficiency without relying on artificial feature selection. Very recent studies have proposed deep learning algorithms to achieve significant empirical improvements in areas such as image classification [14], object detection [15], human behavior recognition [16,17], speech recognition [18,19], traffic signal recognition [20,21], clinical diagnosis [22,23], and plant disease identification [11,24]. The successes of applying CNNs to image recognition have led geologists to investigate their use in identifying rock types [8,9,25], and deep learning has been used in several studies to identify the rock types from images.…”