A hybrid and context-aware framework for normal and abnormal human behavior recognition

Abstract

Human behavior recognition is one of the significant components of Ambient Assisted Living (AAL) systems and personal assistive robots allowing to improve the quality of their lives in terms of safety, autonomy, and well-being. A critical aspect of preventing dangerous situations for users, especially elderlies, is to recognize abnormal human behavior. In spite of the extensive exploration of abnormality recognition in various fields, there remain some challenges in developing effective approaches for recognizing abnormal human behaviors in AAL systems due to the limitations of data-driven and knowledge-driven approaches. In this paper, a context-aware framework combining data-driven and knowledge-driven approaches is proposed to better characterize human behaviors and recognize abnormal behaviors using commonsense reasoning while considering human behavior context. The proposed framework comprises five main modules, which leverage Long Short-Term Memory (LSTM) models and Probabilistic Answer Set Programming (PASP)-based commonsense reasoning to recognize human activities and represent abnormal human behaviors, as well as reason about those behaviors. The proposed framework is evaluated using two datasets, namely Orange4Home and UCI HAR. The obtained results indicate the capability of the proposed framework to characterize human behaviors and recognize abnormal human behaviors with high performance.

Socially Assistive Robots in Smart Environments to Attend Elderly People—A Survey

“…The applications that are provided are human position tracking and human activity monitoring. The recognition of activities, normal or abnormal, is also the service provided by the AAL environment and the robot in Mojarad et al [71]'s work. The proposed framework includes long-term memory models (LSTM) as well as reasoning based on Probabilistic Answer Set Programming (PASP).…”

“…Sometimes, the parameters monitored are related to activity recognition. This is, for example, the case in the proposals by Do et al [70] or Mojarad et al [71]. Daily activities carried out are also monitored in the proposals by Coradeschi et al [25] or in the Living at Home project [36].…”