MICAR: multi-inhabitant context-aware activity recognition in home environments

Abstract

The sensor-based recognition of Activities of Daily Living (ADLs) in smart-home environments enables several important applications, including the continuous monitoring of fragile subjects in their homes for healthcare systems. The majority of the approaches in the literature assume that only one resident is living in the home. Multi-inhabitant ADLs recognition is significantly more challenging, and only a limited effort has been devoted to address this setting by the research community. One of the major open problems is called data association, which is correctly associating each environmental sensor event (e.g., the opening of a fridge door) with the inhabitant that actually triggered it. Moreover, existing multi-inhabitant approaches rely on supervised learning, assuming a high availability of labeled data. However, collecting a comprehensive training set of ADLs (especially in multiple-residents settings) is prohibitive. In this work, we propose MICAR: a novel multi-inhabitant ADLs recognition approach that combines semi-supervised learning and knowledge-based reasoning. Data association is performed by semantic reasoning, combining high-level context information (e.g., residents’ postures and semantic locations) with triggered sensor events. The personalized stream of sensor events is processed by an incremental classifier, that is initialized with a limited amount of labeled ADLs. A novel cache-based active learning strategy is adopted to continuously improve the classifier. Our results on a dataset where up to 4 subjects perform ADLs at the same time show that MICAR reliably recognizes individual and joint activities while triggering a significantly low number of active learning queries.

Application of Explainable Artificial Intelligence in Alzheimer's Disease Classification: A Systematic Review

“…Hence, XAI methods must also incorporate a confidence score to identify situations when the classifier is incorrect before providing explanations. Otherwise, the end user may create false trust in the system [165]. Therefore it is vital to evaluate not only whether an explanation is intuitive to the user but also to arrive at an optimal decision [165].…”

“…Otherwise, the end user may create false trust in the system [165]. Therefore it is vital to evaluate not only whether an explanation is intuitive to the user but also to arrive at an optimal decision [165]. 5.…”

Human Activity Mining in Multi-Occupancy Contexts Based on Nearby Interaction Under a Fuzzy Approach

“…The system was evaluated in a domestic environment, but limitations include limited generalizability, lower accuracy in complex environments, difficulty distinguishing similar activities, and computational costs. In [62], a knowledge-based reasoning approach is employed to analyse contextual data and selectively exclude activities from the probability distribution obtained through activity recognition that does not align with the given context. They propose that MICAR could potentially leverage these technologies to achieve reliable data association.…”

Knowledge Infusion for Context-Aware Sensor-Based Human Activity Recognition

“…In the literature, the majority of interpretable models for HAR are not based on deep learning but on less effective inherently interpretable models [6,16]. While a few works consider deep models [2], they do not take into account data scarcity.…”