Conditional-UNet: A Condition-aware Deep Model for Coherent Human Activity Recognition From Wearables

Abstract

Recognizing human activities from multi-channel time series data collected from wearable sensors has become an important practical application of machine learning. A serious challenge comes from the presence of coherent activities or body movements, such as movements of the head while walking or sitting, since signals representing these movements are mixed and interfere with each other. Basic multi-label classification typically assumes independence within the multiple activities. This is oversimplified and reduces modeling power even when using stateof-the-art deep learning methods. In this paper, we investigate this new problem, which we name "Coherent Human Activity Recognition (Co-HAR)", that keeps complete conditional dependency between the multiple labels. Additionally, we treat Co-HAR as a dense labelling problem that classifies each sample on a time step with multiple coherent labels to provide high-fidelity and duration-sensitive support to high-precision applications. To explicitly model conditional dependency, a novel conditionaware deep architecture "Conditional-UNet" is developed to allow for multiple dense labeling for Co-HAR. We also contribute a first-of-its-kind Co-HAR dataset for head gesture recognition associated with a user's activity, walking or sitting, to the research community. Extensive experiments on this dataset show that our model outperforms state-of-the-art deep learning methods and achieves up to 92% accuracy on context-based head gesture classification.

A Boundary Consistency-Aware Multitask Learning Framework for Joint Activity Segmentation and Recognition With Wearable Sensors

“…Inspired by the image semantic segmentation works, [8] and [31] respectively applied FCN (Fully Convolutional Networks) and U-net on human activity recognition tasks to predict dense labels, which directly predicts the dense activity labels (sample-level activity labels). Furthermore, the Conditional-UNet with multiple coherent dense labels was proposed by [32], modeling conditional dependency between the multiple labels explicitly. Moreover, our recent work [9] advanced the boundary consistency module and the multi-task framework to alleviate the multi-class windows problem and over-segmentation errors, yielding a significant performance improvement.…”