An LSTM Based System for Prediction of Human Activities with Durations

Abstract

Human activity prediction is an interesting problem with a wide variety of applications like intelligent virtual assistants, contextual marketing, etc. One formulation of this problem is jointly predicting human activities (viz. eating, commuting, etc.) with associated durations. Herein a deep learning system is proposed for this problem. Given a sequence of past activities and durations, the system estimates the probabilities for future activities and their durations. Two distinct Long-Short Term Memory (LSTM) networks are developed that cater to different assumptions about the data and achieve different modeling complexities and prediction accuracies. The networks are trained and tested with two real-world datasets, one being publicly available while the other collected from a field experiment. Modeling on the segment level public dataset mitigates the cold-start problem. Experiments indicate that compared to traditional approaches based on sequence mining or hidden Markov modeling, LSTM networks perform significantly better. The ability of LSTM networks to detect long term correlations in activity data is also demonstrated. The trained models are each less than 500KB in size and can be deployed to run in real-time on a mobile device without any dependencies on the cloud. This can help applications like mobile personal assistants by providing predictive context.

Deep PPG: Large-Scale Heart Rate Estimation with Convolutional Neural Networks

“…Our deep learning approach takes the time-frequency spectra of the PPG- and accelerometer-signals as input, and provides the estimated heart rate as output. Deep learning has already been applied to various time-series signals, such as for human activity recognition [20,21,22] or gait parameter extraction [23]. Gjoreski et al [24] compared deep and classical machine learning methods on the task of human activity classification, and showed that with sufficient data a convolutional neural network (CNN) outperforms classical models.…”

SelfHAR

“…In recent years, the use of deep learning for human activity recognition has become more prevalent [11,17,34,35]. Convolutional neural networks have been commonly used [21,34,37,62,63] due to their ability to capture spatial relationships between sensor signals.…”

Classification of the User's Intent Detection in Ecommerce systems – Survey and Recommendations

“…Zhou et al [94] use the Fast-Slow layer for very short sessions and an attention layer for noisy sessions to predict the Dwell Time of the next user action. Krishna et al [36] and Zhou et al [94] predict the next action and its duration, which can be used to propose more interesting actions to the customer. Jing and Smola [31] model RNNs using Long-Short Term Memory cells to estimate when the user will return to a site and what will be their future interest.…”