Evaluation of Deep Learning Models for Smoking Recognition with Smartwatch and Smartphone Sensors

Abstract

Smartwatches and smartphones are extensively used in human activity recognition, particularly for step counting and daily sports applications, thanks to the motion sensors integrated into these devices. Machine learning algorithms are often utilized to process sensor data and classify the activities. There are many studies that explore the use of traditional classification algorithms in activity recognition, however, recently, deep learning approaches are also receiving attention. In this paper, we utilize a dataset that particularly consists of smoking-related activities and explore the recognition performance of three deep learning architectures, namely Long-Short Term Memory (LSTM), Recurrent Neural Networks (RNN) and Convolutional Neural Networks (CNN).We evaluate their performances according to different hyperparameters, different sensor types and device types. The results exhibit that the performance of LSTM is much higher than that of CNN and RNN. Moreover, the use of magnetometer and gyroscope together with accelerometer data improves the performance. Use of data from smartphone sensors also enhances the performance results and the final accuracy with the best parameter combinations is observed to be 98.2%.