Machine learning for Internet of things anomaly detection under low-quality data

Abstract

With the popularization of Internet of things, its network security has aroused widespread concern. Anomaly detection is one of the important technologies to protect network security. To meet the needs of automatic and intelligent detection, supervised machine learning is widely used in anomaly detection. However, the existing schemes ignore the problem of data quality, which leads to the unsatisfactory detection effect in practice. Therefore, practitioners may not know which algorithm to choose due to the lack of review and evaluation of anomaly detection methods under low-quality data. To address this problem, we give a detailed review and evaluation of six supervised anomaly detection methods, as well as release the core code of feature extractor for pcap format traffic traces and anomaly detection methods for reuse. We evaluate the methods on two public datasets (one is a simulated network dataset and the other is a real Internet of things dataset). We believe that our work and insights will help practitioners quickly understand and develop anomaly detection schemes for Internet of things and can provide reference for future research.

IoTDevID: A Behavior-Based Device Identification Method for the IoT

“…The common characteristics of these tools are that all of the generated features are flow-based. Unlike these tools, Kitsune, used in [47]- [50] uses a sliding window approach, converting pcap files into a dataset with 115 features.…”

Machine learning for the management of biochar yield and properties of biomass sources for sustainable energy

“…120 Domain expertise is useful in order to steer the model, and investigators may consider testing its robustness using synthetic data. Ensemble methods and cross-validation can help to improve the generalization performance 121,122 and data augmentation can be used to improve the dataset artificially. It is important to document the steps taken, to apply caution in fields with scant data, and to prioritize continual monitoring to enable ongoing modifications to the model.…”

A Comprehensive Review of Machine Learning Approaches for Anomaly Detection in Smart Homes: Experimental Analysis and Future Directions

“…Detecting anomalies in human activities has various applications, such as guiding dementia patients if they miss essential activities like taking meals or medicines and monitoring the health of those staying alone, especially elderly people [4,5]. Many researchers have proposed various methodologies, including the identification of body positions and actions, as well as the recognition of visual activities, to be significant in the context of anomaly detection [6][7][8]. Nonetheless, these approaches exhibit certain limitations.…”