Intrusion Detection in Computer Networks Using Latent Space Representation and Machine Learning

Abstract

Anomaly detection (AD) identifies samples that are not related to the overall distribution in the feature space. This problem has a long history of research through diverse methods, including statistical and modern Deep Neural Networks (DNN) methods. Non-trivial tasks such as covering ambiguous user actions and the complexity of standard algorithms challenged researchers. This article discusses the results of introducing an intrusion detection system using a machine learning (ML) approach. We compared these results with the characteristics of the most common existing rule-based Snort system. Signature Based Intrusion Detection System (SBIDS) has critical limitations well observed in a large number of previous studies. The crucial disadvantage is the limited variety of the same attack type due to the predetermination of all the rules. DNN solves this problem with long short-term memory (LSTM). However, requiring the amount of data and resources for training, this solution is not suitable for a real-world system. This necessitated a compromise solution based on DNN and latent space techniques.

Parallel Ensemble Feature Subset Selection based Deep Learning Approach for Imbalanced High Dimensional Cancer Datasets

“…Ensemble feature selections [2][3][4][5] are popular due to their accuracy and stability [6,7]. Deep Learning [8][9][10][11][12][13][14] is a recent field of study in machine learning that has had remarkable success in high-level data abstraction and representation. Instead of using a single shallow "fat" structure, it employs numerous levels of non-linear operations to address the relevant machine learning problems.…”

Visualization of Data Cubes for Anomaly Detection in Network Traffic Data Streams

“…Second, machine learning based approaches (see e.g. [3]- [6]) use classifiers like neural networks or random forests. They are trained on data containing attacks and normal instances, usually on a flow basis.…”