Controlling False Alarm/Discovery Rates in Online Internet Traffic Flow Classification

Abstract

Classifying Internet traffic flows online into applications or broader classes without inspecting the packet payloads or without relying on port numbers has become a necessity for network operators. The operators can use this information to monitor their networks and provide per-class quality of service. There has been a great deal of research done on Internet traffic classification recently and numerous techniques have been proposed. While the current techniques can obtain a high accuracy classifying Internet traffic, providing performance guarantees for particular classes of interest has never been addressed. In this thesis, we provide two novel types of online Internet traffic classifiers that can provide performance guarantees on the false alarm and false discovery rates, respectively. These guarantees can be for an entire class (class-wise) or between two classes (pair-wise). Controlling false alarm rates is well-suited for application prioritization (i.e. prioritizing time-sensitive applications like VoIP over HTTP) whereas controlling false discovery rates is better suited for blocking or rate-limiting a targeted class of traffic (i.e. Peer-to-Peer). The classifier that provides false alarm rate guarantees is based on a Neyman-Pearson classification framework while the classifier that provides false discovery rate guarantees is based on the Learning to Satisfy (LSAT) framework. Both of these classifiers are implemented using a machine learning technique, namely, the 2-nu Support Vector Machine (SVM). Moreover, all previous work done with these two statistical methodologies focused on binary classification only; we extend these statistical methodologies to a multi-class setting. In addition to the regular application classification problem, we also present preliminary work on a binary LSAT classifier that can detect, after the reception of only a handful of packets, whether a flow will be large, as defined by a network operator. This large flow detector can act as a preprocessor for regular application classifiers. By allowing only large flows to pass to the classifier, this allows the classifier to focus on the more resource-intensive flows. We validated our Internet traffic classifiers by testing our approaches using data provided by an ISP.ii Abrégé Identifier l'application (ou autre classe plus générale) qui génère un flux de trafic Internet, sans compter sur le numéro du port ou inspecter la charge des paquets, est devenu une nécessité pour les opérateurs de réseau. Les opérateurs peuvent utiliser cette information pour surveiller leurs réseaux et fournir une qualité de service propreà chaque classe. Il y a eu beaucoup de travaux de recherche portant sur la classification du trafic Internet effectué récemment et de nombreuses techniques ontété proposées. Bien que les techniques actuelles puissent obtenir une grande précision pour classer le trafic Internet, offrir des garanties de performance pour des catégories particulières est un problème encore inexploré.Dans ce mémoire, nous proposons deu...

A Survey on TLS-Encrypted Malware Network Traffic Analysis Applicable to Security Operations Centers

“…Note that FDR is defined as the expectation of a false positive/(false positive + true positive)) [111] and performance evaluation with controlling FDR has been widely used in statistics and genomics. In contrast, while an exception [112] can be found in traffic classification literature, controlling FDR was rarely conducted in malware detection literature. As we can observe in its definition, FDR highly depends on false positives.…”

A machine learning approach for feature selection traffic classification using security analysis

“…In our previous works [15][16][17], we applied ML algorithms in flow-based identification for the classification of IM applications, we achieved high promising accuracy results and improved the performance of the utilized ML algorithms. Similarly, several studies in the past [8,[18][19][20][21][22][23][24] have also applied ML algorithms for flow-based traffic classification, bandwidth management and security analysis. However, most of them are related to improving the performance of classification using ML algorithms.…”

“…But, due to altering the original class distribution, the sampling methods were criticized. Nechay et al [22] proposed two different novel ML classifiers based on Neyman-Pearson and Learning Satisfiability framework. Chen and Wasikowski [25] pointed out that it is more difficult for solve class imbalance when the dimensionality is very high.…”

Effective Feature Selection for 5G IM Applications Traffic Classification

“…Recently, machine learning (ML) algorithm has widely been applied in Internet traffic classification in [11][12][13][14][15][16][17][18][19]. Some of them are applied for traffic flow classification and some of them are applied for bandwidth management.…”