Abstract. The curse of dimensionality is a well known but not entirely well-understood phenomena. Too much data, in terms of the number of input variables, is not always a good thing. This is especially true when the problem involves unsupervised learning or supervised learning with unbalanced data (many negative observations but minimal positive observations). This paper addresses two issues involving high dimensional data: The first issue explores the behavior of kernels in high dimensional data. It is shown that variance, especially when contributed by meaningless noisy variables, confounds learning methods. The second part of this paper illustrates methods to overcome dimensionality problems with unsupervised learning utilizing subspace models. The modeling approach involves novelty detection with the one-class SVM. IntroductionHigh dimensional data often create problems. This problem is exacerbated if the training data is only one class, unknown classes, or significantly unbalanced classes. Consider a binary classification problem that involves computer intrusion detection. Our intention is to classify network traffic, and we are interested in classifying the traffic as either attacks (intruders) or non attacks. Capturing network traffic is simple -hookup to a LAN cable, run tcpdump, and you can fill a hard drive within minutes. These captured network connections can be described with attributes; it is not uncommon for a network connection to be described with over 100 attributes [14]. However, the class of each connection will be unknown, or perhaps with reasonable confidence we can assume that all of the connections do not involve any attacks. The above scenario can be generalized to other security problems as well. Given a matrix of data, X, containing N observations and m attributes, we are interested in classifying this data as either potential attackers (positive class) or non attackers (negative class). If m is large, and our labels, y ∈ R N ×1 , are unbalanced (usually plenty of known non attackers and few instances of attacks), one class (all non attackers), or unknown, increased dimensionality rapidly becomes a problem and feature selection is not feasible due to the minimal examples (if any) of the attacker class.
Abstract. This paper proposes a novel approach for directly tuning the gaussian kernel matrix for one class learning. The popular gaussian kernel includes a free parameter, σ, that requires tuning typically performed through validation. The value of this parameter impacts model performance significantly. This paper explores an automated method for tuning this kernel based upon a hill climbing optimization of statistics obtained from the kernel matrix.
This paper introduces a spatial point density algorithm designed to be explainable, meaningful, and efficient. Originally designed for military applications, this technique applies to any spatial point process where there is a desire to clearly understand the measurement of density and maintain fidelity of the point locations. Typical spatial density plotting algorithms, such as kernel density estimation, implement some type of smoothing function that often results in a density value that is difficult to interpret. The purpose of the visualization method in this paper is to understand spatial point activity density with precision and meaning. The temporal tendency of the point process as an extension of the point density methodology is also discussed and displayed. Applications include visualization and measurement of any type of spatial point process. Visualization techniques integrate ggmap with examples from San Diego crime data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.