2004
DOI: 10.1109/tnn.2004.837781
|View full text |Cite
|
Sign up to set email alerts
|

The Pre-Image Problem in Kernel Methods

Abstract: In this paper, we address the problem of finding the pre-image of a feature vector in the feature space induced by a kernel. This is of central importance in some kernel applications, such as on using kernel principal component analysis (PCA) for image denoising. Unlike the traditional method in (Mika et al., 1998) which relies on nonlinear optimization, our proposed method directly finds the location of the pre-image based on distance constraints in the feature space. It is non-iterative, involves only linear… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

2
284
1

Year Published

2006
2006
2018
2018

Publication Types

Select...
4
2
2

Relationship

0
8

Authors

Journals

citations
Cited by 362 publications
(287 citation statements)
references
References 8 publications
(4 reference statements)
2
284
1
Order By: Relevance
“…Many methods were proposed for the K-PCA reconstruction, and different cost functions could lead to different optimization problems. In this work, we used Kwok & Tsang's algorithm for reconstruction [12].…”
Section: Motion Modeling Using Kernel-pcamentioning
confidence: 99%
“…Many methods were proposed for the K-PCA reconstruction, and different cost functions could lead to different optimization problems. In this work, we used Kwok & Tsang's algorithm for reconstruction [12].…”
Section: Motion Modeling Using Kernel-pcamentioning
confidence: 99%
“…In this paper, we do not show these procedures for brief explanation. The details of these procedures are shown in [12]. In the texture classification using Eq.…”
Section: Texture Classification Algorithmmentioning
confidence: 99%
“…Since an exact pre-image, which is the inverse mapping from the feature space back to the input space, typically does not exist [12],x satisfies the following equation:…”
Section: [Constraint 2]mentioning
confidence: 99%
“…Kernel methods, in particular, kernel PCA has been the focus of research in the pattern recognition community [16,17]. The basic idea behind these methods is to map the data in the input space φ ∈ χ to a feature space F via some nonlinear map Ψ , and then apply a linear method in F to do further analysis.…”
Section: Kernel Pcamentioning
confidence: 99%
“…However, this method is dependent on the initial starting point and is highly susceptible to local minima. To circumvent this problem, [17] and more recently [15] proposed an algorithm to reconstruct an approximate pre-image of the projection as described briefly in the remainder of this section. Kernel PCA performs the traditional linear PCA in the feature space corresponding to the kernel k(., .).…”
Section: Kernel Pcamentioning
confidence: 99%