|
HKUST Institutional Repository >
Computer Science and Engineering >
CSE Master Theses >
Please use this identifier to cite or link to this item:
http://hdl.handle.net/1783.1/5783
|
| Title: | Kernel methods in supervised and unsupervised learning |
| Authors: | Tsang, Wai-Hung |
| Issue Date: | 2003 |
| Abstract: | In recent years, kernel methods have become popular and powerful tools in field of machine learning, with superior performance on many practical applications. In this thesis, I study kernel methods in both supervised and unsupervised learning. First, in using the ∈-support vector regression (∈-SVR) algorithm, one has to decide a suitable value for the insensitivity parameter ∈. Smola et al. considered its "optimal" choice by studying the statistical efficiency in a location parameter estimation problem. While they successfully predicted a linear scaling between the optimal ∈ and the noise in the data, their theoretically optimal value does not have a close match with its experimentally observed counterpart in the case of Gaussian noise. In this thesis, I attempt to better explain their experimental results by studying the regression problem itself. This resultant predicted choice of ∈ is much closer to the experimentally observed optimal value, while again demonstrating a linear trend with the input noise.
In the second part of this thesis, I address the problem of finding the preimage of a feature vector in the feature space induced by a kernel. This is of central importance in some kernel applications, such as on using kernel principal component analysis (PCA) for image denoising. Unlike the traditional method in [17] which relies on nonlinear optimization, this proposed method directly finds the location of the pre-image based on distance constraints in the feature space. It is non-iterative, involves only linear algebra and does not suffer from numerical instability or local minimum problems. Evaluations on performing kernel PCA and kernel clustering show much improved performance. |
| Description: | Thesis (M.Phil.)--Hong Kong University of Science and Technology, 2003
x, 49 leaves : ill. ; 30 cm
HKUST Call Number: Thesis COMP 2003 Tsang |
| URI: | http://hdl.handle.net/1783.1/5783 |
| Appears in Collections: | CSE Master Theses
|
Files in This Item:
| File |
Description |
Size | Format |
|---|
| th_redirect.html | | 0Kb | HTML | View/Open |
|
All items in this Repository are protected by copyright, with all rights reserved.
|
