Support vector regression performance analysis and systematic parameter selection

檔案

本條目沒有附加檔案。

日期

2005

期刊名稱

Proceedings of the International Joint Conference on Neural Networks (IJCNN), Vols 1-5

卷期與頁次

頁 877–882

ISSN

1098-7576

ISBN

0-7803-9048-2

語言

英文

摘要

Support Vector Regression (SVR) based on statistical learning is a useful tool for nonlinear regression problems. The SVR method deals with data in a high dimension space by using linear quadratic programming techniques. As a consequence, the regression result has optimal properties. However, if parameters were not properly selected, overfitting and/or underfitting phenomena might occur in SVR. Two parameters sigma, the width of Gaussian kernels and epsilon, the tolerance zone in the cost function are considered in this research. We adopted the concept of the sampling theory into Gaussian Filter to deal with parameter sigma. The idea is to analyze the frequency spectrum of training data and to select a cut-off frequency by including 90% of power in spectrum. The corresponding sigma can then be obtained through the sampling theory. In our simulations, it can be found that good performances are observed when the selected frequency is near the cut-off frequency. For another parameter epsilon, it is a tradeoff between the number of Support Vectors and the RMSE. By introducing the confidence interval concept, a suitable selection of epsilon can be obtained. The idea is to use the L-1-norm (i.e., when epsilon = 0) to estimate the noise distribution of training data. When E is obtained by selecting the 90%, confidence interval, simulations demonstrated superior performance in our illustrative example. By our systematical design, proper values of sigma and epsilon can be obtained and the resultant system performances are nice in all aspects.

所屬典藏

會議論文
顯示完整詮釋資料 統計資料

引用此條目

Lin, P., Su, S., & Lee, T. (2005). Support vector regression performance analysis and systematic parameter selection. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Vols 1-5, 877–882. https://ir.lib.nycu.edu.tw/handle/11536/17635

BibTeX RIS

引用文字依 APA 第 7 版格式自動產生,使用前請再核對。

分享

永久網址:https://ir.lib.nycu.edu.tw/handle/11536/17635