Browsing by Author "Li, Cheng-Hsuan"

Now showing 1 - 13 of 13

A Semisupervised Feature Extraction Method Based on Fuzzy-type Linear Discriminant Analysis
(2011)
Chu, Hui-Shan
;
Li, Cheng-Hsuan
;
Kuo, Bor-Chen
;
Lin, Chin-Teng
;
電控工程研究所
Linear discriminant analysis (LDA) is a commonly used feature extraction (FE) method to resolve the Hughes phenomenon for classification. The Hughes phenomenon (also called the curse of dimensionality) is often encountered in classification when the dimensionality of the space grows and the size of the training set is fixed, especially in the small sampling size problem. Recent studies show that the spatial information can greatly improve the classification performance. Hence, for hyperspectral image classification, it is not only necessary to use the available spectral information but also to exploit the spatial information. In this paper, a semisupervised feature extraction method which is based on the scatter matrices of the fuzzy-type LDA and uses the semi-information is proposed. The experimental results on two hyperspectral images, the Washington DC Mall and the Indian Pine Site, show that the proposed method can yield a better classification performance than LDA in the small sampling size problem.
A Spatial-Contextual Support Vector Machine for Remotely Sensed Image Classification
(2012-03-01)
Li, Cheng-Hsuan
;
Kuo, Bor-Chen
;
Lin, Chin-Teng
;
Huang, Chih-Sheng
;
電控工程研究所
Recent studies show that hyperspectral image classification techniques that use both spectral and spatial information are more suitable, effective, and robust than those that use only spectral information. Using a spatial-contextual term, this study modifies the decision function and constraints of a support vector machine (SVM) and proposes two kinds of spatial-contextual SVMs for hyperspectral image classification. One machine, which is based on the concept of Markov random fields (MRFs), uses the spatial information in the original space (SCSVM). The other machine uses the spatial information in the feature space (SCSVMF), i.e., the nearest neighbors in the feature space. The SCSVM is better able to classify pixels of different class labels with similar spectral values and deal with data that have no clear numerical interpretation. To evaluate the effectiveness of SCSVM, the experiments in this study compare the performances of other classifiers: an SVM, a context-sensitive semisupervised SVM, a maximum likelihood (ML) classifier, a Bayesian contextual classifier based on MRFs (ML_MRF), and k nearest neighbor classifier. Experimental results show that the proposed method achieves good classification performance on famous hyperspectral images (the Indian Pine site (IPS) and the Washington, DC mall data sets). The overall classification accuracy of the hyperspectral image of the IPS data set with 16 classes is 95.5%. The kappa accuracy is up to 94.9%, and the average accuracy of each class is up to 94.2%.
An Adaptive Rule Based on Unknown Pattern for Improving K-Nearest Neighbor Classifier
(2010-01-01)
Chen, I-Ling
;
Pai, Kai-Chih
;
Kuo, Bor-Chen
;
Li, Cheng-Hsuan
;
電控工程研究所
One of popular and simple pattern classification algorithms is the k-nearest neighbor rule. However, it often fails to work well when patterns of different classes overlap in some regions in the feature space. To overcome this problem, many researches strive for developing various adaptive or discriminatory metrics to improve its performance for classification, recently. In this paper, we proposed a simple adaptive nearest neighbor rule on distance measure for two objects. First one is to separate the overlapping data, and the second one is to avoid the influence of outliers. From the experimental results, our method is robust for the choice of the number of k and outperforms than k-nearest neighbor classifier.
An Automatic Method for Selecting the Parameter of the Normalized Kernel Function to Support Vector Machines
(2012-01-01)
Li, Cheng-Hsuan
;
Ho, Hsin-Hua
;
Liu, Yu-Lung
;
Lin, Chin-Teng
;
Kuo, Bor-Chen
Soft-margin support vector machine (SVM) is one of the most powerful techniques for supervised classification. However, the performances of SVMs are based on choosing the proper kernel functions or proper parameters of a kernel function. It is extremely time consuming by applying the k-fold cross-validation (CV) to choose the almost best parameter. Nevertheless, the searching range and fineness of the grid method should be determined in advance. In this paper, an automatic method for selecting the parameter of the normalized kernel function is proposed. In the experimental results, it costs very little time than k-fold cross-validation for selecting the parameter by our proposed method. Moreover, the corresponding soft-margin SVMs can obtain more accurate or at least equal performance than the soft-margin SVMs by applying k-fold cross-validation to determine the parameters.
An Automatic Method for Selecting the Parameter of the Normalized Kernel Function to Support Vector Machines
(2010-01-01)
Li, Cheng-Hsuan
;
Lin, Chin-Teng
;
Kuo, Bor-Chen
;
Ho, Hsin-Hua
;
電控工程研究所
Support vector machine (SVM) is one of the most powerful techniques for supervised classification. However, the performances of SVMs are based on choosing the proper kernel functions or proper parameters of a kernel function. It is extremely time consuming by applying the k-fold cross-validation (CV) to choose the almost best parameter. Nevertheless, the searching range and fineness of the grid method should be determined in advance. In this paper, an automatic method for selecting the parameter of the normalized kernel function is proposed. In the experimental results, it costs very little time than k-fold cross-validation for selecting the parameter by our proposed method. Moreover, the corresponding SVMs can obtain more accurate or at least equal performance than SVMs by applying k-fold cross-validation to determine the parameter.
AN AUTOMATIC METHOD FOR SELECTING THE PARAMETER OF THE RBF KERNEL FUNCTION TO SUPPORT VECTOR MACHINES
(2010)
Li, Cheng-Hsuan
;
Lin, Chin-Teng
;
Kuo, Bor-Chen
;
Chu, Hui-Shan
;
電控工程研究所
Support vector machine (SVM) is one of the most powerful techniques for supervised classification. However, the performances of SVMs are based on choosing the proper kernel functions or proper parameters of a kernel function. It is extremely time consuming by applying the k-fold cross-validation (CV) to choose the almost best parameter. Nevertheless, the searching range and fineness of the grid method should be determined in advance. In this paper, an automatic method for selecting the parameter of the RBF kernel function is proposed. In the experimental results, it costs very little time than k-fold cross-validation for selecting the parameter by our proposed method. Moreover, the corresponding SVMs can obtain more accurate or at least equal performance than SVMs by applying k-fold cross-validation to determine the parameter.
APPLYING OPTIMAL ALGORITHM TO DATA-DEPENDENT KERNEL FOR HYPERSPECTRAL IMAGE CLASSIFICATION
(2010)
Chen, I-Ling
;
Li, Cheng-Hsuan
;
Kuo, Bor-Chen
;
Huang, Hsiao-Yun
;
電控工程研究所
In the kernel methods, it is very important to choose a proper kernel function to avoid overlapping data. Based this fact, in this paper we mainly utilize a unified kernel optimization framework on the hyperspectral image classification to augment the margin between different classes, and under the kernel optimization framework, to employ the Fisher discriminant criteria formulated in a pairwise manner as the objective functions to optimize the kernel function in Kernel-based nonparametric weighted feature extraction. The experimental results display the superiority of the optimizing kernel function over the RBF kernel function with 5-fold cross-validation method, especially, in the small sample size problem.
COMBINING ENSEMBLE TECHNIQUE OF SUPPORT VECTOR MACHINES WITH THE OPTIMAL KERNEL METHOD FOR HYPERSPECTRAL IMAGE CLASSIFICATION
(2011)
Kuo, Bor-Chen
;
Chen, I-Ling
;
Li, Cheng-Hsuan
;
Hung, Chih-Cheng
;
電控工程研究所
In remote sensing researches, the curse of dimensionality is one greatly difficult classification problem. Many studies have demonstrated that multiple classifier systems, such as the random subspace method (RSM), can alleviate small sample size and high dimensionality concern and obtain more outstanding and robust results than a single classifier on extensive pattern recognition issues. A dynamic subspace method (DSM) was proposed for constructing component classifiers with adaptive subspaces to adjust the shortcomings of RSM based on resubstitution accuracy by applying each classifier. However, the performances of SVMs are based on choosing the proper kernel functions or proper parameters of a kernel function. The objective of this research is to develop a novel ensemble technique based on support vector machines (SVMs) via the optimal kernel method, and propose a novel subspace selection mechanism, named the kernel-based dynamic subspace method (KDSM), to improve DSM on automatically determining dimensionality and selecting component dimensions for diverse subspaces. Experimental results show a sound performance of classification on the famous hyperspectral images, Washington DC Mall.
HYPERSPECTRAL IMAGE CLASSIFICATION USING SPECTRAL AND SPATIAL INFORMATION BASED LINEAR DISCRIMINANT ANALYSIS
(2011)
Li, Cheng-Hsuan
;
Chu, Hui-Shan
;
Kuo, Bor-Chen
;
Lin, Chin-Teng
;
電控工程研究所
Feature extraction plays an essential role in Hyperspectral image classification. Linear discriminant analysis (LDA) is a commonly used feature extraction (FE) method to resolve the Hughes phenomenon for classification. The Hughes phenomenon (also called the curse of dimensionality) is often encountered in classification when the dimensionality of the space grows and the size of the training set is fixed, especially in the small sampling size problem. Recent studies show that the spatial information can greatly improve the classification performance. Hence, for hyperspectral image classification, it is not only necessary to use the available spectral information but also to exploit the spatial information. In this paper, spatial information is acquired by the concept of the Markov random field (MRF), and this spatial information is used to form the membership values of every pixel in the hyperspectral image. The experimental results on two hyperspectral images, the Washington DC Mall and the Indian Pine Site, show that the proposed method can yield a better classification performance than LDA in the small sampling size problem.
Improving Read Performance of NAND Flash SSDs by Exploiting Error Locality
(2016-04)
Liu, Ren-Shuo
;
Chuang, Meng-Yen
;
Yang, Chia-Lin
;
Li, Cheng-Hsuan
;
Ho, Kin-Chu
NAND flash-based solid-state drives (SSDs), which can serve as the caches of hard disk drives, have gained popularity in large-scale, high-performance storage. A type of advanced error correction code for SSDs, low-density parity-check (LDPC), is required to mitigate a considerable number of errors in the raw data of NAND flash. However, LDPC imposes read performance overhead due to the complex decoding procedure of LDPC. In this paper, we propose an error-correcting cache (EC-Cache) that exploits "error locality", a characteristic of NAND flash memory, to improve the read performance of SSDs. We use the term "error locality" to refer to the property that the majority of errors in reads to the same flash page appear at the same positions until the page is erased. By caching detected errors, we can correct a significant portion of errors in the requested flash page prior to the LDPC decoding process. This design significantly reduces LDPC decoding overhead because the latency of LDPC is correlated with the number of errors in the input data. We conduct experiments, including flash characterization, LDPC simulation, and SSD simulation, to evaluate EC-Cache. The experimental results demonstrate that EC-Cache can improve the read performance of LDPC-based SSDs by up to 2:6 x.
Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification
(2009-04-01)
Kuo, Bor-Chen
;
Li, Cheng-Hsuan
;
Yang, Jinn-Min
;
電控工程研究所
;
Institute of Electrical and Control Engineering
In recent years, many studies show that kernel methods are computationally efficient, robust, and stable for pattern analysis. Many kernel-based classifiers were designed and applied to classify remote-sensed data, and some results show that kernel-based classifiers have satisfying performances. Many studies about hyperspectral image classification also show that nonparametric weighted feature extraction (NWFE) is a powerful tool for extracting hyperspectral image features. However, NWFE is still based on linear transformation. In this paper, the kernel method is applied to extend NWFE to kernel-based NWFE (KNWFE). The new KNWFE possesses the advantages of both linear and nonlinear transformation, and the experimental results show that KNWFE outperforms NWFE, decision-boundary feature extraction, independent component analysis, kernel-based principal component analysis, and generalized discriminant analysis.
LDA-Based Clustering Algorithm and Its Application to an Unsupervised Feature Extraction
(2011-02-01)
Li, Cheng-Hsuan
;
Kuo, Bor-Chen
;
Lin, Chin-Teng
;
電控工程研究所
;
腦科學研究中心
Research has shown fuzzy c-means (FCM) clustering to be a powerful tool to partition samples into different categories. However, the objective function of FCM is based only on the sum of distances of samples to their cluster centers, which is equal to the trace of the within-cluster scatter matrix. In this study, we propose a clustering algorithm based on both within-and between-cluster scatter matrices, extended from linear discriminant analysis (LDA), and its application to an unsupervised feature extraction (FE). Our proposed methods comprise between-and within-cluster scatter matrices modified from the between-and within-class scatter matrices of LDA. The scatter matrices of LDA are special cases of our proposed unsupervised scatter matrices. The results of experiments on both synthetic and real data show that the proposed clustering algorithm can generate similar or better clustering results than 11 popular clustering algorithms: K-means, K-medoid, FCM, the Gustafson-Kessel, Gath-Geva, possibilistic c-means (PCM), fuzzy PCM, possibilistic FCM, fuzzy compactness and separation, a fuzzy clustering algorithm based on a fuzzy treatment of finite mixtures of multivariate Student's t distributions algorithms, and a fuzzy mixture of the Student's t factor analyzers model. The results also show that the proposed FE outperforms principal component analysis and independent component analysis.
SUBSPACE SELECTION BASED MULTIPLE CLASSIFIER SYSTEMS FOR HYPERSPECTRAL IMAGE CLASSIFICATION
(2009)
Kuo, Bor-Chen
;
Chuang, Chun-Hsiang
;
Li, Cheng-Hsuan
;
Lin, Chin-Teng
;
電控工程研究所
In a typical supervised classification task, the size of training data fundamentally affects the generality of a classifier. Given a finite and fixed size of training data, the classification result may be degraded as the number of features (dimensionality) increase. Many researches have demonstrated that multiple classifier systems (MCS) or so-called ensembles can alleviate small sample size and high dimensionality concern, and obtain more outstanding and robust results than single models. One of the effective approaches for generating an ensemble of diverse base classifiers is the use of different feature subsets such as random subspace method (RSM). The objective of this research is to develop a novel ensemble technique based on cluster algorithms for strengthening RSM. The results of real data experiments show that the proposed method obtains the sound performance especially in the situation of using less number of classifiers.