學術出版;;Publications
Permanent URI for this communityhdl:11536/1
收集所有交通大學研究人員與學生個人或團體所發表之各項學術著作,涵蓋期刊論文、教師專書、學位論文等項。;;Collections of Publications of NCTU Researchers and Students Like Journal Papers and Thesis.
Browse
12 results
Search Results
Item type:Item, Model-based synthesis of plucked string instruments by using a class of scattering recurrent networks(2000-01-01) ;Liang, SF ;Su, AWY ;Lin, CT ;電控工程研究所Institute of Electrical and Control EngineeringA physical modeling method for electronic music synthesis of plucked-string tones by using recurrent networks is proposed. A scattering recurrent network (SRN) which is used to analyze string dynamics is built based on the physics of acoustic strings, The measured vibration of a plucked string is employed as the training data for the supervised learning of the SRN, After the network is well trained, it can be regarded as the virtual model for the measured string and used to generate tones which can be very close to those generated by its acoustic counterpart. The "virtual string" corresponding to the SRN can respond to different "plucks" just like a real string, which is impossible using traditional synthesis techniques such as frequency modulation and wavetable. The simulation of modeling a cello "A"-string demonstrates some encouraging results of the new music synthesis technique. Some aspects of modeling and synthesis procedures are also discussed.Item type:Item, A class of physical modeling recurrent networks for analysis/synthesis of plucked string instruments(2002-09-01) ;Su, AWY ;Liang, SF ;電控工程研究所Institute of Electrical and Control EngineeringA new approach is proposed that closely synthesizes tones of plucked string instruments by using a class of physical modeling recurrent networks. The strategies employed in this paper consist of a fast training algorithm and a multistage training procedure that are able to obtain the synthesis parameters for a specific instrument automatically. The training vector can be recorded tones of most target plucked instruments with ordinary microphones. The proposed approach delivers encouraging results when it is applied to different types of plucked string instruments such as steel-string guitar, nylon-string guitar, harp, Chin, Yueh-chin, and Pipa. The synthesized tones sound very close to the originals produced by their acoustic counterparts. In addition, this paper presents an embedded technique that can produce special effects such as vibrato and portamento that are vital to the playing of plucked-string instruments. The computation required in the resynthesis processing is also reasonable.Item type:Item, A novel prosodic-information synthesizer based on recurrent fuzzy neural network for the Chinese TTS system(2004-02-01) ;Lin, CT ;Wu, RC ;Chang, JY ;Liang, SF電控工程研究所In this paper, a new technique for the Chinese text-to-speech (TTS) system is proposed. Our major effort focuses on the prosodic information generation. New methodologies for constructing fuzzy rules in a prosodic model simulating human's pronouncing rules are developed. The proposed Recurrent Fuzzy Neural Network (RFNN) is a multilayer recurrent neural network (RNN) which integrates a Self-constructing Neural Fuzzy Inference Network (SONFIN) into a recurrent connectionist structure. The RFNN can be functionally divided into two,parts. The first part adopts the SONFIN as a prosodic model to explore the relationship between high-level linguistic features and prosodic information based on fuzzy inference rules. As compared to conventional neural networks, the SONFIN can always construct itself with an economic network size in high learning speed. The second part employs a five-layer network to generate all prosodic parameters by directly using the prosodic fuzzy rules inferred from the first part as well as other important features of syllables. The TTS system combined with the proposed method can behave not only sandhi rules but also the other prosodic phenomena existing in the traditional TTS systems. Moreover, the proposed scheme can even find out some new rules about prosodic phrase structure. The performance of the proposed RFNN-based prosodic model is verified by imbedding it into a Chinese TTS system with a Chinese monosyllable database based on the time-domain pitch synchronous overlap add (TD-PSOLA) method. Our experimental results show that the proposed RFNN can generate proper prosodic parameters including pitch means, pitch shapes, maximum energy levels, syllable duration, and pause duration. Some synthetic sounds are on-line available for demonstration.Item type:Item, Modeling and analysis of acoustic musical strings using Kelly-Lochbaum lattice networks(2004-11-01) ;Liang, SF ;Su, AWY ;電控工程研究所Institute of Electrical and Control EngineeringMusical strings play important roles in the timbre of a stringed instrument. An instrument installed with different strings can produce very different sounds. To model a plucked-string instrument physically, analyzing its strings may be a good starting point. In this paper, a novel strategy for the modeling and analysis of acoustic musical strings is proposed. In order to obtain the vibration of an acoustic string, a measurement device with multiple sets of electromagnetic pickups is built. A recurrent network based on the Kelly-Lochbaum structure with multiple sets of system parameters is proposed to simulate the time-varying vibrating behavior of a target string. A fast training algorithm combining BPTT and SARPROP is also proposed to train the network automatically. The well-trained recurrent network based model can be regarded as a close simulation model of a real string, and using the model, it becomes easier to understand the characteristics of a string under different conditions when it vibrates.Item type:Item, Estimating driving performance based on EEG spectrum analysis(2005) ;Lin, CT ;Wu, RC ;Jung, TP ;Liang, SFHuang, TYThe growing number of traffic accidents in recent years has become a serious concern to society. Accidents caused by driver's drowsiness behind the steering wheel have a high fatality rate because of the marked decline in the driver's abilities of perception, recognition, and vehicle control abilities while sleepy. Preventing such accidents caused by drowsiness is highly desirable but requires techniques for continuously detecting, estimating, and predicting the level of alertness of drivers and delivering effective feedbacks to maintain their maximum performance. This paper proposes an EEG-based drowsiness estimation system that combines electroencephalogram (EEG) log subband power spectrum, correlation analysis, principal component analysis, and linear regression models to indirectly estimate driver's drowsiness level in a virtual-reality-based driving simulator. Our results demonstrated that it is feasible to accurately estimate quantitatively driving performance, expressed as deviation between the center of the vehicle and the center of the cruising lane, in a realistic driving simulator.Item type:Item, An on-line ICA-mixture-model-based self-constructing fuzzy neural network(2005-01-01) ;Lin, CT ;Cheng, WC ;Liang, SF ;電控工程研究所Institute of Electrical and Control EngineeringThis paper proposes a new fuzzy neural network (FNN) capable of parameter self-adapting and structure self-constructing to acquire a small number of fuzzy rules for interpreting the embedded knowledge of a system from the given training data set. The proposed FNN is inherently a modified Takagi-Sugeno-Kang (TSK)-type fuzzy-rule-based model with neural network's learning ability. There are no rules initiated at the beginning and they are created and adapted through an on-line learning processing that performs simultaneous structure and parameter identification. In the structure identification of the precondition part, the input space is partitioned in a flexible way according to newly proposed on-line independent component analysis (ICA) mixture model. The input space is thus represented by linear combinations of independent, non-Gaussian densities. The first input training pattern is assigned to the first rule initially by the on-line ICA mixture model. Afterwards, some additional significant terms (input variables) selected by the on-line ICA mixture model will be added to the consequent part (forming a liner equation of input variables) incrementally or create a new rule in the learning processing. The combined precondition and consequent structure identification scheme can make the network grow dynamically and efficiently. In the parameter identification, the consequent parameters are tuned by the backpropagation rule and the precondition parameters are turned by the on-line ICA mixture model. Both the structure and parameter identifications are done simultaneously to form a fast learning scheme. The derived on-line ICA mixture model also provide a natural linear transformation for each input variable to enhance the knowledge representation ability of the proposed FNN and reduce the required rules and achieve higher accuracy efficiently. in order to demonstrate the performance of the proposed FNN, several experiments covering the areas of system identification, classification, and image segmentation are carried out. Our experiments show that the proposed FNN can achieve significant improvements in the convergence speed and prediction accuracy with simpler network structure.Item type:Item, A robust digital image stabilization technique based on inverse triangle method and background detection(2005-05-01) ;Hsu, SC ;Liang, SF ;Lin, CT ;電控工程研究所Institute of Electrical and Control EngineeringIn this paper, a novel robust digital image stabilization (DIS) technique is proposed to stably remove the unwanted shaking phenomena in the image sequences captured by hand-held camcorders without affecting moving objects in the image sequence and intentional motion of panning condition, etc. It consists of a motion estimation unit and a motion compensation unit. To increase the robustness in adverse image conditions, an inverse triangle method is proposed to extract reliable motion vectors in plain images which are lack of features or contain large low-contrast area, etc., and a background evaluation model is developed to deal with irregular images which contain large moving objects, etc. In the motion compensation unit, a CMV estimation method with an inner feedback-loop integrator is proposed to stably remove the unwanted shaking phenomena without losing the effective area of the image in panning condition. We also propose a smoothness index (SI) to quantitatively evaluate the performances of different image stabilization methods. The experimental results are on-line available to demonstrate the remarkable performance of the proposed DIS technique.(1.2).Item type:Item, Machine learning with automatic feature selection for multi-class protein fold classification(2005-07-01) ;Huang, CD ;Liang, SF ;Lin, CT ;Wu, RC電控工程研究所In machine learning, both the properly used networks and the selected features are important factors which should be considered carefully. These two factors will influence the result, whether for better or worse. In bioinformatics, the amount of features may be very large to make machine learning possible. In this study we introduce the idea of feature selection in the problem of bioinformatics. We use neural networks to complete our task where each input node is associated with a gate. At the beginning of the training, all gates are almost closed, and, at this time, no features are allowed to enter the network. During the training phase, gates are either opened or closed, depending oil the requirements. After the selection training phase has completed, gates corresponding to the helpful features are completely opened while gates Corresponding to the useless features are closed more tightly. Some gates may be partially open, depending oil the importance of the corresponding features. So, the network can not only select features in an online manner during learning, but it also does some feature extraction. We combine feature selection with our novel hierarchical machine learning architecture and apply it to multi-class protein fold classification. At the first level the network classifies the data into four major folds: all alpha, all beta, alpha + beta and alpha/beta. In the next level, we have another set of networks which further classifies the data into twenty-seven folds. This approach helps achieve the following. The gating network is found to reduce the number of features drastically. It is interesting to observe that, for the first level using just 50 features selected by the gating network, we can get a test accuracy comparable to that using 125 features in neural classifiers. The process also helps us get a better insight into the folding process. For example, tracking the evolution of different gates, we call find which characteristics (features) of the data are more important for the folding process. Eventually, it reduces the computation time. The use of the hierarchical architecture helps LIS get a better performance also.Item type:Item, Neural-network-based adaptive hybrid-reflectance model for 3-D surface reconstruction(2005-11-01) ;Lin, CT ;Cheng, WC ;Liang, SF ;生物科技學系資訊工程學系This paper proposes a novel neural-network-based adaptive hybrid-reflectance three-dimensional (3-D) surface reconstruction model. The neural network automatically combines the diffuse and specular components into a hybrid model. The proposed model considers the characteristics of each point and the variant albedo to prevent the reconstructed surface from being distorted. The neural network inputs are the pixel values of the two-dimensional images to be reconstructed. The normal vectors of the surface can then be obtained from the output of the neural network after supervised learning, where the illuminant direction does not have to be known in advance. Finally, the obtained normal vectors are applied to enforce integrability when reconstructing 3-D objects. Facial images and images of other general objects were used to test the proposed approach. The experimental results demonstrate that the proposed neural-network-based adaptive hybrid-reflectance model can be successfully applied to objects generally and perform 3-D surface reconstruction better than some existing approaches.Item type:Item, A 3-D surface reconstruction approach based on postnonlinear ICA model(2005-11-01) ;Lin, CT ;Cheng, WC ;Liang, SF ;生物科技學系資訊工程學系Photometric stereo technique deals with the reconstruction of three-dimensional (3-D) shape of an object by using several images of the same surface taken from the same viewpoint but under illuminations from different directions. In this paper, we propose a new photometric stereo scheme based on a new reflectance model and the postnonlinear (PNL) independent components analysis (ICA) method. The proposed nonlinear reflectance model consists of diffuse components and specular components for modeling the surface reflectance of a stereo object in an image. Unlike the previous approaches, these two components are not separated and processed individually in the proposed model. An unsupervised learning adaptation algorithm is developed to estimate the reflectance model based on image intensities. In this algorithm, the PNL ICA method is used to obtain the surface normal on each point of an image. Then, the 3-D surface model is reconstructed based on the estimated surface normal on each point of image by using the enforcing integrability method. Two experiments are performed to assess the performance of the proposed approach. We test our algorithm on synthetically generated images for the reconstruction of surface of objects and on a number of real images captured from the Yale Face Database B. These testing images contain variability due to illumination and varying albedo in each point of surface of human faces. All the experimental results are compared to those of the existing photometric stereo approaches tested on the same images. The results clearly indicate the superiority of the proposed nonlinear reflectance model over the conventional Lambertian model and the other linear hybrid reflectance model.