標題: Training neural networks via simplified hybrid algorithm mixing Nelder-Mead and particle swarm optimization methods
作者: Liao, Shih-Hui
Hsieh, Jer-Guang
Chang, Jyh-Yeong
Lin, Chin-Teng
電控工程研究所
Institute of Electrical and Control Engineering
關鍵字: Artificial Neural Network (ANN);Particle swarm optimization (PSO);Simplex method of Nelder and Mead (NM)
公開日期: 1-Mar-2015
摘要: In this paper, a new and simplified hybrid algorithm mixing the simplex method of Nelder and Mead (NM) and particle swarm optimization algorithm (PSO), abbreviated as SNM-PSO, is proposed for the training of the parameters of the Artificial Neural Network (ANN). Our method differs from other hybrid PSO methods in that, n+1 particles, where n is the dimension of the search space, are randomly selected (without sorting), at each iteration of the proposed algorithm for use as the initial vertices of the NM algorithm, and each such particle is replaced by the corresponding final vertex after executing the NM algorithm. All the particles are then updated using the standard PSO algorithm. Our proposed method is simpler than other similar hybrid PSO methods and places more emphasis on the exploration of the search space. Some simulation problems will be provided to compare the performances of the proposed method with PSO and other similar hybrid PSO methods in training an ANN. These simulations show that the proposed method outperforms the other compared methods.
URI: http://dx.doi.org/10.1007/s00500-014-1292-y
http://hdl.handle.net/11536/124551
ISSN: 1432-7643
DOI: 10.1007/s00500-014-1292-y
期刊: SOFT COMPUTING
Volume: 19
起始頁: 679
結束頁: 689
Appears in Collections:Articles