Abstract
According to the literature of particle swarm optimization (PSO), there are problems of local minima and premature convergence with this algorithm. A new algorithm is presented called the improved particle swarm optimization using the gradient descent method as operator of particle swarm incorporated into the Algorithm, as a function to test the improvement. The gradient descent method (BP Algorithm) helps not only to increase the global optimization ability, but also to avoid the premature convergence problem. The improved PSO algorithm IPSO is applied to Benchmark Functions. The results show that there is an improvement with respect to using the conventional PSO algorithm.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abraham, H. Guo, and H. Liu, “Swarm intelligence: Foundations, perspectives and applications, swarm intelligent systems”, in Studies in Computational Intelligence. Berlin, Germany: Springer Verlag, pp. 3-25, 2006.
Afsahi Z, Javadzadeh R, “Hybrid Model of Particle Swarm Optimization and Cellular Learning Automata with New Structure of Neighborhood”, International Conference on Machine Learning and Computing (1CMLC 2011), 2011.
Aibinun A.M., M.J.E. Salami, A.A. Shafie, “Artificial neural network based autoregressive modeling technique with application in voice activity detection”, Engineering Applications of Artificial Intelligence, Volume 25, 2012, pp. 1265–1276.
Behnam A., Nader A., Detlef D. Nauck, 2000. Intelligent Systems and Soft Computing Prospects, Tools and Applications. Springer New York. 376p.
Engelbrecht A P., “Fundamentals of Computational Swarm Intelligence”, University of Pretoria, South Africa, 2005, 1st edition.
Fei H., Qing Liu, “A diversity-guided hybrid particle swarm optimization based on gradient search”, School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu 212013, China.
GaoHai-bing, GAO Liang, “Particle Swarm Optimization Based Algorithm for Neural Network Learning”, Acta Electronica Sinica, 32(9) (2004), 1572-1574.
Gevaert W., Tsenov G., Mladenov V., “Neural Networks used for Speech Recognition”, Journal of Automatic Control, University of Belgrade, Vol. 20:1-7, 2010.
H. Shayeghi, H. A. Shayanfar, G. Azimi, “STLF Based on Optimized Neural Network Using PSO”, International Journal of Electrical and Computer Engineering 4:10 2009.
Happel Bart L.M., Murre Jacob M.J., “Design and evolution of modular neural network architectures”, Neural Networks, Volume 7, Issues 6–7, 1994, Pages 985–1004.
Ittichaichareon C., Siwat S. and Thaweesak Y., “Speech Recognition using MFCC”, International Conference on Computer Graphics, Simulation and Modeling (ICGSM’2012) July 28-29, 2012 Pattaya (Thailand).
Jang J. Sun, J. Mitzutani E., “Neuro-Fuzzy and soft computing: a computational approach to learning and machine Intelligence”, Prentice Hall, 1997.
Jun-qing, Quan-ke Pan, Sheng Xie, Bao-xian Jia and Yu-ting Wang. 2009. A Hybrid Particle Swarm Optimization and Tabu Search algorithm for Flexible Job-Shop Scheduling Problem. IACSIT.
Kennedy J. and Eberhart R., 1995. Particle swarm optimization, Proc. IEEE Int. Conf. on Neural Networks, IV. Piscataway, NJ: IEEE Service Center, pp. 1942–1948.
Mathew M. N., A new gradient based particle swarm optimization algorithm for accurate computation of global minimum, Appl. Soft Comput. 12(1) (2012) 353–359.
Mirjalili S., Siti Z., Mohd H., Hossein M. S., “Training feed forward neural networks using hybrid particle swarm optimization and gravitational search algorithm”, Applied Mathematics and Computation, Volume 218, 2012, pp. 11125–11137.
Palupi R. D. and M. S. Siti, “Particle swarm optimization: technique, system and challenges,” International Journal of Applied Information Systems, vol. 1, pp. 19-27, October 2011.
Q. H. Bai. “Analysis of particle swarm optimization algorithm,” Computer and Information Science, vol. 3, pp. 180-184, February 2010.
Rehab F., Abdel-Kader, “Hybrid discrete PSO with GA operators for efficient QoS-multicast routing”, Ain Shams Engineering Journal, Volume 2, Issue 1, March 2011, Pages 21–31.
RlKuo,C.C.Huang. Application of particle swam optimization algorithm for solving bi-level linear programming Problem [J]. Computers and Mathematics with Applications, 58 (2009), 678-685.
Sirko M., Michael P., Ralf S., and Hermann N., “Computing Mel-Frequency Cepstral Coefficients on the Power Spectrum”, Lehrstuhlfür Informatik VI, Computer Science Department, RWTH Aachen – University of Technology, 52056 Aachen, Germany, 2001.
Weidong J., Keqi Wang, “An Improved Particle Swarm Optimization Algorithm”, 2011 International Conference on Computer Science and Network Technology, (2011).
X.Yao. Evolving Artificial Networks Proceedings of the IEEE 87 (1999), 1423-1447.
Y Shi, R C Eberhart, “A modified particle swarm optimizer”, Proc. IEEE Int Conf Evo1 Computing, Anchorage, Alaska, May (1998), 69-73.
Ying-ping Chen, Pei Jiang, “Analysis of particle interaction in particle swarm optimization”, Theoretical Computer Science, 411 (2010), 2101-2115.
Ying-ping Chen, Pei Jiang. Analysis of particle interaction in particle swarm optimization [J]. Theoretical Computer Science, 411 (2010), 2101-2115.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Uriarte, A., Melin, P., Valdez, F. (2017). A New Hybrid PSO Method Applied to Benchmark Functions. In: Melin, P., Castillo, O., Kacprzyk, J. (eds) Nature-Inspired Design of Hybrid Intelligent Systems. Studies in Computational Intelligence, vol 667. Springer, Cham. https://doi.org/10.1007/978-3-319-47054-2_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-47054-2_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47053-5
Online ISBN: 978-3-319-47054-2
eBook Packages: EngineeringEngineering (R0)