Abstract
Based on the algorithm structure, each metaheuristic algorithm may have its pros and cons, which may result in high performance in some problems and low functionality in some others. The idea is to hybridize two or more algorithms to cover each other’s weaknesses. In this study, particle swarm optimization (PSO), simulated annealing (SA) and differential evolution (DE) are combined to develop a more powerful search algorithm. First, the temperature concept of SA is applied to balance the exploration/exploitation capability of the hybridized algorithm. Then, the DE’s mutation operator is used to improve the exploration capability of the algorithm to escape the local minimums. Next, DE’s mutation operator has been modified so that past experiences can be used for smarter mutations. Finally, the PSO particles’ tendency to their local optimums or the global optimum, which balances the algorithm’s random and greedy search, is affected by the temperature. The temperature influences the algorithm’s behavior so that the random search is more significant at the beginning, and the greedy search becomes more important as the temperature is reduced. The results are compared with the basic PSO, SA, DE, cuckoo search (CS), and hybridized CS-PSO algorithm on 20 benchmark problems. The comparison reveals that, in most cases, the new algorithm outperforms others.
Similar content being viewed by others
References
Miller, C.E., Tucker, A.W., Zemlin, R.A.: Integer programming formulation of traveling salesman problems. J. ACM 7(4), 326–329 (1960)
Laporte, G.: The vehicle routing problem: An overview of exact and approximate algorithms. Eur. J. Oper. Res. 59(3), 345–358 (1992)
Davis, L: Job shop scheduling with genetic algorithms. In: Proceedings of an international conference on genetic algorithms and their applications (1985)
Farahani, R. Z., Hekmatfar, M. (Eds.). Facility location: concepts, models, algorithms and case studies. Springer, Berlin (2009)
Błażewicz, J., Kovalyov, M.Y., Musiał, J., Urbański, A.P., Wojciechowski, A.: Internet shopping optimization problem. Intl. J. Appl. Math. 20(2), 385 (2010)
Liu, H., Cai, Z., Wang, Y.: Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl. Soft Comput. 10(2), 629–640 (2010)
Mirsadeghi, E., Panahi, M.S.: Hybridizing artificial bee colony with simulated annealing. Intl. J. Hybrid Inf. Technol. 5(4), 11–18 (2012)
Rizk-Allah, R.M., Zaki, E.M., El-Sawy, A.A.: Hybridizing ant colony optimization with firefly algorithm for unconstrained optimization problems. Appl. Math. Comput. 224, 473–483 (2013)
Wang, G.G., Gandomi, A.H., Alavi, A.H.: Stud krill herd algorithm. Neurocomputing. 128, 363–370 (2014)
Wang, G., Guo, L., Wang, H., Duan, H., Liu, L., Li, J.: Incorporating mutation scheme into krill herd algorithm for global numerical optimization. Neural Comput. Appl. 24(3–4), 853–871 (2014)
Wang, G.G., Gandomi, A.H., Alavi, A.H.: An effective krill herd algorithm with migration operator in biogeography-based optimization. Appl. Math. Model. 38(9–10), 2454–2462 (2014)
Wang, G.G., Guo, L., Gandomi, A.H., Hao, G.S., Wang, H.: Chaotic krill herd algorithm. J. Inf. Sci. 274, 17–34 (2014)
Myszkowski, P.B., Skowroński, M.E., Olech, Ł.P., Oślizło, K.: Hybrid ant colony optimization in solving multi-skill resource-constrained project scheduling problem. Soft. Comput. 19(12), 3599–3619 (2015)
Samuel, G.G., Rajan, C.C.A.: Hybrid: particle swarm optimization–genetic algorithm and particle swarm optimization–shuffled frog leaping algorithm for long-term generator maintenance scheduling. Electr. Power Energy Syst. 65, 432–442 (2015)
Wang, G.G., Deb, S., Gandomi, A.H., Alavi, A.H.: Opposition-based krill herd algorithm with Cauchy mutation and position clamping. Neurocomputing. 177, 147–157 (2016)
Jung, J., Jayakrishnan, R., Park, J.Y.: Dynamic shared-taxi dispatch algorithm with hybrid-simulated annealing. Comput. Aided Civil Infrastr. Eng. 31(4), 275–291 (2016)
Wang, G.G., Gandomi, A.H., Alavi, A.H., Dong, Y.Q.: A hybrid meta-heuristic method based on firefly algorithm and krill herd. In: Handbook of research on advanced computational techniques for simulation-based engineering. IGI Global. pp. 505–524 (2016)
Wang, G.G., Cai, X., Cui, Z., Min, G., Chen, J.: High performance computing for cyber physical social systems by using evolutionary multi-objective optimization algorithm. IEEE Trans. Emerg. Topics Comput. 10, 20 (2017). https://doi.org/10.1109/TETC.2017.2703784
Cui, Z., Sun, B., Wang, G., Xue, Y., Chen, J.: A novel oriented cuckoo search algorithm to improve DV-Hop performance for cyber–physical systems. J. Parallel Distrib. Comput. 103, 42–52 (2017)
Wang, G.G., Tan, Y.: Improving metaheuristic algorithms with information feedback models. IEEE Trans. Cyber. 49(2), 542–555 (2017)
Das, S., Verma, A., Bijwe, P.R.: Transmission network expansion planning using a modified artificial bee colony algorithm. Electr. Eng. Japan. 27(9), e2372 (2017)
Rizk-Allah, R.M., El-Sehiemy, R.A., Wang, G.G.: A novel parallel hurricane optimization algorithm for secure emission/economic load dispatch solution. Appl. Soft Comput. 63, 206–222 (2018)
Yi, J.H., Deb, S., Dong, J., Alavi, A.H., Wang, G.G.: An improved NSGA-III Algorithm with adaptive mutation operator for big data optimization problems. Fut. Gener. Comput. Syst. 88, 571–585 (2018)
Ghobaei-Arani, M., Souri, A., Safara, F., Norouzi, M.: An efficient task scheduling approach using moth-flame optimization algorithm for cyber-physical system applications in fog computing. Trans. Emerg. Telecommun. Technol. 31(2), e3770 (2020)
Laskar, N.M., Guha, K., Chatterjee, I., Chanda, S., Baishnab, K.L., Paul, P.K.: HWPSO: a new hybrid whale-particle swarm optimization algorithm and its application in electronic design optimization problems. Appl Intell 49(1), 265–291 (2019)
Iwata, S., Fukuyama, Y.: Differential evolutionary particle swarm optimization for load adjustment distribution state estimation using correntropy. Electr. Eng. Jpn. 205(3), 11–21 (2018)
Yoshida, H., Fukuyama, Y.: Parallel multipopulation differential evolutionary particle swarm optimization for voltage and reactive power control. Electr. Eng. Jpn. 204(3), 31–40 (2018)
Cao, Y., Lu, Y., Pan, X., Sun, N.: An improved global best guided artificial bee colony algorithm for continuous optimization problems. Clust. Comput. 22, 1–9 (2018)
Ye, Z., Zhu, M., Wang, J.: On modification and application of the artificial bee colony algorithm. Inf. Process. Syst. 14(2), 448–454 (2018)
Carrillo-Santos, C., Seck-Tuoh-Mora, J., Hernandez-Romero, N., Ramos-Velasco, L.: Wave net identification of dynamical systems by a modified PSO algorithm. Eng. Appl. Artif. Intell. 73, 1–9 (2018)
Taetragool, U., Sirinaovakul, B., Achalakul, T.: NeSS: a modified artificial bee colony approach based on nest site selection behavior. Appl. Soft Comput. 71, 659–671 (2018)
Peng, K., Pan, Q.K., Gao, L., Zhang, B., Pang, X.: An improved artificial bee colony algorithm for real-world hybrid flowshop rescheduling in steelmaking-refining continuous casting process. Comput. Ind. Eng. (2018). https://doi.org/10.1016/j.cie.2018.05.056
Zhang, W., Maleki, A., Rosen, M.A., Liu, J.: Optimization with a simulated annealing algorithm of a hybrid system for renewable energy including battery and hydrogen storage. Energy. 163, 191–207 (2018)
Gabi, D.: Hybrid cat swarm optimization and simulated annealing for dynamic task scheduling on cloud computing environment. J. Inf. Commun. Technol. 17(3), 435–467 (2020)
Assad, A., Deep, K.: A Hybrid Harmony search and simulated annealing algorithm for continuous optimization. Inf. Sci. 450, 246–266 (2018)
Lu, Z., Wang, C., Guo, J.: A hybrid of fish swarm algorithm and shuffled frog leaping algorithm for attribute reduction. In: 2018 13th world congress on intelligent control and automation (WCICA). IEEE (2018)
Wang, H., Yi, J.H.: An improved optimization method based on krill herd and artificial bee colony with information exchange. Memetic Comput. 10(2), 177–198 (2018)
Mageshkumar, C., Karthik, S., Arunachalam, V.P.: Hybrid metaheuristic algorithm for improving the efficiency of data clustering. Clust. Comput. 22(1), 435–442 (2019)
Ghobaei-Arani, M., Khorsand, R., Ramezanpour, M.: An autonomous resource provisioning framework for massively multiplayer online games in cloud environment. J. Netw. Comput. Appl. 142, 76–97 (2019)
Ghobaei-Arani, M., Souri, A., Rahmanian, A.A.: Resource management approaches in fog computing: a comprehensive review. J. Grid Comput. 18, 1–42 (2019)
Buba, A.T., Lee, L.S.: Hybrid differential evolution-particle swarm optimization algorithm for multiobjective urban transit network design problem with homogeneous buses. Math. Probl. Eng. (2019). https://doi.org/10.1155/2019/5963240
Donyagard Vahed, N., Ghobaei-Arani, M., Souri, A.: Multiobjective virtual machine placement mechanisms using nature-inspired metaheuristic algorithms in cloud environments: a comprehensive review. Int. J. Commun. Syst. 32(14), e4068 (2019)
Gupta, S., Deep, K.: Hybrid grey wolf optimizer with mutation operator. In: Soft computing for problem solving. Springer, Berlin, pp. 961–968 (2019)
Wang, S., Li, Y., Yang, H.: Self-adaptive mutation differential evolution algorithm based on particle swarm optimization. Appl. Soft Comput. 81, 105496 (2019)
Chen, X., Yu, K.: Hybridizing cuckoo search algorithm with biogeography-based optimization for estimating photovoltaic model parameters. Sol. Energy 180, 192–206 (2019)
Choong, S.S., Wong, L.P., Lim, C.P.: An artificial bee colony algorithm with a modified choice function for the Traveling Salesman Problem. Swarm Evol. Comput. 44, 622–635 (2019)
Yan, C., Ma, J., Luo, H., Patel, A.: Hybrid binary Coral reefs optimization algorithm with simulated annealing for feature selection in high-dimensional biomedical datasets. Chemometrics Intell. Lab. Syst. 184, 102–111 (2019)
Jovanovic, R., Tuba, M., Voß, S.: An efficient ant colony optimization algorithm for the blocks relocation problem. Eur. J. Oper. Res. 274(1), 78–90 (2019)
Madni, S.H.H., Latiff, M.S.A., Ali, J.: Hybrid gradient descent cuckoo search (HGDCS) algorithm for resource scheduling in IaaS cloud computing environment. Clust. Comput. 22(1), 1–34 (2018)
Xiong, F., Gong, P., Jin, P., Fan, J.F.: Supply chain scheduling optimization based on genetic particle swarm optimization algorithm. Clust. Comput. 22(6), 14767–14775 (2019)
Chen, Y., Yuan, X., Cang, X.: Two hypotheses and test assumptions based on Quantum-behaved Particle Swarm Optimization (QPSO). Clust. Comput. 22(6), 14359–14366 (2019)
Madni, S.H.H., Abd Latiff, M.S., Ali, J.: Hybrid gradient descent cuckoo search (HGDCS) algorithm for resource scheduling in IaaS cloud computing environment. Clust. Comput. 22(1), 301–334 (2019)
Dong, L., Yang, Y., Sun, S.: QCs scheduling scheme of genetic algorithm (GA) and improved firefly algorithm (FA). Clust. Comput. 22(2), 4331–4348 (2019)
Rani, K.S.K., Deepa, S.N.: Hybrid evolutionary computing algorithms and statistical methods based optimal fragmentation in smart cloud networks. Clust. Comput. 22(1), 241–254 (2019)
Pan, X., Xue, L., Lu, Y., Sun, N.: Hybrid particle swarm optimization with simulated annealing. Multimed. Tools Appl. 78(21), 29921–29936 (2019)
Dhabal, S., Saha, D.K.: Image enhancement using differential evolution based whale optimization algorithm. In: Emerging technology in modelling and graphics. Springer. pp. 619–628 (2020)
Dabhi, D., Pandya, K.: Enhanced velocity differential evolutionary particle swarm optimization for optimal scheduling of a distributed energy resources with uncertain scenarios. IEEE Access. 8, 27001–27017 (2020)
Özsoy, V.S., Ünsal, M.G., Örkcü, H.H.: Use of the heuristic optimization in the parameter estimation of generalized gamma distribution: comparison of GA, DE, PSO and SA methods. Computational Statistics. pp. 1–31 (2020)
Damiani, L., Diaz, A.I., Iparraguirre, J., Blanco, A.M.: Accelerated particle swarm optimization with explicit consideration of model constraints. Clust. Comput. 23(1), 149–164 (2020)
Huang, X., Li, C., Chen, H., An, D.: Task scheduling in cloud computing using particle swarm optimization with time varying inertia weight strategies. Clust. Comput. 23, 1137–1147 (2019)
Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, 1995. MHS'95. IEEE (1995)
Storn, R., Price, K.: Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)
Yang, X.S., Deb, S.: Engineering optimization by cuckoo search. IJMMNO 1, 330 (2010)
Chi, R., Su, Y.X., Zhang, D.H., Chi, X.X., Zhang, H.J.: A hybridization of cuckoo search and particle swarm optimization for solving optimization problems. Neural Comput. Appl. 31(1), 653–670 (2019)
Ghobaei-Arani, M., Rahmanian, A.A., Souri, A., Rahmani, A.: M: Moth-flame optimization algorithm for web service composition in cloud computing: simulation and verification. Software 48(10), 1865–1892 (2018)
Ghobaei-Arani, M., Rahmanian, A.A., Aslanpour, M.S., Dashti, S.E.: CSA-WSC: cuckoo search algorithm for web service composition in cloud environments. Soft. Comput. 22(24), 8353–8378 (2018)
Acknowledgements
The authors thank the editors and the anonymous referees for their valuable and constructive suggestions on this work, which improved the content substantially.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mirsadeghi, E., Khodayifar, S. Hybridizing particle swarm optimization with simulated annealing and differential evolution. Cluster Comput 24, 1135–1163 (2021). https://doi.org/10.1007/s10586-020-03179-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-020-03179-y