Skip to main content
SpringerLink
Log in

Parallel hybridization of differential evolution and particle swarm optimization for constrained optimization with its application

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

This paper presents a novel hybridization between differential evolution (DE) and particle swarm optimization (PSO), based on ‘tri-population’ environment. Initially, the whole population (in increasing order of fitness) is divided into three groups—inferior group, mid group and superior group. DE is employed in the inferior and superior groups, whereas PSO is used in the mid-group. This proposed method is named as DPD as it uses DE–PSO–DE on the sub-populations of the same population. Two more strategies namely Elitism (to retain the best obtained values so far) and Non-Redundant Search (to improve the solution quality) have been incorporated in DPD cycle. Considering eight variants of popular mutation operators in one DE, a total of 64 variants of DPD are formed. The top four DPDs have been pointed out through 13 constrained benchmark functions and five engineering design problems. Further, based on the ‘performance’ analysis the best DPD is reported. Later to show superiority and effectiveness, the best DPD is compared with various state-of-the-art approaches. The numerical, statistical and graphical analyses reveal the robustness of the proposed DPD.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Ali M, Pant M, Abraham A (2009) Simplex differential evolution. Acta Polytech Hung 6:95–115

    Google Scholar 

  • Araújo TDF, Uturbey W (2013) Performance assessment of PSO, DE and hybrid PSO–DE algorithms when applied to the dispatch of generation and demand. Electr Power Energy Syst 47:205–217

    Article  Google Scholar 

  • Branke J (1999) Memory enhanced evolutionary algorithms for changing optimization problems. In: Congress on evolutionary computation CEC99, vol 3, pp 1875–1882

  • Cagnina L, Esquivel S, Coello Coello CA (2007) A bi-population PSO with a shake-mechanism for solving constrained numerical optimization. In: IEEE congress on evolutionary computation (CEC’2007). IEEE Press, Singapore, pp 670–676

  • Cagnina LC, Esquivel SC, Coello Coello CA (2011) Solving constrained optimization problems with a hybrid particle swarm optimization algorithm. Eng Optim 43:843–866

    Article  MathSciNet  MATH  Google Scholar 

  • Caponio A, Neri F, Tirronen V (2009) Superfit control adaptation in memetic differential evolution frameworks. Soft Comput 13:811–831

    Article  Google Scholar 

  • Chen D, Chen J, Jiang H, Zou F, Liu T (2014) An improved PSO algorithm based on particle exploration for function optimization and the modeling of chaotic systems. Soft Comput (Online 7 Oct 2014)

  • Corder GW, Foreman DI (2009) Nonparametric statistics for non-statisticians: a step-by-step approach. Wiley, Hoboken

    Book  MATH  Google Scholar 

  • Das S, Suganthan PN (2011) Differential evolution: a survey of the state-of-the-art. IEEE Trans Evol Comput 15:4–31

    Article  Google Scholar 

  • Das S, Konar A, Chakraborty UK (2005) Improving particle swarm optimization with differentially perturbed velocity. In: Proceedings of the genetic and evolutionary computation conference, pp 177–184

  • Das S, Abraham A, Konar A (2008) Particle swarm optimization and differential evolution algorithms: technical analysis, applications and hybridization perspectives. In: Advances of computational intelligence in industrial systems. Studies in Computational Intelligence, Springer, Berlin, pp. 1–38

  • Deb K (1995) Optimization for engineering design: algorithms and examples. Prentice-Hall of India, New Delhi

    Google Scholar 

  • Deep K, Das KN (2009) Performance improvement of real coded genetic algorithm with Quadratic Approximation based hybridization. Int J Intell Def Support Syst 2:319–334

    Google Scholar 

  • Dor AE, Clerc M, Siarry P (2012a) Hybridization of differential evolution and particle swarm optimization in a new algorithm DEPSO-2S. Swarm Evol Comput 7269:57–65

    Article  Google Scholar 

  • Dor AE, Clerc M, Siarry P (2012b) A multi-swarm PSO using charged particles in a partitioned search space for continuous optimization. Comput Optim Appl 53:271–295

    Article  MathSciNet  MATH  Google Scholar 

  • Elsayed SM, Sarker RA, Essam DL (2011) Multi-operator based evolutionary algorithms for solving constrained optimization problems. Comput Oper Res 38:1877–1896

    Article  MathSciNet  MATH  Google Scholar 

  • Epitropakis MG, Plagianakos VP, Vrahatis MN (2012) Evolving cognitive and social experience in particle swarm optimization through differential evolution: a hybrid approach. Inf Sci 216:50–92

    Article  Google Scholar 

  • Gong W, Cai Z (2013) Differential evolution with ranking based mutation operators. IEEE Trans Syst Man Cybern B Cybern 43:2066–2081

    Google Scholar 

  • Han MF, Liao SH, Chang JY, Lin CT (2013) Dynamic group-based differential evolution using a self-adaptive strategy for global optimization problems. Appl Intell 39:41–56

    Article  Google Scholar 

  • Hao ZF, Guo GH, Huang H (2007) A particle swarm optimization algorithm with differential evolution. In: Proceedings of the sixth international conference on machine learning and cybernetics, Hong Kong, pp 1031–1035

  • He Q, Wang L (2007a) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186:1407–1422

    MathSciNet  MATH  Google Scholar 

  • He Q, Wang L (2007b) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20:89–99

    Article  Google Scholar 

  • Hendtlass T (2001) A combined swarm differential evolution algorithm for optimization problems. Lecture Notes Computer Science, vol 2070, pp 11–18

  • Jia G, Wang Y, Cai Z, Jin Y (2013) An improved (μ + λ)-constrained differential evolution for constrained optimization. Inf Sci 222:302–322

    Article  MathSciNet  MATH  Google Scholar 

  • Jose N, Alba E, Apolloni J (2009) Particle swarm hybridized with differential evolution: black box optimization benchmarking for noisy functions. In: Proceedings of the international conference on genetic and evolutionary computation, pp 2343–2350

  • Kannan S, Slochanal SMR, Subbaraj P, Padhy NP (2004) Applications of particle swarm optimization techniques and its variants to generation expansion planning. Electr Power Syst Res 70:203–210

    Article  Google Scholar 

  • Karaboga D, Akay B (2011) A modified Artificial Bee Colony (ABC) algorithm for constrained optimization problems. Appl Soft Comput 11:3021–3031

    Article  Google Scholar 

  • Kennedy J, Eberhart R (1995) Particle swarm optimization Proc AESF Annu Tech Conf 1995 IEEE Int Conf. Neural Netw 4:1942–1948

    Google Scholar 

  • Khamsawang S, Wannakarn P, Jiriwibhakorn S (2010) Hybrid PSO-DE for solving the economic dispatch problem with generator constraints. In: Proceedings of the IEEE international conference on computer and automation engineering, vol 5, pp 135–139

  • Khare A, Rangnekar S (2013) A review of particle swarm optimization and its applications in Solar Photovoltaic system. Appl Soft Comput 13:2997–3006

    Article  Google Scholar 

  • Kordestani JK, Rezvanian A, Meybodi MR (2014) CDEPSO: a bi-population hybrid approach for dynamic optimization problems. Appl Intell 40:682–694

    Article  Google Scholar 

  • Kumar P, Pant M (2011) HPDE: a novel hybrid PSO-DE algorithm for global optimization problems. Int J Adv Eng Sci 1:50–54

    Google Scholar 

  • Li Y, Xiang R, Jiao L, Liu R (2012) An improved cooperative quantum-behaved particle swarm optimization. Soft Comput 16:1061–1069

    Article  Google Scholar 

  • Lin CH (2013) A rough penalty genetic algorithm for constrained optimization. Inf Sci 241:119–137

    Article  Google Scholar 

  • Liu H, Cai ZX, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10:629–640

    Article  Google Scholar 

  • Long W, Liang X, Huang Y, Chen Y (2013) A hybrid differential evolution augmented Lagrangian method for constrained numerical and engineering optimization. CAD 45:1562–1574

    MathSciNet  Google Scholar 

  • Lu H, Sriyanyong P, Song YH, Dillon T (2010) Experimental study of a new hybrid PSO with mutation for economic dispatch with non-smooth cost function. Electr Power Energy Syst 32:921–935

    Article  Google Scholar 

  • Mallipeddi R, Suganthan P, Pan Q, Tasgetiren M (2011) Differential evolution algorithm with ensemble of parameters and mutation strategies. Appl Soft Comput 11:1679–1696

    Article  Google Scholar 

  • Michalewicz Z (1995) A survey of constraint handling techniques in evolutionary computation methods. In: Proceedings of the 4th annual conference on evolutionary programming. MIT Press, Cambridge, pp 135–155

  • Moore PW, Venayagamoorthy GK (2006) Evolving digital circuit using hybrid particle swarm optimization and differential evolution. Int J Neural Syst 16:163–177

    Article  Google Scholar 

  • Neri F, Tirronen V (2010) Recent advances in differential evolution: a survey and experimental analysis. Artif Intell Rev 33:61–106

    Article  Google Scholar 

  • Niknam T, Mojarrad HD, Meymand HZ (2011) A novel hybrid particle swarm optimization for economic dispatch with valve-point loading effects. Energy Convers Manag 52:1800–1809

    Article  Google Scholar 

  • Nwankwor E, Nagar A, Reid D (2013) Hybrid differential evolution and particle swarm optimization for optimal well placement. Comput Geosci 17:249–268

    Article  Google Scholar 

  • Omran M, Engelbrecht AP, Salman A (2008) Bare bones differential evolution. Eur J Oper Res 196:128–139

    Article  MathSciNet  MATH  Google Scholar 

  • Pant M, Thangaraj R (2011) DE-PSO: a new hybrid meta-heuristic for solving global optimization problems. New Math Nat Comput 7:363–381

    Article  MathSciNet  Google Scholar 

  • Qin A, Huang V, Suganthan P (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13:398–417

    Article  Google Scholar 

  • Sacco WF, Henderson N (2014) Differential evolution with topographical mutation applied to nuclear reactor core design. Prog Nucl Energy 70:140–148

    Article  Google Scholar 

  • Satapathy S, Maheshwari D, Hanuman AS, Babu AV, Patra PK, Biswal BN (2012) Integrated PSO and DE for data clustering. Int J Mach Learn Comput 2:839–843

    Article  Google Scholar 

  • Sayah S, Hamouda A (2013) A hybrid differential evolution algorithm based on particle swarm optimization for nonconvex economic dispatch problems. Appl Soft Comput 13:1608–1619

    Article  Google Scholar 

  • Sharma A, Sharma D (2012) Real-valued constraint optimization with ICHEA. In: Neural information processing. Lecture Notes in Computer Science, vol 7665, pp 406–416

  • Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359

    Article  MathSciNet  MATH  Google Scholar 

  • Sun CL, Zeng JC, Pan JS (2011) An improved vector particle swarm optimization for constrained optimization problems. Inf Sci 181:1153–1163

    Article  Google Scholar 

  • Talbi H, Batouche M (2004) Hybrid particle swarm with differential evolution for multimodal image registration. In: Proceedings of the IEEE international conference on industrial technology, vol 3, pp 1567–1573

  • Thangaraj R, Pant M, Abraham A, Bouvry P (2011) Particle swarm optimization: hybridization perspectives and experimental illustrations. Appl Math Comput 217:5208–5226

    MATH  Google Scholar 

  • Tsai CW, Huang KW, Yang CS, Chiang MC (2014) A fast particle swarm optimization for clustering. Soft Comput (Online 22 Mar 2014)

  • Vasundhara Mandal D, Kar R, Ghoshal SP (2014) Digital FIR filter design using fitness based hybrid adaptive differential evolution with particle swarm optimization. Nat Comput 13:55–64

    Article  MathSciNet  Google Scholar 

  • Wang Y, Cai Z (2009) A hybrid multi-swarm particle swarm optimization to solve constrained optimization problems. Front Comput Sci China 3:38–52

    Article  MathSciNet  Google Scholar 

  • Wang Y, Cai Z (2011) Constrained evolutionary optimization by means of (μ + λ)-differential evolution and improved adaptive trade-off model. Evol Comput 19:249–285

    Article  Google Scholar 

  • Wang Y, Cai Z (2012a) A dynamic hybrid framework for constrained evolutionary optimization. IEEE Trans Syst Man Cybern B Cybern 42:203–217

    Article  Google Scholar 

  • Wang Y, Cai Z (2012b) Combining multiobjective optimization with differential evolution to solve constrained optimization problems. IEEE Trans Evol Comput 16:117–134

    Article  Google Scholar 

  • Wang L, Li L (2010) An effective differential evolution with level comparison for constrained engineering design. Struct Multidiscipl Optim 41:947–963

    Article  Google Scholar 

  • Wang H, Wang D, Yang S (2007) Triggered memory-based swarm optimization in dynamic environments. In: Applications of evolutionary computing. Lecture Notes in Computer Science, vol 4448, pp 637–646

  • Wang Y, Cai Z, Zhou Y, Fan Z (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscipl Optim 37:395–413

    Article  Google Scholar 

  • Wang X, Yang Q, Zhao Y (2010) Research on hybrid PSODE with triple populations based on multiple differential evolutionary models. In: Proceedings of the international conference on electrical control engineering, Wuhan, pp 1692–1696

  • Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15:55–66

    Article  Google Scholar 

  • Wang Y, Cai Z, Zhang Q (2012) Enhancing the search ability of differential evolution through orthogonal crossover. Inf Sci 185:153–177

    Article  MathSciNet  Google Scholar 

  • Wang Y, Li HX, Huang T, Li L (2014) Differential evolution based on covariance matrix learning and bimodal distribution parameter setting. Appl Soft Comput 18:232–247

    Article  Google Scholar 

  • Wu YC, Lee WP, Chien CW (2011) Modified the performance of differential evolution algorithm with dual evolution strategy. In: 2009 International conference on machine learning and computing, IPCSIT, vol 3. IACSIT Press, Singapore, pp 57–63

  • Xin B, Chen J, Zhang J, Fang H, Peng Z (2012) Hybridizing differential evolution and particle swarm optimization to design powerful optimizers: a review and taxonomy. IEEE Trans Syst Man Cybern C Appl Rev 42:744–767

    Article  Google Scholar 

  • Xu W, Gu X (2009) A hybrid particle swarm optimization approach with prior crossover differential evolution. In: Proceedings of ACM/SIGEVO summit on genetic and evolutionary computation, pp 671–678

  • Yadav A, Deep K (2014) An efficient co-swarm particle swarm optimization for non-linear constrained optimization. J Comput Sci 5(2):258–268

    Article  Google Scholar 

  • Yu X, Cao J, Shan H, Zhu L, Guo J (2014) An adaptive hybrid algorithm based on particle swarm optimization and differential evolution for global optimization. ScientificWorldJournal. doi:10.1155/2014/215472

    Google Scholar 

  • Yufeng YU, Chen XU, Guo LI, Jingwen LI (2014) Hybrid algorithm based on particle swarm optimization and differential evolution. J Comput Inf Syst 10:4619–4627

    Google Scholar 

  • Zaheer H, Pant M, Kumar S, Monakhov O, Monakhova E, Deep K (2014) A new guiding force strategy for differential evolution. Int J Syst Assur Eng Manag. doi:10.1007/s13198-014-0322-6

    Google Scholar 

  • Zhang H, Ishikawa M (2004) An extended hybrid genetic algorithm for exploring a large search space. In: 2nd International conference on autonomous robots and agents, Palmerston North, pp 244–248

  • Zhang WJ, Xie XF (2003) DEPSO: hybrid particle swarm with differential evolution operator. In: Proceedings of the IEEE international conference on systems, man and cybernetics, vol 4, pp 3816–3821

  • Zhang C, Ning J, Lu S, Ouyang D, Ding T (2009) A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization. Oper Res Lett 37:117–122

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang G, Cheng J, Gheorghe M, Meng Q (2013) A hybrid approach based on differential evolution and tissue membrane systems for solving constrained manufacturing parameter optimization problems. Appl Soft Comput 13:1528–1542

    Article  Google Scholar 

  • Zuo X, Xiao L (2014) A DE and PSO based hybrid algorithm for dynamic optimization problems. Soft Comput 18:1405–1424

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, NIT Silchar, Silchar, Assam, India

    Raghav Prasad Parouha & Kedar Nath Das

Authors
  1. Raghav Prasad Parouha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kedar Nath Das
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Raghav Prasad Parouha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parouha, R.P., Das, K.N. Parallel hybridization of differential evolution and particle swarm optimization for constrained optimization with its application. Int J Syst Assur Eng Manag 7 (Suppl 1), 143–162 (2016). https://doi.org/10.1007/s13198-015-0354-6

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-015-0354-6

Keywords

Search

Navigation