Skip to main content

Hybrid Initialization in the Process of Evolutionary Learning

  • Conference paper
  • First Online:
Artificial Intelligence and Soft Computing (ICAISC 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10245))

Included in the following conference series:

Abstract

Population-based algorithms are an interesting tool for solving optimization problems. Their performance depends not only on their specification but also on methods used for initialization of initial population. In this paper a new hybridization approach of initialization methods is proposed. It is based on classification of initialization methods that allow various combination of the methods from each category. To test the proposed approach typical problems related to population-based algorithms were used.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ali, M., Pant, M., Abraham, A.: Unconventional initialization methods for differential evolution. Appl. Math. Comput. 219(9), 4474–4494 (2013)

    MathSciNet  MATH  Google Scholar 

  2. Aluru, S., Prabhu, G.M., Gustafson, J.: A random number generator for parallel computers. Parallel Comput. 18, 839–847 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bartczuk, Ł., Galushkin, A.I.: A new method for generating nonlinear correction models of dynamic objects based on semantic genetic programming. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS, vol. 9693, pp. 249–261. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_22

    Google Scholar 

  4. Bartczuk, Ł., Łapa, K., Koprinkova-Hristova, P.: A new method for generating of fuzzy rules for the nonlinear modelling based on semantic genetic programming. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS, vol. 9693, pp. 262–278. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_23

    Google Scholar 

  5. Basu, M.: Quasi-oppositional differential evolution for optimal reactive power dispatch. Electr. Power Energy Syst. 78, 29–40 (2016)

    Article  Google Scholar 

  6. Bradley, T., Toit, J.d., Tong, R., Giles, M., Woodhams, P.: Parallelization techniques for random numbers generators. In: GPU Computing Gems Emerald Edition, pp. 231–246 (2011)

    Google Scholar 

  7. Cheng, J., Ruzdzel, M.J.: Computational investigation of low-discrepancy sequences in simulation algorithms for Bayesian networks. In: Proceedings of the 16th Annual Conference on Uncertainty in Artificial Intelligence, pp. 72–81 (2000)

    Google Scholar 

  8. Cpałka, K.: Design of Interpretable Fuzzy Systems. Springer, Heidelberg (2017)

    Google Scholar 

  9. Cpałka, K., Łapa, K., Przybył, A.: A new approach to design of control systems using genetic programming. Inf. Technol. Control 44(4), 433–442 (2015)

    Google Scholar 

  10. Cpałka, K., Rebrova, O., Nowicki, R., Rutkowski, L.: On design of flexible neuro-fuzzy systems for nonlinear modelling. Int. J. Gen. Syst. 42(6), 706–720 (2013)

    Article  MATH  Google Scholar 

  11. Cpałka K., Rutkowski, L.: Flexible takagi-Sugeno. Fuzzy systems, neural networks. In: Proceedings of the 2005 IEEE International Joint Conference on IJCNN 2005, vol. 3, pp. 1764–1769 (2005)

    Google Scholar 

  12. Diggle, P.J.: Statistical Analysis of Spatial Point Patterns, Mathematics in Biology, 2nd edn. Academic Press, Cambridge (1983)

    MATH  Google Scholar 

  13. Duda, P., Hayashi, Y., Jaworski, M.: On the strong convergence of the orthogonal series-type kernel regression neural networks in a non-stationary environment. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012. LNCS, vol. 7267, pp. 47–54. Springer, Heidelberg (2012). doi:10.1007/978-3-642-29347-4_6

    Chapter  Google Scholar 

  14. Duda, P., Jaworski, M., Pietruczuk, L.: On pre-processing algorithms for data stream. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012. LNCS, vol. 7268, pp. 56–63. Springer, Heidelberg (2012). doi:10.1007/978-3-642-29350-4_7

    Chapter  Google Scholar 

  15. Dziwiński, P., Avedyan, E.D.: A new approach to nonlinear modeling based on significant operating points detection. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2015. LNCS (LNAI), vol. 9120, pp. 364–378. Springer, Cham (2015). doi:10.1007/978-3-319-19369-4_33

    Chapter  Google Scholar 

  16. Dziwiński, P., Avedyan, E.D.: A new approach for using the fuzzy decision trees for the detection of the significant operating points in the nonlinear modeling. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS (LNAI), vol. 9693, pp. 279–292. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_24

    Google Scholar 

  17. Dziwiński, P., Avedyan, E.D.: A new method of the intelligent modeling of the nonlinear dynamic objects with fuzzy detection of the operating points. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS (LNAI), vol. 9693, pp. 293–305. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_25

    Google Scholar 

  18. Gabryel, M., Cpałka, K., Rutkowski, L.: Evolutionary strategies for learning of neuro-fuzzy systems. In: Proceedings of the I Workshop on Genetic Fuzzy Systems, pp. 119–123. Granada (2005)

    Google Scholar 

  19. Gałkowski, T., Rutkowski, L.: Nonparametric fitting of multivariate functions. IEEE Trans. Autom. Control 31(8), 785–787 (1986)

    Article  MATH  Google Scholar 

  20. Galkowski, T., Starczewski, A., Fu, X.: Improvement of the multiple-view learning based on the self-organizing maps. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2015. LNCS (LNAI), vol. 9120, pp. 3–12. Springer, Cham (2015). doi:10.1007/978-3-319-19369-4_1

    Chapter  Google Scholar 

  21. Grycuk, R., Gabryel, M., Korytkowski, M., Scherer, R.: Content-based image indexing by data clustering and inverse document frequency. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 374–383. Springer, Cham (2014). doi:10.1007/978-3-319-06932-6_36

    Chapter  Google Scholar 

  22. Hayashi, Y., Tanaka, Y., Takagi, T., Saito, T., Iiduka, H., Kikuchi, H., Bologna, G.: Recursive-rule extraction algorithm with J48graft and applications to generating credit scores. J. Artif. Intell. Soft Comput. Res. 6(1), 35–44 (2016)

    Article  Google Scholar 

  23. Jaworski, M., Pietruczuk, L., Duda, P.: On resources optimization in fuzzy clustering of data streams. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012. LNCS, vol. 7268, pp. 92–99. Springer, Heidelberg (2012). doi:10.1007/978-3-642-29350-4_11

    Chapter  Google Scholar 

  24. Jimenez, F., Yoshikawa, T., Furuhashi, T., Kanoh, M.: An emotional expression model for educational-support robots. J. Artif. Intell. Soft Comput. Res. 5(1), 51–57 (2015)

    Article  Google Scholar 

  25. Kasthurirathna, D., Piraveenan, M., Uddin, S.: Evolutionary stable strategies in networked games: the influence of topology. J. Artif. Intell. Soft Comput. Res. 5(2), 83–95 (2015)

    Article  Google Scholar 

  26. Kazimipour, B., Li, X., Qi, A.K.: A review of population initialization techniques for evolutionary algorithms. In: 2014 IEEE Congress on Evolutionary Computation (CEC), 6–11 July, pp. 2585–2592 (2014)

    Google Scholar 

  27. Kazimipour, B., Li, X., Qin, A.K.: Effects of population initialization on differential evolution for large scale optimization. In: 2014 IEEE Congress on Evolutionary Computation (CEC), July 6–11, pp. 2404–2411 (2014)

    Google Scholar 

  28. Korytkowski, M., Rutkowski, L., Scherer, R.: Fast image classification, by boosting fuzzy classifiers. Inf. Sci. 327, 175–182 (2016)

    Article  MathSciNet  Google Scholar 

  29. Knuth, D.E.: The Art of Computer Programming, Volume 2: Seminumerical Algorithms (1997)

    Google Scholar 

  30. Lin, C., Dong, F., Hirota, K.: Common driving notification protocol based on classified driving behavior for cooperation intelligent autonomous vehicle using vehicular ad-hoc network technology. J. Artif. Intell. Soft Comput. Res. 5(1), 5–21 (2015)

    Article  Google Scholar 

  31. Łapa, K., Przybył, A., Cpałka, K.: A new approach to designing interpretable models of dynamic systems. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013. LNCS, vol. 7895, pp. 523–534. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38610-7_48

    Chapter  Google Scholar 

  32. Maaranen, H., Miettinen, K., Penttinen, A.: On initial populations of a genetic algorithm for continuous optimization problems. J. Global Optim. 37(3), 405–436 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  33. McKay, M.D., Beckman, R.J., Conover, W.J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2), 239–245 (1979)

    MathSciNet  MATH  Google Scholar 

  34. Murata, M., Ito, S., Tokuhisa, M., Ma, Q.: Order estimation of japanese paragraphs by supervised machine learning and various textual features. J. Artif. Intell. Soft Comput. Res. 5(4), 247–255 (2015)

    Article  Google Scholar 

  35. Najgebauer, P., Korytkowski, M., Barranco, C.D., Scherer, R.: Novel image descriptor based on color spatial distribution. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS (LNAI), vol. 9693, pp. 712–722. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_63

    Google Scholar 

  36. Nikulin, V.: Prediction of the shoppers loyalty with aggregated data streams. J. Artif. Intell. Soft Comput. Res. 6(2), 69–79 (2016)

    Article  Google Scholar 

  37. Nonaka, S., Tsujimura, T., Izumi, K.: Gain design of quasi-continuous exponential stabilizing controller for a nonholonomic mobile robot. J. Artif. Intell. Soft Comput. Res. 6(3), 189–201 (2016)

    Article  Google Scholar 

  38. Nowicki, R., Scherer, R., Rutkowski, L.: A method for learning of hierarchical fuzzy systems. In: Intelligent Technologies-Theory and Applications, pp. 124–129. IOS Press, Amsterdam (2002)

    Google Scholar 

  39. Orue, A.B., Montoya, F., Encinas, L.H.: Trifork, a new pseudorandom number generator based on lagged fibonacci maps. J. Comput. Sci. Eng. 1(10), 46–51 (2010)

    Google Scholar 

  40. Pan, W., Li, K., Wang, M., Wang, J., Jiang, B.: Adaptive randomness: a new population initialization method. Math. Probl. Eng. 2014, 1–14 (2014)

    Google Scholar 

  41. Panneton, F., L’Ecuyer, P.: On the xorshift random number generators. ACM Trans. Model. Compu. Simul. 15(4), 346–361 (2005)

    Article  Google Scholar 

  42. Pant, M., Thangaraj, T., Abraham, A.: Particle swarm optimization: performance tuning and empirical analysis. In: Abraham, A., Hassanien, A.-E., Siarry, P., Engelbrecht, A. (eds.) Foundations of Computational Intelligence Volume 3. SCI, vol. 203, pp. 101–128. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  43. Pant, M., Ali, M., Singh, V.: Differential evolution using quadratic interpolation for initializing the population. In: Advance Computing Conference, pp. 375–380 (2009)

    Google Scholar 

  44. Patgiri, C., Sarma, M., Sarma, K.K.: A class of neuro-computational methods for assamese fricative classification. J. Artif. Intell. Soft Comput. Res. 5(1), 59–70 (2015)

    Article  Google Scholar 

  45. Pietruczuk, L., Rutkowski, L., Jaworski, M., Duda, P.: How to adjust an ensemble size in stream data mining? Inf. Sci. 381, 46–54 (2017)

    Article  MathSciNet  Google Scholar 

  46. Przybył, A., Jelonkiewicz, J.: Genetic algorithm for observer parameters tuning in sensorless induction motor drive. In: Neural Networks and Soft Computing (Proceedings of the 6th International Conference on Neural Networks and Soft Computing, 2002), pp. 376–381 (2003)

    Google Scholar 

  47. Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: A novel population initialization method for accelerating evolutionary algorithms. Comput. Math. Applicat. 53(10), 1605–1614 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  48. Rahnamayan, S., Wang, G.G.: Toward effective initialization for large-scale search spaces. Wseas Trans. Syst. 8(3), 355–367 (2009)

    MathSciNet  MATH  Google Scholar 

  49. Rivero, C.R., Pucheta, J., Laboret, S., Sauchelli, V., Patio, D.: Energy associated tuning method for short-term series forecasting by complete and incomplete datasets. J. Artif. Intell. Soft Comput. Res. 7(1), 5–16 (2017)

    Article  Google Scholar 

  50. Rutkowski, L.: Sequential pattern-recognition procedures derived from multiple Fourier-series. Pattern Recogn. Lett. 8(4), 213–216 (1988)

    Article  MATH  Google Scholar 

  51. Rutkowski, L., Cpałka, K.: Compromise approach to neuro-fuzzy systems. In: Proceedings of the 2nd Euro-International Symposium on Computation Intelligence. Frontiers in Artificial Intelligence and Applications, vol. 76, pp. 85–90 (2002)

    Google Scholar 

  52. Rutkowski, L., Cpałka, K.: Flexible weighted neuro-fuzzy systems. In: Proceedings of the 9th International Conference on Neural Information Processing (ICONIP 2002). Orchid Country Club, Singapore, 18–22 November 2002

    Google Scholar 

  53. Rutkowski, L., Cpałka, K.: Neuro-fuzzy systems derived from quasi-triangular norms. In: Proceedings of the IEEE International Conference on Fuzzy Systems, Budapest, 26–29 July, vol. 2, pp. 1031–1036 (2004)

    Google Scholar 

  54. Rutkowski, L., Jaworski, M., Pietruczuk, L., Duda, P.: Decision trees for mining data streams based on the gaussian approximation. IEEE Trans. Knowl. Data Eng. 26(1), 108–119 (2014)

    Article  MATH  Google Scholar 

  55. Rutkowski, L., Jaworski, M., Pietruczuk, L., Duda, P.: A new method for data stream mining based on the misclassification error. IEEE Trans. Neural Netw. Learn. Syst. 26, 1048–1059 (2015)

    Article  MathSciNet  Google Scholar 

  56. Rutkowski, L., Jaworski, M., Pietruczuk, L., Duda, P.: The CART decision tree for mining data streams. Inf. Sci. 266, 1–15 (2014)

    Article  MATH  Google Scholar 

  57. Rutkowski, L., Pietruczuk, L., Duda, P., Jaworski, M.: Decision trees for mining data streams based on the mcdiarmid’s bound. IEEE Trans. Knowl. Data Eng. 25(6), 1272–1279 (2013)

    Article  Google Scholar 

  58. Saka, Y., Gunzburger, M., Burkardt, J.: Latinized, improved LHS, and CVT point sets in hypercubes. Int. J. Numer. Anal. Model. 4(3–4), 729–743 (2007)

    MathSciNet  MATH  Google Scholar 

  59. Scherer, R.: Designing boosting ensemble of relational fuzzy systems. Inte. J. Neural Syst. 20, 381–388 (2010)

    Article  Google Scholar 

  60. Scherer, R.: Multiple Fuzzy Classification Systems. Springer, Heidelberg (2012)

    Book  MATH  Google Scholar 

  61. Scherer, R., Rutkowski, L.: Neuro-fuzzy relational systems. In: 2002 International Conference on Fuzzy Systems and Knowledge Discovery, 18–22 November, Singapore, pp. 44–48 (2002)

    Google Scholar 

  62. Scherer, R., Rutkowski, L.: Connectionist fuzzy relational systems. In: Halgamuge, S.K., Wang, L. (eds.) Computational Intelligence for Modelling and Control, Studies in Computational Intelligence, pp. 35–47. Springer, Heidelberg (2005)

    Google Scholar 

  63. Shinzato, T.: Box Muller Method (2007)

    Google Scholar 

  64. Smoląg, J., Rutkowski, L., Bilski, J.: Systolic array for neural networks. IV KSNiIZ, Zakopane, pp. 487–497 (1999)

    Google Scholar 

  65. Szarek, A., Korytkowski, M., Rutkowski, L., Scherer, R., Szyprowski, J.: Application of neural networks in assessing changes around implant after total hip arthroplasty. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012. LNCS, vol. 7268, pp. 335–340. Springer, Heidelberg (2012). doi:10.1007/978-3-642-29350-4_40

    Chapter  Google Scholar 

  66. Villmann, T., Bohnsack, A., Kaden, M.: Can learning vector quantization be an alternative to SVM and deep learning? Recent trends and advanced variants of learning vector quantization for classification learning. J. Artif. Intell. Soft Comput. Res. 7(1), 65–81 (2017)

    Article  Google Scholar 

  67. Wichmann, B.A., Hill, I.D.: Algorithm AS 183: an efficient and portable pseudo-random number generator. Appl. Stat. 31, 188–190 (1982)

    Article  Google Scholar 

  68. Wichmann, B.A., Hill, I.D.: Generating good pseudo-random numbers. Comput. Stat. Data Anal. 51, 1614–1622 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  69. Zalasiński, M.: New algorithm for on-line signature verification using characteristic global features. Adv. Intell. Syst. Comput. 432, 137–146 (2016)

    Google Scholar 

  70. Zalasiński M., Cpałka, K.: A new method of on-line signature verification using a flexible fuzzy one-class classifier, pp. 38–53. Academic Publishing House EXIT (2011)

    Google Scholar 

  71. Zalasiński, M., Cpałka, K.: Novel algorithm for the on-line signature verification using selected discretization points groups. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2013. LNCS, vol. 7894, pp. 493–502. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38658-9_44

    Chapter  Google Scholar 

  72. Zalasiński, M., Cpałka, K.: New algorithm for on-line signature verification using characteristic hybrid partitions. In: Wilimowska, Z., Borzemski, L., Grzech, A., Świątek, J. (eds.) Information Systems Architecture and Technology: Proceedings of 36th International Conference on Information Systems Architecture and Technology – ISAT 2015 – Part IV. AISC, vol. 432, pp. 147–157. Springer, Cham (2016). doi:10.1007/978-3-319-28567-2_13

    Google Scholar 

  73. Zalasiński, M., Cpałka, K., Hayashi, Y.: A new approach to the dynamic signature verification aimed at minimizing the number of global features. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS, vol. 9693, pp. 218–231. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_20

    Google Scholar 

  74. Zalasiński, M., Cpałka, K., Rakus-Andersson, E.: An idea of the dynamic signature verification based on a hybrid approach. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2016. LNCS, vol. 9693, pp. 232–246. Springer, Cham (2016). doi:10.1007/978-3-319-39384-1_21

    Google Scholar 

  75. Zalasiński, M., Cpałka, K., Rutkowski, L.: A new algorithm for identity verification based on the analysis of a handwritten dynamic signature. Appl. Soft Comput. 43, 47–56 (2016)

    Article  Google Scholar 

Download references

Acknowledgments

The project was financed by the National Science Centre (Poland) on the basis of the decision number DEC-2012/05/B/ST7/02138.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Krystian Łapa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Łapa, K., Cpałka, K., Hayashi, Y. (2017). Hybrid Initialization in the Process of Evolutionary Learning. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2017. Lecture Notes in Computer Science(), vol 10245. Springer, Cham. https://doi.org/10.1007/978-3-319-59063-9_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59063-9_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59062-2

  • Online ISBN: 978-3-319-59063-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics