Abstract
As a scalable and lightweight infrastructure technology, containers are quickly gaining popularity in cloud data centers. However, dynamic Resource-Allocation in Container-based clouds (RAC) is challenging due to two interdependent allocation sub-problems, allocating dynamic arriving containers to appropriate Virtual Machines (VMs) and allocating VMs to multiple Physical Machines (PMs). Most of existing research works assume homogeneous PMs and rely on simple and manually designed heuristics such as Best Fit and First Fit, which can only capture limited information, affecting their effectiveness of reducing energy consumption in data centers. In this work, we propose a novel hybrid Cooperative Coevolution Genetic Programming (CCGP) hyper-heuristic approach to automatically generate heuristics that are effective in solving the dynamic RAC problem. Different from existing works, our approach hybridizes Best Fit to automatically designed heuristics to coherently solve the two interdependent sub-problems. Moreover, we introduce a new energy model that accurately captures the energy consumption in a more realistic setting than that in the literature, e.g., real-world workload patterns and heterogeneous PMs. The experiment results show that our approach can significantly reduce energy consumption, in comparison to two state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Online resource allocation benchmarks for container-based clouds and the source code of all discussed approaches are available from https://github.com/chenwangnida/RAC.
References
Abohamama, A.S., Hamouda, E.: A hybrid energy-aware virtual machine placement algorithm for cloud environments. Expert Syst. Appl. 150, 113306 (2020)
Akindele, T., Tan, B., Mei, Y., Ma, H.: Hybrid grouping genetic algorithm for large-scale two-level resource allocation of containers in the cloud. In: Long, G., Yu, X., Wang, S. (eds.) AI 2022. LNCS (LNAI), vol. 13151, pp. 519–530. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-97546-3_42
Al-Moalmi, A., Luo, J., Salah, A., Li, K., Yin, L.: A whale optimization system for energy-efficient container placement in data centers. Expert Syst. Appl. 164, 113719 (2021)
Bhardwaj, A., Krishna, C.R.: Virtualization in cloud computing: moving from hypervisor to containerization-a survey. Arab. J. Sci. Eng. 46(9), 8585–8601 (2021)
Bhattacherjee, S., Das, R., Khatua, S., Roy, S.: Energy-efficient migration techniques for cloud environment: a step toward green computing. J. Supercomputing 76(7), 5192–5220 (2020)
Dayarathna, M., Wen, Y., Fan, R.: Data center energy consumption modeling: a survey. IEEE Commun. Surv. Tutorials 18, 732–794 (2015)
Ding, W., Luo, F., Han, L., Gu, C., Lu, H., Fuentes, J.: Adaptive virtual machine consolidation framework based on performance-to-power ratio in cloud data centers. Future Gener. Comput. Syst. 111, 254–270 (2020)
Gharehpasha, S., Masdari, M., Jafarian, A.: Virtual machine placement in cloud data centers using a hybrid multi-verse optimization algorithm. Artif. Intell. Rev. 54(3), 2221–2257 (2021)
Guo, M., Guan, Q., Chen, W., Ji, F., Peng, Z.: Delay-optimal scheduling of VMs in a Queueing cloud computing system with heterogeneous workloads. IEEE Trans. Serv. Comput. 15(1), pp. 110–123 (2022)
Hussein, M.K., Mousa, M.H., Alqarni, M.A.: A placement architecture for a container as a service (CAAS) in a cloud environment. J. Cloud Comput. 8(1), 1–15 (2019). https://doi.org/10.1186/s13677-019-0131-1
Kaewkasi, C., Chuenmuneewong, K.: Improvement of container scheduling for docker using ant colony optimization. In: 2017 9th International Conference on Knowledge and Smart Technology (KST), pp. 254–259. IEEE (2017)
Kanso, A., Youssef, A.: Serverless: beyond the cloud. In: Proceedings of the 2nd International Workshop on Serverless Computing, pp. 6–10 (2017)
Li, F., Tan, W.J., Cai, W.: A wholistic optimization of containerized workflow scheduling and deployment in the cloud-edge environment. Simul. Model. Pract. Theory 118, 102521 (2022)
Long, S., Wen, W., Li, Z., Li, K., Yu, R., Zhu, J.: A global cost-aware container scheduling strategy in cloud data centers. IEEE Trans. Parallel Distrib. Syst. 33(11), 2752–2766 (2021)
Mann, Z.Á.: Interplay of virtual machine selection and virtual machine placement. In: Aiello, M., Johnsen, E.B., Dustdar, S., Georgievski, I. (eds.) ESOCC 2016. LNCS, vol. 9846, pp. 137–151. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44482-6_9
Nardelli, M., Hochreiner, C., Schulte, S.: Elastic provisioning of virtual machines for container deployment. In: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion, pp. 5–10 (2017)
Piraghaj, S.F., Dastjerdi, A.V., Calheiros, R.N., Buyya, R.: Efficient virtual machine sizing for hosting containers as a service (SERVICES 2015). In: 2015 IEEE World Congress on Services, pp. 31–38. IEEE (2015)
Piraghaj, S.F., Dastjerdi, A.V., Calheiros, R.N., Buyya, R.: A framework and algorithm for energy efficient container consolidation in cloud data centers. In: 2015 IEEE International Conference on Data Science and Data Intensive Systems, pp. 368–375. IEEE (2015)
Shen, S., Van Beek, V., Iosup, A.: Statistical characterization of business-critical workloads hosted in cloud datacenters. In: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 465–474. IEEE (2015)
Shi, T., Ma, H., Chen, G.: Energy-aware container consolidation based on PSO in cloud data centers. In: IEEE CE, pp. 1–8 (2018)
Tan, B., Ma, H., Mei, Y.: A genetic programming hyper-heuristic approach for online resource allocation in container-based clouds. In: Mitrovic, T., Xue, B., Li, X. (eds.) AI 2018. LNCS (LNAI), vol. 11320, pp. 146–152. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-03991-2_15
Tan, B., Ma, H., Mei, Y., Zhang, M.: A cooperative coevolution genetic programming hyper-heuristics approach for on-line resource allocation in container-based clouds. IEEE Trans. Cloud Comput. 10, 1500–1514 (2022)
Tarahomi, M., Izadi, M., Ghobaei-Arani, M.: An efficient power-aware VM allocation mechanism in cloud data centers: a micro genetic-based approach. Clust. Comput. 24(2), 919–934 (2021)
Taylor, P.: Global market share held by operating systems for desktop PCs, from Jan 2013 to Dec 2021. Tech. rep. (2022). https://www.statista.com/statistics/218089/global-market-share-of-windows-7
Zhang, C., Wang, Y., Wu, H., Guo, H.: An energy-aware host resource management framework for two-tier virtualized cloud data centers. IEEE Access 9, 3526–3544 (2020)
Zhang, R., Zhong, A., Dong, B., Tian, F., Li, R.: Container-VM-PM Architecture: a novel architecture for docker container placement. In: Luo, M., Zhang, L.-J. (eds.) CLOUD 2018. LNCS, vol. 10967, pp. 128–140. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-94295-7_9
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, C., Ma, H., Chen, G., Huang, V., Yu, Y., Christopher, K. (2023). Energy-Aware Dynamic Resource Allocation in Container-Based Clouds via Cooperative Coevolution Genetic Programming. In: Correia, J., Smith, S., Qaddoura, R. (eds) Applications of Evolutionary Computation. EvoApplications 2023. Lecture Notes in Computer Science, vol 13989. Springer, Cham. https://doi.org/10.1007/978-3-031-30229-9_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-30229-9_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30228-2
Online ISBN: 978-3-031-30229-9
eBook Packages: Computer ScienceComputer Science (R0)