Abstract
Enterprise cloud data centers consume a tremendous amount of energy due to the large number of physical machines (PMs). These PMs host a huge number of virtual machines (VMs), on which a vast number of applications are deployed. Existing research uses two separate layers to manage data center resources: application assignment to VMs, and VM placement to PMs, each of which is a bin packing problem. While this consecutive two-layer bin packing (Consec2LBP) makes the problems easier to solve, it also limits further improvement in the quality of solution. To address this issue, an integrated any colony optimization approach is proposed in this paper to deal with both layers simultaneously. It formulates the two-layer resource management into an integrated two-layer bin packing (Int2LBP) optimization problem. Then, an integrated first fit-decreasing (FFD) algorithm Int2LBP_FFD is proposed to solve this optimization problem. Using the result of Int2LBP_FFD as an initial solution, an integrated ant colony system (ACS) algorithm Int2LBP_ACS is further developed to improve the quality of solution. Simulation experiments are conducted to demonstrate the effectiveness of our integrated approach.
Similar content being viewed by others
References
Abdessamia, F., Zhang, W.Z., Tian, Y.C.: Energy-efficiency virtual machine placement based on binary gravitational search algorithm. Clust. Comput. (2019). Online published, https://doi.org/10.1007/s10586-019-03021-0
Abdullahi, M., Ngadi, M.A., et al.: Symbiotic organism search optimization based task scheduling in cloud computing environment. Future Gener. Comput. Syst. 56, 640–650 (2016)
Alharbi, F., Tian, Y.C., Tang, M., Zhang, W.Z., Peng, C., Fei, M.: An ant colony system for energy-efficient dynamic virtual machine placement in data centers. Expert Syst. Appl. 120, 228–238 (2018)
Amazon: Amazon ec2. Retrieved from https://aws.amazon.com/de/ec2/instance-types/ (2018). Accessed: 26 Apr 2019
Arroba, P., Arroba, J.M., Ayala, J.L., Buyya, R.: Dynamic voltage and frequency scaling-aware dynamic consolidation of virtual machines for energy efficient cloud data centers. Concurr. Comput. 29(10), e4067 (2017)
Arunarani, A., Manjula, D., Sugumaran, V.: Task scheduling techniques in cloud computing: a literature survey. Future Gener. Comput. Syst. 91, 407–415 (2019)
Azizi, S., Zandsalimi, M., Li, D.: An energy-efficient algorithm for virtual machine placement optimization in cloud data centers. Clust. Comput. (2020). Online published, https://doi.org/10.1007/s10586-020-03096-0
Chen, W., Xie, G., Li, R., Bai, Y., Fan, C., Li, K.: Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems. Future Gener. Comput. Syst. 74, 1–11 (2017)
Ding, Z., Tian, Y.C., Tang, M., Li, Y., Wang, Y.G., Zhou, C.: Profile-guided three-phase virtual resource management for energy efficiency of data centers. IEEE Trans. Indust. Electron. 67(3), 2460–2468 (2020)
Dorigo, M., Gambardella, L.M.: Ant colony system: a cooperative learning approach to the traveling salesman problem. IEEE Trans. Evolut. Comput. 1(1), 53–66 (1997)
Fu, X., Zhou, C.: Predicted affinity based virtual machine placement in cloud computing environments. IEEE Trans. Cloud Comput. 8(1), 1 (2020)
Gebrehiwot, M.E., Aalto, S., Lassila, P.: Near-optimal policies for energy-aware task assignment in server farms. In: 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), pp. 1017–1026. Madrid (2017)
Geng, X., Mao, Y., Xiong, M., Liu, Y.: An improved task scheduling algorithm for scientific workflow in cloud computing environment. Clust. Comput. pp. 1–10 (2018)
Google: Google cluster trace. Retrieved from https://github.com/google/cluster-data (2011). Accessed: 18 June 2020
Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. ACM SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2008)
Han, Z., Tan, H., Wang, R., Chen, G., Li, Y., Lau, F.C.M.: Energy-efficient dynamic virtual machine management in data centers. IEEE-ACM Trans. Netw. 27(1), 344–360 (2019)
Ismkhan, H.: Effective heuristics for ant colony optimization to handle large-scale problems. Swarm Evolut. Comput. 32, 140–149 (2017)
Kim, S.: QoS provisioning of a task-scheduling algorithm for lightweight devices. J. Parall. Distribut. Comput. 107, 67–75 (2017)
Laghrissi, A., Taleb, T.: A survey on the placement of virtual resources and virtual network functions. IEEE Commun. Surv. Tutor. 21(2), 1409–1434 (2019)
Li, K., Tang, X., Li, K.: Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans. Parall. Distribut. Syst. 25(11), 2867–2876 (2014)
Lin, W., Wang, W., Wu, W., Pang, X., Liu, B., Zhang, Y.: A heuristic task scheduling algorithm based on server power efficiency model in cloud environments. Sustain. Comput. 20, 56–65 (2017)
Masdari, M., Gharehpasha, S., Ghobaei-Arani, M., Ghasemi, V.: Bio-inspired virtual machine placement schemes in cloud computing environment: taxonomy, review, and future research directions. Clust. Comput. (2019). Online published, https://doi.org/10.1007/s10586-019-03026-9
Mavrovouniotis, M., Li, C., Yang, S.: A survey of swarm intelligence for dynamic optimization: algorithms and applications. Swarm Evolut. Comput. 33, 1–17 (2017)
Panda, S.K., Jana, P.K.: Efficient task scheduling algorithms for heterogeneous multi-cloud environment. J. Supercomput. 71(4), 1505–1533 (2015)
Parvizi, E., Rezvani, M.H.: Utilization-aware energy-efficient virtual machine placement in cloud networks using NSGA-III meta-heuristic approach. Clust. Comput. (2020). Online published, https://doi.org/10.1007/s10586-020-03060-y
Sharma, N.K., Reddy, G.R.M.: Multi-objective energy efficient virtual machines allocation at the cloud data center. IEEE Trans. Serv. Comput. 12(1), (2019)
Talebian, H., Gani, A., Sookhak, M., Abdelatif, A.A., Yousafzai, A., Vasilakos, A.V., Yu, F.R.: Optimizing virtual machine placement in IaaS data centers: taxonomy, review and open issues. Clust. Comput. 23(2), 837–878 (2020)
Vasudevan, M., Tian, Y.C., Tang, M., Kozan, E.: Profiling: An application assignment approach for green data centers. In: 40th Annual Conference of the IEEE Industrial Electronics Society (IECON), pp. 5400–5406. Dallas(2014)
Vasudevan, M., Tian, Y.C., Tang, M., Kozan, E.: Profile-based application assignment for greener and more energy-efficient data centers. Future Gener. Comput. Syst. 67, 94–108 (2017)
Vasudevan, M., Tian, Y.C., Tang, M., Kozan, E., Zhang, W.: Profile-based dynamic application assignment with a repairing genetic algorithm for greener data centers. J. Supercomput. 73(9), 3977–3998 (2017)
Vasudevan, M., Tian, Y.C., Tang, M., Kozan, E., Zhang, X.: Energy-efficient application assignment in profile-based data center management through a repairing genetic algorithm. Appl. Soft Comput. 68, 399–408 (2018)
Whitney, J., Delforge, P.: Scaling up energy efficiency across the data center industry: evaluating key drivers and barriers (Issue Paper). Natural Resources Defense Council (NRDC) (2014)
Zuo, L., Shu, L., Dong, S., Zhu, C., Hara, T.: A multi-objective optimization scheduling method based on the ant colony algorithm in cloud computing. IEEE Access 3, 2687–2699 (2015)
Acknowledgements
This work was supported in part by the Australian Research Council through the Discovery Project Scheme under Grant DP170103305. Author F. Alharbi would like to acknowledge Shaqra University of Saudi Arabia for its financial support through the Saudi Arabian Culture Mission in Australia under Scholarship Ref No. 11954813
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alharbi, F., Tian, YC., Tang, M. et al. Simultaneous application assignment and virtual machine placement via ant colony optimization for energy-efficient enterprise data centers. Cluster Comput 24, 1255–1275 (2021). https://doi.org/10.1007/s10586-020-03186-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-020-03186-z