Skip to main content

Workload Prediction and VM Clustering Based Server Energy Optimization in Enterprise Cloud Data Center

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 13157))

Abstract

The abstract should briefly summarize the contents of the Server energy consumption of data center is an important issue of energy management. Energy optimization of server is also necessary to reduce energy consumption of data center cooling and power supply, and reduce the operation cost of whole data center. High server energy consumption is mainly caused by excessive allocation of IT resources according to the highest application workload. This paper studies the optimization algorithm of server energy consumption in enterprise cloud environment. By introducing deep learning model LSTM to predict application workload, the proposed algorithm can dynamically determine the starting up and shutting down time of virtual machines (VMs) and physical machines (PMs) according to the workload to realize the matching of application workload needs between IT resources. K-mean clustering algorithm is used to find VMs with similar starting up and shutting down time and put them on same PM group. By properly extending the running time and increasing number of VMs, the algorithm can compensate the impact of inaccurate prediction and workload fluctuation and guarantee the applications QoS. The simulation results show that the proposed method in this paper can reduce the energy consumption of servers by 45–53% with QoS guarantee when the prediction relative error is 20%, which can provide a good balance between energy saving and application QoS.

This work is supported by The Natural Key Research and Development Program of China(2017YFB1010001).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Energy 101: Energy Efficient Data Centers. https://www.energy.gov/eere/videos/energy-101-energy-efficient-data-centers

  2. Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Futur. Gener. Comput. Syst. 28(5), 755–768 (2012)

    Article  Google Scholar 

  3. Bui, D.M., Yoon, Y., Huh, E.N., Jun, S., Lee, S.: Energy efficiency for cloud computing system based on predictive optimization. J. Parallel Distrib. Comput. 102, 103–114 (2017)

    Article  Google Scholar 

  4. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility. Futur. Gener. Comput. Syst. 25(6), 599–616 (2009)

    Article  Google Scholar 

  5. Chase, J.S., Anderson, D.C., Thakar, P.N., Vahdat, A.M., Doyle, R.P.: Managing energy and server resources in hosting centers. ACM SIGOPS Oper. Syst. Rev. 35(5), 103–116 (2001)

    Article  Google Scholar 

  6. Gary, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the Theory of NP-Completeness (1979)

    Google Scholar 

  7. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  8. Iqbal, W., Berral, J.L., Carrera, D., et al.: Adaptive sliding windows for improved estimation of data center resource utilization. Futur. Gener. Comput. Syst. 104, 212–224 (2020)

    Article  Google Scholar 

  9. Li, H., Zhu, G., Cui, C., Tang, H., Dou, Y., He, C.: Energy-efficient migration and consolidation algorithm of virtual machines in data centers for cloud computing. Computing 98(3), 303–317 (2015). https://doi.org/10.1007/s00607-015-0467-4

    Article  MathSciNet  MATH  Google Scholar 

  10. Liu, N., et al.: A hierarchical framework of cloud resource allocation and power management using deep reinforcement learning. In: 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), pp. 372–382. IEEE (2017)

    Google Scholar 

  11. Mahdhi, T., Mezni, H.: A prediction-based VM consolidation approach in IaaS cloud data centers. J. Syst. Softw. 146, 263–285 (2018)

    Article  Google Scholar 

  12. Mohiuddin, I., Almogren, A.: Workload aware VM consolidation method in edge/cloud computing for IoT applications. J. Parallel Distrib. Comput. 123, 204–214 (2019)

    Article  Google Scholar 

  13. Najm, M., Tamarapalli, V.: VM migration for profit maximization in federated cloud data centers. In: 2020 International Conference on COMmunication Systems & NETworkS (COMSNETS), pp. 882–884. IEEE (2020)

    Google Scholar 

  14. Nathuji, R., Schwan, K.: VirtualPower: coordinated power management in virtualized enterprise systems. ACM SIGOPS Oper. Syst. Rev. 41(6), 265–278 (2007)

    Article  Google Scholar 

  15. Qiu, Y., Jiang, C., Wang, Y., Ou, D., Li, Y., Wan, J.: Energy aware virtual machine scheduling in data centers. Energies 12(4), 646 (2019)

    Google Scholar 

  16. Rajamani, K., Lefurgy, C.: On evaluating request-distribution schemes for saving energy in server clusters. In: 2003 IEEE International Symposium on Performance Analysis of Systems and Software, ISPASS 2003, pp. 111–122. IEEE (2003)

    Google Scholar 

  17. Sha, J., Ebadi, A.G., Mavaluru, D., Alshehri, M., Alfarraj, O., Rajabion, L.: A method for virtual machine migration in cloud computing using a collective behavior-based metaheuristics algorithm. Concurrency Comput. Pract. Exp. 32(2), e5441 (2020)

    Article  Google Scholar 

  18. Shehabi, A., et al.: United states data center energy usage report. Technical report, Lawrence Berkeley National Lab. (LBNL), Berkeley, CA, United States (2016)

    Google Scholar 

  19. Sîrbu, A., Babaoglu, O.: A data-driven approach to modeling power consumption for a hybrid supercomputer. Concurrency Comput. Pract. Exp. 30(9), e4410 (2018)

    Article  Google Scholar 

  20. Varia, J.: Best practices in architecting cloud applications in the AWS cloud. In: Cloud Computing: Principles and Paradigms, vol. 18, pp. 459–490. Wiley Online Library (2011)

    Google Scholar 

  21. Xiong, Y., Zhang, Y., Chen, X., Wu, M.: Research of energy consumption optimization methods for cloud video surveillance system. J. Softw. 26(03), 680–698 (2015)

    Google Scholar 

  22. Ye, K., Wu, C., Jiang, X., He, Q.: Power management of virtualized cloud computing platfrom. Chin. J. Comput. 35(06), 1262–1285 (2012)

    Article  Google Scholar 

  23. Zhang, S., Qian, Z., Luo, Z., Wu, J., Lu, S.: Burstiness-aware resource reservation for server consolidation in computing clouds. IEEE Trans. Parallel Distrib. Syst. 27(4), 964–977 (2015)

    Article  Google Scholar 

  24. Zhou, Q., et al.: Energy efficient algorithms based on VM consolidation for cloud computing: comparisons and evaluations. arXiv preprint arXiv:2002.04860 (2020)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Longchuan Yan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yan, L., Liu, W., Zhou, B., Jiang, C., Li, R., Hu, S. (2022). Workload Prediction and VM Clustering Based Server Energy Optimization in Enterprise Cloud Data Center. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13157. Springer, Cham. https://doi.org/10.1007/978-3-030-95391-1_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-95391-1_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-95390-4

  • Online ISBN: 978-3-030-95391-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics