Skip to main content

Analysis of Workloads for Cloud Infrastructure Capacity Planning

  • Conference paper
  • First Online:
Data and Communication Networks

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 847))

Abstract

Workload analysis and characterization are the first steps toward effective cloud infrastructure capacity planning. Identifying workload patterns based on resource utilization not only enables informed decisions about mapping of current request to available capacity, but also serves as a meaningful indicator for future resource requirements. Of paramount concern is the optimal utilization of data center server capacity, i.e., the CPU, I/O, and memory. The compute capacity of modern servers can be further harnessed by optimal utilization of individual CPU cores. A precise CPU core-level usage monitoring and provisioning can lead to cumulative benefits of optimal CPU utilization, efficient VM placement, reduced VM migrations, and energy efficiency through lower power consumption. In this paper, we make a preliminary analysis of usage patterns of CPU cores in the case of CPU- and memory-intensive workloads on an experimental cloud setup in our laboratory. The aim is to make a comparative analysis of the utilization of individual CPU cores with that of aggregated CPU usage to explore the feasibility of incorporating a fine-grained usage detail for resource scheduling and VM provisioning. Initial experiments reveal observable differences between the utilization of individual CPU cores and that reported by aggregate CPU usage. Usage difference ranges from 1 to 29% below and between 4 and 20% above the aggregate. Incorporating such finer details can leverage the vast compute capacity of multicore servers and effective power usage.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Varia, J., Mathew, S.: Overview of Amazon Web Services. Amaz. Web Serv. (2014)

    Google Scholar 

  2. https://creative-brackets.com/business/interesting-facts-statistics-largest-data-centers-world/. Last Accessed 2018/06/10

  3. Feitelson, D.G.: Workload modeling for computer systems performance evaluation. Cambridge University Press, Cambridge (2015)

    Book  Google Scholar 

  4. Mahambre, S., Kulkarni, P., Bellur, U., Chafle, G., Deshpande, D.: Workload characterization for capacity planning and performance management in IaaS cloud. In: 2012 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), pp. 1–7 (2012)

    Google Scholar 

  5. Moreno, I.S., Garraghan, P., Townend, P., Xu, J.: Analysis, modeling and simulation of workload patterns in a large-scale utility cloud. IEEE Trans. Cloud Comput. 2, 208–221 (2014)

    Article  Google Scholar 

  6. Magalhães, D., Calheiros, R.N., Buyya, R., Gomes, D.G.: Workload modeling for resource usage analysis and simulation in cloud computing. Comput. Electr. Eng. 47, 69–81 (2015)

    Article  Google Scholar 

  7. Peng, J., Chen, J., Zhi, X., Qiu, M., Xie, X.: Research on application classification method in cloud computing environment. J. Supercomput. 73, 3488–3507 (2017)

    Article  Google Scholar 

  8. Zhang, Q., Zhani, M.F., Boutaba, R., Hellerstein, J.L.: Dynamic heterogeneity-aware resource provisioning in the cloud. IEEE Trans. Cloud Comput. 2, 14–28 (2014)

    Article  Google Scholar 

  9. Singh, S., Chana, I.: QRSF: QoS-aware resource scheduling framework in cloud computing. J. Supercomput. 71, 241–292 (2015)

    Article  Google Scholar 

  10. Orzechowski, P., Proficz, J., Krawczyk, H., Szymański, J.: Categorization of cloud workload types with clustering. In: Proceedings of the International Conference on Signal, Networks, Computing, and Systems, pp. 303–313 (2017)

    Google Scholar 

  11. Lozi, J.P., Lepers, B., Funston, J., Gaud, F., Quéma, V., Fedorova, A.: The Linux scheduler: a decade of wasted cores. In: Proceedings of the Eleventh European Conference on Computer Systems, p. 1 (2016)

    Google Scholar 

  12. Capacity Planning—Discipline for Data center decisions, https://www.teamquest.com/files/6814/2049/9759/tqeb01.pdf. Last Accessed 2018/06/10

  13. Sokol, A.W., Hogan, M.D.: NIST Cloud Computing Standards Roadmap (2013)

    Google Scholar 

  14. Calzarossa, M.C., Della Vedova, M.L., Massari, L., Petcu, D., Tabash, M.I.M., Tessera, D.: Workloads in the clouds. In: Principles of Performance and Reliability Modeling and Evaluation, pp. 525–550. Springer, Berlin (2016)

    Google Scholar 

  15. Vajda, A.: Programming many-core chips. Springer Science & Business Media, Berlin (2011)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eva Patel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Patel, E., Kushwaha, D.S. (2019). Analysis of Workloads for Cloud Infrastructure Capacity Planning. In: Jain, L., E. Balas, V., Johri, P. (eds) Data and Communication Networks. Advances in Intelligent Systems and Computing, vol 847. Springer, Singapore. https://doi.org/10.1007/978-981-13-2254-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2254-9_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2253-2

  • Online ISBN: 978-981-13-2254-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics