Skip to main content
SpringerLink
Log in

Resource Management for Data Intensive Clouds Through Dynamic Federation: A Game Theoretic Approach

  • Chapter
  • First Online:
Handbook of Data Intensive Computing

Abstract

In recent years deploying data-intensive applications in the cloud are gaining a lot of momentum in both research and industrial communities. As the data rates and the processing demands of these applications vary over time, the on-demand cloud paradigm is becoming a good match for their needs. However, the prevalent commercial cloud providers (CPs), operating in isolation (i.e., proprietary in nature), may face resource over-provisioning, degraded performance, and service level agreement (SLA) violations to meet the storage, communication, and processing demands of data-intensive applications. In this chapter, we argue that data intensive cloud providers can form dynamic federation with other CPs to gain economies of scale and an enlargement of their virtual machine (VM) infrastructure capabilities to meet the requirements of data intensive applications. However, there is a need to develop dynamic resource management mechanism to model the economics of VM resource supplying in federating environment. So we also study a game-theoretic solution to this problem that ensures mutual benefits of all the participants in the federation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Amit, G., Xia, C.H.: Learning Curves and Stochastic Models for Pricing and Provisioning Cloud Computing Services. Service Science3, 99–109 (2011)

    Google Scholar 

  2. An, B., Lesser, V., Irwin, D., Zink, M.: Automated negotiation with decommitment for dynamic resource allocation in cloud computing. In: Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1, AAMAS ’10, pp. 981–988 (2010)

    Google Scholar 

  3. Antoniadis, P., Fdida, S., Friedman, T., Misra, V.: Federation of virtualized infrastructures: sharing the value of diversity. In: Proceedings of the 6th International COnference, Co-NEXT ’10, pp. 12:1–12:12. ACM (2010)

    Google Scholar 

  4. Ardagna, D., Panicucci, B., Passacantando, M.: A game theoretic formulation of the service provisioning problem in cloud systems. In: Proceedings of the 20th international conference on World wide web, WWW ’11, pp. 177–186 (2011)

    Google Scholar 

  5. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I., Zaharia, M.: Above the clouds: A berkeley view of cloud computing. Tech. Rep. UCB/EECS-2009-28, EECS Department, University of California, Berkeley (2009)

    Google Scholar 

  6. Bittman, T.: The evolution of the cloud computing market. Gartner Blog Network, http://blogs.gartner.com/thomasbittman/2008/11/03/theevolution-of-the-cloud-computing-market/ (November, 2008)

  7. Buyya, R., Ranjan, R., Calheiros, R.: Intercloud: Utility-oriented federation of cloud computing environments for scaling of application services. In: Algorithms and Architectures for Parallel Processing, Lecture Notes in Computer Science, vol. 6081, pp. 13–31 (2010)

    Google Scholar 

  8. Carroll, T.E., Grosu, D.: Formation of virtual organizations in grids: a game-theoretic approach. Concurr. Comput. : Pract. Exper.22, 1972–1989 (2010)

    Article  Google Scholar 

  9. Celesti, A., Tusa, F., Villari, M., Puliafito, A.: How to enhance cloud architectures to enable cross-federation. Cloud Computing, IEEE International Conference on 0, 337–345 (2010)

    Google Scholar 

  10. Celesti, A., Tusa, F., Villari, M., Puliafito, A.: Three-phase cross-cloud federation model: The cloud sso authentication. Advances in Future Internet, International Conference on0, 94–101 (2010)

    Google Scholar 

  11. Chiba, T., den Burger, M., Kielmann, T., Matsuoka, S.: Dynamic load-balanced multicast for data-intensive applications on clouds. In: Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pp. 5 –14 (2010)

    Google Scholar 

  12. Goiri, I., Guitart, J., Torres, J.: Characterizing cloud federation for enhancing providers’ profit. Cloud Computing, IEEE International Conference on 0, 123–130 (2010)

    Google Scholar 

  13. Gomes, E.R., Vo, Q.B., Kowalczyk, R.: Pure exchange markets for resource sharing in federated clouds. Concurrency and Computation: Practice and Experience pp. n/a–n/a (2010). 10.1002/cpe.1659. http://dx.doi.org/10.1002/cpe.1659

  14. Grossman, R.L., Gu, Y.: On the varieties of clouds for data intensive computing. IEEE Data Eng. Bull.32(1), 44–50 (2009)

    Google Scholar 

  15. He, L., Ioerger, T.R.: Forming resource-sharing coalitions: a distributed resource allocation mechanism for self-interested agents in computational grids. In: Proceedings of the 2005 ACM symposium on Applied computing, SAC ’05, pp. 84–91 (2005)

    Google Scholar 

  16. Irwin, D., Shenoy, P., Cecchet, E., Zink, M.: Resource management in data-intensive clouds: Opportunities and challenges. In: Local and Metropolitan Area Networks (LANMAN), 2010 17th IEEE Workshop on, pp. 1 –6 (2010). 10.1109/LANMAN.2010.5507156

    Google Scholar 

  17. Jalaparti, V., Nguyen, G.D., Gupta, I., Caesar, M.: Cloud Resource Allocation Games. Technical Report, University of Illinois, http://hdl.handle.net/2142/17427 (Dec, 2010)

  18. Khan, S.U., Ahmad, I.: Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation. In: Proceedings of the 20th international conference on Parallel and distributed processing, IPDPS’ 06, pp. 121–121 (2006)

    Google Scholar 

  19. Kolda, T.G., Lewis, R.M., Torczon, V.: Optimization by direct search: New perspectives on some classical and modern methods. SIAM Review 45, 385–482 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  20. Kumar, C., Altinkemer, K., De, P.: A mechanism for pricing and resource allocation in peer-to-peer networks. Electron. Commer. Rec. Appl.10, 26–37 (2011)

    Article  Google Scholar 

  21. Liu, H., Orban, D.: Gridbatch: Cloud computing for large-scale data-intensive batch applications. In: Cluster Computing and the Grid, 2008. CCGRID ’08. 8th IEEE International Symposium on, pp. 295 –305 (2008). 10.1109/CCGRID.2008.30

    Google Scholar 

  22. Middleton, A.M.: Data-intensive technologies for cloud computing. Chapter 5, Handbook of Cloud Computing (2010)

    Google Scholar 

  23. Rochwerger, B., Breitgand: The reservoir model and architecture for open federated cloud computing. IBM J. Res. Dev. 53(4), 535–545 (2009)

    Article  Google Scholar 

  24. Sakr, S., Liu, A., Batista, D., Alomari, M.: A survey of large scale data management approaches in cloud environments. Communications Surveys Tutorials, IEEEPP(99), 1–26 (2011). 10.1109/SURV.2011.032211.00087

    Google Scholar 

  25. Teng, F., Magouls, F.: A new game theoretical resource allocation algorithm for cloud computing. In: Advances in Grid and Pervasive Computing, Lecture Notes in Computer Science, vol. 6104, pp. 321–330. Springer Berlin / Heidelberg (2010)

    Google Scholar 

  26. Vaquero, L.M., Rodero-Merino, L., Caceres, J., Lindner, M.: A break in the clouds: towards a cloud definition. SIGCOMM Comput. Commun. Rev.39, 50–55 (2008). http://doi.acm.org/10.1145/1496091.1496100. http://doi.acm.org/10.1145/1496091.1496100

  27. Wei, G., V., V.A., Yao, Z., Xiong, N.: A game-theoretic method of fair resource allocation for cloud computing services. J. Supercomput. 54, 252–269 (2010)

    Google Scholar 

  28. Williams, A.: Top 5 cloud outages of the past two years: Lessons Learned. http://www.readwriteweb.com/cloud/2010/02/top-5-cloud-outages-of-the-pas.php (Feb, 2010)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Kyung Hee University, Global Campus, Seoul, South Korea

    Mohammad Mehedi Hassan & Eui-Nam Huh

Authors
  1. Mohammad Mehedi Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eui-Nam Huh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad Mehedi Hassan .

Editor information

Editors and Affiliations

  1. Dept. of Computer Science & Engineering, Florida Atlantic University, Boca Raton, 33431, Florida, USA

    Borko Furht

  2. LexisNexis, Boca Raton, 33487, Florida, USA

    Armando Escalante

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Hassan, M.M., Huh, EN. (2011). Resource Management for Data Intensive Clouds Through Dynamic Federation: A Game Theoretic Approach. In: Furht, B., Escalante, A. (eds) Handbook of Data Intensive Computing. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1415-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-1415-5_7

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-1414-8

  • Online ISBN: 978-1-4614-1415-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation