Skip to main content

Redundancy Maintenance and Garbage Collection Strategies in Peer-to-Peer Storage Systems

  • Conference paper
Stabilization, Safety, and Security of Distributed Systems (SSS 2009)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5873))

Included in the following conference series:

Abstract

Maintaining redundancy in P2P storage systems is essential for reliability guarantees. Numerous P2P storage system maintenance algorithms have been proposed in the last years, each supposedly improving upon the previous approaches. We perform a systematic comparative study of the various strategies taking also into account the influence of different garbage collection mechanisms, an issue not studied so far. Our experiments show that while some strategies generally perform better than some others, there is no universally best strategy, and their relative superiority depends on various other design choices as well as the specific evaluation criterion. Our results can be used by P2P storage systems designers to make prudent design decisions, and our exploration of the various evaluation metrics also provides a more comprehensive framework to compare algorithms for P2P storage systems. While there are numerous network simulators specifically developed even to simulate peer-to-peer networks, there existed no P2P storage simulators - a byproduct of this work is a generic modular P2P storage system simulator which we provide as open-source. Different redundancy, maintenance, placement, garbage-collection policies, churn scenarios can be easily integrated to the simulator to try out new schemes in future, and provides a common framework to compare (future) p2p storage systems designs - something which has not been possible so far.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kubiatowicz, J., Bindel, D., Chen, Y., Eaton, P., Geels, D., Gummadi, R., Rhea, S., Weatherspoon, H., Weimer, W., Wells, C., Zhao, B.: Oceanstore: An architecture for global-scale persistent storage. In: Proceedings of ACM ASPLOS. ACM, New York (2000)

    Google Scholar 

  2. Clarke, I., Miller, S.G., Sandberg, O., Wiley, B.: Protecting free expression online using Freenet. IEEE Internet (2002)

    Google Scholar 

  3. Dabek, F., Kaashoek, M.F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proceedings of the 18th ACM Symposium on Operating Systems Principles, SOSP 2001 (2001)

    Google Scholar 

  4. AG, C.: (2008), http://www.wuala.com/

  5. Bhagwan, R., Tati, K., Cheng, Y.C., Savage, S., Voelker, G.M.: Total recall: system support for automated availability management. In: Proceedings of the 1st Symposium on Networked Systems Design and Implementation (2004)

    Google Scholar 

  6. Haeberlen, A., Mislove, A., Druschel, P.: Glacier: highly durable, decentralized storage despite massive correlated failures. In: NSDI 2005: Proceedings of the 2nd Symposium on Networked Systems Design & Implementation (2005)

    Google Scholar 

  7. Inc., C.: (2007), http://www.cleversafe.org/dispersed-storage

  8. Datta, A., Aberer, K.: Internet-scale storage systems under churn – a study of the steady-state using markov models. In: Proceedings of the Sixth IEEE International Conference on Peer-to-Peer Computing, Washington, DC, USA (2006)

    Google Scholar 

  9. Andreas, E.S., Haeberlen, A., Dabek, F., gon Chun, B., Weatherspoon, H., Morris, R., Kaashoek, M.F., Kubiatowicz, J.: Proactive replication for data durability. In: Proceedings of the 5th Int’l Workshop on Peer-to-Peer Systems, IPTPS (2006)

    Google Scholar 

  10. Bhagwan, R., Savage, S., Voelker, G.: Understanding availability. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735. Springer, Heidelberg (2003)

    Google Scholar 

  11. Wu, D., Tian, Y., Ng, K.W., Datta, A.: Stochastic analysis of the interplay between object maintenance and churn. Elsevier Journal of Computer Communications, Special Issue on Foundations of Peer-to-Peer Computing (2008)

    Google Scholar 

  12. Rhea, S., Eaton, P., Geels, D., Weatherspoon, H., Zhao, B., Kubiatowicz, J.: Pond: The Oceanstore prototype. In: Proceedings of the USENIX Conference on File and Storage Technologies, FAST (2003)

    Google Scholar 

  13. Weatehrspoon, H., Chun, B.G., So, C., Kubiatowicz, J.D.: Long-term data maintenance: A quantitative approach. Technical Report UCB/CSD-05-1404, UC Berkeley (2005)

    Google Scholar 

  14. Williams, C., Huibonhoa, P., Holliday, J., Hospodor, A., Schwarz, T.: Redundancy management for p2p storage. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (2007)

    Google Scholar 

  15. Weatherspoon, H., Kubiatowicz, J.: Erasure coding vs. Replication: A quantitative comparison. In: Druschel, P., Kaashoek, M.F., Rowstron, A. (eds.) IPTPS 2001. LNCS, vol. 2429, p. 328. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  16. Guha, S., Daswani, N., Jain, R.: An Experimental Study of the Skype Peer-to-Peer VoIP System. In: Proceedings of The 5th IPTPS (2006)

    Google Scholar 

  17. Godfrey, B.: http://www.cs.berkeley.edu/~pbg/availability/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Liu, X., Datta, A. (2009). Redundancy Maintenance and Garbage Collection Strategies in Peer-to-Peer Storage Systems. In: Guerraoui, R., Petit, F. (eds) Stabilization, Safety, and Security of Distributed Systems. SSS 2009. Lecture Notes in Computer Science, vol 5873. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05118-0_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-05118-0_36

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-05117-3

  • Online ISBN: 978-3-642-05118-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics