Skip to main content
SpringerLink
Log in

A Subscription Overlay Network for Large-Scale and Efficient File Parallel Downloading

  • Conference paper
  • First Online:
Collaboration and Technology (CRIWG 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9334))

Included in the following conference series:

  • 854 Accesses

Abstract

This paper presents a subscription-based overlay network that supports file parallel downloading for cloud collaboration. First, our system lets users to register to a central server and allows this server to incrementally build a topology graph containing the network connections among the subscribers. With this topology graph in place, we plan to address the challenges of minimizing network traffic and choosing the best set of nodes storing a chosen file for parallel downloading. When a subscriber wants to access a chosen file stored in the cloud, our system obtains for her a list of nodes having this file. Nodes in this list, are sorted considering both their network distance to the subscriber and their workloads. Second, selecting those top nodes, a bandwidth-aware parallel downloading technique is executed. Finally, our proposed system also features leveraging idling nodes for file downloading. More specifically, the subscribers who are on-line but not participating in downloading are recruited to reduce both network traffic and average latency.

This work was supported by the Universidad del Bio-Bio, grant no. GI 150115/EF.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. FileZilla Server. http://filezilla-project.org/download.php?type=server

  2. Ns-3. http://www.nsnam.org

  3. Al-Jaroodi, J., Mohamed, N.: Ddftp: dual-direction ftp. In: Proceedings of the International Symposium on Cluster, Cloud and Grid Computing, pp. 504–513 (2011)

    Google Scholar 

  4. Bernstein, D.J.: Pipeling. http://cr.yp.to/ftp/pipeling

  5. Byers, J.W., Luby, M., Mitzenmacher, M.: Accessing multiple mirror sites in parallel: using tornado codes to speed up downloads. In: Proceedings of IEEE International Conference on Computer Communications, pp. 275–283, 21–25 March 1999

    Google Scholar 

  6. Chang, R.S., Guob, M.H., Lina, H.C.: A multiple parallel download scheme with server throughput and client bandwidth considerations for data grids. Future Gener. Comput. Syst. 24(8), 798–805 (2008)

    Article  Google Scholar 

  7. Chen, H., Gong, Z., Huang, Z.: Parallel downloading algorithm for large-volume file distribution. In: Proceedings of the 6th International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 745–749, December 2005

    Google Scholar 

  8. Feldman, M., Lai, K., Stoica, I., Chuang, J.: Robust incentive techniques for peer-to-peer networks. In: Proceedings of the Conference on Electronic Commerce, pp. 102–111 (2004)

    Google Scholar 

  9. Funasaka, J., Nakawaki, N., Ishida, K., Amano, K.: A parallel downloading method of coping with variable bandwidth. In: Proceedings of the IEEE ICDCS Workshop on Assurance in Distributed Systems and Networks, pp. 14–19, 19–22 May 2003

    Google Scholar 

  10. Galdames, P., Zheng, Q., Cai, Y.: A subscription overlay network for large-scale and cost-efficient any source multicast. In: Proceedings of the IEEE on Performance Computing and Communications Conference, pp. 1–8, 17–19 November 2011

    Google Scholar 

  11. Gkantsidis, C., Ammar, M., Zegura, E.: On the effect of large-scale deployment of parallel downloading. In: IEEE Workshop on Internet Applications, pp. 79–90, 23–24 June 2003

    Google Scholar 

  12. Kolodner, E.K., Tal, S., Kyriazis, D., et al.: A cloud environment for data-intensive storage service. In: Proceedings of the International Conference on Cloud Computing Technology and Science, pp. 357–366, 29 November - 1 December 2011

    Google Scholar 

  13. Koo, M., Rosenberg, C., Dongyan, X.: Analysis of parallel downloading for large file distribution. In: Workshop on Future Trends of Distributed Computing Systems, pp. 128–135, 28–30 May 2003

    Google Scholar 

  14. Koo, S., Lee, C., Kannan, K.: A genetic-algorithm-based neighbor-selection strategy for hybrid peer-to-peer networks. In: Proceedings of the International Conference on Computer Communications and Networks, pp. 469–474 (2004)

    Google Scholar 

  15. Kurose, F., Ross, K.: Computer Networking: A Top-Down Approach, 6th edn. Pearson, US (2012)

    Google Scholar 

  16. Kuznetsov, A.: Tracepath. http://linux.die.net/man/8/tracepath

  17. Lai, K., Feldman, M., Stoica, I., Chuang, J.: Incentives for cooperation in peer-to-peer networks. In: Workshop on Economics of Peer-to-Peer Systems (2003)

    Google Scholar 

  18. Li, J.: Erasure resilient codes in peer-to-peer storage cloud. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, 14–19 May 2006

    Google Scholar 

  19. Lv, Q., Cao, P., Cohen, E., Li, K., Shenker, S.: Search and replication in unstructured peer-to-peer networks. In: Proceedings of ACM International Conference on Supercomputing, New York City, NY, U.S.A, 22–26 June 2002

    Google Scholar 

  20. Ning, K., Zhou, Z., Zhang, L.J.: Leverage personal cloud storage services to provide shared storage for team collaboration. In: Proceedings of the International Conference on Services Computing, pp. 613–620, 27 June - 2 July 2014

    Google Scholar 

  21. Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content-addressable network. In: Proceedings of ACM SIGCOMM, pp. 161–172, San Diego, CA, U.S.A (2001)

    Google Scholar 

  22. Rodriguez, P., Kirpal, A., Biersack, E.: Parallel-access for mirror sites in the internet. In: Proceedings of the IEEE on Computer Communications, pp. 864–873 (2000)

    Google Scholar 

  23. Sohail, S., Jha, S., Kanhere, S., Chun, T.: Qos driven parallelization of resources to reduce file download delay. IEEE Trans. Parallel Distrib. Syst. 17, 12 (2006)

    Google Scholar 

  24. Stoica, I., Morris, R., Karger, D., Kaashock, M., Balakrishman, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. In: Proceedings of ACM SIGCOMM, pp. 149–160. San Diego, CA, U.S.A (2001)

    Google Scholar 

  25. Zhang, Z.L.: Feel free to cache: towards an open cdn architecture for cloud-based content distribution. In: Proceedings of the International Conference on Collaboration Technologies and Systems, pp. 488–490, 19–23 May 2014

    Google Scholar 

  26. Zinner, T., Tutschku, K., Nakao, A., Tran-Gia, P.: Using concurrent multipath transmission for transport virtualization: analyzing path selection. In: International Teletraffic Congress, pp. 1–7. IEEE (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Departamento de Sistemas de Informacion, Universidad del Bio-Bio, Av. Ignacio Collao 1202, Concepcion, Chile

    Patricio Galdames, Claudio Gutierrez-Soto & Cristopher Barrientos

Authors
  1. Patricio Galdames
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Claudio Gutierrez-Soto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cristopher Barrientos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Patricio Galdames .

Editor information

Editors and Affiliations

  1. Universidad de Chile, Santiago, Chile

    Nelson Baloian

  2. SYNOPSIS, Santa Clara, USA

    Yervant Zorian

  3. American University of Armenia, Yerevan, Armenia

    Perouz Taslakian

  4. Yerevan State University, Yerevan, Armenia

    Samvel Shoukouryan

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Galdames, P., Gutierrez-Soto, C., Barrientos, C. (2015). A Subscription Overlay Network for Large-Scale and Efficient File Parallel Downloading. In: Baloian, N., Zorian, Y., Taslakian, P., Shoukouryan, S. (eds) Collaboration and Technology. CRIWG 2015. Lecture Notes in Computer Science(), vol 9334. Springer, Cham. https://doi.org/10.1007/978-3-319-22747-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22747-4_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22746-7

  • Online ISBN: 978-3-319-22747-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation