Abstract
Data replication is a well known technique used to reduce accesses latency, improve availability, and performance in a distributed computing environment. An asynchronous replication is a commonly agreed solution for the consistency of replicas problem. Update propagation using a classical propagation schema called the radial method suffers from high overhead of the master replica while line method suffers from high delay time. This paper presents a new asynchronous replication protocol called Update Propagation Grid (UPG) which especially for a wide area distributed Data Grid. Updates reach other replicas using a propagation technique based on nodes organized into a logical structure network that enables the technique to scale well for thousands of replicas. Restructuring operation is provided to build and reconfigure the UPG dynamically. An analytical model is developed; communication cost, average load balance, and average delay time have been analyzed. The technique achieves load balancing and minimizes the delay for file replication in Data Grid.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chervenak, I., Foster, C., Kesselman, C., Salisbury, C., Tuecke, S.: The data grid: Towards architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 23, 187–200 (2001)
Allcock, J., Bester, J., Bresnahan, A.L., Chervenak, I., Foster, C., Kesselman, S., Meder, V., Nefedova, D., Quesnal, Tuecke, S.: Data management and transfer in high performance computational grid environments. Parallel Computing Journal 28(3), 749–771 (2002)
Gray, J., et al.: The Dangers of Replication and a Solution. In: Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, pp. 173–182 (1996)
Chervenak, A., et al.: Giggle: A Framework for Constructing Scalable Replica Location Services. In: Proc. Of SC 2002 (2002)
Samar, H S.: Grid Data Management Pilot (GDMP): A Tool for Wide Area Replication. Applied Informatics (AI) (2001)
Cameron, J., Casey, L., Guy, P., Kunszt, S., Lemaitre, G., McCance, H., Stockinger, K., Stockinger, G., Andronico, W., Bell, I., Ben-Akiva, D., Bosio, R., Chytracek, A., Domenici, F., Donno, W., Hoschek, E., Laure, L., Lucio, P., Millar, L., Salconi, B., Segal, M.S.: Replica Management Services in the European Data Grid ProjectUK. e-Science All Hands Conference, Nottingham (September 2004)
Bosio, Bell, W.H., Cameron, D., McCance, G., Millar, A.P., et al.: EU Data Grid Data Management Services, UK e-Science All Hands Conference, Nottingham (September 2003)
Lamehamedi, H., Szymanski, B.: Decentralized Data Management Framework for Data Grids. Future eneration Computer Systems 23(1), 109–115 (2007)
Guy, L., Kunszt, P., Laure, E., Stockinger, H., Stockinger, K.: Replica Management in Data Grids. Technical Report, GGF5 Working Draft, Edinburgh Scotland (July 2002)
Dullmann, W.H., Jaen-Martinez, J., Segal, B., Stockinger, H., Stockinger, K., Samar, A.: Models for Replica Synchronisation and Consistency in a Data Grid. hpdc. In: 10th IEEE International Symposium on High Performance Distributed Computing (HPDC-10 ’01), San Francisco, CA, USA, August 7-9, 2001, p. 67. IEEE Computer Society Press, Los Alamitos (2001)
Venugopal, S., Buyya, R., Ramamohanarao, K.: A Taxonomy of Data Grids for Distributed Data Sharing. Management and Processing. In: ACM Computing Surveys, vol. 38(1), pp. 1–53. ACM Press, New York, USA (2006)
Domenici, A., Donno, F., Pucciani, G., Stockinger, H., Stockinger, K.: Replica Consistency in a Data Grid, Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 534(1-2), 24–28 (2004)
No, J., Park, C., Park, S.: Data Replication Techniques for Data-Intensive Applications. In: International Conference on Computational Science. vol. 4, pp. 1063–1070 (2006)
Chang, R., Chang, J.: Adaptable Replica Consistency Service for Data Grids. In: Proceedings of the Third International Conference on Information Technology: New Generations (ITNG’06) (2006)
Sun, Y., Xu, Z.: Grid Replication Coherence Protocol. ipdps. In: 18th International Parallel and Distributed Processing Symposium (IPDPS’04) - Workshop. vol. 13, p. 232b (2004)
Domenici, A., Donno, F., Pucciani, G., Stockinger, H.: Relaxed Data Consistency with CONStanza. In: CCGRID 2006, pp. 425–429
Wang, Z., et al.: An efficient update propagation algorithm for P2P systems, Comput. Commun. (2006), doi:10.1016/j.comcom.2006.11.005.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Radi, M., Mamat, A., Deris, M.M., Ibrahim, H., Shamala, S. (2007). Update Propagation Technique for Data Grid. In: Gervasi, O., Gavrilova, M.L. (eds) Computational Science and Its Applications – ICCSA 2007. ICCSA 2007. Lecture Notes in Computer Science, vol 4707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74484-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-74484-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74482-5
Online ISBN: 978-3-540-74484-9
eBook Packages: Computer ScienceComputer Science (R0)