Abstract
Cloud basically deals with huge volumes of data and each cloud user stores and accesses gigabytes of data. Cloud applications that require very fast data access are emerging quite frequently. Hence it is of utmost importance to provide a high performance with reliability and efficiency. The Hadoop Distributed File System is one of the most widely used distributed file systems. Such cloud systems must provide efficient caching mechanisms in order to improve the speed of accessing the data. However due to inefficient access mechanisms of the Hadoop, the access latency is too high that it reduces the throughput of the system. An efficient pre-fetching technique in Hadoop improves the overall performance of the cloud system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tantisiriroj, W., Patil, S., Gibson, G.: Dataintensive file systems for internet services. Tech. Report CMU-PDL-08-114. Carnegie Mellon University (2008)
Soundararajan, G., Mihailescu, M., Amza, C.: Context-aware prefetching at the storage server. In: Proc. of the 2008 USENIX Annual Tech. Conf. (USENIX 2008), pp. 377–390. USENIX Association Press, Berkeley (2008)
Shriver, E., Small, C., Smith, K.A.: Why Does File System Prefetching Work? In: Proc. of the 1999 USENIX Annual Tech. Conf. (USENIX 1999), pp. 71–84. USENIX Association Press, Monterey (1999)
Dong, B., Zhong, X., Zheng, Q., Jian, L., Liu, J., Qiu, J., Li, Y.: Correlation Based File Prefetching Approach for Hadoop. In: 2nd IEEE International Conference on Cloud Computing Technology and Science, pp. 41–48 (2010)
Kantere, V., Dash, D., Francois, G., Kyriakopoulou, S., Ailamaki, A.: Optimal service pricing for a cloud cache. IEEE Transactions on Knowledge and Data Engineering (2011)
Wu, J., Ping, L., Ge, X., Wang, Y., Fu, J.: Cloud Storage as the Infrastructure of Cloud Computing. In: International Conference on Intelligent Computing and Cognitive Informatics (2010)
HDFS Architecture, http://hadoop.apache.org/common/docs/r0.20.2/hdfs_design.html
Jia, B., Wlodarczyk, T.W., Rong, C.: Performance Considerations of Data Acquisition in Hadoop System. In: 2nd IEEE International Conference on Cloud Computing Technology and Science, pp. 545–549 (2010)
Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The Hadoop Distributed File System. In: IEEE International Conference (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Balasubramaniyan, J., Ramachandran, S. (2012). An Intelligent Cloud System Adopting File Pre-fetching. In: Thilagam, P.S., Pais, A.R., Chandrasekaran, K., Balakrishnan, N. (eds) Advanced Computing, Networking and Security. ADCONS 2011. Lecture Notes in Computer Science, vol 7135. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29280-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-29280-4_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29279-8
Online ISBN: 978-3-642-29280-4
eBook Packages: Computer ScienceComputer Science (R0)