Abstract
High performance computing (HPC) systems utilize parallel file systems that are striped over large number of disks to address the I/O performance requirement of data intensive applications. These large number of disks are typically configured into RAID groups for resiliency. Such arrangements of on-line disk storage systems constitutes one of the major consumers of power in HPC centers. Many disk power management (DPM) schemes have been suggested where by the power consumed by these disks is reduced by spinning them down after they experience long idle periods. Spinning the disks down and up results in additional energy and response time costs. For that reason, DPM schemes are effective only if the disks experience relatively long idle periods and the scheme does not introduce a severe response time penalty. In this paper we focus on RAID storage systems where by, depending on the RAID level, a group of disks are formed into RAID units. We introduce a dynamic block exchange algorithm which switches data between such units based on the observed workload such that frequently accessed blocks end up residing on a few “hot” units thus allowing the majority of RAID groups to experience longer idle periods. We validated the effectiveness of the algorithm with several real-life and synthetic traces showing power savings of up to 50% with very small response time penalties.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Harizopoulos, S., Shah, J.M.M.A., Ranganathan, P.: The new holy grail of data management systems research. In: CIDR 2009: Proc. of the 4th Biennial Conf. on Innovative Data Syst. Research. ACM, New York (2009)
Deskstar Hard Drives: http://www.hitachigst.com/portal/site/en/products/deskstar/
SSD: Solid State Drives From Toshiba, http://www.toshiba.com/taec/catalog
Narayanan, D., Donnelly, A., Rowstron, A.: Write off-loading: Practical power management for enterprise storage. In: Proc. 6th USENIX Conf. on File and Storage Technologies (FAST 2008), San Jose, California, pp. 253–267 (2008)
Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., Franke, H.: Reducing disk power consumption in servers with drpm. Computer 36(12), 59–66 (2003)
Seagate: Seagate Barracuda 7200.10 Serial ATA Product Manual. Seagate Technology, Scotts Valley, CA (December 2007)
Colarelli, D., Grunwald, D.: Massive arrays of idle disks for storage archives. In: Supercomputing 2002: Proc. ACM/IEEE Conference on Supercomputing, pp. 1–11. IEEE Computer Society Press, Los Alamitos (2002)
Weddle, C., Oldham, M., Qian, J., Wang, A.: PARAID: A gear shifting power-aware RAID. ACM Trans. on Storage (TOS) 3(3), 28–26 (2007)
Storer, M.W., Greenan, K.M., Miller, E.L.: Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage. In: Proc. 6th USENIX Conf. on File and Storage Technologies (FAST 2008), San Jose, California, February 2008, pp. 1–16 (2008)
Xie, T.: SEA: a striping-based energy-aware strategy for data placement in RAID-structured storage system. IEEE Transactions on Computers 57(6), 748–769 (2008)
Irani, S., Singh, G., Shukla, S.K., Gupta, R.K.: An overview of the competitive and adversarial approaches to designing dynamic power management strategies. IEEE Trans. VLSI Syst. 13(12), 1349–1361 (2005)
SimPy: SimPy Simulation Package in Python, http://simpy.sourceforge.net/
Wang, A.A., Kuenning, G., Reiher, P., Popek, G.: The conquest file system: Better performance through a disk/persistent-ram hybrid design. ACM Trans. on Storage (TOS) 2(3), 309–348 (2006)
Narayanan, D., Thereska, E., Donnelly, A., Elnikety, S., Rowstron, A.: Migrating server storage to ssds: analysis of tradeoffs. In: EuroSys 2009: Proceedings of the 4th ACM European conference on Computer systems, pp. 145–158. ACM, New York (2009)
Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., Wilkes, J.: Hibernator: Helping disk arrays sleep through the winter. In: SOSP 2005: Proc. 20th ACM Symp. on Operating Syst., pp. 177–190. ACM Press, New York (2005)
Pinheiro, E., Bianchini, R.: Energy conservation techniques for disk array-based servers. In: Proc. Int’l. Conf. on Supercomputing (ICS 2004), Saint-Malo, France, June 26 (2004)
Bhadkamkar, M., Guerra, J., Useche, L., Burnett, S., Liptak, J., Rangaswami, R.: BORG: self-adaptive file reallocation on hybrid disk arrays. In: 7th USENIX Conference on File and Storage Technologies (FAST 2009), February 2009, pp. 183–196. USENIX (2009)
Xie, T., Sun, Y.: PEARL: performance, energy, and reliability balanced dynamic data redistribution for next generation disk arrays. In: IEEE Int’l. Symp. Modeling, Analysis and Simulation of Computers and Telecommunication Systems, MASCOTS 2008, September 2008, pp. 1–8. IEEE, Los Alamitos (2008)
Zhu, Q., David, F.M., Devaraj, C.F., Li, Z., Zhou, Y., Cao, P.: Reducing energy consumption of disk storage using power-aware cache management. In: HPCA 2004: Proc. of the 10th Int’l. Symp. on High Perform. Comp. Arch., Washington, DC, USA, p. 118. IEEE Computer Society, Los Alamitos (2004)
Zhu, Q., Zhou, Y.: Power-aware storage cache management. IEEE Trans. Comput. 54(5), 587–602 (2005)
Levels, N.R.: http://www.absoluteastronomy.com/topics/nested_raid_levels
Otoo, E.J., Rotem, D., Tsao, S.C.: Energy smart management of scientific data. In: 21st Int’l. Conf. on Sc. and Stat. Database Mgmnt., New Orleans, Louisiana, USA (June 2009)
UMassTraceRepository: http://traces.cs.umass.edu/index.php/storage/storage
Zedlewski, J., Sobti, S., Garg, N., Zheng, F., Krishnamurthy, A., Wang, R.: Modeling hard-disk power consumption. In: FAST 2003: Proc. 2nd USENIX Conf. on File and Storage Tech., Berkeley, CA, USA, pp. 217–230. USENIX Association (2003)
Cunha, C., Bestavros, A., Crovella, M.: Characteristics of www client-based traces. Technical report, Boston University, Boston, MA, USA (1995)
Otoo, E.J., Rotem, D., Tsao, S.C.: Workload-adaptive management of energy-smart disk storage systems. In: IASDS 2009: Workshop on Interfaces and Architectures for Scientific Data Storage, New Orleans, Louisiana, USA (September 2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Otoo, E., Rotem, D., Tsao, SC. (2010). Dynamic Data Reorganization for Energy Savings in Disk Storage Systems. In: Gertz, M., Ludäscher, B. (eds) Scientific and Statistical Database Management. SSDBM 2010. Lecture Notes in Computer Science, vol 6187. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13818-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-13818-8_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13817-1
Online ISBN: 978-3-642-13818-8
eBook Packages: Computer ScienceComputer Science (R0)