Abstract
As more and more memory-intensive applications are moved into the cloud, data center operators face the challenge of providing sufficient main memory resources while achieving high resource utilization. Solutions to overcome the unsatisfying performance degradation of traditional on-demand paging include memory disaggregation that allows applications to access remote memory or compressing memory pages in local DRAM; however, the former’s extended failure domain and the latter’s low efficacy limit their broad applicability. This paper presents RapidSwap, a hierarchical far memory manager that exploits the wide availability of phase-change memory (Intel Optane memory) in data centers to achieve quasi-DRAM performance at a significantly lower total cost of ownership (TCO). RapidSwap migrates infrequently accessed data to slower and cheaper devices in a hierarchy of storage devices by tracking applications’ memory accesses. Evaluated with several real-world cloud benchmarks, RapidSwap achieves a reduction of 20% in operating cost at minimal performance degradation and is 30% more cost-effective than pure DRAM solutions. The results demonstrate that proper management of new memory technologies can yield significant TCO savings in cloud data centers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cooper, B.F., Silberstein, A., Tam, E., Ramakrishnan, R., Sears, R.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC 2010, pp. 143–154. Association for Computing Machinery, New York (2010). https://doi.org/10.1145/1807128.1807152
Denning, P.J.: Thrashing: its causes and prevention. In: Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, Part I, AFIPS 1968 (Fall, part I), pp. 915–922. Association for Computing Machinery, New York (1968). https://doi.org/10.1145/1476589.1476705
Douglis, F.: The compression cache: using on-line compression to extend physical memory. In: USENIX Winter 1993 Conference (USENIX Winter 1993 Conference). USENIX Association, San Diego, January 1993. https://www.usenix.org/conference/usenix-winter-1993-conference/compression-cache-using-line-compression-extend-physical
EC2 On-Demand Instance Pricing - Amazon Web Services. https://aws.amazon.com/ko/ec2/pricing/on-demand/
Amazon EC2 high memory instance types. https://aws.amazon.com/ec2/instance-types/
SAP HANA Planning Guide \(|\) Google Cloud. https://cloud.google.com/solutions/sap/do cs/sap-hana-planning-guide
Harel, S., Radinsky, K.: Accelerating prototype-based drug discovery using conditional diversity networks. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, pp. 331–339. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3219819.3219882
Herodotou, H., Kakoulli, E.: Automating distributed tiered storage management in cluster computing. Proc. VLDB Endow. 13(1), 43–56 (2019). https://doi.org/10.14778/3357377.3357381
Why is the Intel Optane persistent memory in memory mode. https://www.intel.com/content/www/us/en/support/articles/000055895/memory-and-storage/intel-optane-persistent-memory.html
Intel NMB1XXD128GPSU4 Intel Optane 200 128GB DDR-T Persistent Memory Module. https://www.itosolutions.net/Intel-Optane-200-128GB-DDR-T-Persistent-Memory-p/nmb1xxd128gpsu4.htm
Intel Optane SSD 905P Series. https://www.intel.com/content/www/us/en/prod ucts/memory-storage/solid-state-drives/consumer-ssds/optane-ssd-9-series/optane-ssd-905p-series.html
Intel Optane 905P 1.50 Tb Solid State Drive. https://www.newegg.com/intel-optane-ssd-905p-series-1-5tb/p/0D9-002V-003X1
Jo, C., Kim, H., Egger, B.: Instant virtual machine live migration. In: Economics of Grids, Clouds, Systems, and Services, GECON 2020, Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63058-4_14
Jo, C., Kim, H., Geng, H., Egger, B.: RackMem: a tailored caching layer for rack scale computing. In: Proceedings of the ACM International Conference on Parallel Architectures and Compilation Techniques, PACT 2020, pp. 467–480. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3410463.3414643
Kilburn, T., Edwards, D.B.G., Lanigan, M.J., Sumner, F.H.: One-level storage system. IRE Trans. Electr. Comput. EC-11(2), 223–235 (1962). https://doi.org/10.1109/TEC.1962.5219356
Lagar-Cavilla, A., et al.: Software-defined far memory in warehouse-scale computers. In: Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2019, pp. 317–330. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3297858.3304053
Lee, Y., Maruf, H.A., Chowdhury, M., Shin, K.G.: Mitigating the performance-efficiency tradeoff in resilient memory disaggregation. CoRR abs/1910.09727 (2019), http://arxiv.org/abs/1910.09727
Lin, S.C., et al.: The architectural implications of autonomous driving: constraints and acceleration. In: Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems, ASPLOS 2018, pp. 751–766. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3173162.3173191
Linux Virtual Machines \(|\) Microsoft Azure. https://azure.microsoft.com/en-us/pricing/details/virtual-machines/linux/
Samsung M386A8K40BM1-CPB 64GB DDR4-2133 4Rx4 LP ECC LRDIMM Server Memory. https://www.amazon.com/Samsung-M386A8K40BM1-CPB-DDR4-2133-LRDIMM-Server/dp/B017A8FJEG
Shi, W., et al.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: CVPR, pp. 1874–1883 (2016). https://doi.org/10.1109/CVPR.2016.207
Wang, Z., et al.: Craft: an erasure-coding-supported version of raft for reducing storage cost and network cost. In: 18th USENIX Conference on File and Storage Technologies (FAST 2020), pp. 297–308. USENIX Association, Santa Clara, February 2020. https://www.usenix.org/conference/fast20/presentation/wang-zizhong
Zaharia, M., Xin, R.S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M.J., Ghodsi, A., Gonzalez, J., Shenker, S., Stoica, I.: Apache spark: a unified engine for big data processing. Commun. ACM 59(11), 56–65 (2016). https://doi.org/10.1145/2934664
zswap - The Linux Kernel documentation. https://www.kernel.org/doc/html/latest/v m/zswap.html
Acknowledgments
We thank our shepherd Carl Waldspurger and the anonymous reviewers for their helpful feedback and guidance. This work was supported by the Korean government (MSIT) through the National Research Foundation by grants 0536-20210093 and 21A20151113068 (BK21 Plus for Pioneers in Innovative Computing - Dept. of Computer Science and Engineering, SNU). ICT at Seoul National University provided research facilities for this study.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kim, H., Jo, C., Altmann, J., Egger, B. (2021). RapidSwap: a Hierarchical Far Memory. In: Tserpes, K., et al. Economics of Grids, Clouds, Systems, and Services. GECON 2021. Lecture Notes in Computer Science(), vol 13072. Springer, Cham. https://doi.org/10.1007/978-3-030-92916-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-92916-9_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92915-2
Online ISBN: 978-3-030-92916-9
eBook Packages: Computer ScienceComputer Science (R0)