Abstract
Multi-core comes to be the mainstream of processor techniques. The data-intensive OLAP relies on inexpensive disks as massive data storage device, so the enhanced processing power oppose to I/O bottleneck in big data OLAP applications becomes more critical because the latency gap between I/O and multi-core gets even larger. In this paper, we focus on the disk resident OLAP with large dataset, exploiting the power of multi-core processing under I/O bottleneck. We propose optimizations for schema-aware storage layout, parallel accessing and I/O latency aware concurrent processing. On the one hand I/O bottleneck should be conquered to reduce latency for multi-core processing, on the other hand we can make good use of I/O latency for heavy concurrent query workload with multi-core power. We design experiments to exploit parallel and concurrent processing power for multi-core with DDTA-OLAP engine which minimizes the star-join cost by directly dimension tuple accessing technique. The experimental results show that we can achieve maximal speedup ratio of 103 for multi-core concurrent query processing in DRDB scenario.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ozmen, O., Salem, K., Schindler, J., Daniel, S.: Workload-aware storage layout for database systems. In: SIGMOD Conference 2010, pp. 939–950 (2010)
MacNicol, R., French, B.: Sybase IQ Multiplex -Designed for analytics. In: Proceedings of VLDB (2004)
Stonebraker, M., Abadi, D.J., Batkin, A., Chen, X., Cherniack, M., Ferreira, M., Lau, E., Lin, A., Madden, S., O’Neil, E.J., O’Neil, P.E., Rasin, A., Tran, N., Zdonik, S.B.: C-Store: A Column-oriented DBMS. In: Proceedings of VLDB, Trondheim, Norway, pp. 553–564 (2005)
Abadi, D.J., Madden, S.R., Hachem, N.: Column-Stores vs. Row-Stores: How Different Are They Really? In: Proceeding of SIGMOD, Vancouvrer, BC, Canada (2008)
Zukowski, M., Nes, N., Boncz, P.A.: DSM vs. NSM: CPU performance tradeoffs in block-oriented query processing. In: DaMoN 2008, pp. 47–54 (2008)
Boncz, P.A., Mangegold, S., Kersten, M.L.: Database architecture optimized for the new bottleneck: Memory access. In: VLDB, pp. 266–277 (1999)
Ailamaki, DeWitt, D.J., Hill, M.D.: Data page layouts for relational databases on deep memory hierarchies. The VLDB Journal 11(3), 198–215 (2002)
Bruno, N.: Teaching an Old Elephant New Tricks. In: CIDR 2009, Asilomar, California, USA (2009)
O’Neil, P., O’Neil, B., Chen, X.: The Star Schema Benchmark (SSB), http://www.cs.umb.edu/~poneil/StarSchemaB.PDF
Zukowski, M., Nes, N., Boncz, P.A.: DSM vs. NSM: CPU performance tradeoffs in block-oriented query processing. In: DaMoN 2008, pp. 47–54 (2008)
Fernandez, P.M.: Red Brick warehouse: A read-mostly RDBMS for open SMP platforms. In: ACM SIGMOD Intl. Conf. on Management of Data (1994)
Zukowski, M., Héman, S., Nes, N., Boncz, P.: Cooperative scans: dynamic bandwidth sharing in a DBMS. In: Intl. Conf. on Very Large Data Bases (2007)
Arumugam, S., Dobra, A., Jermaine, C.M., Pansare, N., Perez, L.L.: The DataPath system: a data-centric analytic processing engine for large data warehouses. In: SIGMOD Conference 2010, pp. 519–530 (2010)
Candea, G., Polyzotis, N., Vingralek, R.: A scalable, Predictable Join Operator for Highly Concurrent Data Warehouse. In: VLDB 2009, pp. 277–288 (2009)
SAP NetWeaver: A Complete Platform for Large-Scale Business Intelligence. WinterCorporation White Paper (May 2005)
Zhang, Y., Hu, W., Wang, S.: MOSS-DB: A Hardware-Aware OLAP Database. In: Chen, L., Tang, C., Yang, J., Gao, Y. (eds.) WAIM 2010. LNCS, vol. 6184, pp. 582–594. Springer, Heidelberg (2010)
Harizopoulos, S., Ailamaki, A.: StagedDB: Designing Database Servers for Modern Hardware. IEEE Data Eng. Bull. 28(2), 11–16 (2005)
Johnson, R., Raman, V., Sidle, R., Swart, G.: Row-wise parallel predicate evaluation. In: Proceedings of the 32nd International Conference on Very Large Data Bases, Auckland, New Zealand (2008); VLDB Endowment 1(1), 622–634
Binnig, C., Hildenbrand, S., Färber, F.: Dictionary-based order-preserving string compression for main memory column stores. In: SIGMOD Conference 2009, pp. 283–296 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Jiao, M., Wang, Z., Wang, S., Zhou, X. (2011). Multi-core vs. I/O Wall: The Approaches to Conquer and Cooperate. In: Wang, H., Li, S., Oyama, S., Hu, X., Qian, T. (eds) Web-Age Information Management. WAIM 2011. Lecture Notes in Computer Science, vol 6897. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23535-1_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-23535-1_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23534-4
Online ISBN: 978-3-642-23535-1
eBook Packages: Computer ScienceComputer Science (R0)