Abstract
In the context of the database query optimization on a parallel architecture, we focus here on the problem of dynamically mapping the tasks making up several SQL queries onto a shared-nothing parallel architecture. The main contribution of this paper lies in the proposal of an incremental parallelization strategy which carries out simultaneously both scheduling and mapping in co-operation with memory allocation in a dynamic multi-user context. The paper functionally describes in terms of components our dynamic PSA/MEGbased parallelization strategy in a multi-user context, as well as one of the two incremental memory allocation heuristics, called ModDeg, which are integrated into the MEG mapping method, and presents a sum-up of the performance evaluation of this heuristic.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bonneau, S., and al., “A Greedy Modifiable Mapping Heuristic of a SQL Query onto a Shared-Nothing Parallel Architecture”. Revue Calculateurs Parallèles, numéro spécial: “Bases de Données Parallèles et Distribuées”, Sept. 1997, Vol. 9, o 3, 285–304.
Bonneau, S., and al., “Database Program Mapping onto a Shared-Nothing Multiprocessor Architecture: Minimizing Communication Costs”, EuroPar’97, Passau, Germany, August 1997, LNCS No 1300, pp. 1154–1158.
Bonneau, S., and al., “Hybrid Simultaneous Scheduling and Mapping of SQL Multi-Query Parallelization”, Tech. Report, No. IRIT/99-15-R, Lab. IRIT, UPS, June 1999, 21 pages.
Brunie, L., and al., “Control Strategies for Complex Relational Query Processing in Shared-Nothing Systems”, ACM SIGMOD Records, Vol. 25, o 3, 1996, 34–39.
Brunie, L., and al., “Integration of Scheduling Heuristics into Parallel Relational Query Optimization”. Revue Calculateurs Parallèles, numéro spécial: “Bases de Données Parallèles et Distribuées”, Ed. Hermès, Vol. 9, No.3, Sep. 1997, 327–346.
Bouganim, L., and al. “Dynamic Load Balancing in Hierarchical Parallel Database Systems”, Proc. of the 23rd VLDB Conf., Bombay, August 1996, 436–447.
Chekuri, C., and al., “Scheduling Problem in Parallel Query Optimization”, Symposium in Principles of Database Systems PODS’95, 1995.
Chen, M.S., and al., “Scheduling and Processor Allocation for Parallel Execution of Multijoin Queries”, Proc. of the 8th Intl. Conf. Data Eng., Tempe, Arizona, 1992, 58–67.
Dewitt, D.J., and al., “Parallel Database Systems: The Future of High Performance Database Systems”, Communication of the ACM, Vol. 35, No 6, June 1992, 85–98.
Garofalakis, M.N. and al., “Parallel Query Scheduling and Optimization with Time-and Space-Shared Resources”, Proc. of the 23rd VLDB Conf., Athens, 1997, 296–305
Hameurlain, A. and al., “An Analytical Method to Allocate Processors in High Performance Parallel Execution of Recursive Queries”, Intl. Conf. DEXA’92, Valencia, 1992, 44–47
Hameurlain, A. and al., “A Cost Evaluator for Parallel Database Systems”, Intl. Conf. DEXA’95, London, 4-8 Sept. 1995, LNCS, No 978, 146–156
Hameurlain, A., and al., “Scheduling and Mapping for Parallel Execution of Extended SQL Queries”, 4th Intl. Conf. on Information and Knowledge Management, ACM Press, Baltimore, Maryland, 28 Nov.-2 Dec. 1995, 197–204.
Hasan, W., and al., “Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism”, Proc. of the 20th Intl. Conf. on VLDB, Santiago, Chile, Sept. 1994.
Hua, K.A., and al., “Handling Data Skew in Multiprocessor Database Computers Using Partition Tuning”, Proc. of the 17th Intl. Conf. on VLDB, Barcelona, Spain, 1991, 525–535.
Ioannidis, Y.E., and al., “On the Propagation of Errors in the Size of Join Results”, Proc. of the ACM SIGMOD Int’l. Conf. on Management of Data, Denver, 1991.
Jagadish, H.V., and al., “Optimal Histograms with Quality Guarantees”, Proc. of the 24th VLDB Conference, New-York, USA, 1998, 275–286.
Kabra, N., and al., “Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans”, ACM SIGMOD Intl. Conf. on Managementof Data, Seatle, June 1998, 106–117.
Lu, H., and al., “Dynamic and Load-Balanced Task-Oriented Database Query Processing in Parallel Systems”, Proc. 3rd Int’l Conf. Extending Data Base Technology, 1992, 357–372.
Mehta, M., and al., “Managing Intra-Operator Parallelism in Parallel Database Systems”, Proc. of the 21th Intl. Conf. on VLDB, Zurich, Sept. 1995, 382–394.
Mehta, M., and al., “Data Placement in Shared-Nothing Parallel Database Systems”, The VLDB Journal, 1997, No 6, 53–72.
Poosala, V., and al., “Estimation of Query-Result Distribution and its Application in Parallel-Join Load Balancing”, Proc. of the 23rd VLDB Conference, Bombay, India, 1996, 448–459.
Rahm, E., and al., “Dynamic Multi-Resource Load Balancing in Parallel Database Systems”, Proc. of the 21st VLDB Conference, Zurich, 1995, 395–406.
Schneider, D., and al., “Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines”, Proceedings of the 16th VLDB Conference, Brisbane, Australia 1990, 469–480.
Walton, C.B., and al. “A Taxonomy and Performance Model of Data Skew Effects in Parallel Join”, Proc. of the 17th Intl. Conf. on VLDB, Barcelona, 1991.
Wilshut, A.N., and al., “Parallel Evaluation of Multi-Join Queries”, ACM SIGMOD Intl. Conf. on Management of Data, San Jose, CA, 1995, 115–126.
Valduriez, P., “Parallel Database Systems: Open Problems and News Issues”, Distributed and Parallel Databases, Kluwer Academic Publishers, Vol. 1, No. 2, 1993, 137–165.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bonneau, S., Hameurlain, A. (1999). Hybrid Simultaneous Scheduling and Mapping in SQL Multi-query Parallelization. In: Bench-Capon, T.J., Soda, G., Tjoa, A.M. (eds) Database and Expert Systems Applications. DEXA 1999. Lecture Notes in Computer Science, vol 1677. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48309-8_8
Download citation
DOI: https://doi.org/10.1007/3-540-48309-8_8
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66448-2
Online ISBN: 978-3-540-48309-0
eBook Packages: Springer Book Archive