Abstract
The problem of solving tridiagonal linear systems on parallel distributed-memory environments is considered in this paper. In particular, two common direct methods for solving such systems are considered: odd-even cyclic reduction and prefix summing. For each method, a variety of lower bounds on execution time for solving tridiagonal linear systems are presented. Specifically, lower bounds are presented that (a) hold when the number of data items per processor is bounded, (b) are general lower bounds, and (c) for specific data layouts commonly used in designing parallel algorithms to solve tridiagonal linear systems. Furthermore, algorithms are presented that have running times within a constant factor of the lower bounds provided. Lastly, a comparison of bounds for odd-even cyclic reduction and prefix summing is given.
Similar content being viewed by others
References
C. Amodio and N. Mastronardi. A parallel version of the cyclic reduction algorithm on a hypercube. Parallel Computing, 19, 1993.
M. Amor et al. Parallelization of a recursive decoupling method for solving tridiagonal linear system on distributed memory computer. VECPAR'2000, 2000.
D. E. Culler, R. M. Karp, D. A. Patterson, A. Sahay, E. Santos, K. E. Schauser, R. Subramonian, and T. von Eicken. LogP: A practical model of parallel computation. Communications of the ACM, 39(11):1996.
W. Dally et al. The J-machine: A fine-grain concurrent computer. In IFIP Congress, 1989.
L. E. Garey et al. Parallel projection methods for tridiagonal systems. Proc. HPCS, 2001
G. A. Gravvanis. Solving symmetric arrowhead and special tridiagonal linear systems by fast approximate inverse preconditioning. J. Math. Modelling and Algorithms, 1(4):2002.
D. Heller. A survey of parallel algorithms in numerical linear algebra. SIAM J. Numer. Anal., 29(4):1987.
A. W. Hockney and C. R. Jesshope. Parallel Computers. Adam-Hilger, 1981.
S. L. Johnsson. Solving tridiagonal systems on ensemble architectures. SIAM J. Sci. Stat. Comput., 8,1987.
R. M. Karp, A. Sahay, E. E. Santos, and K. E. Schauser. Optimal broadcast and summation on the LogP model. In Proceedings of the Fifth Annual ACM Symposium on Parallel Algorithms and Architectures, 1993.
S. P. Kumar. Solving tridiagonal systems on the butterfly parallel computer. International J. Supercomputer Applications, 3,1989.
S. Lakshmivarahan and S. D. Dhall. A lower bound on the communication complexity for solving linear tridiagonal systems on cube architectures. In Hypercubes 1987, 1987.
S. Lakshmivarahan and S. D. Dhall. Analysis and Design of Parallel Algorithms: Arithmetic and Matrix Problems. McGraw-Hill, 1990.
F. T. Leighton. Introduction to Parallel Algorithms and Architectures: Arrays-Trees-Hypercubes. Morgan Kaufmann, 1992.
D. Lenoski et al. The Stanford Dash multiprocessor. IEEE Computer, 25(3):63–79, 1992.
G. M. Papadopoulos and D. E. Culler. Monsoon: An explicit token-store architecture. In Proc. of the 17th Annual Int. Symp. on Comp. Arch. Seattle, Washington, May 1990.
E. E. Santos. Optimal and efficient parallel algorithms for summing and prefix summing. Journal of Parallel and Distributed Computing, 64(2):2002.
E. E. Santos. Optimal parallel algorithms for solving tridiagonal linear systems. In Springer-Verlag Lecture Notes in Computer Science #1300 Proceedings of EURO-PAR97, 1997.
E. E. Santos. Optimal and near-optimal algorithms for k-item broadcast. Journal of Parallel and Distributed Computing, 57(2):1999.
E. E. Santos. Tridiagonal solvers on k-dimensional mesh and torus networks. Proc. of International Conf. on Parallel and Distributed Processing Techniques and Applications, 2000.
E. E. Santos. Tridiagonal solvers with multiple right-hand sides on k-dimensional mesh and torus networks. Parallel Processing Letters, 13(4):2003.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Santos, E.E. Optimal and Efficient Parallel Tridiagonal Solvers Using Direct Methods. The Journal of Supercomputing 30, 97–115 (2004). https://doi.org/10.1023/B:SUPE.0000040615.60545.c6
Issue Date:
DOI: https://doi.org/10.1023/B:SUPE.0000040615.60545.c6