Abstract
We present a support function for MPI derived datatypes on an Enhancer of Memory and Network named DIMMnet-3 which is under development. Semi-hardwired derived datatype communication based on RDMA with hardwired gather and scatter is proposed. This mechanism and MPI using it are implemented on DIMMnet-2 which is a former prototype. The performance of gather or scatter transfer of 8byte elements with large interval by using vector commands of DIMMnet-2 is 6.8 compared with software on a host. Proprietary benchmark of MPI derived datatype communication for transferring a submatrix corresponding to a narrow HALO area is executed. Observed bandwidth on DIMMnet-2 is far higher than that for similar condition with VAPI based MPI implementation on Infiniband, even though poorer CPU and motherboard are used.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Träff, J.L., Hempel, R., Ritzdorf, H., Zimmermann, F.: Flattening on the Fly: Efficient Handling of MPI Derived Datatypes. In: Margalef, T., Dongarra, J., Luque, E. (eds.) PVM/MPI 1999. LNCS, vol. 1697, pp. 109–116. Springer, Heidelberg (1999)
Byna, S., Gropp, W., Sun, X., Thaku, R.: Improving the performance of mpi derived datatypes by optimizing memory-access cost. In: International Conference on Cluster Computing (CLUSTER 2003), pp. 412–419 (December 2003)
Wu, J., Wyckoff, P., Panda, D.K.: High Performance Implementation of MPI Derived Datatype Communication over InfiniBand. In: 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), pp. 26–30 (April 2004)
Tanabe, N., Nakatake, M., Hakozaki, H., Dohi, Y., Nakajo, H., Amano, H.: A New Memory Module for COTS-Based Personal Supercomputing. Innovative Architecture for Future Generation High-Performance Processors and Systems, 40–48 (July 2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tanabe, N., Nakajo, H. (2008). Introduction to Acceleration for MPI Derived Datatypes Using an Enhancer of Memory and Network. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2008. Lecture Notes in Computer Science, vol 5205. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87475-1_46
Download citation
DOI: https://doi.org/10.1007/978-3-540-87475-1_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87474-4
Online ISBN: 978-3-540-87475-1
eBook Packages: Computer ScienceComputer Science (R0)