Abstract
To manage (such as configuring and monitoring) the numerous network chips and its ports efficiently, the in-band management technology is used in the interconnect network of high performance computing systems. However, with the rapid development of network switching chips towards the higher radix, the traditional in-band management implementation of ring structure faces the problem of delay performance scalability. The work proposed two optimized implementation structures for the in-band management, four-quadrant double-layer ring and four-quadrant star ring to solve the problem. The results of resource consumption assessment and delay performance simulation showed that in the high-radix switching chips with 64, 80, 96, 112, 128, 144, and 160 ports, the occupancies of LUT (Look Up Table) resources of the four-quadrant double-layer ring and star ring structures increased by an average of \(5.46\%\) and \(1.71\%\) compared to the traditional ring structure, respectively. Meanwhile, the occupancies of LUTRAM (Look Up Table memory) resources increased by an average of \(30.89\%\) and \(21.81\%\); that of FF (Flip Flop) resources by an average of \(3.86\%\) and \(0.19\%\); the forward delay of management packets decreased by \(25.75\%\) and \(21.81\%\), respectively. Considering both resource consumption and delay performance, the star ring was an ideal structure to deal with the problem of delay performance scalability among the in-band management structures, which can be applied to realize the in-band management for the higher-radix switching chips in the future.
This work was supported by The National Key Research and Development Program of China (grant 2018YFB0204300).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cao, J., Xiao, L., Pang, Z., et al.: The efficient in-band management for interconnect network in Tianhe-2 system. In: 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, pp. 18–26. IEEE Press, New York (2016). https://doi.org/10.1109/PDP.2016.58
Kim, J., Dally, W.J., Towles, B., et al.: Microarchitecture of a high-radix router. In: 32nd International Symposium on Computer Architecture (ISCA), pp. 420–431. IEEE Press, New York (2005). https://doi.org/10.1109/ISCA.2005.35
Kim, J., Dally, W.J., Abts, D.: Adaptive routing in high-radix Clos network. In: The 2006 ACM/IEEE Conference on Supercomputing (SC), pp. 420–431 (2006). https://doi.org/10.1109/SC.2006.10
Broadcom Corporation Homepage. https://www.broadcom.com
Centec Networks Corporation Homepage. https://www.centecnetworks.com
Mellanox Technologies Corporation Homepage. https://www.mellanox.com
Intel Corporation Homepage. https://www.intel.com
InfiniBand Trade Association: Infiniband Architecture Specification: Release 1.0. InfiniBand Trade Association (2000)
Birrittella, M.S., Debbage, M., Huggahalli, R., et al.: Enabling scalable high-performance systems with the intel omni-path architecture. IEEE Micro 36(4), 38–47 (2016). https://doi.org/10.1109/MM.2016.58
Birrittella, M.S., Debbage, M., Huggahalli, R., et al.: Intel omni-path architecture: enabling scalable, high performance fabrics. In: IEEE Symposium on High-performance Interconnects. IEEE Press, New York (2015). https://doi.org/10.1109/HOTI.2015.22
Dally, W.J.: Virtual-channel flow control. ACM Sigarch Comput. Archit. News 18(3), 60–68 (1990). https://doi.org/10.1145/325096.325115
Xilinx Corporation Homepage. https://www.xilinx.com
Synopsys Corporation Homepage. https://www.synopsys.com
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Cao, J., Lai, M., Qi, X., Dai, Y., Pang, Z. (2020). Optimal Implementation of In-Band Network Management for High-Radix Switches. In: Dong, D., Gong, X., Li, C., Li, D., Wu, J. (eds) Advanced Computer Architecture. ACA 2020. Communications in Computer and Information Science, vol 1256. Springer, Singapore. https://doi.org/10.1007/978-981-15-8135-9_2
Download citation
DOI: https://doi.org/10.1007/978-981-15-8135-9_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8134-2
Online ISBN: 978-981-15-8135-9
eBook Packages: Computer ScienceComputer Science (R0)