Abstract
The dynamic brain network (DBN) consists of a set of time-varying states (i.e., functional connectivity matrixes), and has revolutionized the field of brain network analysis through captured dynamic evolution patterns. However, current representation methods of DBN, which use hand-crafted features, are still not data-driven, and cannot effectively learn the hierarchically organized temporal nature of DBN. To address this issue, we propose a novel hierarchical representation learning (HARL) method for dynamic brain networks in the framework of graph convolutional networks. Specifically, we first define a graph model, whose nodes represent time-varying states, node features are determined by states’ functional connectivity matrix, and edges learn according to node features. Then, based on this model, we build a HARL module to learn the representation of DBN under different levels. Each level consists of a convolution layer and a pooling layer. Through a convolution layer, node features can be updated according to their neighbor nodes, which can better learn the representation of each state. In the pooling layer, according to both node features and graph topology, we select some important nodes (i.e., states) from the whole graph to form a coarsened graph, which would be further input to the next level. In each level, the representation of DBN is generated by aggregating these node features. These representations will be input to the fully connected layer for disease prediction. Experiments on a real schizophrenia dataset demonstrate the effectiveness and advantages of our proposed method.
This study was supported by the National Key Research and Development Program of China (Nos. 2018YFC2001600, 2018YFC2001602, 2018ZX10201002) and the National Natural Science Foundation of China (Nos. 61861130366, 61732006, 61876082). Jiashuang Huang and Xu Li contribute equally to this article and should be considered co-first authors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kucyi, A., Hove, M.J., Esterman, M., et al.: Dynamic brain network correlates of spontaneous fluctuations in attention. Cereb. Cortex 27(3), 1831–1840 (2017)
Huang, J., Wang, M., Xu, X., et al.: A novel node-level structure embedding and alignment representation of structural networks for brain disease analysis. Med. Image Anal. 65, 101755 (2020)
Wang, M., Zhang, D., Huang, J., et al.: Identifying autism spectrum disorder with multi-site fMRI via low-rank domain adaptation. IEEE Trans. Med. Imaging 39(3), 644–655 (2019)
Wang, M., Huang, J., Liu, M., et al.: Functional connectivity network analysis with discriminative hub detection for brain disease identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 1198–1205 (2019)
Chang, C., Metzger, C.D., Glover, G.H., et al.: Association between heart rate variability and fluctuations in resting-state functional connectivity. Neuroimage 68, 93–104 (2013)
Sun, Y., Collinson, S.L., Suckling, J., et al.: Dynamic reorganization of functional connectivity reveals abnormal temporal efficiency in schizophrenia. Schizophr. Bull. 45(3), 659–669 (2019)
Crdova-Palomera, A., Kaufmann, T., Persson, K., et al.: Disrupted global metastability and static and dynamic brain connectivity across individuals in the Alzheimers disease continuum. Sci. Rep. 7, 40268 (2017)
Zhang, J., Cheng, W., Liu, Z., et al.: Neural, electrophysiological and anatomical basis of brain-network variability and its characteristic changes in mental disorders. Brain 139(8), 2307–2321 (2016)
Braun, U., Schfer, A., Bassett, D.S., et al.: Dynamic brain network reconfiguration as a potential schizophrenia genetic risk mechanism modulated by NMDA receptor function. Proc. Natl. Acad. Sci. 113(44), 12568–12573 (2016)
Damaraju, E., Allen, E.A., Belger, A., et al.: Dynamic functional connectivity analysis reveals transient states of dysconnectivity in schizophrenia. NeuroImage Clin. 5, 298–308 (2014)
Nomi, J.S., Farrant, K., Damaraju, E., et al.: Dynamic functional network connectivity reveals unique and overlapping profiles of insula subdivisions. Hum. Brain Mapp. 37(5), 1770–1787 (2016)
Jie, B., Liu, M., Lian, C., Shi, F., Shen, D.: Developing novel weighted correlation kernels for convolutional neural networks to extract hierarchical functional connectivities from fMRI for disease diagnosis. In: Shi, Y., Suk, H.I., Liu, M. (eds.) Machine Learning in Medical Imaging. MLMI 2018. LNCS, vol. 11046. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00919-9_1
Kam, T.E., Zhang, H., Jiao, Z., et al.: Deep learning of static and dynamic brain functional networks for early MCI detection. IEEE Trans. Med. Imaging 39, 478–487 (2019)
Vidaurre, D., Smith, S.M., Woolrich, M.W.: Brain network dynamics are hierarchically organized in time. Proc. Natl. Acad. Sci. 114(48), 12827–12832 (2017)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Lee, J., Lee, I., Kang, J.: Self-attention graph pooling. arXiv preprint arXiv:1904.08082 (2019)
Gao, H., Ji, S.: Graph u-nets. arXiv preprint arXiv:1905.05178 (2019)
Wee, C.Y., Yang, S., Yap, P.T., et al.: Sparse temporally dynamic resting-state functional connectivity networks for early MCI identification. Brain Imaging Behav. 10(2), 342–356 (2016). https://doi.org/10.1007/s11682-015-9408-2
Wang, M., Lian, C., Yao, D., et al.: Spatial-temporal dependency modeling and network hub detection for functional MRI analysis via convolutional-recurrent network. IEEE Trans. Biomed. Eng. 67, 2241–2252 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, J., Li, X., Wang, M., Zhang, D. (2020). Hierarchical Representation Learning of Dynamic Brain Networks for Schizophrenia Diagnosis. In: Peng, Y., et al. Pattern Recognition and Computer Vision. PRCV 2020. Lecture Notes in Computer Science(), vol 12306. Springer, Cham. https://doi.org/10.1007/978-3-030-60639-8_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-60639-8_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60638-1
Online ISBN: 978-3-030-60639-8
eBook Packages: Computer ScienceComputer Science (R0)