Abstract
Despite promising results of 14 types of diseases continuously reported on the large-scale NIH dataset, the applicability on real clinical practice with the deep learning based CADx for chest X-ray may still be quite elusive. It is because tens of diseases can be found in the chest X-ray and require to keep on learning and diagnosis. In this paper, we propose a low-shot multi-label incremental learning framework involving three phases, i.e., representation learning, low-shot learning and all-label fine-tuning phase, to demonstrate the feasibility and practicality of thoracic disease abnormalities of CADx in clinic. To facilitate the incremental learning in new small dataset situation, we also formulate a feature regularization prior, say multi-label squared gradient magnitude (MLSGM) to ensure the generalization capability of the deep learning model. The proposed approach has been evaluated on the public ChestX-ray14 dataset covering 14 types of basic abnormalities and a new small dataset MyX-ray including 6 types of novel abnormalities collected from Mianyang Central Hospital. The experimental result shows MLSGM method improves the average Area-Under-Curve (AUC) score on 6 types of novel abnormalities up to 7.6 points above the baseline when shot number is only 10. With the low-shot multi-label incremental learning framework, the AI application for the reading and diagnosis of chest X-ray over-all diseases and abnormalities can be possibly realized in clinic practice.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M.: ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3462–3471, July 2017
Wang, X., Peng, Y., Lu, L., Lu, Z., Summers, R.M.: Tienet: text-image embedding network for common thorax disease classification and reporting in chest x-rays. CoRR, abs/1801.04334 (2018)
Rajpurkar, P., et al.: Chexnet: radiologist-level pneumonia detection on chest X-rays with deep learning. CoRR, abs/1711.05225 (2017)
Hariharan, B., Girshick, R.: Low-shot visual recognition by shrinking and hallucinating features. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 3037–3046, October 2017
Cheng, J.Z., et al.: Computer-aided diagnosis with deep learning architecture: applications to breast lesions in us images and pulmonary nodules in CT scans. Sci. Rep. 6, 24454 (2016)
Shen, W., et al.: Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification. Pattern Recognit. 61(61), 663–673 (2017)
Shen, W., Zhou, M., Yang, F., Yang, C., Tian, J.: Multi-scale convolutional neural networks for lung nodule classification. Inf. Process. Med. Imaging 24, 588–599 (2015)
Suk, H.I., Lee, S.W., Shen, D.: Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct. Funct. 220(2), 841–859 (2015)
Bian, C., Lee, R., Chou, Y.-H., Cheng, J.-Z.: Boundary regularized convolutional neural network for layer parsing of breast anatomy in automated whole breast ultrasound. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 259–266. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_30
Hao, C., et al.: Ultrasound standard plane detection using a composite neural network framework. IEEE Trans. Cybern. 47(6), 1576–1586 (2017)
Wu, L., Cheng, J.Z., Li, S., Lei, B., Wang, T., Dong, N.: FUIQA: fetal ultrasound image quality assessment with deep convolutional networks. IEEE Trans. Cybern. 47(5), 1336–1349 (2017)
Yao, L., Poblenz, E., Dagunts, D., Covington, B., Bernard, D., Lyman, K.: Learning to diagnose from scratch by exploiting dependencies among labels. CoRR, abs/1710.10501 (2017)
Li, Z., et al.: Thoracic disease identification and localization with limited supervision. CoRR, abs/1711.06373 (2017)
Dave, M., Tapiawala, S., Meng, J.E., Venkatesan, R.: A novel progressive multi-label classifier for class-incremental data. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 003589–003593 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, June 2016
Deng, J., Socher, R., Fei-Fei, L., Dong, W., Li, K., Li, L.-J.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 248–255, June 2009
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)
Acknowledgments
This work was supported by National Natural Science Foundation of China (Nos. 61379040, and 61501305), and Sichuan Provincial Open Foundation of Civil-Military Integration Research Institute (Nos. 2017SCII0220 and 2017SCII0219).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, Q. et al. (2018). Low-Shot Multi-label Incremental Learning for Thoracic Diseases Diagnosis. In: Cheng, L., Leung, A., Ozawa, S. (eds) Neural Information Processing. ICONIP 2018. Lecture Notes in Computer Science(), vol 11307. Springer, Cham. https://doi.org/10.1007/978-3-030-04239-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-04239-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04238-7
Online ISBN: 978-3-030-04239-4
eBook Packages: Computer ScienceComputer Science (R0)