Abstract
Medical image segmentation plays an important role in the diagnosis and treatment of diseases. Using fully supervised deep learning methods for medical image segmentation requires large medical image datasets with pixel-level annotations, but medical image annotation is time-consuming and labor-intensive. On this basis, we study a medical image segmentation algorithm based on image-level annotation. Existing weakly supervised semantic segmentation algorithms based on image-level annotations rely on class activation maps (CAM) and saliency maps generated by preprocessing as pseudo-labels to supervise the network. However, the CAMs generated by many existing methods are often over-activated or under-activated, while most of the saliency map generated by preprocessing is also rough and cannot be updated online, which will affect the segmentation effect. In response to this situation, we study a weakly supervised medical image segmentation algorithm based on multi-task learning, which uses graph convolution to correct for improper activation, and uses similarity learning to update pseudo-labels online to improve segmentation performance. We conducted extensive experiments on ISIC2017 skin disease images to validate the proposed method and experiments show that our method achieves a Dice evaluation metric of 68.38% on this dataset, show that our approach outperforms state-of-the-art methods.
This work is supported by the National Natural Science Foundation of China (61873259, U20A20200, 61821005), and the Youth Innovation Promotion Association of Chinese Academy of Sciences (2019203).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bearman, A., Russakovsky, O., Ferrari, V., Fei-Fei, L.: What’s the point: semantic segmentation with point supervision. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9911, pp. 549–565. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_34
Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation (2017)
Chen, Y., Rohrbach, M., Yan, Z., Yan, S., Feng, J., Kalantidis, Y.: Graph-based global reasoning networks. IEEE (2020)
Codella, N., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) (2017)
Fan, J., Zhang, Z., Song, C., Tan, T.: Learning integral objects with intra-class discriminator for weakly-supervised semantic segmentation. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
Fan, R., Hou, Q., Cheng, M.-M., Yu, G., Martin, R.R., Hu, S.-M.: Associating inter-image salient instances for weakly supervised semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11213, pp. 371–388. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01240-3_23
Huang, Z., Wang, X., Wang, J., Liu, W., Wang, J.: Weakly-supervised semantic segmentation network with deep seeded region growing. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2018)
Khoreva, A., Benenson, R., Hosang, J., Hein, M., Schiele, B.: Simple does it: weakly supervised instance and semantic segmentation. IEEE Computer Society (2016)
Lee, J., Kim, E., Lee, S., Lee, J., Yoon, S.: FickleNet: weakly and semi-supervised semantic image segmentation using stochastic inference. IEEE (2019)
Lee, S., Lee, M., Lee, J., Shim, H.: Railroad is not a train: saliency as pseudo-pixel supervision for weakly supervised semantic segmentation (2021)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2015)
Meng, T., Perazzi, F., Djelouah, A., Ayed, I.B., Boykov, Y.: On regularized losses for weakly-supervised CNN segmentation (2018)
Oh, S.J., Benenson, R., Khoreva, A., Akata, Z., Schiele, B.: Exploiting saliency for object segmentation from image level labels. IEEE (2017)
Papandreou, G., Chen, L.C., Murphy, K.P., Yuille, A.L.: Weakly-and semi-supervised learning of a deep convolutional network for semantic image segmentation. In: IEEE International Conference on Computer Vision (2016)
Song, C., Huang, Y., Ouyang, W., Wang, L.: Box-driven class-wise region masking and filling rate guided loss for weakly supervised semantic segmentation. IEEE (2019)
Vernaza, P., Chandraker, M.: Learning random-walk label propagation for weakly-supervised semantic segmentation (2018)
Wang, X., You, S., Li, X., Ma, H.: Weakly-supervised semantic segmentation by iteratively mining common object features. IEEE (2018)
Wei, Y., Feng, J., Liang, X., Cheng, M.M., Zhao, Y., Yan, S.: Object region mining with adversarial erasing: a simple classification to semantic segmentation approach. IEEE (2017)
Wei, Y., Xiao, H., Shi, H., Jie, Z., Fe Ng, J., Huang, T.S.: Revisiting dilated convolution: a simple approach for weakly- and semi- supervised semantic segmentation. IEEE (2018)
Wu, Z., Shen, C., Hengel, A.: Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recogn. (2016)
Xiao, H., Feng, J., Wei, Y., Zhang, M.: Self-explanatory deep salient object detection (2017)
Yang, G.Y., Li, X.L., Martin, R.R., Hu, S.M.: Sampling equivariant self-attention networks for object detection in aerial images. arXiv e-prints (2021)
Yao, Y., et al.: Non-salient region object mining for weakly supervised semantic segmentation (2021)
Zhang, B., Xiao, J., Wei, Y., Sun, M., Huang, K.: Reliability does matter: an end-to-end weakly supervised semantic segmentation approach. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 7, pp. 12765–12772 (2020)
Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. IEEE Computer Society (2016)
Zhao, H., et al.: PSANet: point-wise spatial attention network for scene parsing. In: European Conference on Computer Vision (2018)
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. IEEE Computer Society (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Xie, X., Fan, H., Yu, Z., Bai, H., Tang, Y. (2022). Weakly-Supervised Medical Image Segmentation Based on Multi-task Learning. In: Liu, H., et al. Intelligent Robotics and Applications. ICIRA 2022. Lecture Notes in Computer Science(), vol 13456. Springer, Cham. https://doi.org/10.1007/978-3-031-13822-5_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-13822-5_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-13821-8
Online ISBN: 978-3-031-13822-5
eBook Packages: Computer ScienceComputer Science (R0)