Abstract
Facilitating quantitative analysis of cytology images of fine needle aspirates of uveal melanoma is important to confirm diagnosis and inform management decisions. Extracting high-quality regions of interest (ROIs) from cytology whole slide images is a critical first step. To the best of our knowledge, we describe the first unsupervised clustering-based method for fine needle aspiration cytology (FNAC) that automatically suggests high-quality ROIs. Our method is integrated in a graphical user interface that allows for interactive refinement of ROI suggestions to tailor analysis to any specific specimen. We show that the proposed approach suggests ROIs that are in very good agreement with expert-extracted regions and demonstrate that interactive refinement results in the extraction of more high-quality regions compared to purely algorithmic extraction alone.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Amrehn, M., Gaube, S., Unberath, M., et al.: UI-NET: interactive artificial neural networks for iterative image segmentation based on a user model (2017)
Aresta, G., et al.: iW-Net: an automatic and minimalistic interactive lung nodule segmentation deep network. Sci. Rep. 9, 11591 (2019)
Barker, J., Hoogi, A., Depeursinge, A., Rubin, D.L.: Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles. Med. Image Anal. 30, 60–71 (2016)
Brendel, W., Bethge, M.: Approximating CNNs with bag-of-local-features models works surprisingly well on ImageNet. In: International Conference on Learning Representations (2019)
Caron, M., Bojanowski, P., Joulin, A., Douze, M.: Deep clustering for unsupervised learning of visual features. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision – ECCV 2018. LNCS, vol. 11218, pp. 139–156. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01264-9_9
Chang, L., Zhang, M., Li, W.: A coarse-to-fine approach for medical hyperspectral image classification with sparse representation. In: Yu, J., et al. (eds.) AOPC 2017: Optical Spectroscopy and Imaging, vol. 10461, pp. 136–144. International Society for Optics and Photonics, SPIE (2017)
Corrêa, Z., Augsburger, J.: Sufficiency of FNAB aspirates of posterior uveal melanoma for cytologic versus GEP classification in 159 patients, and relative prognostic significance of these classifications. Graefe’s archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie 252 (2013)
Dov, D., Kovalsky, S.Z., Cohen, J., Range, D.E., Henao, R., Carin, L.: A deep-learning algorithm for thyroid malignancy prediction from whole slide cytopathology images (2019)
Folberg, R., Augsburger, J.J., Gamel, J.W., Shields, J.A., Lang, W.R.: Fine-needle aspirates of uveal melanomas and prognosis. Am. J. Ophthalmol. 100(5), 654–657 (1985)
Garud, H., et al.: High-magnification multi-views based classification of breast fine needle aspiration cytology cell samples using fusion of decisions from deep convolutional networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 828–833, July 2017
Girard, N., Zhygallo, A., Tarabalka, Y.: ClusterNet: unsupervised generic feature learning for fast interactive satellite image segmentation. In: Image and Signal Processing for Remote Sensing XXV, vol. 11155, pp. 244–254. SPIE (2019)
Grossmann, P., Stringfield, O., El-Hachem, N., et al.: Defining the biological basis of radiomic phenotypes in lung cancer. In: eLife (2017)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Li, J., Li, W., Gertych, A., Knudsen, B.S., Speier, W., Arnold, C.W.: An attention-based multi-resolution model for prostate whole slide imageclassification and localization. CoRR abs/1905.13208 (2019)
Lin, H., Chen, H., Dou, Q., Wang, L., Qin, J., Heng, P.: ScanNet: a fast and dense scanning framework for metastastic breast cancer detection from whole-slide image. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 539–546 (2018)
Liu, J., Chen, F., Shi, H., Liao, H.: Single image super-resolution for MRI using a coarse-to-fine network. In: Ibrahim, F., Usman, J., Ahmad, M.Y., Hamzah, N., Teh, S.J. (eds.) ICIBEL 2017. IP, vol. 67, pp. 241–245. Springer, Singapore (2018). https://doi.org/10.1007/978-981-10-7554-4_42
Liu, T.A., Zhu, H., Chen, H., et al.: Gene expression profile prediction in uveal melanoma using deep learning: a pilot study for development of an alternative survival prediction tool. Ophthalmol. Retina S2468-6530, 30251–30257 (2020)
Paszke, A., Gross, S., Chintala, S., et al.: Automatic differentiation in PyTorch (2017)
Roullier, V., Lézoray, O., Ta, V.T., Elmoataz, A.: Multi-resolution graph-based analysis of histopathological whole slide images: application to mitotic cell extraction and visualization. Computer. Med. Imaging Graph. 35(7), 603–615 (2011). Whole Slide Image Process
Saikia, A.R., Bora, K., Mahanta, L.B., Das, A.K.: Comparative assessment of CNN architectures for classification of breast FNAC images. Tissue Cell 57, 8–14 (2019). eM in cell and tissues
Singh, A.D., Turell, M.E., Topham, A.K.: Uveal melanoma: Trends in incidence, treatment, and survival. Ophthalmology 118(9), 1881–1885 (2011)
Wang, G., Li, W., Zuluaga, M.A., et al.: Interactive medical image segmentation using deep learning with image-specific fine tuning. IEEE Trans. Med. Imaging 37(7), 1562–1573 (2018)
Xu, N., Price, B., Cohen, S., Yang, J., Huang, T.S.: Deep interactive object selection. In: IEEE Conference on Computer Vision and Pattern Recognition, June 2016
Yang, B., Fu, X., Sidiropoulos, N., Hong, M.: Towards k-means-friendly spaces: simultaneous deep learning and clustering. In: 34th International Conference on Machine Learning, ICML 2017, pp. 5888–5901 (2017)
Yang, B., Fu, X., Sidiropoulos, N., Hong, M.: Towards k-means-friendly spaces: simultaneous deep learning and clustering. In: 34th International Conference on Machine Learning, ICML 2017, pp. 5888–5901 (2017)
Zhu, Z., Xia, Y., Shen, W., Fishman, E., Yuille, A.: A 3D coarse-to-fine framework for volumetric medical image segmentation. In: 2018 International Conference on 3D Vision (3DV), pp. 682–690, September 2018
Zhu, Z., Xia, Y., Xie, L., Fishman, E.K., Yuille, A.L.: Multi-scale coarse-to-fine segmentation for screening pancreatic ductal adenocarcinoma. CoRR abs/1807.02941 (2018)
Acknowledgement
We gratefully acknowledge funding from the Emerson Collective Cancer Research Fund and internal funds provided by the Wilmer Eye Institute and the Malone Center for Engineering in Healthcare at Johns Hopkins University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Chen, H., Liu, T.Y.A., Correa, Z., Unberath, M. (2020). An Interactive Approach to Region of Interest Selection in Cytologic Analysis of Uveal Melanoma Based on Unsupervised Clustering. In: Fu, H., Garvin, M.K., MacGillivray, T., Xu, Y., Zheng, Y. (eds) Ophthalmic Medical Image Analysis. OMIA 2020. Lecture Notes in Computer Science(), vol 12069. Springer, Cham. https://doi.org/10.1007/978-3-030-63419-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-63419-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63418-6
Online ISBN: 978-3-030-63419-3
eBook Packages: Computer ScienceComputer Science (R0)
