Abstract
Voluminous medical images are critical assets for clinical decision support systems. Retrieval based on the image content can help the clinician in mining images relevant to the current case from a large database. In this paper we address the problem of retrieving relevant sub-images with similar anatomical structures as that of the query image across modalities. The images in the database are automatically annotated with information regarding body region depicted in the scan and organs present, along with their localizing bounding box. For this purpose, initially a coarse localization of body regions is done in the 2D space taking contextual information into account. Following this, finer localization and verification of organs is done using a novel, computationally efficient fuzzy approximation method for constructing 3D texture signatures of organs of interest. They are then indexed using an inverted-file data structure which helps in ranked retrieval of relevant images. Apart from retrieving sub-images across modalities by image example, automatic annotation and efficient indexing allows query by text, limited only by the semantic vocabulary. The algorithm was tested on a database of non-contrast CT and T1-weighted MR volumes. Quantitative assessment of the proposed algorithm was evaluated using ground-truth database sanitized by medical experts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gueld, M.O., Kohnen, M., Keysers, D., Schubert, H., Wein, B.B., Bredno, J., Lehmann, T.M.: Quality of DICOM headers information for image categorization. In: Proceedings of SPIE Medical Imaging, vol. 4685, pp. 280–287 (2002)
Criminisi, A., Shotton, J., Robertson, D., Konukoglu, E.: Regression Forests for Efficient Anatomy Detection and Localization in CT Studies. In: Menze, B., Langs, G., Tu, Z., Criminisi, A. (eds.) MICCAI 2010. LNCS, vol. 6533, pp. 106–117. Springer, Heidelberg (2011)
Criminisi, A., Shotton, J., Bucciarelli, S.: Decision forests with long-range spatial context for organ localization in CT volumes. In: MICCAI Workshop on Probabilistic Models for Medical Image Analysis, MICCAI-PMMIA (2009)
Hyunjin, P., Bland, P.H., Meyer, C.R.: Construction of an abdominal probabilistic atlas and its application in segmentation. IEEE Transactions on Medical Imaging 22(4), 483–492 (2003)
Yoshida, Y., Chen, Y.W., Okada, T., Yokota, F., Sato, Y., Hori, M.: Representation and evaluation of statistical prediction powers of neighboring organ shapes for construction of multi-organ statistical atlas. In: 2nd International Conference on Software Engineering and Data Mining (SEDM), pp. 696–699 (2010)
Okada, T., Yokota, K., Hori, M., Nakamoto, M., Nakamura, H., Sato, Y.: Construction of Hierarchical Multi-Organ Statistical Atlases and Their Application to Multi-Organ Segmentation from CT Images. In: Metaxas, D., Axel, L., Fichtinger, G., Székely, G. (eds.) MICCAI 2008, Part I. LNCS, vol. 5241, pp. 502–509. Springer, Heidelberg (2008)
Seifert, S., Barbu, A., Zhou, S.K., Liu, D., Feulner, J., Huber, M., Suehling, M., Cavallaro, A., Comaniciu, D.: Hierarchical parsing and semantic navigation of full body CT data. In: Proceedings of SPIE, vol. 7259 (2009)
Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: Proc. of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 119–126. ACM, New York (2003)
Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.: Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 97–112. Springer, Heidelberg (2002)
Zhang, D., Islam, M.M., Lu, G., Hou, J.: Semantic Image Retrieval Using Region Based Inverted File. In: Proc. of Digital Image Computing: Techniques and Applications, pp. 242–249 (2009)
Fehr, J., Burkhardt, H.: 3D rotation invariant local binary patterns. In: Proc. of 19th International Conference on Pattern Recognition, pp. 1–4 (2008)
Feulner, J., Zhou, S.K., Seifert, S., Cavallaro, A., Hornegger, J., Comaniciu, D.: Estimating the body portion of CT volumes by matching histograms of visual words. In: Proc. of SPIE Medical Imaging, Lake Buena Vista, Florida (2009)
Huong, V.T.L., Park, D.C., Woo, D.M., Lee, Y.: Centroid neural network with Chi square distance measure for texture classification. In: Proc. of International Joint Conference on Neural Networks, pp. 1310–1315 (2009)
Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: SURF: Speeded Up Robust Features. Computer Vision and Image Understanding (CVIU) 110(3), 346–359 (2008)
Peng, Z., Zhong, J., Wee, W., Lee, J.: Automated Vertebra Detection and Segmentation from the Whole Spine MR Images. In: Proc. of 27th Annual International Conference of the Engineering in Medicine and Biology Society, pp. 2527–2530 (2006)
Shan, S., Gao, W., Chang, Y., Cao, B., Yang, P.: Review the strength of Gabor features for face recognition from the angle of its robustness to misalignment. In: Proc. of International Conference on Pattern Recognition, pp. 338–341 (2004)
Zhang, W., Shan, S., Gao, W., Zhang, H.: Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A novel non-statistical model for face representation and recognition. In: Proc. Of International Conference on Computer Vision, Beijing, China, pp. 786–791 (2005)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Oliva, A.: Gist of the scene. Neurobiology of Attention, pp. 251–256 (2005)
Qian, Z., Metaxas, D.N., Axel, L.: Extraction and Tracking of MRI Tagging Sheets Using a 3D Gabor Filter Bank. In: Proc. of 28th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society, pp. 711–714 (2006)
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(7), 971–987 (2002)
Paulhac, L., Makris, P., Ramel, J.Y.: Comparison between 2D and 3D Local Binary Pattern Methods for Characterisation of Three-Dimensional Textures. In: Proceedings of the 5th International Conference on Image Analysis and Recognition, pp. 670–679 (2008)
Sheet, D., Ray, A.K., Chatterjee, J.: Feature Usability Index. LAP Lambert Academic Publishing (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Venkatraghavan, V., Ranjan, S. (2012). Semantic Analysis of 3D Anatomical Medical Images for Sub-image Retrieval. In: Müller, H., Greenspan, H., Syeda-Mahmood, T. (eds) Medical Content-Based Retrieval for Clinical Decision Support. MCBR-CDS 2011. Lecture Notes in Computer Science, vol 7075. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28460-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-28460-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28459-5
Online ISBN: 978-3-642-28460-1
eBook Packages: Computer ScienceComputer Science (R0)