Abstract
Registration of multimodal retinal images such as fundus and Optical Coherence Tomography (OCT) images is important as the two structural imaging modalities provide complementary views of the retina. This enables a more accurate assessment of the health of the retina. However, registration is a challenging task because fundus image (2D) is obtained via optical projection whereas the OCT image (3D) is derived via optical coherence and is very noisy. Furthermore, the field of view of imaging possible in the two modalities is very different resulting in low overlap (5–20%) between the obtained images. Existing methods for this task rely on either key-point (junction/corner) detection or accurate segmentation of vessels which is difficult due to noise. We propose a registration algorithm for finding efficient landmarks under noisy conditions. The method requires neither accurate structure segmentation nor key-point detection. The Modality Independent Neighborhood Descriptor (MIND) features are used to represent landmarks to achieve insensitivity to noise, contrast. Similarity transformation is used to register images. Evaluation of the proposed method on 142 fundus-OCT pairs results in an RMSE of 2.61 pixels. The proposed method outperforms the existing algorithm in terms of robustness, accuracy, and computational efficiency.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, Y.T., Tadarati, M., Wolfson, Y., Bressler, S.B., Bressler, N.M.: Comparison of prevalence of diabetic macular edema based on monocular fundus photography vs optical coherence tomography. JAMA Ophthalmol. 134(2), 222–228 (2016)
Lee, J.A., Cheng, J., Lee, B.H., Ong, E.P., Xu, G., Wong, D.W.K., Liu, J., Laude, A., Lim, T.H.: A low-dimensional step pattern analysis algorithm with application to multimodal retinal image registration. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1046–1053 (2015)
Chen, J., Tian, J., Lee, N., Zheng, J., Smith, R.T., Laine, A.F.: A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Trans. Biomed. Eng. 57(7), 1707–1718 (2010)
Li, Y., Gregori, G., Knighton, R.W., Lujan, B.J., Rosenfeld, P.J.: Registration of OCT fundus images with color fundus photographs based on blood vessel ridges. Opt. Express 19(1), 7–16 (2011)
Golabbakhsh, M., Rabbani, H.: Vessel-based registration of fundus and optical coherence tomography projection images of retina using a quadratic registration model. IET Image Process. 7(8), 768–776 (2013)
Niu, S., Chen, Q., Shen, H., de Sisternes, L., Rubin, D.L.: Registration of SD-OCT en-face images with color fundus photographs based on local patch matching (2014)
Ghassabi, Z., Shanbehzadeh, J., Sedaghat, A., Fatemizadeh, E.: An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors. EURASIP J. Image Video Process. 2013(1), 1–16 (2013)
Joshi, G.D., Sivaswamy, J.: Colour retinal image enhancement based on domain knowledge. In: Sixth Indian Conference on Computer Vision, Graphics and Image Processing, ICVGIP 2008, pp. 591–598. IEEE (2008)
Heinrich, M.P., Jenkinson, M., Bhushan, M., Matin, T., Gleeson, F.V., Brady, M., Schnabel, J.A.: MIND: modality independent neighbourhood descriptor for multi-modal deformable registration. Med. Image Anal. 16(7), 1423–1435 (2012)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Mahmudi, T., Kafieh, R., Rabbani, H., Akhlagi, M., et al.: Comparison of macular OCTs in right and left eyes of normal people. In: SPIE Medical Imaging, p. 90381W. International Society for Optics and Photonics (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Jahnavi, G.S., Sivaswamy, J. (2018). Multimodal Registration of Retinal Images. In: Rameshan, R., Arora, C., Dutta Roy, S. (eds) Computer Vision, Pattern Recognition, Image Processing, and Graphics. NCVPRIPG 2017. Communications in Computer and Information Science, vol 841. Springer, Singapore. https://doi.org/10.1007/978-981-13-0020-2_28
Download citation
DOI: https://doi.org/10.1007/978-981-13-0020-2_28
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-0019-6
Online ISBN: 978-981-13-0020-2
eBook Packages: Computer ScienceComputer Science (R0)