Abstract
In this paper we develop a novel measure of information in a random variable based on its cumulative distribution that we dub cumulative residual entropy (CRE). This measure parallels the well known Shannon entropy but has the following advantages: (1) it is more general than the Shannon Entropy as its definition is valid in the discrete and continuous domains, (2) it possess more general mathematical properties and (3) it can be easily computed from sample data and these computations asymptotically converge to the true values. Based on CRE, we define the cross-CRE (CCRE) between two random variables, and apply it to solve the image alignment problem for parameterized (3D rigid and affine) transformations. The key strengths of the CCRE over using the mutual information (based on Shannon’s entropy) are that the former has significantly larger tolerance to noise and a much larger convergence range over the field of parameterized transformations. We demonstrate these strengths via experiments on synthesized and real image data.
This research was in part funded by the NIH grant NS42075.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bertsekas, D.P.: Nonlinear programming. Athena Scientific, Belmont
Simulated brain database, Online http://www.bic.mni.mcgill.ca/brainweb/
Chefd’Hotel, C., Hermosillo, G., Faugeras, O.: A variational approach to multimodal image matching. In: IEEE Workshop on VLSM, Vancouver, BC, Canada, pp. 21–28 (2001)
Chen, Y., Rao, M., Vemuri, B.C., Wang, F.: Cumulative residual entropy, a new measure of information. Institute of Fundamental Theory, Technical Report IFT-Math-01-02, University of Florida, Gainesville, Florida
Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., Marchal, G.: Automated multimodality image registration using information theory. In: Bizais, Y.J.C. (ed.) Proc. IPMI, pp. 263–274 (1995)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. John Wiley and Sons, Chichester (1991)
Kapur, J.N.: Measure of Information and their Applications. John Wiley & Sons Inc., Chichester
Lai, S.H., Fang, M.: Robust and efficient image alignment with spatially varying illumination models. In: IEEE CVPR, pp. 167–172 (1999)
Liu, J., Vemuri, B.C., Marroquin, J.L.: Local frequency representations for robust multi-modal image registration. IEEE Trans. on Medical Imaging 21(5), 462–469 (2002)
Leventon, M., Grimson, W.E.L.: Multi-modal volume registration using joint intensity distributions. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 672–679. Springer, Heidelberg (1999)
Maintz, J.B., Viergever, M.A.: A Survey of Medical Image Registration. MedIA 2, 1–36 (1998)
Roche, A., Mandalain, G., Pennec, X., Ayache, N.: The correlation ratio as new similarity metric for multi-modal image registration. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, p. 1115. Springer, Heidelberg (1998)
Ruckert, D., Hayes, C., Studholme, C., Leach, M., Hawkes, D.: Non-rigid registration of breast MRI using MI. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, p. 1144. Springer, Heidelberg (1998)
Shannon, C.E.: A mathematical theory of communication. Bell System Technical Journal 27, 379–423, 623–656 (1948)
Studholme, C., Hill, D.L.G., Hawkes, D.J.: An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognition 32, 71–86 (1999)
Szeliski, R., Coughlan, J.: Spline-based image registration. IJCV 22(3), 199–218 (1997)
Vemuri, B.C., Huang, S., Sahni, S., Leonard, C.M., Mohr, C., Gilmore, R., Fitzsimmons, J.: An efficient motion estimator with application to medical image registration. Medical Image Analysis 2(1), 79–98 (1998)
Viola, P.A., Wells, W.M.: Alignment by maximization of mutual information. In: Fifth ICCV, pp. 16–23. MIT, Cambridge (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, F., Vemuri, B.C., Rao, M., Chen, Y. (2003). A New & Robust Information Theoretic Measure and Its Application to Image Alignment. In: Taylor, C., Noble, J.A. (eds) Information Processing in Medical Imaging. IPMI 2003. Lecture Notes in Computer Science, vol 2732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45087-0_33
Download citation
DOI: https://doi.org/10.1007/978-3-540-45087-0_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40560-3
Online ISBN: 978-3-540-45087-0
eBook Packages: Springer Book Archive