Skip to main content
SpringerLink
Log in

Multiscale Segmentation of Three-Dimensional MR Brain Images

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Segmentation of MR brain images using intensity values is severely limited owing to field inhomogeneities, susceptibility artifacts and partial volume effects. Edge based segmentation methods suffer from spurious edges and gaps in boundaries. A multiscale method to MRI brain segmentation is presented which uses both edge and intensity information. First a multiscale representation of an image is created, which can be made edge dependent to favor intra-tissue diffusion over inter-tissue diffusion. Subsequently a multiscale linking model (the hyperstack) is used to group voxels into a number of objects based on intensity. It is shown that both an improvement in accuracy and a reduction in image post-processing can be achieved if edge dependent diffusion is used instead of linear diffusion. The combination of edge dependent diffusion and intensity based linking facilitates segmentation of grey matter, white matter and cerebrospinal fluid with minimal user interaction. To segment the total brain (white matter plus grey matter) morphological operations are applied to remove small bridges between the brain and cranium. If the total brain is segmented, grey matter, white matter and cerebrospinal fluid can be segmented by joining a small number of segments. Using a supervised segmentation technique and MRI simulations of a brain phantom for validation it is shown that the errors are in the order of or smaller than reported in literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Acton, S.T., Bovik, A.C., and Crawford, M.M. 1994. Anisotropic diffusion pyramids for image segmentation. Proc. First International Conference on Image Processing, IEEE, pp. 478–482.

  • Alvarez, L., Guichard, F., Lions, P.L., and Morel, J.M. 1993. Axioms and fundamental equations of image processing. Archives for Rational Mechanics, 123(3):199–257.

    Google Scholar 

  • Atkins, M.S. and Mackiewich, B.T. 1998. Fully automated segmentation of the brain in MRI. IEEE Transactions on Medical Imaging, 17(1):98–107.

    Google Scholar 

  • Bezdek, J.C., Hall, L.O., and Clarke, L.P. 1993. Review of MR image segmentation techniques using pattern recognition. Medical Physics, 20(4):1033–1048.

    Google Scholar 

  • Bomans, M., Höhne, K, Tiede, U., and Riemer, M. 1990. 3-D segmentation of MR images of the head for 3-D display. IEEE Transactions on Medical Imaging, 9(2):177–183.

    Google Scholar 

  • Brummer, M.E., Mersereau, R.M., Eisner, R.L., and Lewine, R.R.J. 1992. Automatic detection of brain contours in MRI data sets. IEEE Transactions on Medical Imaging, 12(2):153–166.

    Google Scholar 

  • Caselles, V. and Sbert, C. 1997. What is the best causal scale space for 3-D images? SIAM Journal on Numerical Analysis, 56(4): 1199–1246.

    Google Scholar 

  • Catté, F., Lions, P.L., Morel, J.M., and Coll, T. 1992. Image selective smoothing and edge detection by nonlinear diffusion. SIAM Journal on Numerical Analysis, 29(1):182–193.

    Google Scholar 

  • Chakraborty, A., Staib, L.H., and Duncan, J.S. 1996. Deformable boundary finding in medical images by integrating gradient and region information. IEEE Transactions on Medical Imaging, 15(6):859–870.

    Google Scholar 

  • Chu, C.C. and Aggarwal, J.K. 1993. The integration of image segmentation maps using region and edge information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(12): 1241–1252.

    Google Scholar 

  • Clarke, L.P., Velthuizen, R.P., Camacho, M.A., Heine, J.J., Vaidyanathan, M., Hall, L.O., Thatcher, R.W., and Silbiger, M.L. 1995. MRI segmentation: Methods and applications. Magn. Reson. Imag., 13(3):343–368.

    Google Scholar 

  • Cline, H.E., Lorensen, W.E., Kikinis, R., and Jolesz, F. 1990. Three dimensional segmentation of MR images of the head using probability and connectivity. Journal of Computer Assisted Tomography, 14(6):1037–1045.

    Google Scholar 

  • Collins, D.L., Peters, T.M., Dai, W., and Evans, A.C. 1992. Model based segmentation of individual brain structures from MRI data. In Proceedings Visualization in Biomedical Computing, R. Robb (Ed.), SPIE, pp. 10–23.

  • Dai, D., Condon, B., Rampling, R., and Teasdale, G. 1993. Intracranial deformation caused by brain tumors; assessment of 3-D surface by magnetic resonance imaging. IEEE Transactions on Medical Imaging, 12(4):693–702.

    Google Scholar 

  • Davatzikos, C. and Bryan, R.N. 1996. Using a deformable surface model to obtain a shape representation of the cortex. IEEE Transactions on Medical Imaging, 15(6):785–795.

    Google Scholar 

  • Dawant, B.M., Zijdenbos, A.P., and Margolin, R.A. 1993. Correction of intensity variations in MR images for computer-aided tissue classification. IEEE Transactions on Medical Imaging, 12(4): 770–781.

    Google Scholar 

  • Dziuk, G. and Kawohl, B. 1991. On rotationally symmetric mean curvature flow. Journal of Differential Equations, 93:142–149.

    Google Scholar 

  • Evans, L.C. and Spruck, J. 1991. Motion of level sets by mean curvature I. Journal of Differential Geometry, 33:635–681.

    Google Scholar 

  • Firey, W.J. 1974. Shape of worn stones. Mathematika, 21:1–11.

    Google Scholar 

  • Fletcher, L.M., Barsotti, J.B., and Hornak, J.P. 1993. A multispectral analysis of brain tissues. Magnetic Resonance in Medicine, 29:623–630.

    Google Scholar 

  • Florack, L.M.J., ter Haar Romeny, B.M., Koenderink, J.J., and Viergever, M.A. 1994. Linear scale-space. Journal of Mathematical Imaging and Vision, 4(4):325–351.

    Google Scholar 

  • Gerig, G., Martin, J., Kikinis, R., Kübler, O., Shenton, M., and Jolesz, F.A. 1992. Unsupervised tissue type segmentation of 3D dual-echo MR head data. Image and Vision Computing, 10(6):349–360.

    Google Scholar 

  • Grayson, M. 1989. A short note on the evolution of a surface by its mean curvature. Duke Mathematical Journal, 58:555–558.

    Google Scholar 

  • Griffin, L.D., Colchester, A.C.F., and Robinson, G.P. 1992. Structure-sensitive scale and the hierarchical segmentation of images. In Visualization in Biomedical Computing, R. Robb (Ed.), SPIE, vol. 1808, pp. 24–32.

  • Griffin, L.D., Robinson, G.P., and Colchester, A.C.F. 1993. Multiscale hierarchical segmentation. British Machine Vision Conference, J. Illingworth (Ed.), BNVA Press, pp. 135–144.

  • Grimson, W.E.L., Ettinger, G.J., White, S.J., Gleason, P.L., Pérez, L., Wells, W.M., and Kikinis, R. 1995. Evaluating and validating an automated registration system for enhanced reality visualization in surgery. In Proceedings CVRMed, N. Ayache (Ed.), volume 905 of Lecture Notes in Computer Science, Springer-Verlag: Berlin, pp. 3–12.

    Google Scholar 

  • Grimson, W.E.L., Ettinger, G.J., White, S.J., Gleason, P.L., Pérez, L., Wells, W.M., and Kikinis, R. 1996. An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. IEEE Transactions on Medical Imaging, 15(2):129–140.

    Google Scholar 

  • Höhne, K.H. and Hanson, W.H. 1992. Interactive 3-D segmentation of MRI and CT volumes using morphological operations. Journal of Computer Assisted Tomography, 16(2):285–294.

    Google Scholar 

  • Huisken, G. 1984. Flow by mean curvature of convex surfaces into spheres. Journal of Differential Geometry, 20:237–266.

    Google Scholar 

  • Huisken, G. 1991. Asymptotic behaviour of singularities of the mean curvature flow. Journal of Differential Geometry, 31: 285–299.

    Google Scholar 

  • Johnston, B., Atkins, M.S., Mackiewich, B., and Anderson, M. 1996. Segmentation of multiple sclerosis lesions in intensity corrected multispectral MRI. IEEE Transactions on Medical Imaging, 15(2):154–169.

    Google Scholar 

  • Kapur, T., Grimson, W.E.L., Wells, W.M., and Kikinis, R. 1996. Segmentation of brain tissue from Magnetic Resonance images. Medical Image Analysis, 1(2):109–127.

    Google Scholar 

  • Kennedy, D.N., Filipek, P.A., and Caviness, V.S. 1989. Anatomic segmentation and volumetric calculations in nuclear magnetic resonance imaging. IEEE Transactions on Medical Imaging, 8(1):1–7.

    Google Scholar 

  • Kikinis, R., Shenton, M.E., Gerig, G., Martin, J., Anderson, M., Metcalf, D., Guttmann, Ch. R.G., McCarley, R.W., Lorensen, B., Cline, H., and Jolesz, F.A. 1992. Routine quantitative analysis of brain and cerebrospinal fluid spaces with MR imaging. Journal of Magnetic Resonance Imaging, 2(6):619–629.

    Google Scholar 

  • Koenderink, J.J. 1984. The structure of images. Biological Cybernetics, 50:363–370.

    Article  Google Scholar 

  • Koenderink, J.J. and van Doorn, A.J. 1986. Dynamic shape. Biological Cybernetics, 53:383–396.

    Google Scholar 

  • Kohn, M., Tanna, N., Herman, G., Resnick, S.M., Mozley, P.D., Gur, R.E., Alavi, A., Zimmerman, R.A., and Gur, R.C. 1991. Analysis of brain and cerebrospinal fluid volumes with MR imaging. Radiology, 178:115–122.

    Google Scholar 

  • Koster, A.S.E. 1995. Linking Models for Multiscale Image Segmentation. Ph.D. Thesis, Utrecht University, The Netherlands.

    Google Scholar 

  • Koster, A.S.E., Vincken, K.L., De Graaf, C.N., Zander, O.C., and Viergever, M.A. 1997. Heuristic linking models in multiscale image segmentation. Computer Vision and Image Understanding, 65(3):382–402.

    Google Scholar 

  • Li, C., Goldgof, B., and Hall, L.O. 1993. Knowledge-based classi-fication and tissue labeling of MR images of human brain. IEEE Transactions on Medical Imaging, 12(4):740–750.

    Google Scholar 

  • Lim, K.O. and Pfefferbaum, A. 1990. Segmentation of MR brain images into cerebrospinal fluid spaces, white and gray matter. Journal of Computer Assisted Tomography, 13(4):588–593.

    Google Scholar 

  • Maes, F., Vandermeulen, D., Suetens, P., and Marchal, G. 1995. Computer-aided interactive object delineation using an intelligent paintbrush technique. In Proceedings CVRMed, N. Ayache (Ed.), volume 905 of Lecture Notes in Computer Science, Springer-Verlag: Berlin, pp. 77–83.

    Google Scholar 

  • McInerney, T. and Terzopoulos, D. 1996. Deformable models in medical image analysis: A survey. Medical Image Analysis, 1(2): 91–108.

    Google Scholar 

  • Neskovic, P. and Kimia, B.B. 1994. Three-dimensional shape representation from curvature dependent surface evolution. Proc. First International Conference on Image Processing, IEEE, pp. 6–10.

  • Niessen, W.J., Vincken, K.L., and Viergever, M.A. 1996. Comparison of multiscale representations for a linking-based image segmentation model. Proc. IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, San Francisco, pp. 263–272.

  • Niessen, W.J., Vincken, K.L., Weickert, J., ter Haar Romeny, B.M., and Viergever, M.A. n.d. Geodesic deformable models for medical image analysis. IEEE Transactions on Medical Imaging, 17(μ):634–641.

  • Niessen, W.J., Vincken, K.L., Weickert, J., and Viergever, M.A. 1997. Nonlinear multiscale representations for image segmentation. Computer Vision and Image Understanding, 66(2):233–245.

    Google Scholar 

  • Osher, S. and Sethian, S. 1988. Fronts propagating with curvature dependent speed: Algorithms based on the Hamilton-Jacobi formalism. Journal of Computational Physics, 79:12–49.

    Article  Google Scholar 

  • Perona, P. and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7):629–639.

    Article  Google Scholar 

  • Peters, T., Davey, B., Munger, P., Comeau, R., Evans, A., and Olivier, A. 1996. Three-dimensional multimodal image-guidance for neurosurgery. IEEE Transactions on Medical Imaging, 15(2): 121–128.

    Google Scholar 

  • Raya, S.P. 1990. Low-level segmentation of 3-D Magnetic Resonance brain images: A rule-based system. IEEE Transactions on Medical Imaging, 9(3):327–337.

    Google Scholar 

  • Rusinek, H., deLeon, M.J., Goerge, A.E., Stylopoulos, L.A., Chandra, R., Smith, G., Rand, T., Mourino, M., and Kowalski, H. 1991. Alzheimer disease: Measuring loss of cerebral gray matter with MR imaging. Radiology, 178:109–114.

    Google Scholar 

  • Sandor, S. and Leahy, R. 1997. Surface-based labeling of cortical anatomy using a deformable atlas. IEEE Transactions on Medical Imaging, 16(1):41–54.

    Google Scholar 

  • Sethian, J.A. 1990. Numerical algorithms for propagating interfaces: Hamilton-Jacobi equations and conservation laws. Journal of Differential Geometry, 31:131–161.

    Google Scholar 

  • Shenton, M., Kikinis, R., Jolez, F.A., Pollak, S.D., LeMay, M., Wible, C.G., Hokama, H., Martin, J., Metcalf, D., Coleman, M., and McCarley, R.W. 1992. Abnormalities of the left temporal lobe and thought disorder in schizophrenia. New England Journal of Medicine, 327:604–612.

    Google Scholar 

  • Sled, J.G., Zijdenbos, A.P., and Evans, A.C. 1997. A comparison of retrospective intensity non-uniformity correction methods for MRI. In Proceedings Information Processing in Medical Imaging, J.S. Duncan and G. Gindi (Eds.), pp. 459–464.

  • Sled, J.G., Zijdenbos, A.P., and Evans, A.C. 1998. A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Transactions on Medical Imaging, 17(1):87–97.

    Google Scholar 

  • Sonka, M., Tadikonda, S.K., and Collins, S.M. 1996. Knowledgebased interpretation of MR brain images. IEEE Transactions on Medical Imaging, 15(4):443–452.

    Google Scholar 

  • Staib, L.H. and Duncan, J.S. 1996. Model-based deformable surface finding for medical images. IEEE Transactions on Medical Imaging, 15(5):720–731.

    Google Scholar 

  • Vannier, M., Butterfield, R., Jordon, D., Murphy, W., Levitt, R.G., and Gado, M. 1985. Multispectral analysis of magnetic resonance images. Radiology, 154:221–224.

    Google Scholar 

  • Vincken, K.L. 1995. Probabilistic Multiscale Image Segmentation by the Hyperstack. Ph.D. Thesis, Utrecht University, The Netherlands.

    Google Scholar 

  • Vincken, K.L., Koster, A.S.E., and Viergever, M.A. 1997. Probabilistic multiscale image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2(19):109–120.

    Google Scholar 

  • Weickert, J. 1996. Anisotropic Diffusion in Image Processing. Ph.D. Thesis, Dept. of Mathematics, University of Kaiserslautern, Germany. Revised and extended version available as book (Teubner Verlag: Stuttgart, 1998).

    Google Scholar 

  • Weickert, J., ter Haar Romeny, B.M., and Viergever, M.A. 1998. Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Transactions on Image Processing, 7(3):398–410.

    Article  Google Scholar 

  • Wells, W., Kikinis, R., Grimson, E., and Jolesz, F. 1996. Adaptive segmentation of MRI data. IEEE Transactions on Medical Imaging, 15(4):429–442.

    Article  Google Scholar 

  • Yezzi, A., Kichenassamy, S., Kumar, A., Olver, P., and Tannenbaum, A. 1997. A geometric snake model for segmentation of medical imagery. IEEE Transactions on Medical Imaging, 16(2):199–209.

    Article  Google Scholar 

  • Zhu, S.C. and Yuille, A. 1996. Region competition: Unifying snakes, region growing, and Bayes/MDL for multiband image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(9):884–900.

    Article  Google Scholar 

  • Zijdenbos, A., Dawant, B.M., and Margolin, R.A. 1994. Automatic detection of intracranial contours in MR images. Computerized Medical Imaging and Graphics, 18:11–23.

    Article  Google Scholar 

  • Zijdenbos, A., Dawant, B.M., Margolin, R.A., and Palmer, A.C. 1994. Morphometric analysis of white matter lesions in MR images. IEEE Transactions on Medical Imaging, 13(4):716–724.

    Article  Google Scholar 

  • Zuiderveld, K.J., Koning, A.H.J., Stokking, R., Maintz, J.B. Antoine, Appelman, Fred and Viergever, M.A. 1996. Multimodality visualization of medical volume data—our techniques, applications, and experiences. Computer and Graphics, 20(6):775–791.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Image Sciences Institute, University Hospital Utrecht, HP E01. 334, P.O. Box 85500, 3508 CX, The Netherlands

    W.J. Niessen, K.L. Vincken, J. Weickert, B.M. Ter Haar Romeny & M.A. Viergever

Authors
  1. W.J. Niessen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K.L. Vincken
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Weickert
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. B.M. Ter Haar Romeny
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M.A. Viergever
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Niessen, W., Vincken, K., Weickert, J. et al. Multiscale Segmentation of Three-Dimensional MR Brain Images. International Journal of Computer Vision 31, 185–202 (1999). https://doi.org/10.1023/A:1008070000018

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008070000018

Search

Navigation