Skip to main content

Deep Spatial-Temporal Convolutional Neural Networks for Medical Image Restoration

  • Chapter
  • First Online:
Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics

Abstract

Computed tomography perfusion (CTP)  facilitates low-cost diagnosis and treatment of acute stroke. Cine scanning allows users to visualize brain anatomy and blood flow in virtually live time. However, effective visualization exposes patients to radiocontrast pharmaceuticals and extended scan times. Higher radiation dosage exposes patients to potential risks including hair loss, cataract formation, and cancer. To alleviate these risks, radiation dosage can be reduced along with tube current and/or X-ray radiation exposure time. However, resulting images may lack sufficient information or be affected by noise and/or artifacts. In this chapter, we propose a deep spatial-temporal convolutional neural network to preserve CTP image quality at reduced tube current, low spatial resolution, and shorter exposure time. This network structure extracts multi-directional features from low-dose and low-resolution patches at different cross sections of the spatial-temporal data and reconstructs high-quality CT volumes. We assess the performance of the network concerning image restoration at different tube currents and multiple resolution scales. The results indicate the ability of our network in restoring high-quality scans from data captured at as low as 21% of the standard radiation dose. The proposed network achieves an average improvement of 7% in perfusion maps compared to the state-of-the-art method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, Floyd J, Fornage M, Gillespie C, Isasi C et al (2017) Heart disease and stroke statistics-2017 update: a report from the american heart association. Circulation 135(10):e146–e603

    Article  Google Scholar 

  2. Britten A, Crotty M, Kiremidjian H, Grundy A, Adam E (2004) The addition of computer simulated noise to investigate radiation dose and image quality in images with spatial correlation of statistical noise: an example application to X-ray CT of the brain. Br J Radiol 77(916):323–328

    Article  Google Scholar 

  3. Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2392–2399

    Google Scholar 

  4. Centers for Disease Control and Prevention (2008) Awareness of stroke warning symptoms-13 States and the District of Columbia, 2005. Morb Mortal Wkly Rep 57(18):481

    Google Scholar 

  5. Cho G, Kim JH, Park TS, Cho K (2017) Proposing a simple radiation scale for the public: Radiation index. Nucl Eng Technol 49(3):598–608

    Article  Google Scholar 

  6. Chodick G, Bekiroglu N, Hauptmann M, Alexander BH, Freedman DM, Doody MM, Cheung LC, Simon SL, Weinstock RM, Bouville A et al (2008) Risk of cataract after exposure to low doses of ionizing radiation: a 20-year prospective cohort study among US radiologic technologists. Am J Epidemiol 168(6):620–631

    Article  Google Scholar 

  7. de González AB, Mahesh M, Kim K-P, Bhargavan M, Lewis R, Mettler F, Land C (2009) Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med 169(22):2071–2077

    Article  Google Scholar 

  8. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision. Springer, pp 184–199

    Google Scholar 

  9. Erhan D, Szegedy C, Toshev A, Anguelov D (2014) Scalable object detection using deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2147–2154

    Google Scholar 

  10. Hall MJ, Levant S, DeFrances CJ (2012) Hospitalization for stroke in US hospitals, 1989–2009. Diabetes 18(23):23

    Google Scholar 

  11. Erhan D, Szegedy C, Toshev A, Anguelov D (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

    Google Scholar 

  12. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM international conference on Multimedia. ACM, pp 675–678

    Google Scholar 

  13. Journy NM, Lee C, Harbron RW, McHugh K, Pearce MS, de González AB (2017) Projected cancer risks potentially related to past, current, and future practices in paediatric CT in the United Kingdom, 1990–2020. Br J Cancer 116(1):109

    Article  Google Scholar 

  14. Juluru K, Shih J, Raj A, Comunale J, Delaney H, Greenberg E, Hermann C, Liu Y, Hoelscher A, Al-Khori N et al (2013) Effects of increased image noise on image quality and quantitative interpretation in brain CT perfusion. Am J Neuroradiol 34(8):1506–1512

    Article  Google Scholar 

  15. Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: The IEEE conference on computer vision and pattern recognition, June 2016

    Google Scholar 

  16. Mao XJ, Shen C, Yang YB (2016) Image restoration using convolutional auto-encoders with symmetric skip connections. arXiv:1606.08921

  17. Mettler FA Jr, Bhargavan M et al (2009) Radiologic and nuclear medicine studies in the United States and Worldwide: frequency, radiation dose, and comparison with other radiation sources-1950-2007 1. Radiology 253(2):520–531

    Article  Google Scholar 

  18. Murphy A, So A, Lee T-Y, Symons S, Jakubovic R, Zhang L, Aviv RI (2014) Low dose CT perfusion in acute ischemic stroke. Neuroradiology 56(12):1055–1062

    Article  Google Scholar 

  19. Oktay O, Bai W, Lee M et al (2016) Multi-input cardiac image super-resolution using convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 246–254

    Google Scholar 

  20. Papyan V, Elad M (2016) Multi-scale patch-based image restoration. IEEE Trans Image Process 25(1):249–261

    Article  MathSciNet  Google Scholar 

  21. Shi W et al (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883

    Google Scholar 

  22. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

    Google Scholar 

  23. Takei Y, Miyazaki O, Matsubara K, Shimada Y, Muramatsu Y, Akahane K, Fujii K, Suzuki S, Koshida K (2016) Nationwide survey of radiation exposure during pediatric computed tomography examinations and proposal of age-based diagnostic reference levels for Japan. Pediatr Radiol 46(2):280–285

    Article  Google Scholar 

  24. Thierfelder KM, Sommer WH, Baumann AB, Klotz E, Meinel FG, Strobl FF, Nikolaou K, Reiser MF, von Baumgarten L (2013) Whole-brain CT perfusion: reliability and reproducibility of volumetric perfusion deficit assessment in patients with acute ischemic stroke. Neuroradiology 55(7):827–835

    Article  Google Scholar 

  25. Wintermark M, Lev M (2010) FDA investigates the safety of brain perfusion CT. Am J Neuroradiol 31(1):2–3

    Article  Google Scholar 

  26. Xiao Y, Gupta A, Sanelli PC, Fang R (2017) STAR: spatio-temporal architecture for super-resolution in low-dose CT perfusion. In: International workshop on machine learning in medical imaging. Springer, pp 97–105

    Google Scholar 

  27. Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Advances in neural information processing systems, pp 341–349

    Google Scholar 

  28. Yang Q, Tong X, Schieb L, Vaughan A, Gillespie C, Wiltz JL, King SC, Odom E, Merritt R, Hong Y et al (2017) Vital signs: recent trends in stroke death rates-United States, 2000–2015. Morb Mortal Wkly Rep 66(35):933–939

    Article  Google Scholar 

  29. Yu L, Fletcher JG, Shiung M, Thomas KB, Matsumoto JM, Zingula SN, McCollough CH (2015) Radiation dose reduction in pediatric body CT using iterative reconstruction and a novel image-based denoising method. Am J Roentgenol 205(5):1026–1037

    Article  Google Scholar 

  30. Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work is partially supported by the National Science Foundation under Grant No. IIS-1564892, the University of Florida Informatics Institute SEED Funds and the UF Clinical and Translational Science Institute, which is supported in part by the NIH National Center for Advancing Translational Sciences under award number UL1 TR001427. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ruogu Fang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Xiao, Y. et al. (2019). Deep Spatial-Temporal Convolutional Neural Networks for Medical Image Restoration. In: Lu, L., Wang, X., Carneiro, G., Yang, L. (eds) Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-030-13969-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-13969-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-13968-1

  • Online ISBN: 978-3-030-13969-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics