Skip to main content

Targeting Atmospheric Simulation Algorithms for Large, Distributed-Memory, GPU-Accelerated Computers

  • Chapter
  • First Online:
GPU Solutions to Multi-scale Problems in Science and Engineering

Part of the book series: Lecture Notes in Earth System Sciences ((LNESS))

Abstract

Computing platforms are increasingly moving to accelerated architectures, and here we deal particularly with GPUs. In Norman et al. (2011), a method was developed for atmospheric simulation to improve efficiency on large, distributed-memory machines by reducing communication demand and increasing the time step. Here, we improve upon this method to further target GPU-accelerated platforms by reducing GPU memory accesses, removing a synchronization point, and clustering computations. The modified code ran more than two times faster than the original in some cases even though more computations were required, demonstrating the importance of improving memory handling on the GPU. Furthermore, we discovered that the modification also has a near 100 % hit rate in fast, on-chip L1 cache and discuss the reasons for this. Finally, we remark on further potential improvements to GPU efficiency.

This submission was written by the author(s) acting in (his/her/their) own independent capacity and not on behalf of UT-Battelle, LLC, or its affiliates or successors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ahmad N, Linderman J (2007) Euler solutions using flux-based wave decomposition. Int J Numer Methods Fluids 54:47–72

    Article  MATH  Google Scholar 

  • Capdeville G (2008) A central weno scheme for solving hyperbolic conservation laws on non-uniform meshes. J Comput Phys 227:2977–3014

    Article  MathSciNet  MATH  Google Scholar 

  • Cullen MJP, Davies T (1991) A conservative split-explicit integration scheme with fourth-order horizontal advection. Q J R Meteorol Soc 117:993–1002

    Article  Google Scholar 

  • Durran DR (1991) The third-order Adams-Bashforth method: an attractive alternative to leapfrog time differencing. Monthly Weather Rev 119:702–720

    Article  Google Scholar 

  • Evans KJ, Rouson DW, Salinger AG, Taylor MA, Weijer W, White IJB (2009). A scalable and adaptable solution framework within components of the community climate system model. In: ICCS 2009 proceedings of the 9th international conference on computational science.

    Google Scholar 

  • Gassmann A (2005) An improved two-time-level split-explicit integration scheme for non-hydrostatic compressible models. Meteorol Atmos Phys 88:23–38

    Article  Google Scholar 

  • Giraldo FX, Restelli M (2008) A study of spectral element and discontinuous Galerkin methods for the Navier-Stokes equations in nonhydrostatic mesoscale atmospheric modeling: equation sets and test cases. J Comput Phys 227:3849–3877

    Article  MathSciNet  MATH  Google Scholar 

  • Khairoutdinov M, Randall D, DeMott C (2005) Simulations of the atmospheric general circulation using a cloud-resolving model as a superparameterization of physical processes. J Atmos Sci 62:2136–2154

    Article  Google Scholar 

  • Klemp JB, Skamarock WC, Dudhia J (2007) Conservative split-explicit time integration methods for the compressible nonhydrostatic equations. Monthly Weather Rev 135:2897–2913

    Article  Google Scholar 

  • Knoll DA, Keyes DE (2004) Jacobian-free Newton-Krylov methods: a survey of approaches and applications. J Comput Phys 193:357–397

    Article  MathSciNet  MATH  Google Scholar 

  • Leveque RJ (2002) Finite volume methods for hyperbolic problems. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  • Lin S-J, Rood RB (1997) An explicit flux-form semi-Lagrangian shallow-water model on the sphere. Q J R Meteorol Soc 123:2477–2498

    Article  Google Scholar 

  • Nair RD, Choi H-W, Tufo HM (2009) Computational aspects of a scalable high-order discontinuous Galerkin atmospheric dynamical core. Comput Fluids 38:309–319

    Article  MathSciNet  MATH  Google Scholar 

  • Norman MR, Nair RD, Semazzi FHM (2011) A low communication and large time step explicit finite-volume solver for non-hydrostatic atmospheric dynamics. J Comput Phys 230(4):1567–1584

    Article  MathSciNet  MATH  Google Scholar 

  • Staniforth A, Cote J (1991) Semi-lagrangian integration schemes for atmospheric models: a review. Monthly Weather Rev 119(9):2206–2223

    Article  Google Scholar 

  • Taylor MA, Tribbia JJ, Iskandarani M (1997) The spectral element method for the shallow water equations on the sphere. J Comput Phys 130:92–108

    Article  MATH  Google Scholar 

  • Taylor MA, Edwards J, Thomas S, Nair R (2007) A mass and energy conserving spectral element atmospheric dynamical core on the cubed-sphere grid. J Phys Conf Ser 78:012074

    Article  Google Scholar 

  • Williamson DL (2007) The evolution of dynamical cores for global atmospheric models. J Meteorol Soc Jpn 85B:241–269

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthew R. Norman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Norman, M.R. (2013). Targeting Atmospheric Simulation Algorithms for Large, Distributed-Memory, GPU-Accelerated Computers. In: Yuen, D., Wang, L., Chi, X., Johnsson, L., Ge, W., Shi, Y. (eds) GPU Solutions to Multi-scale Problems in Science and Engineering. Lecture Notes in Earth System Sciences. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16405-7_17

Download citation

Publish with us

Policies and ethics