Abstract
Variational data assimilation is used at major weather prediction centers to produce the initial conditions for 7- to 10-day weather forecasts. This technique requires the solution of a very large data-fitting problem in which the major element is a set of partial differential equations that models the evolution of the atmosphere over a time window for which observational data has been gathered. Real-time solution of this difficult computational problem requires sophisticated models of atmospheric physics and dynamics, effective use of supercomputers, and specialized algorithms for optimization and linear algebra. The optimization algorithm can be accelerated by using a spectral preconditioner based on the Lanczos method. This paper shows how practical demands of the application dictate the various algorithmic choices that are made in the nonlinear optimization solver, with particular reference to the system in operation at the European Centre for Medium-Range Weather Forecasts.
Similar content being viewed by others
References
Biegler L, Waecther A (2003) DAE-constrained optimization. SIAG/OPT Views-and-News 14:10–15
Biegler LT, Ghattas O, Heinkenschloss M, van Bloemen Waanders B (2003) Large-scale PDE-constrained optimization. Lecture notes in computational science and engineering, vol 30. Springer, Berlin
Biros G, Ghattas O (2005) Parallel Lagrange-Newton-Krylov-Schur methods for PDE-constrained optimization. Part I: The Krylov-Schur solver. SIAM J Sci Comput 27:687–713
Bock H-G, Plitt KJ (1984) A multiple shooting algorithm for direct solution of optimal control problems. In: Proceedings of the 9th IFAC world conference, Budapest, 1984. Pergamon, Elmsford, pp 242–247
Courtier P, Thépaut J-N, Hollingsworth A (1994) A strategy for operational implementation of 4D-Var, using an incremental approach. Q J R Meteorol Soc 120:1367–1387
Fisher M, Leutbecher M, Kelly G (2005) On the equivalence between Kalman smoothing and weak-constraint four-dimensional variational data assimilation. Q J R Meteorol Soc 131:3235–3246
Giraud L, Gratton S (2006) On the sensitivity of some spectral preconditioners. SIAM J Matrix Anal Appl 27:1089–1105
Golub GH, Van Loan CF (1989) Matrix computations, 2nd edn. Johns Hopkins Press, Baltimore
Haltiner GJ, Williams R (1980) Numerical prediction and dynamic meteorology, 2nd edn. Wiley, New York
Morales JL, Nocedal J (2000) Automatic preconditioning by limited memory quasi-Newton updating. SIAM J Optim 10:1079–1096
Nabben R, Vuik C (2004) A comparison of deflation and coarse grid correction applied to porous media flow. SIAM J Numer Anal 42:1631–1647
Nocedal J, Wright SJ (2006) Numerical optimization, 2nd edn. Springer, Berlin
Notay Y (1993) On the convergence rate of the conjugate gradients in presence of rounding errors. Numer Math 65:301–317
Simmons A, Hollingsworth A (2002) Some aspects of the improvement in skill of numerical weather prediction. Q J R Meteorol Soc 128:647–677
Trémolet Y (2005) Incremental 4D-Var convergence study. Technical Memorandum 469, European Center for Medium-Range Weather Forecasts, July 2005
Trémolet Y (2006) Accounting for an imperfect model in 4D-Var. Q J R Meteorol Soc 132:2483–2504
Young DP, Huffman WP, Melvin RG, Hilmes CL, Johnson FT (2002) Nonlinear elimination in aerodynamic analysis and design optimization. In: Proceedings of the first Sandia workshop on large-scale PDE constrained optimization. Lecture notes in computational science and engineering. Springer, Berlin
Author information
Authors and Affiliations
Corresponding author
Additional information
The research of J. Nocedal was supported by National Science Foundation grant CCR-0219438 and Department of Energy grant DE-FG02-87ER25047-A004.
The research of S.J. Wright was supported by National Science Foundation grants CCF-0430504, DMS-0427589, CTS-0456694 and CNS-0540147.
Rights and permissions
About this article
Cite this article
Fisher, M., Nocedal, J., Trémolet, Y. et al. Data assimilation in weather forecasting: a case study in PDE-constrained optimization. Optim Eng 10, 409–426 (2009). https://doi.org/10.1007/s11081-008-9051-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11081-008-9051-5