Skip to main content

Sampling and Low-Rank Tensor Approximation of the Response Surface

  • Conference paper
  • First Online:
Monte Carlo and Quasi-Monte Carlo Methods 2012

Abstract

Most (quasi)-Monte Carlo procedures can be seen as computing some integral over an often high-dimensional domain. If the integrand is expensive to evaluate—we are thinking of a stochastic PDE (SPDE) where the coefficients are random fields and the integrand is some functional of the PDE-solution—there is the desire to keep all the samples for possible later computations of similar integrals. This obviously means a lot of data. To keep the storage demands low, and to allow evaluation of the integrand at points which were not sampled, we construct a low-rank tensor approximation of the integrand over the whole integration domain. This can also be viewed as a representation in some problem-dependent basis which allows a sparse representation. What one obtains is sometimes called a “surrogate” or “proxy” model, or a “response surface”. This representation is built step by step or sample by sample, and can already be used for each new sample. In case we are sampling a solution of an SPDE, this allows us to reduce the number of necessary samples, namely in case the solution is already well-represented by the low-rank tensor approximation. This can be easily checked by evaluating the residuum of the PDE with the approximate solution. The procedure will be demonstrated in the computation of a compressible transonic Reynolds-averaged Navier-Strokes flow around an airfoil with random/uncertain data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brand, M.: Fast low-rank modifications of the thin singular value decomposition. Linear Algebra Appl. 415, 20–30 (2006).

    Article  MathSciNet  MATH  Google Scholar 

  2. Bungartz, H.J., Griebel, M.: Sparse grids. Acta Numer. 13, 147–269 (2004)

    Article  MathSciNet  Google Scholar 

  3. Doostan, A., Iaccarino, G.: A least-squares approximation of partial differential equations with high-dimensional random inputs. J. Comput. Phys. 228, 4332–4345 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  4. Espig, M., Hackbusch, W., Litvinenko, A., Matthies, H.G., Wähnert, P.: Efficient low-rank approximation of the stochastic galerkin matrix in tensor formats. Comput. Math. Appl. (2012). doi:10.1016/j.camwa.2012.10.008

    Google Scholar 

  5. Espig, M., Hackbusch, W., Litvinenko, A., Matthies, H.G., Zander, E.: Efficient analysis of high dimensional data in tensor formats. In: Garcke, J., Griebel, M. (eds.) Sparse Grids and Applications. Lecture Notes in Computational Science and Engineering, vol. 88, pp. 31–56. Springer, Berlin/Heidelberg (2013)

    Google Scholar 

  6. Gerstner, T., Griebel, M.: Numerical integration using sparse grids. Numer. Algorithms 18, 209–232 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  7. Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. Johns Hopkins Studies in the Mathematical Sciences. Johns Hopkins University Press, Baltimore (1996)

    MATH  Google Scholar 

  8. Hackbusch, W., Khoromskij, B.N.: Tensor-product approximation to operators and functions in high dimensions. J. Complexity 23, 697–714 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  9. Janson, S.: Gaussian Hilbert spaces. In: Cambridge Tracts in Mathematics, vol. 129. Cambridge University Press, Cambridge (1997)

    Google Scholar 

  10. Krée, P., Soize, C.: Mathematics of random phenomena. D. Reidel Publishing Co., Dordrecht (1986)

    Book  MATH  Google Scholar 

  11. Kressner, D., Tobler, C.: Low-rank tensor Krylov subspace methods for parametrized linear systems. SIAM J. Matrix Anal. Appl. 32, 1288–1316 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  12. Krosche, M., Niekamp, R.: Low rank approximation in spectral stochastic finite element method with solution space adaption. Informatikbericht 2010–03, Technische Universität Braunschweig, Brunswick (2010). http://www.digibib.tu-bs.de/?docid=00036351

  13. Le Maître, O.P., Knio, O.M.: Spectral methods for uncertainty quantification. In: Scientific Computation. Springer, New York (2010)

    Book  MATH  Google Scholar 

  14. Litvinenko, A., Matthies, H.G.: Sparse data representation of random fields. In: Proceedings in Applied Mathematics and Mechanics. PAMM, vol. 9, pp. 587–588. Wiley-InterScience, Hoboken (2009)

    Google Scholar 

  15. Litvinenko, A., Matthies, H.G.: Low-rank data format for uncertainty quantification. In: Skiadas, Chr.H. (ed.) International Conference on Stochastic Modeling Techniques and Data Analysis Proceedings, pp. 477–484, Chania Crete (2010)

    Google Scholar 

  16. Litvinenko, A., Matthies, H.G.: Uncertainties quantification and data compression in numerical aerodynamics. Proc. Appl. Math. Mech. 11, 877–878 (2011)

    Article  Google Scholar 

  17. Matthies, H.G.: Uncertainty Quantification with Stochastic Finite Elements. Part 1. Fundamentals. Encyclopedia of Computational Mechanics. Wiley, Chichester (2007)

    Google Scholar 

  18. Matthies, H.G., Keese, A.: Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations. Comput. Methods Appl. Mech. Engrg. 194, 1295–1331 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  19. Matthies, H.G., Zander, E.: Solving stochastic systems with low-rank tensor compression. Linear Algebra Appl. 436, 3819–3838 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  20. Mirsky, L.: Symmetric gauge functions and unitarily invariant norms. Q. J. Math. Oxf. Second Series(2) 11, 50–59 (1960)

    Google Scholar 

  21. Nouy, A., Maître, O.L.: Generalized spectral decomposition for stochastic nonlinear problems. J. Comput. Phys. 228, 202–235 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  22. Oseledets, I.V., Savostyanov, D.V., Tyrtyshnikov, E.E.: Linear algebra for tensor problems. Computing 85, 169–188 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  23. Oseledets, I.V., Tyrtyshnikov, E.E.: Breaking the curse of dimensionality, or how to use SVD in many dimensions. SIAM J. Sci. Comput. 31, 3744–3759 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  24. Schwab, C., Gittelson, C.J.: Sparse tensor discretizations of high-dimensional parametric and stochastic PDEs. Acta Numer. 20, 291–467 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  25. Segal, I.E., Kunze, R.A.: Integrals and Operators. Springer, Berlin (1978)

    Book  MATH  Google Scholar 

  26. Wiener, N.: The homogeneous chaos. Amer. J. Math. 60, 897–936 (1938)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

We thank the German Ministry of Economics for the financial support of the project “MUNA—Management and Minimisation of Uncertainties and Errors in Numerical Aerodynamic” within the Luftfahrtforschungsprogramm IV under contract number 20A0604A. We thank also Nathalie Rauschmayr for Fig. 2.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Litvinenko .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Litvinenko, A., Matthies, H.G., El-Moselhy, T.A. (2013). Sampling and Low-Rank Tensor Approximation of the Response Surface. In: Dick, J., Kuo, F., Peters, G., Sloan, I. (eds) Monte Carlo and Quasi-Monte Carlo Methods 2012. Springer Proceedings in Mathematics & Statistics, vol 65. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41095-6_27

Download citation

Publish with us

Policies and ethics