Abstract
Surrogates have been widely used for replacing computationally costly computer simulations. To improve the prediction accuracy with less sampling cost, sequential sampling is often used to seek targeted training samples for surrogate modeling. Previous methods often integrate gradient information to improve the sampling effect, but the increase of prediction accuracy is still limited for complicated problems. It is intractable how to better exploit the useful gradient information to sample potential highly nonlinear regions. In this paper, an effective gradient and geometry enhanced Kriging sequential sampling approach is proposed to handle this problem. First, a novel improvement function, which combines the approximate gradient and prediction variance, is constructed to measure the improvement of a candidate sampling point. Second, the design domain is partitioned into multiple Voronoi subdomains according to design points, and an adaptive and efficient cross-validation-based criterion is introduced to determine the candidate sampling regions and reduce the optimization cost. Finally, the improvement function is maximized in the selected Voronoi subdomains to sample a new point, which can effectively achieve great accuracy improvement in the nonlinear area. The proposed approach is tested on several highly nonlinear functions and an application-related example, and the experimental results confirm its effectiveness.
Similar content being viewed by others
References
Aute V, Saleh K, Abdelaziz O, Azarm S, Radermacher R (2013) Cross-validation based single response adaptive design of experiments for kriging metamodeling of deterministic computer simulations. Struct Multidiscip Optim 48(3):581–605
Beck J, Guillas S (2016) Sequential design with mutual information for computer experiments (mice): emulation of a tsunami model. SIAM/ASA J Uncertain Quantif 4(1):739–766
Ben Salem M, Roustant O, Gamboa F, Tomaso L (2017) Universal prediction distribution for surrogate models. SIAM/ASA J Uncertain Quantif 5(1):1086–1109
Bouhlel MA, Hwang JT, Bartoli N, Lafage R, Morlier J, Martins JRRA (2019) A python surrogate modeling framework with derivatives. Adv Eng Softw pp 102662
Busby D (2009) Hierarchical adaptive experimental design for gaussian process emulators. Reliab Eng Syst Saf 94(7):1183–1193
Crombecq K, Gorissen D, Deschrijver D, Dhaene T (2011) A novel hybrid sequential design strategy for global surrogate modeling of computer experiments. SIAM J Sci Comput 33(4):1948–1974
Dubrule O (1983) Cross validation of kriging in a unique neighborhood. J Int Assoc Math Geol 15(6):687–699
Gorissen D, De Tommasi L, Crombecq K, Dhaene T (2009) Sequential modeling of a low noise amplifier with neural networks and active learning. Neural Comput Appl 18(5):485–494
Handcock MS, Stein ML (1993) A Bayesian analysis of kriging. Technometrics 35(4):403–410
Jin R, Chen W, Sudjianto A (2002) On sequential sampling for global metamodeling in engineering design. In: 2002 ASME international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers Digital Collection, pp 539–548
Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J Glob Optim 13(4):455–492
Kaminsky AL, Wang Y, Pant K, Hashii WN, Atachbarian A (2018) Adaptive sampling techniques for surrogate modeling to create high-dimension aerodynamic loading response surfaces. In: 2018 applied aerodynamics conference, p 4199
Lam CQ (2008) Sequential adaptive designs in computer experiments for response surface model fit. PhD thesis The Ohio State University, Columbus
Li G, Aute V, Azarm S (2010) An accumulative error based adaptive design of experiments for offline metamodeling. Struct Multidiscip Optim 40(1-6):137
Lin Y, Mistree F, Allen JK, Tsui KL, Chen VC (2004) A sequential exploratory experimental design method: development of appropriate empirical models in design. In: ASME 2004 international design engineering technical conferences and computers and information in engineering conference. American Society of Mechanical Engineers Digital Collection, pp 1021–1035
Liu H, Xu S, Ma Y, Chen X, Wang X (2016) An adaptive bayesian sequential sampling approach for global metamodeling. J Mech Des 138(1):011404
Liu H, Cai J, Ong YS (2017) An adaptive sampling approach for kriging metamodeling by maximizing expected prediction error. Comput Chem Eng 106:171–182
Liu H, Ong YS, Cai J (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416
Lophaven SN, Nielsen HB, Søndergaard J (2002) Dace–a matlab kriging toolbox–version 2.0. Tech. rep., Technical University of Denmark
Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808
Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060
Mu R, Dai L, Xu J (2017) Sequential design for response surface model fit in computer experiments using derivative information. Commun Stat-Simul Comput 46(2):1148–1155
Romero DA, Marin VE, Amon CH (2015) Error metrics and the sequential refinement of kriging metamodels. J Mech Des 137(1)
Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423
Santner TJ, Williams BJ, Notz W, Williams BJ (2018) The design and analysis of computer experiments. Springer Series in Statistics, Springer, New York
Sasena M, Papalambros PY, Goovaerts P (2002) Exploration of metamodeling sampling criteria for constrained global optimization. Eng Optim 34(3):263–278
Schöbi R, Sudret B, Wiart J (2015) Polynomial-chaos-based kriging. Int J Uncertain Quantif 5(2):171–193
van der Herten J, Couckuyt I, Deschrijver D, Dhaene T (2015) A fuzzy hybrid sequential design strategy for global surrogate modeling of high-dimensional computer experiments. SIAM J Sci Comput 37(2):A1020–A1039
Viana FAC (2011) SURROGATES toolbox user’s guide. Gainesville, FL Version 3.0. https://sites.google.com/site/srgtstoolbox/
Viana FAC, Simpson TW, Balabanov V, Toropov V (2014) Metamodeling in multidisciplinary design optimization: how far have we really come? AIAA J 52(4):670–690
Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on voronoi diagram and cross validation. J Mech Des 136(7):071009
Yao W, Chen X, Zhao Y, Tooren MV (2012) Concurrent subspace width optimization method for rbf neural network modeling. IEEE Trans Neural Netw Learn Syst 23(2):247–259
Yao W, Chen X, Huang Y, van Tooren M (2014) A surrogate-based optimization method with rbf neural network enhanced by linear interpolation and hybrid infill strategy. Optim Methods Softw 29 (2):406–429
Zhang Y, Kim NH, Park C, Haftka RT (2018) Multifidelity surrogate based on single linear regression. AIAA J 56(12):4944–4952
Zhang Y, Neelakantan A, Park C, Kim NH, Lam H, Haftka RT (2019a) Adaptive sampling with varying sampling cost for design space exploration. AIAA J 57(3):1032–1043
Zhang Y, Yao W, Ye S, Chen X (2019b) A regularization method for constructing trend function in kriging model. Struct Multidiscip Optim 59(4):1221–1239
Zhang Y, Yao W, Chen X, Ye S (2020) A penalized blind likelihood kriging method for surrogate modeling. Struct Multidiscip Optim 61(2):457–474
Funding
This work is supported by the National Natural Science Foundation of China (Nos. 11725211 and 51675525).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Shapour Azarm
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Replication of results
The codes are made available as Supplementary material.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Chen, X., Zhang, Y., Zhou, W. et al. An effective gradient and geometry enhanced sequential sampling approach for Kriging modeling. Struct Multidisc Optim 64, 3423–3438 (2021). https://doi.org/10.1007/s00158-021-03016-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-021-03016-9