Abstract
Sample average approximation (SAA) method has recently been applied to solve stochastic programs with second order stochastic dominance (SSD) constraints. In particular, Hu et al. (Math Program 133:171–201, 2012) presented a detailed convergence analysis of \(\epsilon \)-optimal values and \(\epsilon \)-optimal solutions of sample average approximated stochastic programs with polyhedral SSD constraints. In this paper, we complement the existing research by presenting convergence analysis of stationary points when SAA is applied to a class of stochastic minimization problems with SSD constraints. Specifically, under some moderate conditions we prove that optimal solutions and stationary points obtained from solving sample average approximated problems converge with probability one to their true counterparts. Moreover, by exploiting some recent results on large deviation of random functions and sensitivity analysis of generalized equations, we derive exponential rate of convergence of stationary points.
Similar content being viewed by others
References
Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhauser, Boston (1990)
Aumann, R.J.: Integrals of set-valued functions. J. Math. Anal. Appl. 12, 1–12 (1965)
Athreya, K.B., Lahiri, S.N.: Measure Theory and Probability Theory. Springer Texts in Statistics. Springer, New York (2006)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer Series in Operations Research. Springer, New York (2000)
Borwein, J.M.: Stability and regular points of inequality systems. J. Optim. Theory Appl. 48, 9–52 (1986)
Borwein, J.M., Zhu, Q.J.: A survey of subdifferential calculus with applications. Nonlinear Anal. Ser. A Theory Methods 38, 687–773 (1999)
Castaing, C., Valadier, M.: Convex Analysis and Measurable Multifunctions. Lecture Notes in Mathematics. Springer, Berlin (1977)
Clarke, F.H.: Optimization and Nonsmooth Analysis. Wiley, New York (1983)
Conejo, A., Carrión, M., Morales, J.: Decision Making Under Uncertainty in Electricity Markets. Internation Series in Operations Research & Management Science. Springer, New York (2010)
Dentcheva, D., Ruszczyński, A.: Optimization with stochastic dominance constraints. SIAM J. Optim. 14, 548–566 (2003)
Dentcheva, D., Ruszczyński, A.: Optimality and duality theory for stochastic optimization problems with nonlinear dominance constraints. Math. Program. 99, 329–350 (2004)
Dentcheva, D., Ruszczyński, A.: Portfolio optimization with stochastic dominance constraints. J. Banking Financ. 30, 433–451 (2006)
Dentcheva, D., Ruszczyński, A.: Composite semi-infinite optimization. Control Cybern. 36, 1–14 (2007)
Dentcheva, D., Ruszczyński, A.: Risk-averse portfolio optimization via stochastic dominance constraints. In: Lee, C., Lee, A., Lee, J. (eds.) Handbook of Quantitative Finance and Risk Management, vol. 1. Springer, New York (2010)
Fábián, C., Mitra, G., Roman, D.: Processing second-order stochastic dominance models using cutting-plane representations. Math. Program. 130, 33–57 (2011)
Gugat, M.: A parametric review on the Mangasarian–Fromovitz constraint qualification. Math. Program. 85, 643–653 (1999)
Hess, C.: Set-Valued Integration and Set-Valued Probability Theory: An Overview, Handbook of Measure Theory, vol. 1-2. North-Holland, Amsterdam (2002)
Homem-de-Mello, T.: A cutting surface method for uncertain linear programs with polyhedral stochastic dominance constraints. SIAM J. Optim. 20, 1250–1273 (2009)
Hu, J., Homem-de-Mello, T., Mehrotra, S.: Sample average approximation for stochastic dominance constrained programs. Math. Program. 133, 171–201 (2012)
Liu Y., Römisch W., Xu H.: Quantitative Stability Analysis of Stochastic Generalized Equations, manuscript (2011)
Liu, Y., Xu, H., Lin, G.H.: Stability analysis of two stage stochastic mathematical programs with complementarity constraints via NLP-regularization. SIAM J. Optim. 21, 669–705 (2011)
Liu, Y., Xu, H.: Stability and sensitivity analysis of stochastic programs with second order dominance constraints. Math. Program. first online (2012)
Meskarian, R., Xu, H., Fliege, J.: Numerical methods for stochastic programs with second order dominance constraints with applications to portfolio optimization. Eur. J. Oper. Res. 216, 376–385 (2011)
Papageorgiou, N.S.: On the theory of banach space valued multifunctions. I: integration and conditional expectation. J. Multivar. Anal. 17, 185–206 (1985)
Polak, E.: On the mathematical foundations of nondifferentiable optimization in engineering design. SIAM Rev. 29, 21–91 (1987)
Qi, L., Shapiro, A., Ling, C.: Differentiability and semismoothness properties of integral functions and their applications. Math. Program. 102, 223–248 (2005)
Robinson, S.M.: Analysis of sample-path optimization. Math. Oper. Res. 21, 513–528 (1996)
Rudolf, G., Ruszczyński, A.: Optimization problems with second order stochastic dominance constraints: duality, compact formulations, and cut generation methods. SIAM J. Optim. 19, 1326–1343 (2008)
Rusczyński, A., Shapiro, A.: Stochastic programming models. In: Rusczyński, A., Shapiro, A. (eds.) Stochastic Programming, Handbooks in OR & MS, vol. 10. North-Holland Publishing Company, Amsterdam (2003)
Shapiro, A.: Monte Carlo sampling methods. In: Rusczyński, A., Shapiro, A. (eds.) Stochastic Programming, Handbooks in OR & MS, vol. 10. North-Holland Publishing Company, Amsterdam (2003)
Shapiro, A., Xu, H.: Uniform laws of large numbers for set-valued mappings and subdifferentials of random functions. J. Math. Anal. Appl. 325, 1390–1399 (2007)
Shapiro, A., Xu, H.: Stochastic mathematical programs with equilibrium constraints, modelling and sample average approximation. Optimization 57, 395–418 (2008)
Sun, H., Xu, H.: A note on uniform exponential convergence of sample average approximation of random functions. J. Math. Anal. Appl. 385, 698–708 (2012)
Terán, P.: On a uniform law of large numbers for random sets and subdifferentials of random functions. Stat. Probab. Lett. 78, 42–49 (2008)
Xu, H.: Uniform exponential convergence of sample average random functions under general sampling with applications in stochastic programming. J. Math. Anal. Appl. 368, 692–710 (2010)
Xu, H., Zhang, D.: Monte Carlo methods for mean-risk optimization and portfolio selection. Comput. Manag. Sci. 9, 3–29 (2012)
Ye, J.J.: Constraint qualifications and necessary optimality conditions for optimization problems with variational inequality constraints. SIAM J. Optim. 10, 943–962 (2000)
Acknowledgments
The authors are grateful to the three anonymous referees for their insightful comments which have significantly helped improve the quality of the paper. They are also thankful to Professor Henry Wolkowicz for organizing an effective review.
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to Professor Jon Borwein on the occasion of his 60th birthday.
The first author was supported by China Scholarship Council, the National Natural Science Foundation of China No. 11171159 and the Specialized Research Fund of Doctoral Program of Higher Education of China No. 20103207110002.
Rights and permissions
About this article
Cite this article
Sun, H., Xu, H. Convergence analysis of stationary points in sample average approximation of stochastic programs with second order stochastic dominance constraints. Math. Program. 143, 31–59 (2014). https://doi.org/10.1007/s10107-013-0711-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-013-0711-7