Abstract
We investigate in this paper global convergence properties of the augmented Lagrangian method for nonlinear semidefinite programming (NLSDP). Four modified augmented Lagrangian methods for solving NLSDP based on different algorithmic strategies are proposed. Possibly infeasible limit points of the proposed methods are characterized. It is proved that feasible limit points that satisfy the Mangasarian-Fromovitz constraint qualification are KKT points of NLSDP without requiring the boundedness condition of the multipliers. Preliminary numerical results are reported to compare the performance of the modified augmented Lagrangian methods.
Similar content being viewed by others
References
Andreani, R., Birgin, E.G., Martínez, J.M., Schuverdt, M.L.: Augmented Lagrangian methods under the constant positive linear dependence constraint qualification. Math. Program. 111, 5–32 (2008)
Andreani, R., Birgin, E.G., Martínez, J.M., Schuverdt, M.L.: On augmented Lagrangian methods with general lower-level constraints. SIAM J. Optim. 18, 1286–1309 (2007)
Andreani, R., Martínez, J.M., Schuverdt, M.L.: On the relation between the constant positive linear dependence condition and quasinormality constraint qualification. J. Optim. Theory Appl. 125, 473–485 (2005)
Ben-Tal, A., Jarre, F., Kocvara, M., Nemirovski, A., Zowe, J.: Optimal design of trusses under a nonconvex global buckling constraints. Optim. Eng. 1, 189–213 (2000)
Bertsekas, D.P.: Nonlinear Programming, 2nd edn. Athena Scientific, Belmont (1999)
Birgin, E.G., Martínez, J.M., Raydan, M.: Nonmonotone spectral projected gradient methods on convex sets. SIAM J. Optim. 10, 1196–1211 (2000)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Chan, Z.X., Sun, D.: Constraint nondegeneracy, strong regularity and nonsingularity in semidefinite programming. SIAM J. Optim. 19, 370–396 (2008)
Coleman, T.F., Li, Y., Kaya, C.Y.: An interior trust region approach for nonlinear minimization subject to bounds. SIAM J. Optim. 6, 418–445 (1996)
Coleman, T.F., Li, Y.: On the convergence of reflective Newton methods for largescale nonlinear minimization subject to bounds. Math. Program. 67, 189–224 (1994)
Conn, A.R., Gould, N.I.M., Sartenaer, A., Toint, P.L.: Convergence properties of an augmented Lagrangian algorithm for optimization with a combination of general equality and linear constraints. SIAM J. Optim. 6, 674–703 (1996)
Conn, A.R., Gould, N.I.M., Toint, P.L.: A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds. SIAM J. Numer. Anal. 28, 545–572 (1991)
Correa, R., Ramírez, C.H.: A global algorithm for solving nonlinear semidefinite programming. SIAM J. Optim. 15, 303–318 (2004)
Diniz-Ehrhardt, M.A., Gomes-Ruggiero, M.A., Martınez, J.M., Santos, S.A.: Augmented Lagrangian algorithms based on the spectral projected gradient method for solving nonlinear programming problems. J. Optim. Theory Appl. 123, 497–517 (2004)
Fares, B., Apkarian, P., Noll, D.: An augmented Lagrangian method for a class of LMI-constrained problems in robust control theory. Int. J. Control 74, 348–360 (2001)
Fares, B., Noll, D., Apkarian, P.: Robust control via sequential semidefinite programming. SIAM J. Control Optim. 40, 1791–1820 (2002)
Forsgren, A.: Optimality conditions for nonconvex semidefinite programming. Math. Program. 88, 105–128 (2000)
Huang, X.X., Teo, K.L., Yang, X.Q.: Approximate augmented Lagrangian functions and nonlinear semidefinite programs. Acta Math. Sin. Engl. Ser. 22, 1283–1296 (2006)
Huang, X.X., Teo, K.L., Yang, X.Q.: Lower-order penalization to nonlinear semidefinite programming. J. Optim. Theory Appl. 132, 1–20 (2007)
Huang, X.X., Yang, X.Q., Teo, K.L.: Augmented Lagrangian and nonlinear semidefinite programs. In: Variational Analysis and Applications. Nonconvex Optimization and Its Applications, vol. 79, pp. 513–529 (2005)
Jarre, F.: An interior point method for semidefinite programs. Optim. Eng. 1, 347–372 (2000)
Kanzow, C., Nagel, C.: Semidefinite programs: new search directions, smoothing-type methods, and numerical results. SIAM J. Optim. 13, 1–23 (2002)
Lewis, R.M., Torczon, V.: A globally convergent augmented Lagrangian pattern search algorithm for optimization with general constraints and simple bounds. SIAM J. Optim. 12, 1075–1089 (2002)
Luo, H.Z., Wu, H.X., Chen, G.T.: On the convergence of augmented Lagrangian methods for nonlinear semidefinite programming. J. Glob. Optim. 54, 599–618 (2012)
Luo, H.Z., Mastroeni, G., Wu, H.X.: Separation approach for augmented Lagrangians in constrained nonconvex optimization. J. Optim. Theory Appl. 144, 275–290 (2010)
Luo, H.Z., Sun, X.L., Li, D.: On the convergence of augmented Lagrangian methods for constrained global optimization. SIAM J. Optim. 18, 1209–1230 (2007)
Luo, H.Z., Sun, X.L., Wu, H.X.: Convergence properties of augmented Lagrangian methods for constrained global optimization. Optim. Methods Softw. 23, 763–778 (2008)
Luo, H.Z., Sun, X.L., Xu, Y.F.: Convergence properties of modified and partially-augmented Lagrangian methods for mathematical programming with complementarity constraints. J. Optim. Theory Appl. 145, 489–506 (2010)
Luo, H.Z., Sun, X.L., Xu, Y.F., Wu, H.X.: On the convergence properties of modified augmented Lagrangian methods for mathematical programming with complementarity constraints. J. Glob. Optim. 46, 217–232 (2010)
Mosheyev, L., Zibulevsky, M.: Penalty/barrier multiplier algorithm for semidefinite programming. Optim. Methods Softw. 13, 235–261 (2000)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (1999)
Noll, D.: Local convergence of an augmented Lagrangian method for matrix inequality constrained programming. Optim. Methods Softw. 22, 777–802 (2007)
Qi, H.D.: Local duality of nonlinear semidefinite programming. Math. Oper. Res. 34, 124–141 (2009)
Qi, L., Wei, Z.: On the constant positive linear dependence condition and its application to SQP methods. SIAM J. Optim. 10, 963–981 (2000)
Rockafellar, R.T.: Lagrange multipliers and optimality. SIAM Rev. 35, 183–238 (1993)
Shapiro, A.: First and second order analysis of nonlinear semidefinite programs. Math. Program., Ser. B 77, 301–320 (1997)
Stingl, M.: On the solution of nonlinear semidefinite programs by augmented Lagrangian methods. PhD thesis, Institute of Applied Mathematics, University Erlangen-Nurnberg (2005)
Sun, D.: The strong second-order sufficient condition and constraint nondegeneracy in nonlinear semidefinite programming and their implications. Math. Oper. Res. 31, 761–776 (2006)
Sun, D., Sun, J., Zhang, L.W.: The rate of convergence of the augmented Lagrangian method for nonlinear semidefinite programming. Math. Program. 114, 349–391 (2008)
Sun, J., Zhang, L.W., Wu, Y.: Properties of the augmented Lagrangian in nonlinear semidefinite optimization. J. Optim. Theory Appl. 129, 437–456 (2006)
Todd, M.: Semidefinite optimization. Acta Numer. 10, 515–560 (2001)
Vandenberghe, L., Boyd, S.: Semidefinite programming. SIAM Rev. 38, 49–95 (1996)
Wu, H.X., Luo, H.Z.: Saddle points of general augmented Lagrangians for constrained nonconvex optimization. J. Glob. Optim. 53, 683–697 (2012)
Yamashita, H., Yabe, H.: A primal-dual interior point method for nonlinear semidefinite programming. Inst. Stat. Math. Cooper. Res. Report 203, 296–317 (2007)
Yamashita, H., Yabe, H., Harada, K.: A primal-dual interior point method for nonlinear semidefinite programming. Math. Program. 135, 89–121 (2012)
Ye, Y.: Interior Point Algorithms: Theory and Analysis. Wiley, New York (1997)
Acknowledgements
The authors would like to thank the two anonymous referees for the detailed comments and valuable suggestions which have improved the final presentation of the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was jointly supported by the National Natural Science Foundation of China under grant 11071219, the Postdoctoral Key Research Foundation of China under grant 201003242, and the Zhejiang Provincial Natural Science Foundation of China under grants Y13A010077 and Y13A010050.
Rights and permissions
About this article
Cite this article
Wu, H., Luo, H., Ding, X. et al. Global convergence of modified augmented Lagrangian methods for nonlinear semidefinite programming. Comput Optim Appl 56, 531–558 (2013). https://doi.org/10.1007/s10589-013-9568-1
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10589-013-9568-1