Abstract
In this work, we investigate pseudomonotone variational inequality problems in a real Hilbert space and propose two projection-type methods with inertial terms for solving them. The first method does not require prior knowledge of the Lipschitz constant and the second one does not require the Lipschitz continuity of the mapping which governs the variational inequality. A weak convergence theorem for our first algorithm is established under pseudomonotonicity and Lipschitz continuity assumptions, and a weak convergence theorem for our second algorithm is proved under pseudomonotonicity and uniform continuity assumptions. We also establish a nonasymptotic O(1/n) convergence rate for our proposed methods. In order to illustrate the computational effectiveness of our algorithms, some numerical examples are also provided.
Similar content being viewed by others
References
Alvarez, F., Attouch, H.: An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping. Set-Valued Anal. 9, 3–11 (2001)
Antipin, A. S.: On a method for convex programs using a symmetrical modification of the Lagrange function. Ekon. Mat. Metody. 12, 1164–1173 (1976)
Aubin, J. P., Ekeland, I.: Applied Nonlinear Analysis. Wiley, New York (1984)
Baiocchi, C., Capelo, A.: Variational and Quasivariational Inequalities; Applications to Free Boundary Problems. Wiley, New York (1984)
Boţ, R. I., Csetnek, E. R., Vuong, P. T.: The forward-backward-forward method from discrete and continuous perspective for pseudo-monotone variational inequalities in Hilbert spaces. Europ. J. Oper. Res. 287, 49–60 (2020)
Ceng, L.C., Hadjisavvas, N., Wong, N.C.: Strong convergence theorem by a hybrid extragradient-like approximation method for variational inequalities and fixed point problems. J. Glob. Optim. 46, 635–646 (2010)
Ceng, L. C., Petrusel, A., Qin, X., Yao, J. C.: A modified inertial subgradient extragradient method for solving pseudomonotone variational inequalities and common fixed point problems. Fixed Point Theory. 21, 93–108 (2020)
Ceng, L.C., Petrusel, A., Wen, C.F., Yao, J.C.: Inertial-like subgradient extragradient methods for variational inequalities and fixed points of asymptotically nonexpansive and strictly pseudocontractive mappings. Mathematics 7(9) (2019), Art. ID 860, pp. 19
Ceng, L.C., Qin, X., Shehu, Y., Yao, J.C.: Mildly inertial subgradient extragradient method for variational inequalities involving an asymptotically nonexpansive and finitely many nonexpansive mappings. Mathematics 7(10) (2019), Art. ID 881, pp. 19
Ceng, L. C., Shang, M. J.: Hybrid inertial subgradient extragradient methods for variational inequalities and fixed point problems involving asymptotically nonexpansive mappings. Optimization. https://doi.org/10.1080/02331934.2019.1647203 (2019)
Ceng, L. C., Teboulle, M., Yao, J. C.: Weak convergence of an iterative method for pseudomonotone variational inequalities and fixed-point problems. J. Optim. Theory Appl. 146, 19–31 (2010)
Ceng, L.C., Yuan, Q.: Composite inertial subgradient extragradient methods for variational inequalities and fixed point problems. J. Inequal. Appl. 2019, Paper No. 274, pp. 20
Censor, Y., Gibali, A., Reich, S.: The subgradient extragradient method for solving variational inequalities in Hilbert spaces. J. Optim. Theory Appl. 148, 318–335 (2011)
Censor, Y., Gibali, A., Reich, S.: Strong convergence of subgradient extragradient methods for the variational inequality problem in Hilbert space. Optim. Meth. Softw. 26, 827–845 (2011)
Censor, Y., Gibali, A., Reich, S.: Extensions of Korpelevich’s extragradient method for the variational inequality problem in Euclidean space. Optimization. 61, 1119–1132 (2012)
Cottle, R.W., Yao, J.C.: Pseudo-monotone complementarity problems in Hilbert space. J. Optim. Theory Appl. 75, 281–295 (1992)
Denisov, S. V., Semenov, V. V., Chabak, L. M.: Convergence of the modified extragradient method for variational inequalities with non-Lipschitz operators. Cybern. Syst. Anal. 51, 757–765 (2015)
Dong, Q. L., Lu, Y. Y., Yang, J. F.: The extragradient algorithm with inertial effects for solving the variational inequality. Optimization 65, 2217–2226 (2016)
Dong, Q. L., Yuan, H. B., Cho, Y. J., Rassias, Th.M.: Modified inertial Mann algorithm and inertial CQ-algorithm for nonexpansive mappings. Optim. Lett. 12, 87–102 (2018)
Dong, Q. L., Cho, Y. J., Zhong, L. L., Rassias, Th.M.: Inertial projection and contraction algorithms for variational inequalities. J. Glob. Optim. 70, 687–704 (2018)
Facchinei, F., Pang, J. S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, vol. I. Springer Series in Operations Research, Springer, New York (2003)
Gibali, A., Reich, S., Zalas, R.: Outer approximation methods for solving variational inequalities in Hilbert space. Optimization 66, 417–437 (2017)
Goebel, K., Reich, S.: Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings. Marcel Dekker, New York (1984)
Ha, N. T. T., Thanh, T. T. H., Hai, N. N., et al.: A note on the combination of equilibrium problems. Math. Meth. Oper. Res. 91, 311–323 (2020)
Harker, P. T., Pang, J. S.: A damped-Newton method for the linear complementarity problem. AMS Lect. Appl. Math. 26, 265–284 (1990)
Iusem, A. N., Nasri, M.: Korpelevich’s method for variational inequality problems in Banach spaces. J. Global Optim. 50, 59–76 (2011)
Karamardian, S., Schaible, S.: Seven kinds of monotone maps. J. Optim. Theory Appl. 66, 37–46 (1990)
Kinderlehrer, D., Stampacchia, G.: An Introduction to Variational Inequalities and Their Applications. Academic Press, New York (1980)
Kraikaew, R., Saejung, S.: Strong convergence of the Halpern subgradient extragradient method for solving variational inequalities in Hilbert spaces. J. Optim. Theory Appl. 163, 399–412 (2014)
Konnov, I. V.: Combined Relaxation Methods for Variational Inequalities. Springer, Berlin (2001)
Konnov, I. V.: Equilibrium formulations of relative optimization problems. Math. Meth. Oper. Res. 90, 137–152 (2019)
Korpelevich, G. M.: The extragradient method for finding saddle points and other problems. Ekon. Mat. Metody. 12, 747–756 (1976)
Maingé, P. E.: A hybrid extragradient-viscosity method for monotone operators and fixed point problems. SIAM J. Control Optim. 47, 1499–1515 (2008)
Maingé, P. E., Gobinddass, M. L.: Convergence of one-step projected gradient methods for variational inequalities. J. Optim. Theory Appl. 171, 146–168 (2016)
Malitsky, Y. V., Semenov, V. V.: A hybrid method without extrapolation step for solving variational inequality problems. J. Glob. Optim. 61, 193–202 (2015)
Malitsky, Y. V.: Projected reflected gradient methods for monotone variational inequalities. SIAM J. Optim. 25, 502–520 (2015)
Liu, H., Yang, J.: Weak convergence of iterative methods for solving quasimonotone variational inequalities. Comput. Optim. Appl. 77, 491–508 (2020)
Opial, Z.: Weak convergence of the sequence of successive approximations for nonexpansive mappings. Bull. Amer. Math. Soc. 73, 591–597 (1967)
Shehu, Y., Iyiola, O. S., Thong, D. V., Van, N. T. C.: An inertial subgradient extragradient algorithm extended to pseudomonotone equilibrium problems. Math. Meth. Oper Res. https://doi.org/10.1007/s00186-020-00730-w (2020)
Solodov, M. V., Svaiter, B. F.: A new projection method for variational inequality problems. J. Control Optim. 37, 765–776 (1999)
Thong, D. V., Hieu, D. V.: Weak and strong convergence theorems for variational inequality problems. Numer. Algorithms. 78, 1045–1060 (2018)
Thong, D. V., Hieu, D. V.: Modified Tseng’s extragradient algorithms for variational inequality problems. J. Fixed Point Theory Appl. 20, 152 (2018). https://doi.org/10.1007/s11784-018-0634-2
Thong, D. V., Vuong, P. T.: Modified Tseng’s extragradient methods for solving pseudo-monotone variational inequalities. Optimziation 68, 2207–2226 (2019)
Toint, P. L.: Global convergence of a class of trust region methods for nonconvex minimization in Hilbert space. IMA J. Numer. Anal. 8, 231–252 (1988)
Tseng, P.: A modified forward-backward splitting method for maximal monotone mappings. SIAM J. Control Optim. 38, 431–446 (2000)
Vuong, P. T.: On the weak convergence of the extragradient method for solving pseudo-monotone variational inequalities. J. Optim. Theory Appl. 176, 399–409 (2018)
Vuong, P. T., Shehu, Y.: Convergence of an extragradient-type method for variational inequality with applications to optimal control problems. Numer. Algorithms. 81, 269–291 (2019)
Wang, F. H., Xu, H. K.: Weak and strong convergence theorems for variational inequality and fixed point problems with Tseng’s extragradient method. Taiwan. J. Math. 16, 1125–1136 (2012)
Wang, Y. M., Xiao, Y. B., Wang, X., Cho, Y. J.: Equivalence of well-posedness between systems of hemivariational inequalities and inclusion problems. J. Nonlinear Sci. Appl. 9, 1178–1192 (2016)
Xiao, Y. B., Huang, N. J., Cho, Y. J.: A class of generalized evolution variational inequalities in Banach space. Appl. Math. Lett. 25, 914–920 (2012)
Yao, Y., Marino, G., Muglia, L.: A modified Korpelevich’s method convergent to the minimum-norm solution of a variational inequality. Optimization 63, 559–569 (2014)
Yang, J., Liu, H.: Strong convergence result for solving monotone variational inequalities in Hilbert space. Numer. Algorithm. 80, 741–752 (2019)
Yang, J., Liu, H., Liu, Z.: Modified subgradient extragradient algorithms for solving monotone variational inequalities. Optimization 67, 2247–2258 (2018)
Yang, J., Liu, H.: A modified projected gradient method for monotone variational inequalities. J. Optim. Theory Appl. 179, 197–211 (2018)
Yao, Y., Postolache, M.: Iterative methods for pseudomonotone variational inequalities and fixed point problems. J. Optim. Theory Appl. 155, 273–287 (2012)
Acknowledgments
All the authors are grateful to an anonymous referee for several helpful comments and useful suggestions
Funding
The first author was partially supported by the Israel Science Foundation (Grant 820/17), by the Fund for the Promotion of Research at the Technion and by the Technion General Research Fund.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Reich, S., Thong, D.V., Cholamjiak, P. et al. Inertial projection-type methods for solving pseudomonotone variational inequality problems in Hilbert space. Numer Algor 88, 813–835 (2021). https://doi.org/10.1007/s11075-020-01058-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-020-01058-6
Keywords
- Inertial method
- Non-Lipschitz continuity
- Pseudomonotone mapping
- Tseng’s extragradient method
- Variational inequality
- Weak convergence