An improved nonmonotone adaptive trust region method

Yang, Xue; Liu, Hongwei; Liu, Zexian

doi:10.21136/am.2019.0138-18

Cited by 5 publications

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The problem has widely used in many applications based on medical science, optimal control, and functional approximation, etc. As we all know, there are many methods for solving unconstrained optimization problems, such as the conjugate gradient method [1][2][3], the Newton method [4,5], and the trust region method [6][7][8]. Constrained optimization problems can also be solved by processing constraint conditions and transforming them into unconstrained optimization problems.…”

Section: Introductionmentioning

confidence: 99%

A Filter and Nonmonotone Adaptive Trust Region Line Search Method for Unconstrained Optimization

Ding

Wang

2020

Symmetry

View full text Add to dashboard Cite

In this paper, a new nonmonotone adaptive trust region algorithm is proposed for unconstrained optimization by combining a multidimensional filter and the Goldstein-type line search technique. A modified trust region ratio is presented which results in more reasonable consistency between the accurate model and the approximate model. When a trial step is rejected, we use a multidimensional filter to increase the likelihood that the trial step is accepted. If the trial step is still not successful with the filter, a nonmonotone Goldstein-type line search is used in the direction of the rejected trial step. The approximation of the Hessian matrix is updated by the modified Quasi-Newton formula (CBFGS). Under appropriate conditions, the proposed algorithm is globally convergent and superlinearly convergent. The new algorithm shows better performance in terms of the Dolan-Moré performance profile. Numerical results demonstrate the efficiency and robustness of the proposed algorithm for solving unconstrained optimization problems. Symmetry 2020, 12, 656 2 of 22where . is the Euclidean norm, f k = f (x k ), g k = ∇ f (x k ), B k is a symmetric approximation matrix of G k = ∇ 2 f (x k ), and ∆ k is a trust region radius.Traditional trust region methods have some disadvantages, such as the fact that the subproblem needs to be solved many times to obtain an acceptable trial step within one iteration, which leads to high computational costs for the iterative process. One way to overcome this disadvantage is to use a line search strategy in the direction of the rejected trial step. Based on this situation, Nocedal and Yuan [9] proposed an algorithm in 1998, combining the trust region method and the line search method for the first time. Inspired by this, Michael et al., Li et al., and Zhang et al. proposed a trust region method with the line search strategy ([10-12], respectively).As can be seen in other works [4,7,8] monotone techniques are distinguished from nonmonotone techniques in that the value of the function needs to be reduced at each iteration; at the same time, the use of nonmonotone techniques can not only guarantee finding the global optimal solution effectively, but also improve the convergence rate of the algorithm. The watchdog technique was presented by Chamberlain et al. [13] in 1982 to overcome the Maratos effect of constrained optimization problems. Motivated by this idea, a nonmonotone line search technique was proposed by Grippo et al. [14] in 1986. The step length α k satisfies the following inequality:

show abstract