Comparative performance analysis of some accelerated and hybrid accelerated gradient models

Petrović, Milena J.; Ivanović, Milica; Ðorðević, Marijana

doi:10.5937/univtho9-18174

Cited by 3 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Usual way of computing this very important element is through the features of Taylor's expansion taken on the posed scheme. This way of accelerated parameter determination is confirmed as a good choice [13]. We highlight here three accelerated parameter expressions used in efficient accelerated double step size model, i.e.…”

Section: Algorithmmentioning

confidence: 69%

Hybridization rule applied on accelerated double step size optimization scheme

Petrović¹

2019

Filomat

View full text Add to dashboard Cite

A hybrid accelerated model with two step length parameters for solving unconstrained optimization problems is presented. Applied hybridization process involves an efficient three term hybrid method. The accelerated double step size model is taken as guiding operator in this hybridization process. Defined method is convergent on the set of uniformly convex functions as well as on the set on strictly convex quadratics. We display a Dolan Moré performance profiles of derived iteration and of some other comparative hybrid and accelerated methods regarding the number of iterations and the number of function evaluations metrics. Displayed numerical test results confirm that derived model keeps a good properties of its forerunner method and outperform other comparative hybrid accelerated schemes.

show abstract

Section: Algorithmmentioning

confidence: 69%

Hybridization rule applied on accelerated double step size optimization scheme

Petrović¹

2019

Filomat

View full text Add to dashboard Cite

show abstract

“…The derived function would be extended to construct the unconstrained optimization function. Based on the above discussion, it is obvious that there exist some parabolic relations between the regression parameters u 0 , u 1 , u 2 , the regression function (20) with the data x j and the value of y j . min…”

Section: Numerical Experimentsmentioning

confidence: 94%

“…Besides the CG method, the class of accelerated gradient descent schemes of Quasi-Newton type also contains very efficient and robust methods and can be considered for solving optimization problems. The accelerated parameters highlights can be seen in other studies [18][19][20][21][22]. However, in this paper we restrict the discussion to the CG method.…”

Section: Introductionmentioning

confidence: 99%

Modified spectral conjugate gradient iterative scheme for unconstrained optimization problems with application on COVID-19 model

Novkaniza

Malik

Sulaiman

et al. 2022

Front. Appl. Math. Stat.

View full text Add to dashboard Cite

In this work, a new class of spectral conjugate gradient (CG) method is proposed for solving unconstrained optimization models. The search direction of the new method uses the ZPRP and JYJLL CG coefficients. The search direction satisfies the descent condition independent of the line search. The global convergence properties of the proposed method under the strong Wolfe line search are proved with some certain assumptions. Based on some test functions, numerical experiments are presented to show the proposed method's efficiency compared with other existing methods. The application of the proposed method for solving regression models of COVID-19 is provided.Mathematics subject classification65K10, 90C52, 90C26.

show abstract

“…Here are some expressions of the accelerated factors defined in the accelerated gradient models mentioned above. These accelerated parameters are also listed in [6]:…”

Section: Accelerated Double Direction and Double Step Size Methods Overviewmentioning

confidence: 99%

An Improved Modification of Accelerated Double Direction and Double Step-Size Optimization Schemes

Petrović¹,

Valjarević²,

Ilić

et al. 2022

Mathematics

Self Cite

View full text Add to dashboard Cite

We propose an improved variant of the accelerated gradient optimization models for solving unconstrained minimization problems. Merging the positive features of either double direction, as well as double step size accelerated gradient models, we define an iterative method of a simpler form which is generally more effective. Performed convergence analysis shows that the defined iterative method is at least linearly convergent for uniformly convex and strictly convex functions. Numerical test results confirm the efficiency of the developed model regarding the CPU time, the number of iterations and the number of function evaluations metrics.

show abstract

Comparative performance analysis of some accelerated and hybrid accelerated gradient models

Cited by 3 publications

References 5 publications

Hybridization rule applied on accelerated double step size optimization scheme

Hybridization rule applied on accelerated double step size optimization scheme

Modified spectral conjugate gradient iterative scheme for unconstrained optimization problems with application on COVID-19 model

An Improved Modification of Accelerated Double Direction and Double Step-Size Optimization Schemes

Contact Info

Product

Resources

About