Hybrid approaches to optimization and machine learning methods: a systematic literature review

Abstract

Notably, real problems are increasingly complex and require sophisticated models and algorithms capable of quickly dealing with large data sets and finding optimal solutions. However, there is no perfect method or algorithm; all of them have some limitations that can be mitigated or eliminated by combining the skills of different methodologies. In this way, it is expected to develop hybrid algorithms that can take advantage of the potential and particularities of each method (optimization and machine learning) to integrate methodologies and make them more efficient. This paper presents an extensive systematic and bibliometric literature review on hybrid methods involving optimization and machine learning techniques for clustering and classification. It aims to identify the potential of methods and algorithms to overcome the difficulties of one or both methodologies when combined. After the description of optimization and machine learning methods, a numerical overview of the works published since 1970 is presented. Moreover, an in-depth state-of-art review over the last three years is presented. Furthermore, a SWOT analysis of the ten most cited algorithms of the collected database is performed, investigating the strengths and weaknesses of the pure algorithms and detaching the opportunities and threats that have been explored with hybrid methods. Thus, with this investigation, it was possible to highlight the most notable works and discoveries involving hybrid methods in terms of clustering and classification and also point out the difficulties of the pure methods and algorithms that can be strengthened through the inspirations of other methodologies; they are hybrid methods.

Using Physics-Informed Neural Networks (PINNs) for Tumor Cell Growth Modeling

“…• Use an optimization algorithm (in this case, ADAM) [9] to update the neural network parameters to minimize the mean of residuals.…”

New Trends in Symmetry in Optimization Theory, Algorithms and Applications

“…Along with the rapid development of computer science and the urgent need to solve realworld problems, spectacular advancements have been made in modern optimization theory and its related methods. These advances have had a significant impact on the development of many fields, including statistics, biology, finance, economics, control, and so on [1][2][3][4][5][6][7][8][9][10]. Moreover, these developments all span across interdisciplinary areas.…”