A Hybrid Many-Objective Optimization Algorithm for Job Scheduling in Cloud Computing Based on Merge-and-Split Theory

Abstract

Scheduling jobs within a cloud environment is a critical area of research that necessitates meticulous analysis. It entails the challenge of optimally assigning jobs to various cloud servers, each with different capabilities, and is classified as a non-deterministic polynomial (NP) problem. Many conventional methods have been suggested to tackle this difficulty, but they often struggle to find nearly perfect solutions within a reasonable timeframe. As a result, researchers have turned to evolutionary algorithms to tackle this problem. However, relying on a single metaheuristic approach can be problematic as it may become trapped in local optima, resulting in slow convergence. Therefore, combining different metaheuristic strategies to improve the overall system enactment is essential. This paper presents a novel approach that integrates three methods to enhance exploration and exploitation, increasing search process efficiency and optimizing many-objective functions. In the initial phase, we adopt cooperative game theory with merge-and-split techniques to train computing hosts at different utilization load levels, determining the ideal utilization for each server. This approach ensures that servers operate at their highest utilization range, maximizing their profitability. In the second stage, we incorporate the mean variation of the grey wolf optimization algorithm, making significant adjustments to the encircling and hunting phases to enhance the exploitation of the search space. In the final phase, we introduce an innovative pollination operator inspired by the sunflower optimization algorithm to enrich the exploration of the search domain. By skillfully balancing exploration and exploitation, we effectively address many-objective optimization problems. To validate the performance of our proposed method, we conducted experiments using both real-world and synthesized datasets, employing CloudSim software version 5.0. The evaluation involved two sets of experiments to measure different evaluation metrics. In the first experiment, we focused on minimizing factors such as energy costs, completion time, latency, and SLA violations. The second experiment, in contrast, aimed at maximizing metrics such as service quality, bandwidth utilization, asset utilization ratio, and service provider outcomes. The results from these experiments unequivocally demonstrate the outstanding performance of our algorithm, surpassing existing state-of-the-art approaches.