Intelligent Decision-Making of Load Balancing Using Deep Reinforcement Learning and Parallel PSO in Cloud Environment

Abstract

Machine learning and parallel processing are extremely commonly used to enhance computing power to induce knowledge from an outsized volume of data. To deal with the problem of complexity and high dimension, machine learning algorithms like Deep Reinforcement Learning (DRL) are used, while parallel processing algorithms like Parallel Particle Swarm Optimization (PPSO) are parallelized to speed up the operation and reduce the processing time to train the neural network. Due to the arrival of a large number of incoming tasks in the cloud environment, load balancing is an important issue. To solve this problem, the datacenter controller or an agent makes an intelligent decision to handle a large number of tasks within a minimum time period or at high speed. In this work, we proposed an effective scheduling algorithm named Deep Reinforcement Learning with Parallel Particle Swarm Optimization (DRLPPSO) to solve the load balancing problem and its various parameters with greater accuracy and high speed. Our experimental results show that our proposed scheduling algorithm increases the reward by 15.7%, 12%, and 13.1% when the task set is 2000 and improves the reward by 17.5%, 12.6%, and 15.3% when the task set is 4000, as compared to the Modified Particle Swarm Optimization (MPSO), Asynchronous Advantage Actor-Critic (A3C), and Deep Q-Network (DQN) techniques.

VMMISD: An Efficient Load Balancing Model for Virtual Machine Migrations via Fused Metaheuristics With Iterative Security Measures and Deep Learning Optimizations

“…Another widely used security model is the Blockchain-based security model. Blockchain technology provides a decentralized and transparent ledger that ensures data integrity and traceability levels with use of Deep Reinforcement Learning and Parallel PSO operations (DRLPPSO) [30,31,32]. While Blockchain-based models offer a secure and tamper-proof solution, they can be computationally intensive and may not be suitable for realtime security monitoring operations.…”

An Intelligent Parameter Identification Method of DFIG Systems Using Hybrid Particle Swarm Optimization and Reinforcement Learning

“…In PSO-QL [25], PSO accelerates the Q-learning update speed in multiagent scenarios, resulting in efficient pose calculations for industrial robots. DRL-PPSO [26] introduces DRL with Parallel PSO, where agents aim to receive the global largest reward while minimizing processing time by sharing information with neighboring particles. Furthermore, RL-enhanced PSO employs two policy networks as proposed in [27].…”

Energy Efficient Load Balancing Algorithm for Cloud Computing Using Rock Hyrax Optimization

“…They presented another idea, Ant Lion Optimizer (ALO) based for the most part on distributed computing environments, as an affordable standard that was expected to give results in adjusting the heap. The authors of [30] propose a reinforcement Learning-based parallel PSO for Intelligent Decision-Making. The authors of [31] presented a hybrid algorithm that combines Harries Hawks Optimisation (HHO) with Ant Colony Optimisation (ACO).…”