SparkGrid: Blockchain Assisted Secure Query Scheduling and Dynamic Risk Assessment for Live Migration of Services in Apache Spark based Grid Environment

Abstract

Grid computing is an emerging technology that enabled the heterogeneous collection of data and provisioning of services to the users. Due to the high amount of incoming heterogeneous request, grid computing needs an efficient scheduling to reduce execution time and satisfy Service Level Agreement (SLA) and Quality of Service (QoS) requirements. For that purpose, we proposed SprakGrid method to reduce execution time and satisfying SLA, QoS requirements. The proposed work includes four consecutive phases which are explained as follows, in first we perform user authentication in order to ensure the legitimacy of the users using Elliptic Curve based Chaos Theory (ECCT) algorithm which generate secret key and stored it into the blockchain. In second we perform query scheduling for resource discovery using Soft Actor Critic (SAC) algorithm by considering 3P’s parameters which is performed by spark environment that schedules optimal resources based on the service request. In third, we perform risk assessment and request dropping, in which the risk nodes of workers are evaluated by master node. To address the resource wastage by attacker, this research evaluates the risk value in a dynamic manner using Shannon entropy. Based on the risk assessment the requestsare classified into two classes such as normal and malicious. In fourth we perform service live migration, in which the malicious requests are dropped and normal request are migrated from source node to target node using Multi-Constraints based Emperor Penguin Optimization (MC-EPO). Finally, simulation is performed by GridSim and the simulation results demonstrate that the proposed SparkGrid method achieves superior performance compared to other state-of-the art methods.