Storage Qos Provisioning for Execution Programming of Data-Intensive Applications

Abstract

Abstract. In this paper a method for execution programming of data-intensive applications is presented. The method is based on storage Quality of Service (SQoS) provisioning. SQoS provisioning uses the semantic based storage monitoring based on a storage resources model and a storage performance management. Test results show the gain for the execution time when using the QStorMan toolkit which implements the presented method. Taking into account the SQoS provisioning opportunity on the one hand, and the increasingly growing user demands on the other hand, we believe that the execution programming of data-intensive applications can bring a new quality into the application execution.

Towards Transparent Data Access With Context Awareness

“…In such a case, there are usually different Lustre instances on the different sites, which means that the data stored on this file system can only be shared within the local cluster. Although the efficiency of the Lustre system is high, there is still a possibility of improving it using dedicated tools such as QstorMan [50][51][52].…”

“…The problems encountered in this case pertain to possible network failures, higher latencies [23], or the simultaneous work of many users influencing the quality of service [38,53]. The balance of use of available storage systems to maintain QoS and cost effectiveness in an organization while request scheduling and resource allocation is also expected [9,50].…”