An agent based network resource planner for workflow applications

Abstract

Many scientific workflow applications are driven by simulation generated data, or data collected from sensors or instruments, and the processing of the data is commonly done at a different location from where the data is stored. Moving large quantities of data among different locations is thus a frequently invoked process in scientific workflow applications. These data transfers often have high quality requirements on the network services, especially when the application requires steering from human interaction. Advanced networks such as hybrid networks make it feasible for high level applications to request network paths and service provisioning. However, current workflow applications tune the execution quality neglecting network resources, and by selecting only optimal software services and computing resources. Including network services in the resource scheduling adds an extra dimension for workflow applications to optimize the runtime performance. In this paper we present a system called NEtwork aware Workflow QoS Planner (NEWQoSPlanner) to complement existing workflow systems on selecting network resources in the context of workflow composition, scheduling and execution when advanced network services are available.

Information Modelling and Semantic Linking for a Software Workbench for Interactive, Time Critical and Self-Adaptive Cloud Applications

“…Key to this intelligence is the understanding of how the user quality of experience (QoE) is determined by the degree to which an application deployment adheres to certain quality of service (QoS) constraints. QoS constraints have been used for describing abstract workflows, and for customising the runtime enactment [3], however in such applications the specification of the application logic is mostly separated from the runtime customisation. SWITCH aims to realise an application-infrastructure co-programming and control model that takes application QoS/QoE requirements into account along with the underlying infrastructure's programmability.…”

“…• It is necessary to be able to describe virtual infrastructures capable of hosting applications if suitably provisioned by cloud providers (2)(3)(4)(5)(6). Produced in DRIP, infrastructure profiles are needed to be shown to developers to solicit their approval (2), and used to direct the provisioning of infrastructure (4).…”

A Software Workbench for Interactive, Time Critical and Highly Self-Adaptive Cloud Applications (SWITCH)

“…Quality constraints are used in workflow applications for describing the abstract workflows, and for creating the runtime enactment, such as in [2] [3] [4]. However, in those applications, the creation of the application logic is mostly separated from the customisation of the runtime environment; in particular, a formal model is rarely utilised in verifying the time constraints.…”

A semantic-web approach for modeling computing infrastructures

“…The INDL provides a suitable mechanism to describe the resources in the computing and storage infrastructure, and network connectivity among those resources. NEtWork QoS Planner (NEWQoSPlanner) is a workflow planning system which is able to select network resources in the context of workflow composition and scheduling [31]. In the NEWQoSPlanner system, a schema for describing abstract workflows process(qosawf.owl ) was proposed to define the basic concepts of workflow processes, pre/post/execution conditions of a process, data, and quality attributes, as shown in Fig 13.…”

“…In the NEWQoSPlanner system, a schema for describing abstract workflows process(qosawf.owl ) was proposed to define the basic concepts of workflow processes, pre/post/execution conditions of a process, data, and quality attributes, as shown in Fig 13. The original application context of NEWQoSPlanner is CineGrid, and the mapping mechanism between the qosawf.owl and the CineGrid is via a separate file called qosawf-ontmap-cdl.owl [31]. The information model of INDL promotes a better mapping between services, storage and computing elements, and the network topologies compared to the early semantic description stack used by the NEWQoSPlanner.…”