ACS: an effective admission control scheme with deadlock resolutions for workflow scheduling in clouds

Wang, Yan; Hu, Menglan; Kent, Kenneth B.

doi:10.1007/s00607-014-0409-6

Cited by 3 publications

(1 citation statement)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Most of existing works in this area either leverage online techniques or resort to off-line infrastructure to detect failure or execution anomaly in large-scale workflows whereby their performance model is established, [18,12,1]. Wang et al [20] introduce ACS, which is an admission control scheme with deadlock resolutions to facilitate workflow scheduling in the cloud. Although this scheme can optimize the storage utilization, and sometimes, can get rid of the performance anomaly, it is not performance resilient as it fails to address this problem in general sense.…”

Section: Related Workmentioning

confidence: 99%

On Performance Resilient Scheduling for Scientific Workflows in HPC Systems with Constrained Storage Resources

Wang

Shi

Berrocal

2015

Proceedings of the 6th Workshop on Scientific Cloud Computing

Self Cite

View full text Add to dashboard Cite

Although the storage capacity is rapidly increasing, the size of datasets is also ever-growing, especially for those workflows in HPC that perform the parameter sweep studies. Consequently, the deadlock caused by the storage competition between concurrent workflow instances is still a major pragmatic concern and storage management remains important for high performance and throughput computing. In practice, there are various ways to this issue, ranging from admission control to deadlock resolution. Despite being a simple solution, the admission control is conservative and not space efficient to storage utilization. Therefore, in this paper, we study the performance of the deadlock resolution approach by proposing a resource allocation algorithm which is performance resilient to the workflows characterized by different features. The algorithm is designed based on our previous result, called DDS, which takes advantages of the dataflow information of the workflow to resolve deadlock based on detection&recovery principle. We improve DDS to allow it to not only resolve the deadlock but also overcome the performance anomaly, a not yet investigated problem in our previous studies. We thus called the improved algorithm performance-resilience algorithm, denoted as DDS + . The studies in this paper can be viewed as a follow-up research on DDS and show the performance behavior of the improved algorithm in various conditions. Therefore, the results in this paper are more useful to adapt DDS + to the workflows with different characteristics in reality while keeping the performance stable.

show abstract

Section: Related Workmentioning

confidence: 99%