Adaptive time-based coordinated checkpointing for cloud computing workfl ows

Meroufel, Bakhta; Belalem, Ghalem

doi:10.12694/scpe.v15i2.981

Cited by 11 publications

(17 citation statements)

References 29 publications

(67 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Meroufel and Belalem [6] proposed an adaptive time-based coordinated checkpointing technique without clock synchronization on the cloud infrastructure. Between the different VMs, jobs can communicate with each other through a messagepassing interface.…”

Section: State Of the Artmentioning

confidence: 99%

See 1 more Smart Citation

A novel adaptive checkpointing method based on information obtained from workflow structure

Kail

Kacsuk

Kozlovszky

2016

csci

View full text Add to dashboard Cite

Scientific workflows are data-and compute-intensive; thus, they may run for days or even weeks on parallel and distributed infrastructures such as grids, supercomputers, and clouds. In these high-performance computing infrastructures, the number of failures that can arise during scientific-workflow enactment can be high, so the use of fault-tolerance techniques is unavoidable. The most-frequently used fault-tolerance technique is taking checkpoints from time to time; when failure is detected, the last consistent state is restored. One of the most-critical factors that has great impact on the effectiveness of the checkpointing method is the checkpointing interval. In this work, we propose a Static (Wsb) and an Adaptive (AWsb) Workflow Structure Based checkpointing algorithm. Our results showed that, compared to the optimal checkpointing strategy, the static algorithm may decrease the checkpointing overhead by as much as 33% without affecting the total processing time of workflow execution. The adaptive algorithm may further decrease this overhead while keeping the overall processing time at its necessary minimum.

show abstract

Section: State Of the Artmentioning

confidence: 99%

“…Logging the messages can also resolve the transit-message problem. The initiator selection is also investigated in Meroufel and Belalems other work [7]; they found that the impact of initiator choice is significant in terms of performance. They also proposed a simple and efficient strategy to select the best initiator.…”

Section: State Of the Artmentioning

confidence: 99%

A novel adaptive checkpointing method based on information obtained from workflow structure

Kail

Kacsuk

Kozlovszky

2016

csci

View full text Add to dashboard Cite

show abstract

“…Meroufel and Belalem [9] proposed an adaptive time-based coordinated checkpointing technique without clock synchronization on cloud infrastructure. Between the different VMs jobs can communicate with each other through a message passing interface.…”

Section: A1mentioning

confidence: 99%

Provenance Based Checkpointing Method for Dynamic Health Care Smart System

Kail¹,

Karóczkai²,

Kacsuk³

et al. 2016

SCPE

View full text Add to dashboard Cite

Abstract. Smart systems in telemedicine frequently use intelligent sensor devices at large scale. Practitioners can monitor non-stop the vital parameters of hundreds of patients in real-time. The most important pillars of remote patient monitoring services are communication and data processing. Large scale data processing is done mainly using workflows. Some workflows are working in real-time, more complex ones are running for days or even for weeks on parallel and distributed infrastructures such as HPC systems and cloud. In HPC environment high number of failures can arise during health care smart systems workflow enactment, so the use of fault tolerance techniques is unavoidable. The most frequently used fault tolerance technique is checkpointing. The effectiveness of the checkpointing method depends on the checkpointing interval. In this work we give a brief overview of the different checkpointing techniques and propose two new provenance based checkpointing algorithms which uses the information stored in the workflow structure to dynamically change the frequency of checkpointing and can be efficiently used for dynamic health care smart systems.

show abstract

“…The authors of [5,6,7,8] make some assumptions or gather statistics about failure distribution of individual resources or resource systems and based on these values and calculations adjust fault tolerant mechanisms. For example Theresa et al propose in their work [8] two dynamic checkpoint strategies: Last Failure time based Checkpoint Adaptation (LFCA) and Mean Failure time based Checkpoint Adaptation (MFCA) which takes into account the stability of the system and the probability of failure concerning the individual resources.…”

Section: A Fault Tolerancementioning

confidence: 99%