Multi-Capacity Bin Packing with Dependent Items and its Application to the Packing of Brokered Workloads in Virtualized Environments

Bassem, Christine; Bestavros, Azer

doi:10.1016/j.future.2016.08.017

Cited by 5 publications

(1 citation statement)

References 34 publications

(36 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To solve this problem, the authors [32] combine multiple imprecise computations for continuous execution by avoiding the execution gap as maximum as possible. Some works [33], [34] focus on varying the bin size to manage heterogeneity, while some works focus on varying the size of the workloads [35], [36] for placing them into homogeneous/heterogeneous bins. Bin packing is also widely used in mapping VMs to PMs to improve resource utilization.…”

Section: Literature Surveymentioning

confidence: 99%

Optimizing MapReduce Task Scheduling on Virtualized Heterogeneous Environments Using Ant Colony Optimization

Jeyaraj

Paul

2022

IEEE Access

View full text Add to dashboard Cite

Consuming Hadoop MapReduce via virtual infrastructure as a service is becoming common practice as cloud service providers (CSP) offers relevant applications and scalable resources. One of the predominant requirements of cloud users is to improve resource utilization in the virtual cluster during the service period. However, it may not be possible when MapReduce workloads and virtual machines (VM) are highly heterogeneous. Therefore, in this paper, we addressed these heterogeneities and proposed an efficient MapReduce scheduler to improve resource utilization by placing the right combination of the map and reduce tasks in each VM in the virtual cluster. To achieve this, we transformed the MapReduce task scheduling problem into a 2-Dimensional (2D) bin packing model and obtained an optimal schedule using the ant colony optimization (ACO) algorithm. As an added advantage, our proposed ACO based bin packing (ACO-BP) scheduler minimized the makespan for a batch of jobs. To showcase the performance improvement, we compared our proposed scheduler with three existing schedulers that work well in a heterogeneous environment. As expected, results show that ACO-BP significantly outperformed the existing schedulers while dealing with workload and VM level heterogeneities.

show abstract