Efficient network and I/O throttling for fine-grain cycle stealing

Abstract

Abstract

Improving cluster utilization through intelligent processor sharing

“…At the same time, we would like to maintain the average turnaround time and the quality of service of the primary jobs. Condor [4], LSF [5], NOW [6], and Linger-Longer [1,2,3,7] all present ways to exploit the available idle time in a network of nondedicated workstations while taking steps to limit the impact on the owner of the workstation.…”

“…In [2] and [3], the efficiency with which idle cycles were used by guest jobs as well as the change in the throughput of guest jobs was evaluated using simulation. In [7], the impact of I/O and network resources is considered, which is beyond the scope of the present work.…”

Unobtrusiveness and efficiency in idle cycle stealing for PC grids

“…With several micro benchmarks, we demonstrated that I/O and network bandwidth usage of guest jobs could be limited effectively to within a few percent of target usages [10].…”

“…However, the host job will be adversely affected unless the guest job's resource use is strictly limited. In this section, we summarize our earlier work [10,14] on resource policing mechanisms for CPU, memory, I/O and Network bandwidth.…”

“…In [10], our resource throttling mechanisms have been benchmarked. Finally, in this paper, we bring all of the policies, algorithms and mechanisms together and implement the Linger-Longer system by extending Condor.…”