Acala: Aggregate Monitoring for Geo-Distributed Cluster Federations

Abstract

Monitoring plays a vital role in geo-distributed cluster federation environments to accurately schedule applications across geographically dispersed computing resources. However, using a fixed frequency for collecting monitoring data from clusters may waste network bandwidth and is not necessary for ensuring accurate scheduling. In this paper, we propose Adaptive Prometheus Federation (AdapPF), an extension of the widelyused open-source monitoring tool, Prometheus, and its feature, Prometheus Federation. AdapPF aims to dynamically adjust the collection frequency of monitoring data for each cluster in geodistributed cluster federations. Based on actual deployment in the geo-distributed Grid'5000 testbed, our evaluations demonstrate that AdapPF can achieve comparable results to Prometheus Federation with 5-seconds scrape interval while reducing crosscluster network traffic by 36%.

A Low-overhead Network Monitoring for SDN-Based Edge Computing

“…This concept has received much attention from academia. Many prior works have presented different facets of this field, including placement of jobs and services [6], seamless application migration [7], and monitoring computing resources [8]. However, these works are based on the traditional network that does not have enough flexibility to control the network.…”