QuLa: Queue and latency-aware service selection and routing in service-centric networking

Abstract

Due to an explosive growth in services running in different datacenters, there is need for service selection and routing to deliver user requests to the best service instance. In current solutions, it is generally the client that must first select a datacenter to forward the request to before an internal load-balancer of the selected datacenter can select the optimal instance. An optimal selection requires knowledge of both network and server characteristics, making clients less suitable to make this decision. Information-Centric Networking (ICN) research solved a similar selection problem for static data retrieval by integrating content delivery as a native network feature.We address the selection problem for services by extending the ICN-principles for services. In this paper we present Queue and Latency (QuLa), a network-driven service selection algorithm which maps user demand to service instances, taking into account both network and server metrics. To reduce the size of service router forwarding tables, we present a statistical method to approximate an optimal load distribution with minimized router state required. Simulation results show that our statistical routing approach approximates the average system response time of sourcebased routing with minimized state in forwarding tables.

QuLa: Service Selection and Forwarding Table Population in Service-Centric Networking Using Real-Life Topologies

“…To overcome this problem, we present a weighted average method to reduce the amount of state required in the service router forwarding tables while minimizing the performance loss caused by this data reduction. This concept has already been proposed in a prior publication [16] using arti¿cial networks for preliminary results. To verify the bene¿t of our selection algorithm and weighted average forwarding approach in more practical environments, we performed simulations on real-life network topologies which are presented in this paper.…”