Impact of Service- and Cloud-Based Dynamic Routing Architectures on System Reliability

Amiri, Amirali; Zdun, Uwe; Simhandl, Georg; Hoorn, André van

doi:10.1007/978-3-030-65310-1_13

Cited by 4 publications

(21 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this section, we evaluate the ADR architecture by comparing the ADR performance and reliability predictions to the empirical results of our experiment, already reported in [4], [5]. Note that the ADR architecture is not specific to our experiment infrastructure, nor to our experimental cases.…”

Section: Discussionmentioning

confidence: 99%

“…Any combination in between these two extremes can be modeled by the dynamic routers architecture. The CE, DR, and SA architecture patterns are implemented based on very different concepts, including API Gateways [29], such as NGINX 2 or Kong 3 , Enterprise Service Buses [12], Message Brokers [19], or sidecars [15], [22], [25] such as Envoy 4 . Essentially they all route the incoming requests dynamically.…”

Section: Background: Dynamic Routing Architecture Patternsmentioning

confidence: 99%

“…A. ADR Models 1) Reliability Model: In [4], [5], we used Bernoulli processes [32] to model request loss during router and service crashes. Request loss was defined as the number of incoming requests that were not processed due to a failure such as a crash of a component.…”

Section: Fig 3: Activities Of Adr Configuration Managermentioning

confidence: 99%

“…2) Preference Function: We can define different criteria to choose the final ADR router configuration. Let us consider a scenario: In our prior work [4], [5], we empirically validated that the centralized routing offers a higher reliability compared to distributed approaches; on the other hand, decentralized routing improves performance by processing the incoming requests in parallel. An architect can define operational profiles (see Section V-C2 for a sample case) for low and high levels of cf , based on which ADR adapts to more centralized routing (a lower n rout ) to improve reliability, or more distributed approaches (a higher n rout ) to improve performance.…”

Section: B Adr Reconfiguration Algorithmmentioning

confidence: 99%

“…The main contribution of this paper is a self-adaptive architecture in dynamic routing called Adaptive Dynamic Routers (ADR) Architecture that is based on Monitor, Analyse, Plan, Execute, Knowledge (MAPE-K) loops [6], [7], [21]. The proposed architecture uses the reliability and performance tradeoffs analysis of representative dynamic routing architecture patterns from our prior work [4], [5]. The ADR architecture performs a multi-criteria optimization analysis [2] to find a To evaluate our proposed architecture, we used the empirical data set from our prior work [5], where we designed an extensive experiment of 200 runs with multiple experimental cases running for 1200 hours to empirically validate our reliability and performance models.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Automatic Adaptation of Reliability and Performance Trade-Offs in Service- and Cloud-Based Dynamic Routing Architectures

Amiri

Zdun

Hoorn

et al. 2021

2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS)

Self Cite

View full text Add to dashboard Cite

Many different dynamic routing architectures are available, including sidecar-based routing, routing through a central entity such as an event store or gateway, or architectures with multiple routers. These architectures are currently based on vastly different implementation concepts, such as API Gateways, Message Brokers, or Service Proxies. We propose a new approach that abstracts all these architecture patterns using one Adaptive Dynamic Routers architecture. We hypothesize that a dynamic self-adaptation of the routing architecture is beneficial over any fixed architecture selections for reliability and performance trade-offs. That is, if encountered with traffic and load changes, our approach dynamically self-adapts between more central or distributed routing to optimize system reliability and performance. We evaluate our approach by analyzing our previously-measured data during an experiment of 1200 hours of runtime. Our extensive systematic evaluation with 1089 cases confirms that our hypothesis holds and our approach is beneficial in terms of reliability and performance. Moreover, we empirically validate our results on Google Cloud Platform infrastructure.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Background: Dynamic Routing Architecture Patternsmentioning

confidence: 99%

Section: Fig 3: Activities Of Adr Configuration Managermentioning

confidence: 99%

Section: B Adr Reconfiguration Algorithmmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Automatic Adaptation of Reliability and Performance Trade-Offs in Service- and Cloud-Based Dynamic Routing Architectures

Amiri

Zdun

Hoorn

et al. 2021

2021 IEEE 21st International Conference on Software Quality, Reliability and Security (QRS)

Self Cite

View full text Add to dashboard Cite

show abstract

Cost-Aware Multifaceted Reconfiguration of Service-and Cloud-Based Dynamic Routing Applications

Amiri,

Zdun

2023

2023 IEEE 16th International Conference on Cloud Computing (CLOUD)

Self Cite

View full text Add to dashboard Cite

Dynamic reconfiguration is commonly used in service-and cloud-based applications. In combination with autoscalers, dynamic routers can adapt the system to the resource demands, e.g., in an e-commerce application offering discounts for services in a specific location. Without such measures, the quality-of-service measures are affected negatively, and a system overload can lead to an application being nonresponsive. However, the cost of cloud resource usage must be considered when performing these reconfiguration steps to avoid adding high additional costs. This paper proposes a cost-aware multifaceted reconfiguration of dynamic routing applications. We study the depletion and rescheduling of idle components and use an infrastructure-as-code module to apply changes to the infrastructure. Moreover, when system components are in a steady state, our approach dynamically self-adapts between more central or distributed routing to optimize reliability and performance. This adaptation is calculated based on a systemwide optimization analysis. When components are overloaded, we perform a per-component optimization to autoscale components multidimensionally. Our extensive systematic evaluation shows significant improvements in quality trade-off adaptations and system overload prevention. We provide prototypical tool support to demonstrate our concepts with illustrative sample cases.

show abstract

Cost-Aware Multidimensional Auto-Scaling of Service- and Cloud-Based Dynamic Routing to Prevent System Overload

Amiri

Zdun

Hoorn

et al. 2022

2022 IEEE International Conference on Web Services (ICWS)

Self Cite

View full text Add to dashboard Cite

Dynamic reconfiguration is commonly used to accommodate the dynamic behavior of today's applications. As cloud-based systems become increasingly complex, it is hard and cost-ineffective to manage them manually. Dynamic routers, such as API Gateways or Message Brokers, in combination with auto-scalers can adapt the system to the resource demands, e.g., when a sudden load spike for a specific part of the system is observed. Without taking costs of cloud resources into account, this reconfiguration can lead to significant increase of charges. We propose a self-adaptive and cost-aware dynamic routing architecture called Adaptive Dynamic Routers. The novel architecture performs a multi-criteria optimization analysis to automatically reconfigure the routers and the services of a cloud-based system considering the costs of reconfiguration. This multidimensional auto-scaling of resources takes incoming load as an input, and uses queuing theory to find an optimal reconfiguration solution. We systematically evaluated our architecture with an extensive number of evaluation cases (9600). On average over cases where an overload is predicted, our approach reduces the overload rate by 46.7% and 61.8% for routers and services, respectively.

show abstract

Impact of Service- and Cloud-Based Dynamic Routing Architectures on System Reliability

Cited by 4 publications

References 11 publications

Automatic Adaptation of Reliability and Performance Trade-Offs in Service- and Cloud-Based Dynamic Routing Architectures

Automatic Adaptation of Reliability and Performance Trade-Offs in Service- and Cloud-Based Dynamic Routing Architectures

Cost-Aware Multifaceted Reconfiguration of Service-and Cloud-Based Dynamic Routing Applications

Cost-Aware Multidimensional Auto-Scaling of Service- and Cloud-Based Dynamic Routing to Prevent System Overload

Contact Info

Product

Resources

About