Data Fusion of Observability Signals for Assisting Orchestration of Distributed Applications

Tzanettis, Ioannis; Androna, Christina-Maria; Zafeiropoulos, Anastasios; Fotopoulou, Eleni; Papavassiliou, Symeon

doi:10.3390/s22052061

Cited by 12 publications

(7 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another paper by Ioannis Tzanettis et al, [2] talks about about orchestration of distributed applications. It discusses using data fusion to improve the observability of these applications.…”

Section: Literature Reviewmentioning

confidence: 99%

Enhanced Visibility for Real-time Monitoring and Alerting in Kubernetes by Integrating Prometheus,Prometheus, Grafana, Loki, and Alerta

sai

2024

IJSREM

View full text Add to dashboard Cite

With the increasing popularity of Kubernetes as the go-to platform for containerized applications, numerous companies are adopting Kubernetes as their preferred platform for containerized applications. As organizations embrace this container orchestration technology for its scalability, flexibility, and portability benefits, the need for robust monitoring solutions becomes paramount. Monitoring Kubernetes environments is essential to ensure the health, performance, and availability of applications running within the cluster. This paper aims to provide a comprehensive approach for monitoring Kubernetes via Prometheus, Grafana, and Alerta Prometheus, a powerful open-source monitoring system, col- lects metrics from Kubernetes pods and nodes, enabling real- time monitoring of resource utilization, performance metrics, and application health. Grafana complements Prometheus by providing intuitive visualization of collected metrics through customizable dashboards, facilitating comprehensive insights into cluster performance and trends. Loki and Promtail by Grafana are used to collect and aggregate the logs associated with the cluster. Alerta enhances the monitoring setup by enabling alerting based on predefined thresholds and conditions, ensuring prompt notification of potential issues or anomalies. Together, this stack empowers administrators to gain deep visibility into their Kubernetes infrastructure, proactively identify and mitigate issues, and maintain the high availability and reliability of their applications and services. Index Terms—Kubernetes, Prometheus, Grafana, Alerta, Loki, Promtail, Monitoring, Alerting, Logging.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Enhanced Visibility for Real-time Monitoring and Alerting in Kubernetes by Integrating Prometheus,Prometheus, Grafana, Loki, and Alerta

sai

2024

IJSREM

View full text Add to dashboard Cite

show abstract

“…12 Novel approaches that support cloud-native observability are considered, where various types of signals are collected and processed, aiming to produce knowledge from the collected information [59] [60]. Such approaches are in accordance with the open telemetry specifications [61].…”

Section: ) Data Collection Frameworkmentioning

confidence: 99%

Design Methodology for 6G End-to-End System: Hexa-X-II Perspective

Kerboeuf,

Porambage,

Jain

et al. 2024

IEEE Open J. Commun. Soc.

Self Cite

View full text Add to dashboard Cite

As the fifth generation (5G) mobile communication systems are commercially deployed, they bring new services, enhance user experiences, and offer various opportunities to different industries. Despite its advancements, 5G encounters several challenges. To tackle these issues, global industrial, academic, and standards organizations are actively researching on sixth generation (6G) wireless communication systems. 6G networks are envisioned as a transformative shift in the interactions between the physical, digital, and human realms, paving the way for a pervasive human-centered cyber-physical world. 6G is positioned to be a platform that offers communication and beyond communication services considering both performance and value centric technological development approaches. In this paper, we present the way forward towards the design of 6G end-to-end (E2E) system as a consolidated view of leading industry stakeholders and academia in the European level 6G flagship project Hexa-X-II. We discuss the key challenges with 5G and how 6G is expected to tackle those by introducing new technological innovations and supporting novel use case requirements. We provide a comprehensive methodology for the design of a 6G E2E system including ten principles, a blueprint, and a structured design process. The architecture design principles prioritize environmental sustainability, digital inclusiveness, and trustworthiness, considering their impact on the 6G E2E system. The blueprint is described corresponding to the infrastructure, network centric application, and application layers, as well as the pervasive functionalities and the relevant technological innovations. Following the design principles and the system blueprint, the design process is demonstrated as two-way approaches (i.e., 1) key performance and value indicators based design process. 2) top-down versus bottomup alignment process) through the lens of a collaborative robot use case. Through this use case, a special attention is given to the technological enablers that cover management and orchestration functionalities and their 6G enhancement to go beyond the limitations characterizing the previous network generation. In addition, virtual modelling aspects related to digital twining and simulations for 6G E2E system design are also discussed. INDEX TERMS 6G, end-to-end, platform, system, blueprint, network architecture, design process, use case, key value indicators, key performance indicators, collaborative robots.

show abstract

“…To support the continuous monitoring of the various metrics, the development of cloud-native observability tools in the various levels is required. Data fusion of information coming from various signals (e.g., resource usage metrics, QoS metrics, software traces, logs) has to be considered [11]. Aggregation of metrics and production of composite metrics (e.g., Key Performance Indicators (KPIs)) is also needed, where aggregated metrics can be provided to higher levels in the hierarchy for assisting decision making processes.…”

Section: System Of Systems Approach For Intent-driven Orchestrationmentioning

confidence: 99%

“…trained and/or evaluated. To support cloud-native observability, a relational schema is proposed (Figure 6) as part of the architecture, extending the work at [11].…”

Section: Data Management and Cloud-native Observabilitymentioning

confidence: 99%

Intent-Driven Distributed Applications Management Over Compute and Network Resources in the Computing Continuum

Zafeiropoulos,

Fotopoulou,

Vassilakis

et al. 2023

2023 19th International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT)

Self Cite

View full text Add to dashboard Cite

Intent-driven orchestration enables organizations to achieve greater automation, integration, and intelligence of their compute and network resources by defining their objectives and policies in a more abstract and holistic way, and letting the orchestration system handle the coordination, optimization, and adaptation of the resources in response to changing needs and conditions. The trend for the development of intent-driven orchestration mechanisms has been growing in recent years as the deployment of distributed applications in the computing continuum has become more complex and diverse. In this manuscript we detail a novel approach for the management of distributed applications in the computing continuum. An hierarchical decision making scheme is proposed where an entity in a specific level of the hierarchy has the responsibility for management of the overall application or a part of it, without having the control of all the management actions. The control is distributed across various entities that have to collaborate towards some joint objectives. Both compute and network resources management is considered that can be provided by the same or different infrastructure providers.

show abstract

Data Fusion of Observability Signals for Assisting Orchestration of Distributed Applications

Cited by 12 publications

References 27 publications

Enhanced Visibility for Real-time Monitoring and Alerting in Kubernetes by Integrating Prometheus,Prometheus, Grafana, Loki, and Alerta

Enhanced Visibility for Real-time Monitoring and Alerting in Kubernetes by Integrating Prometheus,Prometheus, Grafana, Loki, and Alerta

Design Methodology for 6G End-to-End System: Hexa-X-II Perspective

Intent-Driven Distributed Applications Management Over Compute and Network Resources in the Computing Continuum

Contact Info

Product

Resources

About