Integrated System for Performance Monitoring of the ATLAS TDAQ Network

Savu, D. O.; Al-Shabibi, Ali; Martin, B.; Sjoen, R; Batraneanu, S.; Stancu, S.

doi:10.1088/1742-6596/331/5/052031

Cited by 4 publications

(7 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A database (known as the central database) is used to store information from various sources and supply it on demand to several presentation clients. This modular system [106,110,111] statistics gathering (imposed by the real-time nature of the DAQ/HLT system). Time-stamped data are typically stored in round-robin databases (RRD [112]) and consist of network traffic statistics, as well as various environmental and PC specific statistics (2.14.2).…”

Section: Network Managementmentioning

confidence: 99%

“…Some of them are targeted mainly at the operator in charge of monitoring and control of the networking functionality, while others provide in depth information typically accessed by experts. The most complete of them is Net-IS (the Integrated System for Performance Monitoring of the ATLAS DAQ/HLT Network [110,111]): a powerful interface which provides convenient access to all the data stored or referenced by the central database. The information can either be browsed by several predefined hierarchical trees, or it can be directly searched using regular expressions.…”

Section: Network Managementmentioning

confidence: 99%

See 1 more Smart Citation

The ATLAS Data Acquisition and High Level Trigger system

2016

J. Inst.

View full text Add to dashboard Cite

show abstract

Section: Network Managementmentioning

confidence: 99%

Section: Network Managementmentioning

confidence: 99%

The ATLAS Data Acquisition and High Level Trigger system

2016

J. Inst.

View full text Add to dashboard Cite

show abstract

“…The computing and network infrastructure of the experiment consists of 4,020 computing nodes, 285 network switches and 14,778 switch interfaces (ports). The NetIs system was designed to monitor this network [2]. The first version of NetIs was developed in 2010 based on the cyclic time series Round Robin Database (RRD) [3].…”

Section: First Version Of the Atlas Network Monitoring Tool And Motivation For Upgradementioning

confidence: 99%

Usage of Time Series Databases in the Grafana Platform for the Netis Service

Alexandrov¹,

Avolio²

2021

9th International Conference "Distributed Computing and Grid Technologies in Science and Education"

View full text Add to dashboard Cite

NetIs is a service used to monitor the Data Acquisition network of the ATLAS experiment. The firstversion was developed at CERN in 2010. Over the years, the need to replace NetIs with an improvedservice emerged. Indeed, the effort to maintain NetIs has considerably increased together with the sizeand complexity of the network system; additionally, the Round Robin Database used to store the dataresults in a loss of granularity over time that makes the tool unsuitable for retrieving accurate valuesfrom the past. The graphs produced by NetIs are generated by the backend server and they are quitestatic, though the GUI is familiar to many users. The main idea was to exploit the recent advancementsin time series databases and visualization tools like Grafana in order to present data to the users in amore dynamic way. The Persistent Back-End for the ATLAS Information System, developed inATLAS for permanent storage of operational data, was already integrated with Grafana andsuccessfully collecting network monitoring statistics. Grafana, despite being a very popularvisualization web application, does not support some GUI elements that are used in NetIs such as atree or position of drop-down. Javascript code integrated with Grafana was used to overcome theselimitations.

show abstract

“…Net-IS The Net-IS (Networking Integrated System) [6] is the main tool used for collecting statistics of the network infrastructure. Net-IS provides system metrics (e.g.…”

Section: Data Providersmentioning

confidence: 99%

The ADAM project: a generic web interface for retrieval and display of ATLAS TDAQ information

Harwood

Miotto

Magnoni

et al. 2012

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Abstract. This paper describes a new approach to the visualization of information about the operation of the ATLAS Trigger and Data Acquisition system. ATLAS is one of the two general purpose detectors positioned along the Large Hadron Collider at CERN. Its data acquisition system consists of several thousand computers interconnected via multiple gigabit Ethernet networks, that are constantly monitored via different tools. Operational parameters ranging from the temperature of the computers to the network utilization are stored in several databases for later analysis. Although the ability to view these data-sets individually is already in place, currently there is no way to view this data together, in a uniform format, from one location. The ADAM project has been launched in order to overcome this limitation. It defines a uniform web interface to collect data from multiple providers that have different structures. It is capable of aggregating and correlating the data according to user defined criteria. Finally, it visualizes the collected data using a flexible and interactive front-end web system. Structurally, the project comprises of 3 main levels of the data collection cycle: The Level 0 represents the information sources within ATLAS. These providers do not store information in a uniform fashion. The first step of the project was to define a common interface with which to expose stored data. The interface designed for the project originates from the Google Data Protocol API. The idea is to allow read-only access to data providers, through HTTP requests similar in format to the SQL query structure. This provides a standardized way to access this different information sources within ATLAS. The Level 1 can be considered the engine of the system. The primary task of the Level 1 is to gather data from multiple data sources via the common interface, to correlate this data together, or over a defined time series, and expose the combined data as a whole to the Level 2 web interface. The Level 2 is designed to present the data in a similar style and aesthetic, despite the different data sources. Pages can be constructed, edited and personalized by users to suit the specific data being shown. Pages can show a collection of graphs displaying data potentially coming from multiple sources. The project as a whole has a great amount of scope thanks to the uniform approach chosen for exposing data, and the flexibility of the Level 2 in presenting results. The paper will describe in detail the design and implementation of this new tool. In particular we will go through the project architecture, the implementation choices and the examples of usage of the system in place within the ATLAS TDAQ infrastructure.

show abstract

Integrated System for Performance Monitoring of the ATLAS TDAQ Network

Cited by 4 publications

References 2 publications

The ATLAS Data Acquisition and High Level Trigger system

The ATLAS Data Acquisition and High Level Trigger system

Usage of Time Series Databases in the Grafana Platform for the Netis Service

The ADAM project: a generic web interface for retrieval and display of ATLAS TDAQ information

Contact Info

Product

Resources

About