ATLAS job monitoring in the Dashboard Framework

Abstract

Monitoring of the large-scale data processing of the ATLAS experiment includes monitoring of production and user analysis jobs. The Experiment Dashboard provides a common job monitoring solution, which is shared by ATLAS and CMS experiments. This includes an accounting portal as well as real-time monitoring. Dashboard job monitoring for ATLAS combines information from the PanDA job processing database, Production system database and monitoring information from jobs submitted through GANGA to Workload Management System (WMS) or local batch systems. Usage of Dashboard-based job monitoring applications will decrease load on the PanDA database and overcome scale limitations in PanDA monitoring caused by the short job rotation cycle in the PanDA database. Aggregation of the task/job metrics from different sources provides complete view of job processing activity in ATLAS scope.

Dashboard Task Monitor for Managing ATLAS User Analysis on the Grid

“…The main components of the Experimental Dashboard framework are information collectors, data repository, and services that retrieve and expose monitoring data. The comprehensive description of the Experimental Dashboard framework components is provided in [11]. ATLAS job monitoring architecture is presented in Figure 1.…”