Monitoring of large-scale federated data storage: XRootD and beyond

Andreeva, Julia; Beche, A; Belov, Sergey; Arias, D Diguez; Giordano, D.; Oleynik, D.; Petrosyan, A.; Sáiz, Pablo; Tadel, M.; Tuckett, David; Vukotić, I.

doi:10.1088/1742-6596/513/3/032004

Cited by 7 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…it lives inside the domain of the Tier-1 itself, where you also have the GPFS storage system. In Openstack, extra VMs were instantiated to talk to the LSF master through a tunnel and can access the local data ("local" meaning local to CNAF) either through a GPFS export via NFS, or directly via xrootd [12]. The data access from the WAN is implemented just through xrootd.…”

Section: Pos(isgc 2016)023mentioning

confidence: 99%

Elastic Computing from Grid sites to External Clouds

Codispoti¹,

Maria²,

Aiftimiei³

et al. 2017

Proceedings of International Symposium on Grids and Clouds (ISGC) 2016 — PoS(ISGC 2016)

View full text Add to dashboard Cite

LHC experiments are now in Run-II data taking and approaching new challenges in the operation of the computing facilities in future Runs. Despite having demonstrated to be able to sustain operations at scale during Run-I, it has become evident that the computing infrastructure for Run-II already is dimensioned to cope at most with the average amount of data recorded, and not for peak usage. The latter are frequent and may create large backlogs and have a direct impact on data reconstruction completion times, hence to data availability for physics analysis. Among others, the CMS experiment is exploring (since the first Long Shutdown period after Run-I) the access and utilisation of Cloud resources provided by external partners or commercial providers. In this work we present proof of concepts of the elastic extension of a CMS Tier-3 site in Bologna (Italy), on an external OpenStack infrastructure. We start from presenting the experience on a first work on the "Cloud Bursting" of a CMS Grid site using a novel LSF configuration to dynamically register new worker nodes. Then, we move to an even more recent work on a "Cloud Site as-aService" prototype, based on a more direct access/integration of OpenStack resources into the CMS workload management system. Results with real CMS workflows and future plans are also presented and discussed.

show abstract

Section: Pos(isgc 2016)023mentioning

confidence: 99%