Integration of the JINR Hybrid Computing Resources with the DIRAC Interware for Data Intensive Applications

Korenkov, V.; Pelevanyuk, I.; Tsaregorodtsev, A.

doi:10.1007/978-3-030-51913-1_3

Cited by 4 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The work related to DIRAC integration was started in 2016 [1]. The standard incremental process of system enhancement went through three basic steps:…”

Section: Dirac Development In Jinrmentioning

confidence: 99%

DIRAC Interware as a Service for High-Thoughput Computing in JINR

Pelevanyuk

Tsaregorodtsev

2022

Phys. Part. Nuclei Lett.

View full text Add to dashboard Cite

DIRACInterware is an open-source development platform for the integration of heterogeneous computing and storage resources. The service based on this platform was deployed and configured in Joint Institute for Nuclear Research in 2016. Now it is actively used for MPD, Baikal-GVD, and BM@N experiments. In JINR we have five big computing resources with uniform access via the DIRAC service: Tier1, Tier2, Govorun supercomputer, cloud, and NICA cluster. In particular, the DIRAC service was used as a tool for the integration of cloud resources of JINR member states. The overall performance of the united system is at least three times more efficient compared to the use of any single computing resource. Of course, using the united system adds complexity for users and requires additional effort to reach high performance. But, for the last three years of active use of the DIRAC, the approaches were elaborated to simplify the use of the system. Right now there are many tools and components developed to allow the fast construction of new workflows. The total number of completed jobs exceeds 1 million, and the total amount of computing work is around 4.5 million HS06days.

show abstract

“…The work related to DIRAC integration was started in 2016 [1]. The standard incremental process of system enhancement went through three basic steps:…”

Section: Dirac Development In Jinrmentioning

confidence: 99%

DIRAC Interware as a Service for High-Thoughput Computing in JINR

Pelevanyuk

Tsaregorodtsev

2022

Phys. Part. Nuclei Lett.

View full text Add to dashboard Cite

show abstract

“…The service based on the DIRAC platform was deployed and configured at the Joint Institute for Nuclear Research in 2016. Various tests were performed to estimate its possibilities and performance [3]. By 2019, standard workflow tests related to general Monte-Carlo generation were successfully carried out, which proved the possibility of using DIRAC for real scientific computation.…”

Section: Use Of the Dirac Interware For Mpd Distributed Computingmentioning

confidence: 99%

Design and Development of Application Software for the MPD Distributed Computing Infrastructure

Moshkin¹,

Pelevanyuk²,

Rogachevsky³

2021

9th International Conference "Distributed Computing and Grid Technologies in Science and Education"

View full text Add to dashboard Cite

The Multi-Purpose Detector collaboration began using distributed computing for centralized MonteCarlo generation in mid-2019. The DIRAC Interware is used as a platform for the integration ofheterogeneous distributed computing resources. Since then, workflows of job submission, datatransfer, and storage have been designed, tested, and successfully applied. Moreover, the growth ofinterest in access to the computing system from users is observed. One way to provide such access forthe users is to allow them to directly submit jobs to DIRAC. However, direct access to the resourcesimposes a high responsibility on users and must be restricted. For this reason, another approach waschosen, i.e. to design and develop a dedicated application that collects requirements from users andstarts the required number of jobs. Such an approach entails additional effort: elaboration ofrequirements, application design and development. Nevertheless, it allows for greater control over theworkload submitted by other users, reducing possible failures and the inefficient usage of resources.

show abstract

“…The integration of the cloud resources of JINR and its Member States was performed with the help of the DIRAC Interware [2]. DIRAC is a platform that provides basic tools and methods for combining heterogeneous infrastructures and their operation for large sets of computing tasks.…”

Section: Introductionmentioning

confidence: 99%

Using Distributed Clouds for Scientific Computing

Kutovskiy¹,

Pelevanyuk²,

Zaborov³

2021

9th International Conference "Distributed Computing and Grid Technologies in Science and Education"

View full text Add to dashboard Cite

Nowadays, cloud resources are the most flexible tool to provide access to infrastructures forestablishing services and applications. However, it is also a valuable resource for scientific computing.At the Joint Institute for Nuclear Research, the computing cloud was integrated with the DIRACsystem. It allowed for the submission of scientific computing jobs directly to the cloud. Thanks to theexperience, the cloud resources of several organizations from the JINR Member States were integratedin the same way. It increased the total amount of cloud resources accessible in a uniform way throughDIRAC, in the scope of the so-called Distributed Information and Computing Environment (DICE).Folding@Home tasks related to the SARS-CoV-2 virus were submitted to all available cloudresources. In addition to useful scientific results, such experience was also helpful in obtaininginformation about the performance, limitations, strengths, and weaknesses of the combined system.Based on the gained experience, the DICE infrastructure was tuned to successfully perform real userjobs related to Monte-Carlo simulation for the Baikal-GVD experiment.

show abstract

Integration of the JINR Hybrid Computing Resources with the DIRAC Interware for Data Intensive Applications

Cited by 4 publications

References 9 publications

DIRAC Interware as a Service for High-Thoughput Computing in JINR

DIRAC Interware as a Service for High-Thoughput Computing in JINR

Design and Development of Application Software for the MPD Distributed Computing Infrastructure

Using Distributed Clouds for Scientific Computing

Contact Info

Product

Resources

About