Improvements to Supercomputing Service Availability Based on Data Analysis

Abstract

As the demand for high-performance computing (HPC) resources has increased in the field of computational science, an inevitable consideration is service availability in large cluster systems such as supercomputers. In particular, the factor that most affects availability in supercomputing services is the job scheduler utilized for allocating resources. Consequent to submitting user data through the job scheduler for data analysis, 25.6% of jobs failed because of program errors, scheduler errors, or I/O errors. Based on this analysis, we propose a K-hook method for scheduling to increase the success rate of job submissions and improve the availability of supercomputing services. By applying this method, the job-submission success rate was improved by 15% without negatively affecting users’ waiting time. We also achieved a mean time between interrupts (MTBI) of 24.3 days and maintained average system availability at 97%. As this research was verified on the Nurion supercomputer in a real service environment, the value of the research is expected to be found in significant service improvements.

Untitled

“…This study utilized the BIGKinds service provided by the Korea Press Foundation, a big data analysis program for news that leverages data mining technology to present results [10]. The BIGKinds platform utilizes news text data from 104 Korean press agencies to offer various analytical functions.…”

“…To examine societal interest in Metaverse IPRs, this study utilized BIGKinds, a program that analyzes news article data using big data [9]. BIGKinds is a big data analysis system for new from the Korea Press Foundation, where media reports can be classified and analyzed according to keywords [10], which has accumulated over 82 million articles provided by 104 major newspapers, broadcasters, and specialized magazines in Korea since 1990 [11]. This study utilized the BIGKinds program to investigate the extent of interest in and discourse surrounding IPRs in the metaverse within the context of Korean society, assessing the potential IPRs likely to emerge with the increasing prevalence of the metaverse.…”