A Parallel Hybrid Testing Technique for Tri-Programming Model-Based Software Systems

Abstract

Recently, researchers have shown increasing interest in combining more than one programming model into systems running on high performance computing systems (HPCs) to achieve exascale by applying parallelism at multiple levels. Combining different programming paradigms, such as Message Passing Interface (MPI), Open Multiple Processing (OpenMP), and Open Accelerators (OpenACC), can increase computation speed and improve performance. During the integration of multiple models, the probability of runtime errors increases, making their detection difficult, especially in the absence of testing techniques that can detect these errors. Numerous studies have been conducted to identify these errors, but no technique exists for detecting errors in three-level programming models. Despite the increasing research that integrates the three programming models, MPI, OpenMP, and OpenACC, a testing technology to detect runtime errors, such as deadlocks and race conditions, which can arise from this integration has not been developed. Therefore, this paper begins with a definition and explanation of runtime errors that result from integrating the three programming models that compilers cannot detect. For the first time, this paper presents a classification of operational errors that can result from the integration of the three models. This paper also proposes a parallel hybrid testing technique for detecting runtime errors in systems built in the C++ programming language that uses the triple programming models MPI, OpenMP, and OpenACC. This hybrid technology combines static technology and dynamic technology, given that some errors can be detected using static techniques, whereas others can be detected using dynamic technology. The hybrid technique can detect more errors because it combines two distinct technologies. The proposed static technology detects a wide range of error types in less time, whereas a portion of the potential errors that may or may not occur depending on the 4502 CMC, 2023, vol.74, no.2 operating environment are left to the dynamic technology, which completes the validation.

Errors Classification and Static Detection Techniques for Dual-Programming Model (OpenMP and OpenACC)

“…A 'two-level programming model' is a programming model that combines the features of two different programming models [5], [30]. This combination will aid in the transition to exascale systems, which will require the development of more powerful programming models that allow supercomputers to operate in parallel.…”

“…Hybrid technologies, on the other hand, are ones that incorporate more than one testing method, such as a combination of static and dynamic technologies. The topic has been covered in our previous study [30].…”

“…In parallel systems, there are various sorts of runtime errors that can arise after program run and the compiler is incapable of identifying them. When hybrid models are used, the percentage of these mistakes increases and the reasons for these errors are different from those of traditional models [5], [6], [8], [16], [30], [36], [56]- [59]. Parallel systems have many advantages, but in order to reap the benefits of these advantages, they must be error-free.…”

“…There are various testing methods [5], [30], including static methods that test the system before runtime. The source code is examined using this technique to find a variety of errors, whether they are actual runtime errors or potential runtime errors.…”

“…This technique requires more time to test the system, as additional codes are added to the user source code for testing. The new code is bigger, and consequently, it -takes longer to find these errors [5], [30], [31]. Additionally, the dynamic method detects fewer errors than the static method.…”