Integrating software and hardware hierarchies in an autotuning method for parallel routines in heterogeneous clusters

PARCSIM is a parallel software simulator that allows a user to capture, through a graphical interface, matrix algorithm schemes that solve scientific problems. With this tool, the user can analyse the execution times that would be obtained by using different spatio-temporal mapping of computational tasks on available computational units, parallelism parameters and computational libraries. Furthermore, for complex problem models, the self-optimization engine incorporated in this tool analyses the huge tree of possible calculations grouping and mapping strategies in search of the choice that makes the best use of the available hardware resources. This tool also offers polyalgorithmic resolution by making automatically the best decision between different software approaches to solve a given problem on the hardware system available. This work shows the usefulness of this simulator to efficiently solve hierarchical problems constructed from previously modelled subproblems. This task is performed by reusing, in a scalable way, the optimization information of these subproblems to establish the best execution configuration for the composite problem.

show abstract

POAS: a framework for exploiting accelerator level parallelism in heterogeneous environments

Martínez,

Bernabé,

García

2024

J Supercomput

View full text Add to dashboard Cite

In the era of heterogeneous computing, a new paradigm called accelerator level parallelism (ALP) has emerged. In ALP, accelerators are used concurrently to provide unprecedented levels of performance and energy efficiency. To reach that there are many problems to be solved, one of the most challenging being co-execution. In this paper, we present a new scheduling framework called POAS, a general method for providing co-execution to applications. Our proposal consists of four steps: predict, optimize, adapt and schedule. With POAS, an unseen application can be executed concurrently in ALP with little effort. We evaluate POAS on a heterogeneous environment consisting of CPUs, GPUs (CUDA cores), and XPUs (Tensor cores) on two different fields, namely linear algebra (matrix multiplication benchmark) and deep learning (convolution benchmark). Our experiments prove that POAS provides excellent performance and completes the tasks within a time very close to the optimal time for the hardware and applications used, with a negligible execution time overhead. Moreover, the POAS predictor performed exceptionally well, achieving very low RMSE values for both use cases. Therefore, POAS can be a valuable tool for fully exploiting ALP and improving overall performance over offloading in heterogeneous settings.

show abstract

Integrating software and hardware hierarchies in an autotuning method for parallel routines in heterogeneous clusters

Cited by 3 publications

References 18 publications

Improving the Performance of Task-Based Linear Algebra Software with Autotuning Techniques on Heterogeneous Architectures

Improving the Performance of Task-Based Linear Algebra Software with Autotuning Techniques on Heterogeneous Architectures

PARCSIM: a parallel computing simulator for scalable software optimization

POAS: a framework for exploiting accelerator level parallelism in heterogeneous environments

Contact Info

Product

Resources

About