A hierarchic task-based programming model for distributed heterogeneous computing

Abstract

Distributed computing platforms are evolving to heterogeneous ecosystems with Clusters, Grids and Clouds introducing in its computing nodes, processors with different core architectures, accelerators (i.e. GPUs, FPGAs), as well as different memories and storage devices in order to achieve better performance with lower energy consumption. As a consequence of this heterogeneity, programming applications for these distributed heterogeneous platforms becomes a complex task. Additionally to the complexity of developing an application for distributed platforms, developers must also deal now with the complexity of the different computing devices inside the node. In this article, we present a programming model that aims to facilitate the development and execution of applications in current and future distributed heterogeneous parallel architectures. This programming model is based on the hierarchical composition of the COMP Superscalar and Omp Superscalar programming models that allow developers to implement infrastructure-agnostic applications. The underlying runtime enables applications to adapt to the infrastructure without the need of maintaining different versions of the code. Our programming model proposal has been evaluated on real platforms, in terms of heterogeneous resource usage, performance and adaptation.

A programming model for Hybrid Workflows: Combining task-based workflows and dataflows all-in-one

“…As shown in Figure 2, Java is the native programming language to develop COMPSs applications; however, it also provides bindings for Python (Py-COMPSs [29]) and C/C++ [30]. Its programming model is based on annotations that are used to choose class and object methods as tasks.…”

Managing Failures in Task-Based Parallel Workflows in Distributed Computing Environments

“…... COMPSs provides Java as native programming language and it also provides bindings for Python (PyCOMPSs [2]) and C/C++ [7]. Figure 1 shows an example of a task annotation and COMPSs main program.…”