DASH: A C++ PGAS Library for Distributed Data Structures and Parallel Algorithms

Fuerlinger, Karl; Fuchs, Tobias; Kowalewski, Roger

doi:10.1109/hpcc-smartcity-dss.2016.0140

Cited by 37 publications

(16 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This benchmark in version 2.0.3 was ported by the MNM research team (Fürlinger et al, described in [8]) to DASH, a C++ template library for distributed data structures, supporting hierarchical locality for HPC and datadriven science. Adopting the Partitioned Global Address Space (PGAS) programming model, DASH developed a template library that provides PGAS-like abstraction for important data containers and allows a developer to control and take advantage of the hierarchical data layout of global data structures.…”

Section: Discussionmentioning

confidence: 99%

Enabling EASEY Deployment of Containerized Applications for Future HPC Systems

Höb

Kranzlmüller

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

The upcoming exascale era will push the changes in computing architecture from classical CPU-based systems towards hybrid GPU-heavy systems with much higher levels of complexity. While such clusters are expected to improve the performance of certain optimized HPC applications, it will also increase the difficulties for those users who have yet to adapt their codes or are starting from scratch with new programming paradigms. Since there are still no comprehensive automatic assistance mechanisms to enhance application performance on such systems, we propose a support framework for future HPC architectures, called EASEY (Enable exASclae for EverYone). Our solution builds on a layered software architecture, which offers different mechanisms on each layer for different tasks of tuning, including a workflow management system. This enables users to adjust the parameters on each of the layers, thereby enhancing specific characteristics of their codes. We introduce the framework with a Charliecloud-based solution, showcasing the LULESH benchmark on the upper layers of our framework. Our approach can automatically deploy optimized container computations with negligible overhead and at the same time reduce the time a scientist needs to spent on manual job submission configurations.

show abstract

Section: Discussionmentioning

confidence: 99%

Enabling EASEY Deployment of Containerized Applications for Future HPC Systems

Höb

Kranzlmüller

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…Recently, the libraries supporting the PGAS model, such as OpenShmem [15], GlobalArray [16], even MPI3 RMA, are getting popular for programming some specific applications. Furthermore, many C++ template-based design for PGAS, such as UPC++ [17], DASH [18], are proposed as a compiler-free approach, as C++ template provides powerful abstraction mechanism. This approach may increase portability, clean separation from base compiler optimization, but a problem is that it is sometimes hard to debug in C++ template once a programmer writes wrong programs.…”

Section: Xcalablemp Api: Compiler-free Approachmentioning

confidence: 99%

XcalableMP 2.0 and Future Directions

Sato

Murai

Nakao

et al. 2020

XcalableMP PGAS Programming Language

View full text Add to dashboard Cite

This chapter presents the XcalableMP on the Fugaku supercomputer, the Japanese flagship supercomputer developed by FLAGSHIP2020 project in RIKEN R-CCS. The porting and the performance evaluation were done as a part of this project, and the XcalableMP is available for the Fugaku users for improving the productivity and performance of parallel programing. The performance of XcalableMP on the Fugaku is enhanced by the manycore processor and a new Tofu-D interconnect. We are now working on the next version, XcalableMP 2.0, for cutting-edge high-performance systems with manycore processors by multithreading and multi-tasking with integrations of PGAS model and synchronization models. We conclude this book with retrospectives and challenges for future PGAS models.

show abstract

“…Compared to parallel patterns, its relatively low-level interface can be errorprone for unexperienced programmers and, therefore, it may have a negative effect on software reliability. To tackle this issue, some state-of-the-art parallel pattern frameworks [5,46], already support distributed execution policies.…”

Section: Motivationmentioning

confidence: 99%

“…MALLBA leverages NetStream, a custom MPI abstraction layer that takes care of primitive data type marshaling and synchronization between processes running in distributed machines. Finally, we highlight DASH [46], a C++ template library that offers distributed data structures and parallel Standard template library (STL) algorithms via a compiler-free Partitioned Global Address Space (PGAS) approach. Table 2.2 summarizes the features of state-of-the-art frameworks for DaSP application development.…”

Section: Data Stream Processing Applications (Dasp)mentioning

confidence: 99%

Exploring stream parallel patterns in distributed MPI environments

et al. 2019

View full text Add to dashboard Cite

En primer lugar, a mis padres. Os debo todo lo que soy y seré. Gracias por el cuidado y educación recibidos, por los buenos (y malos) momentos, por aquellos días de piscina en Playa de Madrid, por las barbacoas en la Fundación del Lesionado Medular/ASPAYM Madrid, por las comidas en "La Bodeguita" y en el Centro Municipal de Mayores Ascao. Gracias a vosotros aprendí a ser fuerte. A mamá, porque me enseñaste lo más importante, a sonreir a pesar de la adversidad, y otras cosas de menor importancia, como mantener un hogar. A papá, por enseñarme gran parte de lo que sé, el equilibrio, e iluminarme el camino; aunque fuera de forma accidental, sin tí, mi vocación sería otra. Nunca os lo podré agradecer tanto como lo merecisteis. D.E.P.En segundo lugar, a mis compañeros de trabajo: Manu, Javi Doc, y David. Por todos los momentos compartidos en el laboratorio y fuera de él; por ayudarme y presionarme para que trabajara. Sin vosotros, dudo que estuviera escribiendo estas líneas ahora. A mis compañeros de laboratorio: Guille, Mario, Javi Prieto, y José Cabrero, por las charlas y momentos de risa. A Alejandro Calderón, que siempre ha estado ahí para escucharme y echar una mano. A José Daniel, por darme la oportunadad de trabajar en el grupo y por estar ahí en los momentos difíciles que últimamente han acontecido. También a mis compañeros de trabajo del CERN: Enric, Stephan, Guilherme, Bertrand, Javi, Emmanouil "Manos", y especialmente a Axel, Jakob y Pere, por acogerme en ROOT.No voy a terminar sin mencionar a las personas que siempre estuvieron ahí (no, no me olvido de vosotros): a mi hermano, a Úrsula, a mi tía Paloma y mi tío Matías, a mi primo "el niño".

show abstract

DASH: A C++ PGAS Library for Distributed Data Structures and Parallel Algorithms

Cited by 37 publications

References 32 publications

Enabling EASEY Deployment of Containerized Applications for Future HPC Systems

Enabling EASEY Deployment of Containerized Applications for Future HPC Systems

XcalableMP 2.0 and Future Directions

Exploring stream parallel patterns in distributed MPI environments

Contact Info

Product

Resources

About