Adaptive MPI

Huang, Chao; Lawlor, Orion Sky; Kalé, Laxmikant V.

doi:10.1007/978-3-540-24644-2_20

Cited by 120 publications

(108 citation statements)

References 11 publications

Supporting

Mentioning

107

Contrasting

Unclassified

Order By: Relevance

“…A search of the literature yields some generic tools such as mpC [12,13] and HeteroMPI [14,15] which provide the mechanisms that allow algorithms to be adapted to heterogeneous architectures, but which also require more input from the user and are more code intrusive. Adaptive strategies have been also proposed in AMPI [16] and Dyn-MPI [17]. AMPI is built on Charm++ [18] and allows automatic load balancing based on process virtualization.…”

Section: Background and Objectivesmentioning

confidence: 99%

Dynamic Load Balancing on Dedicated Heterogeneous Systems

Galindo¹,

Almeida²,

Badía³

2008

Recent Advances in Parallel Virtual Machine and Message Passing Interface

View full text Add to dashboard Cite

Abstract. Parallel computing in heterogeneous environments is drawing considerable attention due to the growing number of these kind of systems. Adapting existing code and libraries to such systems is a fundamental problem. The performance of this code is affected by the large interdependence between the code and these parallel architectures. We have developed a dynamic load balancing library that allows parallel code to be adapted to heterogeneous systems for a wide variety of problems. The overhead introduced by our system is minimal and the cost to the programmer negligible. The strategy was validated on several problems to confirm the soundness of our proposal.

show abstract

Section: Background and Objectivesmentioning

confidence: 99%

Dynamic Load Balancing on Dedicated Heterogeneous Systems

Galindo¹,

Almeida²,

Badía³

2008

Recent Advances in Parallel Virtual Machine and Message Passing Interface

View full text Add to dashboard Cite

show abstract

“…Adaptive MPI (AMPI) [17] is an MPI extension which uses processor virtualization to provide malleability by mapping several virtual MPI processes to the same physical processor. AMPI is built on top of CHARM++, in which virtualized MPI processes are managed as threads encapsulated into CHARM++ objects.…”

Section: Related Workmentioning

confidence: 99%

Enhancing the performance of malleable MPI applications by using performance-aware dynamic reconfiguration

et al. 2015

View full text Add to dashboard Cite

The work in this paper focuses on providing malleability to MPI applications by using a novel performance-aware dynamic reconfiguration technique. This paper describes the design and implementation of Flex-MPI, an MPI library extension which can automatically monitor and predict the performance of applications, balance and redistribute the workload, and reconfigure the application at runtime by changing the number of processes. Unlike existent approaches, our reconfiguring policy is guided by user-defined performance criteria. We focus on iterative SPMD programs, a class of applications with critical mass within the scientific community. Extensive experiments show that Flex-MPI can improve the performance, parallel efficiency, and cost-efficiency of MPI programs with a minimal effort from the programmer.

show abstract

“…HeteroMPI requires a significant intrusive instrumenting, even for simple parallel programs. AdaptiveMPI [11] is an adaptive implementation of MPI built on top of the CHARM++ runtime environment which supports dynamic load balancing through processor virtualization. It only offers full compatibility with the MPI-1.1 features and MPI standard programs need to be significantly modified.…”

Section: Related Workmentioning

confidence: 99%

FLEX-MPI: An MPI Extension for Supporting Dynamic Load Balancing on Heterogeneous Non-dedicated Systems

Martín

Marinescu

Singh

et al. 2013

Euro-Par 2013 Parallel Processing

View full text Add to dashboard Cite

Abstract. This paper introduces FLEX-MPI, a novel runtime approach for the dynamic load balancing of MPI-based SPMD applications running on heterogeneous platforms in the presence of dynamic external loads. To effectively balance the workload, FLEX-MPI monitors the actual performance of applications via hardware counters and the MPI profiling interface-with a negligible overhead and minimal code modifications. Our results show that by using this approach the execution time of an application may be significantly reduced.

show abstract

Adaptive MPI

Cited by 120 publications

References 11 publications

Dynamic Load Balancing on Dedicated Heterogeneous Systems

Dynamic Load Balancing on Dedicated Heterogeneous Systems

Enhancing the performance of malleable MPI applications by using performance-aware dynamic reconfiguration

FLEX-MPI: An MPI Extension for Supporting Dynamic Load Balancing on Heterogeneous Non-dedicated Systems

Contact Info

Product

Resources

About