High Performance Distributed Lock Management Services using Network-based Remote Atomic Operations

Narravula, S.; Mamidala, Amith R.; Vishnu, Abhinav; Vaidyanathan, Karthikeyan; Panda, Dhabaleswar K.

doi:10.1109/ccgrid.2007.58

Cited by 20 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are many more works, such as RDMA-based transaction processing systems [14,19,24], distributed lock management [25], resource desegregation [16,17]. In these systems RDMA part provides primitives like one-sided RDMA read/write and can be used with fast RPC implementation.…”

Section: Related Workmentioning

confidence: 99%

Data structures access model for remote shared memory

et al. 2021

View full text Add to dashboard Cite

Recent achievements in high-performance computing significantly narrow the performance gap between single and multi-node computing, and open up opportunities for systems with remote shared memory. The combination of in-memory storage, remote direct memory access and remote calls requires rethinking how data organized, protected and queried in distributed systems. Reviewed models let us implement new interpretations of distributed algorithms allowing us to validate different approaches to avoid race conditions, decrease resource acquisition or synchronization time. In this paper, we describe the data model for mixed memory access with analysis of optimized data structures. We also provide the result of experiments, which contain a performance comparison of data structures, operating with different approaches, evaluate the limitations of these models, and show that the model does not always meet expectations. The purpose of this paper to assist developers in designing data structures that will help to achieve architectural benefits or improve the design of existing distributed system.

show abstract

Section: Related Workmentioning

confidence: 99%

Data structures access model for remote shared memory

et al. 2021

View full text Add to dashboard Cite

show abstract

“…While some of the core components such as high-speed reliable UDP incorporate new and novel concepts, the ideas of others may not be completely new. For example, there has been previous work that utilizes specialized hardware support to achieve distributed data management and locking efficiently [25,16]. However, our this thesis work focuses on providing such useful functionality in the context of a general purpose software-based accelerator, which presents its own unique challenges.…”

Section: Core Componentsmentioning

confidence: 99%

GePSeA: A General-Purpose Software Acceleration Framework for Lightweight Task Offloading

Singh

Balaji

Feng

2009

2009 International Conference on Parallel Processing

View full text Add to dashboard Cite

Hardware-acceleration techniques continue to be used to boost the performance of scientific codes. To do so, software developers identify portions of these codes that are amenable for offloading and map them to hardware accelerators. However, offloading such tasks to specialized hardware accelerators is non-trivial. Furthermore, these accelerators can add significant cost to a computing system. Consequently, this thesis proposes a framework called GePSeA (General Purpose Software Acceleration Framework), which uses a small fraction of the computational power on multicore architectures to offload complex application-specific tasks. Specifically, GePSeA provides a lightweight process that acts as a helper agent to the application by executing application-specific tasks asynchronously and efficiently. GePSeA is not meant to replace hardware accelerators but to extend them. GePSeA provide several utilities called core components that offload tasks on to the core or to the special-purpose hardware when available in a way that is transparent to the application. Examples of such core components include reliable communication service, distributed lock management, global memory management, dynamic load distribution and network protocol processing. We then apply the GePSeA framework to two applications, namely mpiBLAST, an open-source computational biology application and Reliable Blast UDP (RBUDP) based file transfer application. We observe significant speed-up for both applications.

show abstract

“…Though this work exploits the benefits of RDMA operations for locking services, their design can only support exclusive mode locking. Further, prior research in [14] extensively utilizes InfiniBand's remote atomic operations for shared and exclusive mode locking, however, the main focus in their work is not in the context of MPI-2 one-sided synchronization but rather as a system-wide distributed locking service typically used in data-centers. In the context of MPI, previous work in MVAPICH2 have studied the benefits of RDMA atomic operations to efficiently implement locks in exclusive mode [11].…”

Section: Related Workmentioning

confidence: 99%

Designing passive synchronization for MPI-2 one-sided communication to maximize overlap

Santhanaraman

Narravula

Panda

2008

2008 IEEE International Symposium on Parallel and Distributed Processing

View full text Add to dashboard Cite

Scientific computing has seen an immense growth in recent years. MPI has become the de facto standard for parallel programming model for distributed memory systems. MPI-2 standard expanded MPI to include onesided communications. Computation and communication overlap is an important goal for one-sided applications. While the passive synchronization mechanism for MPI-2 one-sided communication allows for good overlap, the actual overlap achieved is often limited by the design of both the MPI library and the application.In this paper we aim to improve the performance of MPI-2 one-sided communication. In particular, we focus on the following important aspects: (i) designing one-sided passive synchronization (Direct Passive) support using InfiniBand atomic operations to handle both exclusive as well as shared locks (ii) enhancing one-sided communication progress to provide scope for better overlap that one-sided applications can leverage. (iii) study the overlap potential of passive synchronization and its impact on applications. We demonstrate the possible benefits of our approaches for the MPI-2 SPLASH LU application benchmark. Our results show an improvement of up to 87% for a 64 process run over the existing design.

show abstract

High Performance Distributed Lock Management Services using Network-based Remote Atomic Operations

Cited by 20 publications

References 4 publications

Data structures access model for remote shared memory

Data structures access model for remote shared memory

GePSeA: A General-Purpose Software Acceleration Framework for Lightweight Task Offloading

Designing passive synchronization for MPI-2 one-sided communication to maximize overlap

Contact Info

Product

Resources

About