Designing Efficient Cooperative Caching Schemes for Multi-Tier Data-Centers over RDMA-enabled Networks

Narravula, S.; Jin, Hyun-Wook; Vaidyanathan, Karthikeyan; Panda, Dhabaleswar K.

doi:10.1109/ccgrid.2006.33

Cited by 8 publications

(13 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Servers can achieve higher gains by sharing a common distributed cache (intra-tier, inter-tier) and maintaining meta-data information about the cached content on the cooperating nodes. As a part of our current study [25], we have designed and evaluated a remote memory based multi-tier distributed shared cache and studied the associated trade offs. We plan to extend the knowledge gained in this study to integrate and evaluate active and cooperative caching mechanisms proposed in this study.…”

Section: Discussion and Work-in-progressmentioning

confidence: 99%

Designing next generation data-centers with advanced communication protocols and systems services

Balaji¹,

Vaidyanathan²,

Narravula³

et al. 2006

Proceedings 20th IEEE International Parallel &Amp; Distributed Processing Symposium

Self Cite

View full text Add to dashboard Cite

Current data-centers rely on TCP/IP over Fast-and Gigabit-Ethernet for data communication even within the cluster environment for costeffective designs, thus limiting their maximum capacity. Together with raw performance, such data-centers also lack in efficient support for intelligent services, such as requirements for caching documents, managing limited physical resources, load-balancing, controlling overload scenarios, and prioritization and QoS mechanisms, that are becoming a common requirement today. On the other hand, the System Area Network (SAN) technology is making rapid advances during the recent years. Besides high performance, these modern interconnects are providing a range of novel features and their support in hardware (e.g., RDMA, atomic operations, QoS support). In this paper, we address the capabilities of these current generation SAN technologies in addressing the limitations of existing data-centers. Specifically, we present a novel framework comprising of three layers (communication protocol support, data-center service primitives and advanced data-center services) that work together to tackle the issues associated with existing data-centers. We also present preliminary results in the various aspects of the framework, which demonstrate close to an order of magnitude performance benefits achievable by our framework as compared to existing data-centers in several cases.

show abstract

Section: Discussion and Work-in-progressmentioning

confidence: 99%

Designing next generation data-centers with advanced communication protocols and systems services

Balaji¹,

Vaidyanathan²,

Narravula³

et al. 2006

Proceedings 20th IEEE International Parallel &Amp; Distributed Processing Symposium

Self Cite

View full text Add to dashboard Cite

show abstract

“…Narravula et al investigated the use of caching schemes for InfiniBand-based data center architectures [14]. The performance of InfiniBand networks over long distances was investigated by Rao et al [16], with a comparison to 10GigE.…”

Section: Related Workmentioning

confidence: 99%

Evaluation of ConnectX Virtual Protocol Interconnect for Data Centers

Grant

Afsahi

Balaji

2009

2009 15th International Conference on Parallel and Distributed Systems

View full text Add to dashboard Cite

Abstract-With the emergence of new technologies such asVirtual Protocol Interconnect (VPI) for the modern data center, the separation between commodity networking technology and high-performance interconnects is shrinking. With VPI, a single network adapter on a data center server can easily be configured to use one port to interface with Ethernet traffic and another port to interface with high-bandwidth, low-latency InfiniBand technology. In this paper, we evaluate ConnectX VPI using microbenchmarks as well as real traces from a three-tier data center architecture. We find that with VPI each network segment in the data center can use the most optimal configuration (whether InfiniBand or Ethernet) without having to fall back to the lowest common denominator, as is currently the case. Our results show a maximum 26.7% increase in bandwidth, a 54.5% reduction in latency, and a 5% increase in real data center throughput.

show abstract

“…Recently, Narravula et al [27] exploit remote memory and direct remote DMA operations to improve utilization of aggregate distributed caches in a cooperative caching environment. Our work differs in that it employs remote memory in an application-controlled execution environment.…”

Section: Related Workmentioning

confidence: 99%

Runtime and Programming Support for Memory Adaptation in Scientific Applications via Local Disk and Remote Memory

et al. 2007

View full text Add to dashboard Cite

The ever increasing memory demands of many scientific applications and the complexity of today's shared computational resources still require the occasional use of virtual memory, network memory, or even out-of-core implementations, with well known drawbacks in performance and usability. In Mills et al. (Adapting to memory pressure from within scientific applications on multiprogrammed COWS. basic framework for a runtime, user-level library, MMlib, in which DRAM is treated as a dynamic size cache for large memory objects residing on local disk. Application developers can specify and access these objects through MMlib, enabling their application to execute optimally under variable memory availability, using as much DRAM as fluctuating memory levels will allow. In this paper, we first extend our earlier MMlib prototype from a proof of concept to a usable, robust, and flexible library. We present a general framework that enables fully customizable memory malleability in a wide variety of scientific applications. We provide several necessary enhancements to the environment sensing capabilities of MMlib, and introduce a remote memory capability, based on MPI communication of cached memory blocks between 'compute nodes' and designated memory servers. The increasing speed of interconnection networks makes a remote memory approach attractive, especially at the large granularity present in large scientific applications. We show experimental results from three important scientific applications that require the general MMlib framework. The memoryadaptive versions perform nearly optimally under constant memory pressure and execute harmoniously with other applications competing for memory, without thrashing the memory system. Under constant memory pressure, we observe execution time improvements of factors between 214 R. T. Mills, et al. three and five over relying solely on the virtual memory system. With remote memory employed, these factors are even larger and significantly better than other, system-level remote memory implementations.

show abstract

Designing Efficient Cooperative Caching Schemes for Multi-Tier Data-Centers over RDMA-enabled Networks

Cited by 8 publications

References 11 publications

Designing next generation data-centers with advanced communication protocols and systems services

Designing next generation data-centers with advanced communication protocols and systems services

Evaluation of ConnectX Virtual Protocol Interconnect for Data Centers

Runtime and Programming Support for Memory Adaptation in Scientific Applications via Local Disk and Remote Memory

Contact Info

Product

Resources

About