Automatic compiler-inserted I/O prefetching for out-of-core applications

Mowry, Todd C.; Demke, Angela K.; Krieger, Orran

doi:10.1145/248155.238734

Cited by 7 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The OWCache is not as efficient when prefetching is either ineffective or absent even though victim caching improves the performance of many applications significantly. We expect results for realistic and sophisticated prefetching techniques 1,5 to lie between these two extremes. In addition, as prefetching techniques improve and optical technology develops, we should see greater gains coming from the OWCache architecture.…”

Section: Discussionmentioning

confidence: 99%

Disk caching with an optical ring

Carrera

Bianchini

2000

Appl. Opt.

View full text Add to dashboard Cite

We propose a simple extension to the optical network of a scalable multiprocessor that optimizes page swap outs. More specifically, we propose to extend the network with an optical ring that not only transfers swapped-out pages between the local memories and the disks of the multiprocessor but also acts as a systemwide write cache for these pages. This extended optical network confers several performance benefits: It provides a staging area where swapped-out pages can reside until the disk is free, it increases the possibility of combining several writes to disk, and it acts as a victim cache for pages that are swapped out and subsequently accessed by the same or a different processor. To evaluate the extent to which these benefits affect performance, we use detailed execution-driven simulations of several out-of-core parallel applications that run on an eight-node scalable multiprocessor. Our results demonstrate that our optical ring provides consistent performance improvements that derive mostly from faster page swap outs and victim caching. To show that our optical ring can also be applied successfully to traditional multiprocessors in which processors are interconnected with electronic networks, we evaluate its benefits for a mesh-connected multiprocessor. This latter evaluation shows that our optical ring improves performance for a traditional multiprocessor by roughly the same amount as it does for an optically interconnected multiprocessor. On the basis of these results and our parameter-space study our main conclusion is that our optical ring is highly efficient under several architectural assumptions and for most out-of-core parallel applications. Even though our study focuses on optimizing page swap outs, we believe that caching data with an optical ring can be beneficial for other types of disk-write traffic as well.

show abstract

Section: Discussionmentioning

confidence: 99%

Disk caching with an optical ring

Carrera

Bianchini

2000

Appl. Opt.

View full text Add to dashboard Cite

show abstract

“…The previous work [36] has pointed out that explicit I/O operations can have several disadvantages and proposes an approach from the compiler level.…”

Section: Related Workmentioning

confidence: 99%

MPI windows on storage for HPC applications

Rivas-Gomez

Gioiosa

Kestor

et al. 2017

Proceedings of the 24th European MPI Users' Group Meeting

View full text Add to dashboard Cite

Upcoming HPC clusters will feature hybrid memories and storage devices per compute node. In this work, we propose to use the MPI one-sided communication model and MPI windows as unique interface for programming memory and storage. We describe the design and implementation of MPI storage windows, and present its benefits for out-of-core execution, parallel I/O and fault-tolerance. In addition, we explore the integration of heterogeneous window allocations, where memory and storage share a unified virtual address space. When performing large, irregular memory operations, we verify that MPI windows on local storage incurs a 55% performance penalty on average. When using a Lustre parallel file system, "asymmetric" performance is observed with over 90% degradation in writing operations. Nonetheless, experimental results of a Distributed Hash Table, the HACC I/O kernel mini-application, and a novel MapReduce implementation based on the use of MPI one-sided communication, indicate that the overall penalty of MPI windows on storage can be negligible in most cases in real-world applications.

show abstract