IOPro: a parallel I/O profiling and visualization framework for high-performance storage systems

Kim, Seong Jo; Zhang, Yuanrui; Son, Seung Woo; Kandemir, Mahmut; Liao, Wei-keng; Thakur, Rajeev; Choudhary, Alok

doi:10.1007/s11227-014-1329-0

Search citation statements

Order By: Relevance

Paper Sections

Select...

Related Work1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2022

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At the storage hierarchy level, several I/O profilers exist and aim to understand applications I/Os such as IOPIN [18] and IOPRO [19]. Their principal utility is to identify I/O bottlenecks and thus better exploit the system potential.…”

Section: Related Workmentioning

confidence: 99%

FiLiP: A File Lifecycle-based Profiler for hierarchical storage

Khelili¹,

Robert²,

Zertal³

2022

Infocommunications journal

View full text Add to dashboard Cite

The increasing gap between computing speed and storage latency leads to possible I/O bottlenecks on massively parallel computers. To mitigate this issue, hierarchical storage provides multi-tiered configurations where each tier has its own physical characteristics and associated performance. Selecting the most appropriate file placement policy on this multi-tiered storage is difficult and there is to our knowledge no tool that systematically provides statistics and metrics for optimal file policy selection. In this paper, we present FiLiP (File Lifecycle Profiler), a software which provides statistics and metrics for a better understanding of file access by applications and the consequences on file movements across hierarchical storage. After the description of FiLiP’s main features and architecture, we highlight the usefulness of our tool using three I/O intensive simulation HPC applications: NEMO, S3DIO and NAMD and a three-tiered burst buffer.

show abstract

Section: Related Workmentioning

confidence: 99%