Abstract
The demand for parallel I/O performance continues to grow. However, modelling and generating parallel I/O work-loads are challenging for several reasons including the large number of processes, I/O request dependencies and workload scalability. In this paper, we propose the PIONEER, a complete solution to Parallel I/O workload characterization and gEnERation. The core of PIONEER is a proposed generic workload path, which is essentially an abstract and dense representation of the parallel I/O patterns for all processes in a High Performance Computing (HPC) application. The generic workload path can be built via exploring the inter-processes correlations, I/O dependencies as well as file open session properties. We demonstrate the effectiveness of PIONEER by faithfully generating synthetic workloads for two popular HPC benchmarks and one real HPC application.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 111-120 |
Number of pages | 10 |
ISBN (Electronic) | 9781479980062 |
DOIs | |
State | Published - Jul 7 2015 |
Event | 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 - Shenzhen, China Duration: May 4 2015 → May 7 2015 |
Publication series
Name | Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
---|
Other
Other | 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
---|---|
Country/Territory | China |
City | Shenzhen |
Period | 5/4/15 → 5/7/15 |
Bibliographical note
Publisher Copyright:© 2015 IEEE.
Keywords
- Parallel IO
- Workload characterization