Topology-Aware Data Movement and Staging for I/O Acceleration on Blue Gene/P Supercomputing Systems.
|Title||Topology-Aware Data Movement and Staging for I/O Acceleration on Blue Gene/P Supercomputing Systems.|
|Publication Type||Conference Paper|
|Year of Publication||2011|
|Authors||Vishwanath, V, Hereld, M, Morozov, V, Papka, ME|
|Conference Name||Proc. 2011 International Conference for High Performance Computing, Networking, Storage and Analysis|
|Conference Location||Seattle, Washington|
There is growing concern that I/O systems will be hard pressed to satisfy the requirements of future leadership-class machines. Even current machines are found to be I/O bound for some applications. In this paper, we identify existing performance bottlenecks in data movement for I/O on the IBM Blue Gene/P (BG/P) supercomputer currently deployed at several leadership computing facilities. We improve the I/O performance by exploiting the network topology of BG/P for collective I/O, leveraging data semantics of applications an incorporating asynchronous data staging. We demonstrate the efficacy of our approaches for synthetic benchmark experiments and for application-level benchmarks at scale on leadership computing systems.