Topology-Aware Data Movement and Staging for I/O Acceleration on Blue Gene/P Supercomputing Systems.

TitleTopology-Aware Data Movement and Staging for I/O Acceleration on Blue Gene/P Supercomputing Systems.
Publication TypeConference Paper
Year of Publication2011
AuthorsVishwanath, V, Hereld, M, Morozov, V, Papka, ME
Conference NameProc. 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Date Published11/2011
PublisherACM
Conference LocationSeattle, Washington
Other NumbersANL/MCS-P1936-0911
Abstract

There is growing concern that I/O systems will be hard pressed to satisfy the requirements of future leadership-class machines. Even current machines are found to be I/O bound for some applications. In this paper, we identify existing performance bottlenecks in data movement for I/O on the IBM Blue Gene/P (BG/P) supercomputer currently deployed at several leadership computing facilities. We improve the I/O performance by exploiting the network topology of BG/P for collective I/O, leveraging data semantics of applications an incorporating asynchronous data staging. We demonstrate the efficacy of our approaches for synthetic benchmark experiments and for application-level benchmarks at scale on leadership computing systems.

PDFhttp://www.mcs.anl.gov/papers/P1936-0911.pdf