Argonne National Laboratory

Latency Hiding File I/O for Blue Gene Systems

TitleLatency Hiding File I/O for Blue Gene Systems
Publication TypeConference Paper
Year of Publication2009
AuthorsIsaila, F, J. Blas, G, Carretero, J
Conference Name2009 Nineth IEEE International Symposium on Cluster Computing and the Grid
Conference LocationShanghai
Other NumbersANL/MCS-P5385-0715

This paper presents the design and implementation of a novel file I/O solution for Blue Gene systems. We propose a hierarchical I/O cache architecture based on open source software. Our solution is based on an asynchronous data staging strategy, which hides the latency of file system access from compute nodes. The performance results demonstrate the high scalability and significant performance improvements of our architecture over existing solutions.