Latency Hiding File I/O for Blue Gene Systems
|Title||Latency Hiding File I/O for Blue Gene Systems|
|Publication Type||Conference Paper|
|Year of Publication||2009|
|Authors||Isaila, F, J. Blas, G, Carretero, J|
|Conference Name||2009 Nineth IEEE International Symposium on Cluster Computing and the Grid|
This paper presents the design and implementation of a novel file I/O solution for Blue Gene systems. We propose a hierarchical I/O cache architecture based on open source software. Our solution is based on an asynchronous data staging strategy, which hides the latency of file system access from compute nodes. The performance results demonstrate the high scalability and significant performance improvements of our architecture over existing solutions.