Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems
Title | Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems |
Publication Type | Conference Paper |
Year of Publication | 2009 |
Authors | J. Blas, G, Isaila, F, Carretero, J, Latham, R, Ross, RB |
Conference Name | Recent Advances in Parallel Virtual Machine and Message Passing Interface |
Date Published | 09/2009 |
Publisher | Springer Berlin / Heidelberg |
Conference Location | Espoo, Finland |
Other Numbers | ANL/MCS-P1632-0509 |
Abstract | This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O. |
URL | http://www.springerlink.com/content/34u93145953wv1w2/ |
http://www.mcs.anl.gov/papers/P1632.pdf |