Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems
| Title | Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems |
| Publication Type | Conference Paper |
| Year of Publication | 2009 |
| Authors | J. Blas, G, Isaila, F, Carretero, J, Latham, R, Ross, RB |
| Conference Name | Recent Advances in Parallel Virtual Machine and Message Passing Interface |
| Date Published | 09/2009 |
| Publisher | Springer Berlin / Heidelberg |
| Conference Location | Espoo, Finland |
| Other Numbers | ANL/MCS-P1632-0509 |
| Abstract | This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O. |
| URL | http://www.springerlink.com/content/34u93145953wv1w2/ |
| http://www.mcs.anl.gov/papers/P1632.pdf |