Argonne National Laboratory

Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems

TitleMultiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems
Publication TypeConference Paper
Year of Publication2009
AuthorsJ. Blas, G, Isaila, F, Carretero, J, Latham, R, Ross, RB
Conference NameRecent Advances in Parallel Virtual Machine and Message Passing Interface
Date Published09/2009
PublisherSpringer Berlin / Heidelberg
Conference LocationEspoo, Finland
Other NumbersANL/MCS-P1632-0509

This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O.