Argonne National Laboratory

Bridging HPC and Grid File I/O with IOFSL

TitleBridging HPC and Grid File I/O with IOFSL
Publication TypeConference Paper
Year of Publication2010
AuthorsCope, J, Iskra, K, Kimpe, D, Ross, RB
Conference NameApplied Parallel and Scientific Computing (PARA 2010)
Date Published12/2010
Other NumbersANL/MCS-P1816-1210

Traditionally there has been little interaction between the Grid and High-Performance Computing (HPC) storage research communities. Grid research often focused on optimizing data accesses for high-latency, wide-area networks while HPC research focused on optimizing data accesses for local, high-performance storage systems. Recent software and hardware trends are blurring the distinction between Grids and HPC. In this paper, we investigate the use of I/O forwarding---a well established technique in leadership-class HPC machines---in a Grid context. We show that the problems that triggered the introduction of I/O forwarding for HPC systems also apply to contemporary Grid computing environments. We present the design of our I/O forwarding infrastructure for Grid computing environments. Finally, we discuss the advantages our infrastructure provides for Grids, such as simplied application data management in heterogeneous computing environments and support for multiple application I/O interfaces.