Bridging HPC and Grid File I/O with IOFSL
|Title||Bridging HPC and Grid File I/O with IOFSL|
|Publication Type||Conference Paper|
|Year of Publication||2010|
|Authors||Cope, J, Iskra, K, Kimpe, D, Ross, RB|
|Conference Name||Applied Parallel and Scientific Computing (PARA 2010)|
Traditionally there has been little interaction between the Grid and High-Performance Computing (HPC) storage research communities. Grid research often focused on optimizing data accesses for high-latency, wide-area networks while HPC research focused on optimizing data accesses for local, high-performance storage systems. Recent software and hardware trends are blurring the distinction between Grids and HPC. In this paper, we investigate the use of I/O forwarding---a well established technique in leadership-class HPC machines---in a Grid context. We show that the problems that triggered the introduction of I/O forwarding for HPC systems also apply to contemporary Grid computing environments. We present the design of our I/O forwarding infrastructure for Grid computing environments. Finally, we discuss the advantages our infrastructure provides for Grids, such as simplied application data management in heterogeneous computing environments and support for multiple application I/O interfaces.