|Title||Leveraging Burst Buffer Coordination to Prevent I/O Interference |
|Publication Type||Conference Paper |
|Year of Publication||2016 |
|Authors||Kougkas, A, Dorier, M, Latham, R, Ross, R, Sun, X-H |
|Conference Name||2016 IEEE 12th international conference on e-Science |
|Date Published||03/2016 |
|Conference Location||Baltimore, MD |
|Abstract||Concurrent accesses to the shared storage resources in cur- rent HPC machines lead to severe performance degradation caused by I/O contention. In this study, we identify some key challenges to effi- ciently handling interleaved data accesses, and we propose a systemwide solution to optimize global performance. We implemented and tested sev- eral I/O scheduling policies, including prioritizing specific applications by leveraging burst buffers to defer the conflicting accesses from another ap- plication and/or directing the requests to different storage servers inside the parallel file system infrastructure. The results show that we mitigate the negative effects of interference and optimize the performance up to 2x depending on the selected I/O policy.