Argonne National Laboratory

Distributed Monitoring and Management of Exascale Systems in Argo Project

TitleDistributed Monitoring and Management of Exascale Systems in Argo Project
Publication TypeBook Chapter
Year of Publication2015
AuthorsPerarnau, S, Thakur, R, Iskra, K, Raffenetti, K, Cappello, F, Gupta, R, Beckman, PH, Snir, M, Hoffman, H, Schulz, M, Rountree, B
Book TitleDistributed Applications and Interoperable Systems
ChapterDistributed Monitoring and Management of Exascale Systems in the Argo Project
Other NumbersANL/MCS-P5326-0315
AbstractNew computing technologies are expected to change the high- performance computing landscape dramatically. Future exascale systems will comprise hundreds of thousands of compute nodes linked by complex networks—resources that need to be actively monitored and controlled, at a scale difficult to manage from a central point as in previous systems. In this context, we describe here on-going work in the Argo exascale soft- ware stack project to develop a distributed collection of services working together to track scientific applications across nodes, control the power budget of the system, and respond to eventual failures. Our solution leverages the idea of enclaves: a hierarchy of logical partitions of the system, representing groups of nodes sharing a common configuration, created to encapsulate user jobs as well as by the user inside its own job. These enclaves provide a second (and greater) level of control over portions of the system, can be tuned to manage specific scenarios, and have dedicated resources to do so.