A Scalable Process-Management Environment for Parallel Programs
|Title||A Scalable Process-Management Environment for Parallel Programs|
|Publication Type||Conference Paper|
|Year of Publication||2000|
|Authors||Butler, RM, Gropp, WD, Lusk, EL|
|Conference Name||7th EuroPVM/MPI Users|
|Conference Location||Balatonfured, Hungary|
We present a process management system for parallel programs such as those written using MPI. A primary goal of the system, which we call MPD (for multipurpose daemon), is to be scalable. By this we mean that startup of interactive parallel jobs comprising a thousand processes is quick, that signals can be quickly delivered to processes, and that stdin, stdout, and stderr are managed intuitively. Our primary target is parallel machines made up of clusters of SMPs, but the system is also useful in more tightly integrated environments. We describe how MPD enables much faster startup and better runtime management of MPICH jobs. We show how close control of stdio can support the easy implementation of a number of convenient system utilities, even a parallel debugger. MPD is implemented and freely distributed with MPICH.