Argonne National Laboratory

A Scalable Process-Management Environment for Parallel Programs

TitleA Scalable Process-Management Environment for Parallel Programs
Publication TypeConference Paper
Year of Publication2000
AuthorsButler, RM, Gropp, WD, Lusk, EL
Conference Name7th EuroPVM/MPI Users
Date Published03/2000
Conference LocationBalatonfured, Hungary

We present a process management system for parallel programs such as those written using MPI. A primary goal of the system, which we call MPD (for multipurpose daemon), is to be scalable. By this we mean that startup of interactive parallel jobs comprising a thousand processes is quick, that signals can be quickly delivered to processes, and that stdin, stdout, and stderr are managed intuitively. Our primary target is parallel machines made up of clusters of SMPs, but the system is also useful in more tightly integrated environments. We describe how MPD enables much faster startup and better runtime management of MPICH jobs. We show how close control of stdio can support the easy implementation of a number of convenient system utilities, even a parallel debugger. MPD is implemented and freely distributed with MPICH.