ExM: High Level Dataflow Programming for Extreme-Scale Systems

TitleExM: High Level Dataflow Programming for Extreme-Scale Systems
Publication TypeConference Paper
Year of Publication2012
Conference Name4th USENIX Workshop on Hot Topics in Parallelism
Date Published02/2012
PublisherProceedings of HotPar'12
Conference Location4th USENIX Workshop on Hot Topics in Parallelism
Other NumbersANL/MCS-P2045-0212
Abstract

We present here the ExM (extreme-scalemany-task) programming and execution model as a practical solution to the challenges of programing the higher-level logic of complex parallel applications on current petascale and future exascale computing systems. ExM provides an expressive high-level functional programming model that yields massive concurrency through implicit, automated parallelism. It comprises a judicious integration of dataflow constructs, highly parallel function evaluation, and extremely scalable task generation. It directly addresses the intertwined programmability and scalability requirements of systems with massive concurrency with a programming model that may be attractive and feasible for systems of much lower scale. We describe here the benefits of the ExM programming and execution model, its potential applications, and the performance of its current implementation.

PDFhttp://www.mcs.anl.gov/papers/P2045-0212.pdf