Compiler Optimization for Extreme-Scale Scripting

TitleCompiler Optimization for Extreme-Scale Scripting
Publication TypeReport
Year of Publication2014
AuthorsArmstrong, TG, Wozniak, JM, Wilde, M, Foster, IT
Other NumbersANL/MCS-P5080-0214
Abstract

The data-driven task parallelism execution model can support parallel programming models that are well suited for large-scale distributed-memory parallel computing, for example, simulations and analysis pipelines running on clusters and clouds. We describe a novel compiler intermediate representation and optimizations for this execution model, including adaptions of standard techniques alongside novel techniques. These techniques are applied to Swift/T, a high-level declarative language for flexible data flow composition of functions, which may be serial or use lower-level parallel programming models such as MPI and OpenMP. This paper presents preliminary results, indicating that our compiler optimizations reduce communication overhead by 70 to 93% on distributed memory systems.

PDFhttp://www.mcs.anl.gov/papers/P5080-0214.pdf