Compiler Optimization for Extreme-Scale Scripting

TitleCompiler Optimization for Extreme-Scale Scripting
Publication TypeConference Proceedings
Year of Publication2014
AuthorsArmstrong, TG, Wozniak, JM, Wilde, M, Foster, IT
Conference NameCluster, Cloud and Grid Computing (CCGrid)
Date Published05/2014
Conference LocationChicago, IL
Accession Number 10.1109/CCGrid.2014.115
Other NumbersANL/MCS-P5080-0214
AbstractThe data-driven task parallelism execution model can support parallel programming models that are well suited for large-scale distributed-memory parallel computing, for example, simulations and analysis pipelines running on clusters and clouds. We describe a novel compiler intermediate representation and optimizations for this execution model, including adaptions of standard techniques alongside novel techniques. These techniques are applied to Swift/T, a high-level declarative language for flexible data flow composition of functions, which may be serial or use lower-level parallel programming models such as MPI and OpenMP. This paper presents preliminary results, indicating that our compiler optimizations reduce communication overhead by 70 to 93% on distributed memory systems.