Compiler Optimization for Distributed Dynamic Data Flow Programs

TitleCompiler Optimization for Distributed Dynamic Data Flow Programs
Publication TypeConference Paper
Year of Publication2013
AuthorsArmstrong, TG, Wozniak, JM, Wilde, M, Foster, IT
Other Numbers ANL/MCS-P4045-0313

Distributed, dynamic data flow is an execution model well-suited for many large-scale parallel applications, particularly scientific simulations and analysis pipelines running on large, distributed memory clusters. In this paper, we describe compiler optimization techniques and an intermediate representation for distributed dynamic data flow programs. These techniques are applied to Swift/T, a high-level declarative language that allows flexible data flow composition of functions written in other programming languages such as C or Fortran. We show that compiler optimization can reduce communication overhead by 70-93% on distributed memory systems, making the high-level language competitive with hand-coded coordination logic for certain common application styles.