Workshop Program (Tentative: Subject to Change)

[8:15am - 8:30am] Opening Remarks

Pavan Balaji and Min Si

[8:30am - 9:30am] Session 1: Keynote Talk

Title: The Nightmare and Power of Heterogeneity in HPC

Dr. Antonio Pena, Barcelona Supercomputing Center


Not so long ago heterogeneity in HPC was coming mostly on the processing side: within a compute node we had several processing units of different architectures (let it be the Cell processor, or a combination of traditioanl CPUs, GPU accelerators, and/or FPGAs). Currently, heterogeneity has expanded with the advent of multiple explicitly-addressable memory subsystems featuring different technologies, but also in the form of clusters of compute nodes featuring completely different hardware configurations (we find a recent example in the MareNostrum 4 supercomputer). Programming models and runtime systems have been charged with the task of easing the programming burden of this heterogeneity. In this talk I will review current, upcoming, and foreseeable heterogeneity in HPC, as well as some of the proposed and available ways of handling it. I will also highlight some of the remaining challenges.


Antonio holds a BS + MS degree in Computer Engineering (2006), and MS and PhD degrees in Advanced Computer Systems (2010, 2013), from Universitat Jaume I, Spain. He is currently a Senior Researcher at the Barcelona Supercomputing Center (BSC), Computer Sciences Department. At BSC, Antonio works within the Programming Models group where he is the Activity Leader for "Accelerators and Communications for HPC". Antonio is also the Manager of the BSC/UPC NVIDIA GPU Center of Excellence and member of the BSC Outreach Working Group. He is a Juan de la Cierva Fellow and prospective Marie Curie Fellow. His research interests in the area of runtime systems and programming models for high performance computing include resource heterogeneity and communications.

Antonio was formerly with Argonne National Laboratory (USA, 2012-2015), driving the heterogeneous memory and accelerator computing areas of research within the Programming Models and Runtime Systems group, where he was the technical lead of heterogeneous memory and accelerator virtualization projects. He was also part of the core MPICH R&D team. His PhD dissertation, in a joint collaboration between the Universitat Jaume I and the Universitat Politecnica de Valencia (Spain) started the rCUDA remote GPU virtualization project (from which he is the original developer and architect), for which he was awarded the Extraordinary Doctoral Award from the Jaume I University.

[9:30am - 10:00am] Tea/Coffee Break

[10:00am - 12:00pm] Session 2: Scalable Distributed Computing

Session Chair: Min Si, Argonne National Laboratory

  • "Improving Valiant Routing for Slim Fly Networks", Deyu Han, Zhaofeng Wang and David Bunde.
  • "Efficient Broadcasting Algorithm in Harary-like Networks", Puspal Bhabak, Hovhannes Harutyunyan and Peter Kropf.
  • "Programming Model to Develop Supercomputer Combinatorial Solvers", Ghaith Tarawneh, Andrey Mokhov, Matthew Naylor, Alex Rast, Simon Moore, David Thomas, Alex Yakovlev and Andrew Brown.
  • "Efficient Scalable Computing through Flexible Applications and Adaptive Workloads", Sergio Iserte, Rafael Mayo, Enrique S. Quintana-Orti, Vicenc Beltran, and Antonio J. Pena.

[12:00pm - 1:30pm] Lunch Break

[1:30pm - 3:30pm] Session 3: On-node Optimizations

Session Chair: Taisuke Boku, University of Tsukuba

  • "A Region-Aware Multi-Objective Auto-Tuner for Parallel Programs", Klaus Kofler, Juan J. Durillo, Philipp Gschwandtner and Thomas Fahringer.
  • "A Parallel Shared-Memory Architecture for OWL Ontology Classification", Zixi Quan and Volker Haarslev.
  • "Communication-Computation Overlapping with Dynamic Loop Scheduling for Preconditioned Parallel Iterative Solvers on Multicore/Manycore Clusters", Kengo Nakajima and Toshihiro Hanawa.
  • "OpenMP Memkind: An Extension for Heterogeneous Physical Memories", Xi Wang, John D. Leidel and Yong Chen.

[3:30pm - 4:00pm] Tea/Coffee Break

[4:00pm - 6:00pm] Session 4: Invited Papers

Session Chair: John D. Leidel, Tactical Computing Laboratories

  • "On a Storage System Software Stack for Extreme Scale Data Centric Computing", Sai Narasimhamurthy.
  • "Toward Highly Productive Parallel Programming on Large Scale Accelerated Computing", Taisuke Boku, Hitoshi Murai, Masahiro Nakao, Jinpil Lee, Mitsuhisa Sato, Akihiro Tabuchi, and Keisuke Tsugane. [paper]
  • "Towards Portable and Adaptable Asynchronous Communication for One-Sided Applications", Min Si, Jeff Hammond, Masamichi Takagi, and Yutaka Ishikawa. [paper]
  • "Integrating Memory Perspective into the BSC Performance Tools", Harald Servat, Jesus Labarta, Hans-Christian Hoppe, Judit Gimenez, and Antonio J. Pena.

[6:00pm - 6:05pm] Closing Remarks

Pavan Balaji and Min Si