Seminar Details:

LANS Informal Seminar
"Power-Aware Consolidation of Scientific Workflows in Virtualized Environments"

DATE: November 8, 2010

TIME: 15:00:00 - 16:00:00
SPEAKER: Qian Zhu, Postdoctoral Appointee, MCS
LOCATION: Bldg 240 Conference Center 1404-1405, Argonne National Laboratory

The recent emergence of clouds with large, virtualized pools of compute and storage resources raises the possibility of a new compute paradigm for scientific research. With virtualization technologies, consolidation of scientific workflows presents a promising opportunity for energy and resource cost optimization, while achieving high performance. We have developed pSciMapper, a power-aware consolidation framework for scientific workflows. We view consolidation as a hierarchical clustering problem, and introduce a distance metric that is based on interference between resource requirements. A dimensionality reduction method (KCCA) is used to relate the resource requirements to performance and power consumption. We have evaluated pSciMapper with both real-world and synthetic scientific workflows, and demonstrated that it is able to reduce power consumption by up to 56%, with less than 15% slowdown. Our experiments also show that scheduling overheads of pSciMapper are low, and it can scale well for workflows with hundreds of tasks.


Please send questions or suggestions to Jeffrey Larson: jmlarson at anl dot gov.