Argonne National Laboratory

Going Back and Forth: Efficient Multideployment and Multisnapshotting on Clouds

TitleGoing Back and Forth: Efficient Multideployment and Multisnapshotting on Clouds
Publication TypeConference Paper
Year of Publication2011
AuthorsNicolae, B, Bresnahan, J, Keahey, K
Conference NameProc. 20th Internatinoal Symposium on High Performance Distributed Computing (HPDC'11)
Date Published06/2011
Conference LocationSan Jose, CA
Other NumbersANL/MCS-P1873-0411

Infrastructure as a Service (IaaS) cloud computing has revolutionized the way we think of acquiring resources by introducing a simple change: allowing users to lease computational resources from the cloud provider's datacenter for a short time by deploying virtual machines (VMs) on these resources. This new model raises new challenges in the design and development of IaaS middleware. One of those challenges is the need to deploy a large number (hundreds or even thousands) of VM instances simultaneously. Once the VM instances are deployed, another challenge is to simultaneously take a snapshot of many images and transfer them to persistent storage to support management tasks, such as suspend-resume and migration. With datacenters growing rapidly and configurations becoming heterogeneous, it is important to enable efficient concurrent deployment and snapshotting that are at the same time hypervisor independent and ensure a maximum compatibility with different configurations. This paper addresses these challenges by proposing a virtual file system specifically optimized for virtual machine image storage. It is based on a lazy transfer scheme coupled with object versioning that handles snapshotting transparently in a hypervisor-independent fashion, ensuring high portability for different configurations. Large-scale experiments on hundreds of nodes demonstrate excellent performance results: speedup for concurrent VM deployments ranges from a factor of 2 up to 25, with a reduction in bandwidth utilization of as much as 90%.