Starling: Minimizing communication overhead in virtualized computing platforms using decentralized affinity-aware migration

Jason Sonnek, James Greensky, Robert Reutiman, Abhishek Chandra

Research output: Chapter in Book/Report/Conference proceedingConference contribution

89 Scopus citations

Abstract

Virtualization is being widely used in large-scale computing environments, such as clouds, data centers, and grids, to provide application portability and facilitate resource multiplexing while retaining application isolation. In many existing virtualized platforms, it has been found that the network bandwidth often becomes the bottleneck resource, causing both high network contention and reduced performance for communication and data-intensive applications. In this paper, we present a decentralized affinity-aware migration technique that incorporates heterogeneity and dynamism in network topology and job communication patterns to allocate virtual machines on the available physical resources. Our technique monitors network affinity between pairs of VMs and uses a distributed bartering algorithm, coupled with migration, to dynamically adjust VM placement such that communication overhead is minimized. Our experimental results running the Intel MPI benchmark and a scientific application on a 7-node Xen cluster show that we can get up to 42% improvement in the runtime of the application over a no-migration technique, while achieving up to 85% reduction in network communication cost. In addition, our technique is able to adjust to dynamic variations in communication patterns and provides both good performance and low network contention with minimal overhead.

Original languageEnglish (US)
Title of host publicationProceedings - 39th International Conference on Parallel Processing, ICPP 2010
Pages228-237
Number of pages10
DOIs
StatePublished - 2010
Event39th International Conference on Parallel Processing, ICPP 2010 - San Diego, CA, United States
Duration: Sep 13 2010Sep 16 2010

Publication series

NameProceedings of the International Conference on Parallel Processing
ISSN (Print)0190-3918

Other

Other39th International Conference on Parallel Processing, ICPP 2010
CountryUnited States
CitySan Diego, CA
Period9/13/109/16/10

Fingerprint Dive into the research topics of 'Starling: Minimizing communication overhead in virtualized computing platforms using decentralized affinity-aware migration'. Together they form a unique fingerprint.

Cite this