Awan: Locality-aware resource manager for geo-distributed data-intensive applications

Albert Jonathan; Abhishek Chandra; Jon Weissman

doi:10.1109/IC2E.2016.15

Awan: Locality-aware resource manager for geo-distributed data-intensive applications

Albert Jonathan, Abhishek Chandra, Jon Weissman

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

10 Scopus citations

Abstract

Today, many organizations need to operate on datathat is distributed around the globe. This is inevitable due to thenature of data that is generated in different locations such as videofeeds from distributed cameras, log files from distributed servers, and many others. Although centralized cloud platforms havebeen widely used for data-intensive applications, such systemsare not suitable for processing geo-distributed data due to highdata transfer overheads. An alternative approach is to use anEdge Cloud which reduces the network cost of transferringdata by distributing its computations globally. While the EdgeCloud is attractive for geo-distributed data-intensive applications, extending existing cluster computing frameworks to a wide-areaenvironment must account for locality. We propose Awan: anew locality-aware resource manager for geo-distributed dataintensiveapplications. Awan allows resource sharing betweenmultiple computing frameworks while enabling high localityscheduling within each framework. Our experiments with theNebula Edge Cloud on PlanetLab show that Awan achieves up toa 28% increase in locality scheduling which reduces the averagejob turnaround time by approximately 18% compared to existingcluster management mechanisms.

Original language	English (US)
Title of host publication	Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016
Subtitle of host publication	Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	32-41
Number of pages	10
ISBN (Electronic)	9781509019618
DOIs	https://doi.org/10.1109/IC2E.2016.15
State	Published - Jun 1 2016
Event	4th IEEE Annual International Conference on Cloud Engineering, IC2E 2016 - Berlin, Germany Duration: Apr 4 2016 → Apr 8 2016

Publication series

Name	Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016

Other

Other	4th IEEE Annual International Conference on Cloud Engineering, IC2E 2016
Country/Territory	Germany
City	Berlin
Period	4/4/16 → 4/8/16

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Keywords

Cloud Computing
Data Intensive
Edge Cloud
Geo-distributed
Resource Management
Scheduling

Access

10.1109/IC2E.2016.15

OpenUrl availability

Full text

Cite this

Jonathan, A., Chandra, A., & Weissman, J. (2016). Awan: Locality-aware resource manager for geo-distributed data-intensive applications. In Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016 (pp. 32-41). Article 7484161 (Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IC2E.2016.15

Awan: Locality-aware resource manager for geo-distributed data-intensive applications. / Jonathan, Albert; Chandra, Abhishek ; Weissman, Jon.
Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 32-41 7484161 (Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jonathan, A, Chandra, A & Weissman, J 2016, Awan: Locality-aware resource manager for geo-distributed data-intensive applications. in Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016., 7484161, Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016, Institute of Electrical and Electronics Engineers Inc., pp. 32-41, 4th IEEE Annual International Conference on Cloud Engineering, IC2E 2016, Berlin, Germany, 4/4/16. https://doi.org/10.1109/IC2E.2016.15

Jonathan A, Chandra A , Weissman J. Awan: Locality-aware resource manager for geo-distributed data-intensive applications. In Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 32-41. 7484161. (Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016). doi: 10.1109/IC2E.2016.15

Jonathan, Albert ; Chandra, Abhishek ; Weissman, Jon. / Awan : Locality-aware resource manager for geo-distributed data-intensive applications. Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 32-41 (Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016).

@inproceedings{c7c1f706091b42a2ad85477c66bacee0,

title = "Awan: Locality-aware resource manager for geo-distributed data-intensive applications",

abstract = "Today, many organizations need to operate on datathat is distributed around the globe. This is inevitable due to thenature of data that is generated in different locations such as videofeeds from distributed cameras, log files from distributed servers, and many others. Although centralized cloud platforms havebeen widely used for data-intensive applications, such systemsare not suitable for processing geo-distributed data due to highdata transfer overheads. An alternative approach is to use anEdge Cloud which reduces the network cost of transferringdata by distributing its computations globally. While the EdgeCloud is attractive for geo-distributed data-intensive applications, extending existing cluster computing frameworks to a wide-areaenvironment must account for locality. We propose Awan: anew locality-aware resource manager for geo-distributed dataintensiveapplications. Awan allows resource sharing betweenmultiple computing frameworks while enabling high localityscheduling within each framework. Our experiments with theNebula Edge Cloud on PlanetLab show that Awan achieves up toa 28% increase in locality scheduling which reduces the averagejob turnaround time by approximately 18% compared to existingcluster management mechanisms.",

keywords = "Cloud Computing, Data Intensive, Edge Cloud, Geo-distributed, Resource Management, Scheduling",

author = "Albert Jonathan and Abhishek Chandra and Jon Weissman",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 4th IEEE Annual International Conference on Cloud Engineering, IC2E 2016 ; Conference date: 04-04-2016 Through 08-04-2016",

year = "2016",

month = jun,

day = "1",

doi = "10.1109/IC2E.2016.15",

language = "English (US)",

series = "Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "32--41",

booktitle = "Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016",

}

TY - GEN

T1 - Awan

T2 - 4th IEEE Annual International Conference on Cloud Engineering, IC2E 2016

AU - Jonathan, Albert

AU - Chandra, Abhishek

AU - Weissman, Jon

PY - 2016/6/1

Y1 - 2016/6/1

N2 - Today, many organizations need to operate on datathat is distributed around the globe. This is inevitable due to thenature of data that is generated in different locations such as videofeeds from distributed cameras, log files from distributed servers, and many others. Although centralized cloud platforms havebeen widely used for data-intensive applications, such systemsare not suitable for processing geo-distributed data due to highdata transfer overheads. An alternative approach is to use anEdge Cloud which reduces the network cost of transferringdata by distributing its computations globally. While the EdgeCloud is attractive for geo-distributed data-intensive applications, extending existing cluster computing frameworks to a wide-areaenvironment must account for locality. We propose Awan: anew locality-aware resource manager for geo-distributed dataintensiveapplications. Awan allows resource sharing betweenmultiple computing frameworks while enabling high localityscheduling within each framework. Our experiments with theNebula Edge Cloud on PlanetLab show that Awan achieves up toa 28% increase in locality scheduling which reduces the averagejob turnaround time by approximately 18% compared to existingcluster management mechanisms.

AB - Today, many organizations need to operate on datathat is distributed around the globe. This is inevitable due to thenature of data that is generated in different locations such as videofeeds from distributed cameras, log files from distributed servers, and many others. Although centralized cloud platforms havebeen widely used for data-intensive applications, such systemsare not suitable for processing geo-distributed data due to highdata transfer overheads. An alternative approach is to use anEdge Cloud which reduces the network cost of transferringdata by distributing its computations globally. While the EdgeCloud is attractive for geo-distributed data-intensive applications, extending existing cluster computing frameworks to a wide-areaenvironment must account for locality. We propose Awan: anew locality-aware resource manager for geo-distributed dataintensiveapplications. Awan allows resource sharing betweenmultiple computing frameworks while enabling high localityscheduling within each framework. Our experiments with theNebula Edge Cloud on PlanetLab show that Awan achieves up toa 28% increase in locality scheduling which reduces the averagejob turnaround time by approximately 18% compared to existingcluster management mechanisms.

KW - Cloud Computing

KW - Data Intensive

KW - Edge Cloud

KW - Geo-distributed

KW - Resource Management

KW - Scheduling

UR - http://www.scopus.com/inward/record.url?scp=84978034019&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978034019&partnerID=8YFLogxK

U2 - 10.1109/IC2E.2016.15

DO - 10.1109/IC2E.2016.15

M3 - Conference contribution

AN - SCOPUS:84978034019

T3 - Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016: Co-located with the 1st IEEE International Conference on Internet-of-Things Design and Implementation, IoTDI 2016

SP - 32

EP - 41

BT - Proceedings - 2016 IEEE International Conference on Cloud Engineering, IC2E 2016

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 4 April 2016 through 8 April 2016

ER -

Awan: Locality-aware resource manager for geo-distributed data-intensive applications

Abstract

Publication series

Other

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this