Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis

Cong Zhang; Jiangchuan Liu; Haiyang Wang

doi:10.1145/2910642.2910644

Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis

Cong Zhang, Jiangchuan Liu, Haiyang Wang

Computer Science (Duluth)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

13 Scopus citations

Abstract

Crowdsourced Live Streaming (CLS), most notably Twitch.tv, has seen explosive growth in its popularity in the past few years. In such systems, any user can lively broadcast video content of interest to others, e.g., from a game player to many online viewers. To fulfill the demands from both massive and heterogeneous broadcasters and viewers, expensive server clusters have been deployed to provide video ingesting and transcoding services. Despite the existence of highly popular channels, a significant portion of the channels is indeed unpopular. Yet as our measurement shows, these broadcasters are consuming considerable system resources; in particular, 25% (resp. 30%) of bandwidth (resp. computation) resources are used by the broadcasters who do not have any viewers at all. In this paper, we closely examine the challenge of handling unpopular live-broadcasting channels in CLS systems and present a comprehensive solution for service partitioning on hybrid cloud. The trace-driven evaluation shows that our hybrid cloud-assisted design can smartly assign ingesting and transcoding tasks to the elastic cloud virtual machines, providing flexible system deployment cost-effectively.

Original language	English (US)
Title of host publication	Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016
Publisher	Association for Computing Machinery, Inc
Pages	1-6
Number of pages	6
ISBN (Electronic)	9781450343565
DOIs	https://doi.org/10.1145/2910642.2910644
State	Published - May 10 2016
Event	26th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016 - Klagenfurt, Austria Duration: May 13 2016 → …

Publication series

Name	Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016

Other

Other	26th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016
Country/Territory	Austria
City	Klagenfurt
Period	5/13/16 → …

Bibliographical note

Funding Information:
This research is supported by an NSERC Discovery Grant, NSERC RTI Grant and NSERC Strategic Grant. C. Zhang' s work is supported in part by a China Scholarship Council (CSC) Scholarship Program. H. Wang's work was supported by Chancellor's Small Grant and Grant-in-aid programs from the University of Minnesota.

Publisher Copyright:
© 2016 ACM.

Keywords

Crowdsourced live streaming
Hybrid cloud
Twitch.tv
Workload migration

Access

10.1145/2910642.2910644

OpenUrl availability

Full text

Cite this

Zhang, C., Liu, J., & Wang, H. (2016). Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis. In Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016 (pp. 1-6). (Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016). Association for Computing Machinery, Inc. https://doi.org/10.1145/2910642.2910644

Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis. / Zhang, Cong; Liu, Jiangchuan; Wang, Haiyang.
Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016. Association for Computing Machinery, Inc, 2016. p. 1-6 (Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhang, C, Liu, J & Wang, H 2016, Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis. in Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016. Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016, Association for Computing Machinery, Inc, pp. 1-6, 26th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016, Klagenfurt, Austria, 5/13/16. https://doi.org/10.1145/2910642.2910644

Zhang C, Liu J, Wang H. Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis. In Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016. Association for Computing Machinery, Inc. 2016. p. 1-6. (Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016). doi: 10.1145/2910642.2910644

Zhang, Cong ; Liu, Jiangchuan ; Wang, Haiyang. / Towards hybrid cloud-assisted crowdsourced live streaming : Measurement and analysis. Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016. Association for Computing Machinery, Inc, 2016. pp. 1-6 (Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016).

@inproceedings{7d8b29d7749f47d4aedaf252d5085777,

title = "Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis",

abstract = "Crowdsourced Live Streaming (CLS), most notably Twitch.tv, has seen explosive growth in its popularity in the past few years. In such systems, any user can lively broadcast video content of interest to others, e.g., from a game player to many online viewers. To fulfill the demands from both massive and heterogeneous broadcasters and viewers, expensive server clusters have been deployed to provide video ingesting and transcoding services. Despite the existence of highly popular channels, a significant portion of the channels is indeed unpopular. Yet as our measurement shows, these broadcasters are consuming considerable system resources; in particular, 25% (resp. 30%) of bandwidth (resp. computation) resources are used by the broadcasters who do not have any viewers at all. In this paper, we closely examine the challenge of handling unpopular live-broadcasting channels in CLS systems and present a comprehensive solution for service partitioning on hybrid cloud. The trace-driven evaluation shows that our hybrid cloud-assisted design can smartly assign ingesting and transcoding tasks to the elastic cloud virtual machines, providing flexible system deployment cost-effectively.",

keywords = "Crowdsourced live streaming, Hybrid cloud, Twitch.tv, Workload migration",

author = "Cong Zhang and Jiangchuan Liu and Haiyang Wang",

note = "Funding Information: This research is supported by an NSERC Discovery Grant, NSERC RTI Grant and NSERC Strategic Grant. C. Zhang' s work is supported in part by a China Scholarship Council (CSC) Scholarship Program. H. Wang's work was supported by Chancellor's Small Grant and Grant-in-aid programs from the University of Minnesota. Publisher Copyright: {\textcopyright} 2016 ACM.; 26th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016 ; Conference date: 13-05-2016",

year = "2016",

month = may,

day = "10",

doi = "10.1145/2910642.2910644",

language = "English (US)",

series = "Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016",

publisher = "Association for Computing Machinery, Inc",

pages = "1--6",

booktitle = "Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016",

}

TY - GEN

T1 - Towards hybrid cloud-assisted crowdsourced live streaming

T2 - 26th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016

AU - Zhang, Cong

AU - Liu, Jiangchuan

AU - Wang, Haiyang

N1 - Funding Information: This research is supported by an NSERC Discovery Grant, NSERC RTI Grant and NSERC Strategic Grant. C. Zhang' s work is supported in part by a China Scholarship Council (CSC) Scholarship Program. H. Wang's work was supported by Chancellor's Small Grant and Grant-in-aid programs from the University of Minnesota. Publisher Copyright: © 2016 ACM.

PY - 2016/5/10

Y1 - 2016/5/10

N2 - Crowdsourced Live Streaming (CLS), most notably Twitch.tv, has seen explosive growth in its popularity in the past few years. In such systems, any user can lively broadcast video content of interest to others, e.g., from a game player to many online viewers. To fulfill the demands from both massive and heterogeneous broadcasters and viewers, expensive server clusters have been deployed to provide video ingesting and transcoding services. Despite the existence of highly popular channels, a significant portion of the channels is indeed unpopular. Yet as our measurement shows, these broadcasters are consuming considerable system resources; in particular, 25% (resp. 30%) of bandwidth (resp. computation) resources are used by the broadcasters who do not have any viewers at all. In this paper, we closely examine the challenge of handling unpopular live-broadcasting channels in CLS systems and present a comprehensive solution for service partitioning on hybrid cloud. The trace-driven evaluation shows that our hybrid cloud-assisted design can smartly assign ingesting and transcoding tasks to the elastic cloud virtual machines, providing flexible system deployment cost-effectively.

AB - Crowdsourced Live Streaming (CLS), most notably Twitch.tv, has seen explosive growth in its popularity in the past few years. In such systems, any user can lively broadcast video content of interest to others, e.g., from a game player to many online viewers. To fulfill the demands from both massive and heterogeneous broadcasters and viewers, expensive server clusters have been deployed to provide video ingesting and transcoding services. Despite the existence of highly popular channels, a significant portion of the channels is indeed unpopular. Yet as our measurement shows, these broadcasters are consuming considerable system resources; in particular, 25% (resp. 30%) of bandwidth (resp. computation) resources are used by the broadcasters who do not have any viewers at all. In this paper, we closely examine the challenge of handling unpopular live-broadcasting channels in CLS systems and present a comprehensive solution for service partitioning on hybrid cloud. The trace-driven evaluation shows that our hybrid cloud-assisted design can smartly assign ingesting and transcoding tasks to the elastic cloud virtual machines, providing flexible system deployment cost-effectively.

KW - Crowdsourced live streaming

KW - Hybrid cloud

KW - Twitch.tv

KW - Workload migration

UR - http://www.scopus.com/inward/record.url?scp=84974577459&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84974577459&partnerID=8YFLogxK

U2 - 10.1145/2910642.2910644

DO - 10.1145/2910642.2910644

M3 - Conference contribution

AN - SCOPUS:84974577459

T3 - Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016

SP - 1

EP - 6

BT - Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2016

PB - Association for Computing Machinery, Inc

Y2 - 13 May 2016

ER -

Towards hybrid cloud-assisted crowdsourced live streaming: Measurement and analysis

Abstract

Publication series

Other

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this