CAPS: Coding-based adaptive packet spraying to reduce flow completion time in data center

Jinbin Hu, Jiawei Huang, Wenjun Lv, Yutao Zhou, Jianxin Wang, Tian He

Research output: Contribution to journalArticlepeer-review

39 Scopus citations

Abstract

Modern data-center applications generate a diverse mix of short and long flows with different performance requirements and weaknesses. The short flows are typically delay-sensitive but to suffer the head-of-line blocking and out-of-order problems. Recent solutions prioritize the short flows to meet their latency requirements, while damaging the throughput-sensitive long flows. To solve these problems, we design a Coding-based Adaptive Packet Spraying (CAPS) that effectively mitigates the negative impact of short and long flows on each other. To exploit the availability of multiple paths and avoid the head-of-line blocking, CAPS spreads the packets of short flows to all paths, while the long flows are limited to a few paths with Equal Cost Multi Path (ECMP). Meanwhile, to resolve the out-of-order problem with low overhead, CAPS encodes the short flows using forward error correction (FEC) technology and adjusts the coding redundancy according to the blocking probability. Moreover, since the coding efficiency decreases when the coding unit is too small or large, we demonstrate how to obtain the optimal size of coding unit. The coding layer is deployed between the TCP and IP layers, without any modifications on the existing TCP/IP protocols. The test results of NS2 simulation and small-scale testbed experiments show that CAPS significantly reduces the average flow completion time of short flows by 30%-70% over the state-of-the-art multipath transmission schemes and achieves the high throughput for long flows with negligible traffic overhead.

Original languageEnglish (US)
Article number8884684
Pages (from-to)2338-2353
Number of pages16
JournalIEEE/ACM Transactions on Networking
Volume27
Issue number6
DOIs
StatePublished - Dec 2019

Bibliographical note

Funding Information:
Manuscript received June 2, 2018; revised February 26, 2019 and June 17, 2019; accepted September 25, 2019; approved by IEEE/ACM TRANSAC-TIONS ON NETWORKING Editor N. Hegde. Date of publication October 28, 2019; date of current version December 17, 2019. This work was supported in part by the National Natural Science Foundation of China under Grant 61872387, Grant 61572530, and Grant 61872403 and in part by the CERNET Innovation Project under Grant NGII20170107. A preliminary version of this article appeared in IEEE INFOCOM [25], Honolulu, HI, USA, April 2018. (Corresponding author: Jiawei Huang.) J. Hu, J. Huang, W. Lv, and J. Wang are with the School of Computer Science and Engineering, Central South University, Changsha 410083, China (e-mail: jiaweihuang@csu.edu.cn).

Publisher Copyright:
© 1993-2012 IEEE.

Keywords

  • Data center
  • TCP
  • multipath
  • packet spray

Fingerprint

Dive into the research topics of 'CAPS: Coding-based adaptive packet spraying to reduce flow completion time in data center'. Together they form a unique fingerprint.

Cite this