MasQ: RDMA for Virtual Private Cloud

Zhiqiang He; Dongyang Wang; Binzhang Fu; Kun Tan; Bei Hua; Zhi Li Zhang; Kai Zheng

doi:10.1145/3387514.3405849

MasQ: RDMA for Virtual Private Cloud

Zhiqiang He, Dongyang Wang, Binzhang Fu, Kun Tan, Bei Hua, Zhi Li Zhang, Kai Zheng

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

24 Scopus citations

Abstract

RDMA communication in virtual private cloud (VPC) networks is still a challenging job due to the difficulty in fulfilling all virtualization requirements without sacrificing RDMA communication performance. To address this problem, this paper proposes a software-defined solution, namely, MasQ, which is short for "queue masquerade". The core insight of MasQ is that all RDMA communications should associate with at least one queue pair (QP). Thus, the requirements of virtualization, such as network isolation and the application of security rules, can be easily fulfilled if QP's behavior is properly defined. In particular, MasQ exploits the virtio-based paravirtualization technique to realize the control path. Moreover, to avoid performance overhead, MasQ leaves all data path operations, such as sending and receiving, to the hardware. We have implemented MasQ in the OpenFabrics Enterprise Distribution (OFED) framework and proved its scalability and performance efficiency by evaluating it against typical applications. The results demonstrate that MasQ achieves almost the same performance as bare-metal RDMA for data communication.

Original language	English (US)
Title of host publication	SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication
Publisher	Association for Computing Machinery
Pages	1-14
Number of pages	14
ISBN (Electronic)	9781450379557
DOIs	https://doi.org/10.1145/3387514.3405849
State	Published - Jul 30 2020
Event	2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM 2020 - Virtual, Online, United States Duration: Aug 10 2020 → Aug 14 2020

Publication series

Name	SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication

Conference

Conference	2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM 2020
Country/Territory	United States
City	Virtual, Online
Period	8/10/20 → 8/14/20

Bibliographical note

Funding Information:
We would like to thank our shepherd and the anonymous SIG-COMM reviewers for their valuable comments. We would also like to thank our former colleague, JinZhao Su and Ming Zhang for their contributions to this work. This work was partially supported by the NSFC under Grant No.: 61672499.

Publisher Copyright:
© 2020 ACM.

Keywords

Datacenter network
Network virtualization
RDMA

Access

10.1145/3387514.3405849

OpenUrl availability

Full text

Cite this

He, Z., Wang, D., Fu, B., Tan, K., Hua, B., Zhang, Z. L., & Zheng, K. (2020). MasQ: RDMA for Virtual Private Cloud. In SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (pp. 1-14). (SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication). Association for Computing Machinery. https://doi.org/10.1145/3387514.3405849

MasQ: RDMA for Virtual Private Cloud. / He, Zhiqiang; Wang, Dongyang; Fu, Binzhang et al.
SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication. Association for Computing Machinery, 2020. p. 1-14 (SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

He, Z, Wang, D, Fu, B, Tan, K, Hua, B, Zhang, ZL & Zheng, K 2020, MasQ: RDMA for Virtual Private Cloud. in SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication. SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, Association for Computing Machinery, pp. 1-14, 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM 2020, Virtual, Online, United States, 8/10/20. https://doi.org/10.1145/3387514.3405849

He Z, Wang D, Fu B, Tan K, Hua B, Zhang ZL et al. MasQ: RDMA for Virtual Private Cloud. In SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication. Association for Computing Machinery. 2020. p. 1-14. (SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication). doi: 10.1145/3387514.3405849

He, Zhiqiang ; Wang, Dongyang ; Fu, Binzhang et al. / MasQ : RDMA for Virtual Private Cloud. SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication. Association for Computing Machinery, 2020. pp. 1-14 (SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication).

@inproceedings{57bfce7effd94322b4fb502302023110,

title = "MasQ: RDMA for Virtual Private Cloud",

abstract = "RDMA communication in virtual private cloud (VPC) networks is still a challenging job due to the difficulty in fulfilling all virtualization requirements without sacrificing RDMA communication performance. To address this problem, this paper proposes a software-defined solution, namely, MasQ, which is short for {"}queue masquerade{"}. The core insight of MasQ is that all RDMA communications should associate with at least one queue pair (QP). Thus, the requirements of virtualization, such as network isolation and the application of security rules, can be easily fulfilled if QP's behavior is properly defined. In particular, MasQ exploits the virtio-based paravirtualization technique to realize the control path. Moreover, to avoid performance overhead, MasQ leaves all data path operations, such as sending and receiving, to the hardware. We have implemented MasQ in the OpenFabrics Enterprise Distribution (OFED) framework and proved its scalability and performance efficiency by evaluating it against typical applications. The results demonstrate that MasQ achieves almost the same performance as bare-metal RDMA for data communication.",

keywords = "Datacenter network, Network virtualization, RDMA",

author = "Zhiqiang He and Dongyang Wang and Binzhang Fu and Kun Tan and Bei Hua and Zhang, {Zhi Li} and Kai Zheng",

note = "Funding Information: We would like to thank our shepherd and the anonymous SIG-COMM reviewers for their valuable comments. We would also like to thank our former colleague, JinZhao Su and Ming Zhang for their contributions to this work. This work was partially supported by the NSFC under Grant No.: 61672499. Publisher Copyright: {\textcopyright} 2020 ACM.; 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM 2020 ; Conference date: 10-08-2020 Through 14-08-2020",

year = "2020",

month = jul,

day = "30",

doi = "10.1145/3387514.3405849",

language = "English (US)",

series = "SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication",

publisher = "Association for Computing Machinery",

pages = "1--14",

booktitle = "SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication",

}

TY - GEN

T1 - MasQ

T2 - 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, SIGCOMM 2020

AU - He, Zhiqiang

AU - Wang, Dongyang

AU - Fu, Binzhang

AU - Tan, Kun

AU - Hua, Bei

AU - Zhang, Zhi Li

AU - Zheng, Kai

N1 - Funding Information: We would like to thank our shepherd and the anonymous SIG-COMM reviewers for their valuable comments. We would also like to thank our former colleague, JinZhao Su and Ming Zhang for their contributions to this work. This work was partially supported by the NSFC under Grant No.: 61672499. Publisher Copyright: © 2020 ACM.

PY - 2020/7/30

Y1 - 2020/7/30

N2 - RDMA communication in virtual private cloud (VPC) networks is still a challenging job due to the difficulty in fulfilling all virtualization requirements without sacrificing RDMA communication performance. To address this problem, this paper proposes a software-defined solution, namely, MasQ, which is short for "queue masquerade". The core insight of MasQ is that all RDMA communications should associate with at least one queue pair (QP). Thus, the requirements of virtualization, such as network isolation and the application of security rules, can be easily fulfilled if QP's behavior is properly defined. In particular, MasQ exploits the virtio-based paravirtualization technique to realize the control path. Moreover, to avoid performance overhead, MasQ leaves all data path operations, such as sending and receiving, to the hardware. We have implemented MasQ in the OpenFabrics Enterprise Distribution (OFED) framework and proved its scalability and performance efficiency by evaluating it against typical applications. The results demonstrate that MasQ achieves almost the same performance as bare-metal RDMA for data communication.

AB - RDMA communication in virtual private cloud (VPC) networks is still a challenging job due to the difficulty in fulfilling all virtualization requirements without sacrificing RDMA communication performance. To address this problem, this paper proposes a software-defined solution, namely, MasQ, which is short for "queue masquerade". The core insight of MasQ is that all RDMA communications should associate with at least one queue pair (QP). Thus, the requirements of virtualization, such as network isolation and the application of security rules, can be easily fulfilled if QP's behavior is properly defined. In particular, MasQ exploits the virtio-based paravirtualization technique to realize the control path. Moreover, to avoid performance overhead, MasQ leaves all data path operations, such as sending and receiving, to the hardware. We have implemented MasQ in the OpenFabrics Enterprise Distribution (OFED) framework and proved its scalability and performance efficiency by evaluating it against typical applications. The results demonstrate that MasQ achieves almost the same performance as bare-metal RDMA for data communication.

KW - Datacenter network

KW - Network virtualization

KW - RDMA

UR - http://www.scopus.com/inward/record.url?scp=85094863152&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85094863152&partnerID=8YFLogxK

U2 - 10.1145/3387514.3405849

DO - 10.1145/3387514.3405849

M3 - Conference contribution

AN - SCOPUS:85094863152

T3 - SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication

SP - 1

EP - 14

BT - SIGCOMM 2020 - Proceedings of the 2020 Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication

PB - Association for Computing Machinery

Y2 - 10 August 2020 through 14 August 2020

ER -

MasQ: RDMA for Virtual Private Cloud

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this