In-Network Memory Access Ordering for Heterogeneous Multicore Systems

Jieming Yin, Antonia Zhai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In heterogeneous multicore systems, implementing a programmer-friendly memory consistency model while maximizing memory-level parallelism is challenging. Ideally, memory accesses can be performed out of order as long as program order is not violated. But enforcing memory access order at the end-point (e.g., a core) prohibits a number of architecture optimizations and limits memory-level parallelism. In this work, we explore the opportunity of preserving memory access order inside the on-chip interconnection network. We propose a hybrid switching networks-on-chip (NoC) attached with a light-weight token ring network to guarantee global memory access order. The hybrid switching NoC that supports both packet and circuit switching serves as the underlying communication infrastructure, while the token ring network is used to preserve memory order among multiple ordering points. Our proposed design enables strong memory consistency models and deterministic program execution, with negligible performance overhead compared to an un-ordered packet switching network.

Original languageEnglish (US)
Title of host publication14th IEEE/ACM International Symposium on Networks-on-Chip, NOCS 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728188478
DOIs
StatePublished - Sep 24 2020
Event14th IEEE/ACM International Symposium on Networks-on-Chip, NOCS 2020 - Hamburg, Germany
Duration: Sep 24 2020Sep 25 2020

Publication series

Name14th IEEE/ACM International Symposium on Networks-on-Chip, NOCS 2020

Conference

Conference14th IEEE/ACM International Symposium on Networks-on-Chip, NOCS 2020
CountryGermany
CityHamburg
Period9/24/209/25/20

Fingerprint Dive into the research topics of 'In-Network Memory Access Ordering for Heterogeneous Multicore Systems'. Together they form a unique fingerprint.

Cite this