A Study on Modeling and Optimization of Memory Systems  

作　　者：Jason Liu Pedro Espina Xian-He Sun 

机构地区：[1]School of Computing and Information Sciences,Florida International University,Miami,FL 33199,U.S.A [2]Department of Computer Science,Illinois Institute of Technology,Chicago,IL 60616,U.S.A

出　　处：《Journal of Computer Science & Technology》2021年第1期71-89,共19页计算机科学技术学报（英文版）

基　　金：supported in part by the U.S.National Science Foundation under Grant Nos.CCF-2008000,CNS-1730488,and CCF-2008907;the U.S.Department of Homeland Security under Grant No.2017-ST-062-000002.

摘　　要：Accesses Per Cycle(APC),Concurrent Average Memory Access Time(C-AMAT),and Layered Performance Matching(LPM)are three memory performance models that consider both data locality and memory assess concurrency.The APC model measures the throughput of a memory architecture and therefore reflects the quality of service(QoS)of a memory system.The C-AMAT model provides a recursive expression for the memory access delay and therefore can be used for identifying the potential bottlenecks in a memory hierarchy.The LPM method transforms a global memory system optimization into localized optimizations at each memory layer by matching the data access demands of the applications with the underlying memory system design.These three models have been proposed separately through prior efforts.This paper reexamines the three models under one coherent mathematical framework.More specifically,we present a new memorycentric view of data accesses.We divide the memory cycles at each memory layer into four distinct categories and use them to recursively define the memory access latency and concurrency along the memory hierarchy.This new perspective offers new insights with a clear formulation of the memory performance considering both locality and concurrency.Consequently,the performance model can be easily understood and applied in engineering practices.As such,the memory-centric approach helps establish a unified mathematical foundation for model-driven performance analysis and optimization of contemporary and future memory systems.

关 键 词：performance modeling performance optimization memory architecture memory hierarchy concurrent average memory access time 

分 类 号：TP31[自动化与计算机技术—计算机软件与理论]