位置信息与替换概率相结合的多核共享Cache管理机制

多核系统中末级Cache是影响整体性能的关键。为了提出一种细粒度、低延迟、低代价的末级共享Cache资源管理机制,将系统性能目标转换为每个内核当前占用Cache资源的替换概率,以决定每个内核能够提供的被替换资源的数量;对某个需要增加Cache资源的内核,从可提供被替换资源的候选内核中选出距离较近且替换概率较高的一个内核,并以Cache块为粒度进行替换,从而实现Cache资源在不同内核间的动态划分。与传统以相联度为粒度的粗粒度替换机制相比,以Cache块为单位的替换机制具有更细的替换粒度,灵活性更高。另外,通过将位置信息和替换概率结合,保证了Cache资源与相应内核在物理布局上的收敛,降低了访问延迟。同时,所提出的方法只需要增加极少的硬件代价。实验结果表明,根据实验场景和对比对象的不同,所提方法与其他已有研究成果相比,可以实现从6.8%到22.7%的性能提升。

Shared cache management scheme with location information and eviction probability in multi-core system

Last level cache(LLC) plays an important role in multi-core systems. This paper aims to propose a shared LLC management scheme with fine granularity, low latency and simple hardware complexity. In this work, the performance goal is translated into eviction probabilities of each core. Then, a victim core which is near from the current core and has higher eviction probability is chosen to provide the victim cache block for replacement. In this way, LLC are dynamically partitioned among all cores at finer granularity of cache blocks. This proposal is more flexible than traditional way-partitioning scheme. In addition, the combination of location information and eviction probability improves the locality between cache resources and the corresponding cores, which can reduce the cache access latency. The proposed scheme requires only little additional hardware changes to traditional cache structure. Results on M5 simulator suggest that performance improvements from 6.8% to 22.7% can be achieved while compared with related works.