Title: An efficient cache management algorithm for streaming workloads

Authors: Kyungwoon Cho; Hyokyung Bahn

Addresses: Embedded Software Research Center, Ewha University, Seoul, 03760, South Korea ' Department of Computer Engineering, Ewha University, Seoul, 03760, South Korea

Abstract: In this paper, we present a novel cache management algorithm for real-world streaming workloads. Streaming workloads are believed to exhibit very large and sequential access patterns, which has been the main consideration in designing media caching algorithms. However, legacy caching algorithms do not fully utilise fine-grained access patterns of streaming workloads and also tend to ignore human interactivity. In this paper, we present the least expectation first (LEF) algorithm, which manages a large number of block caches as two-level grouping. Specifically, we select caching and eviction targets based on the expected gain of the cached data blocks, thereby improving the cache hit ratio significantly. Experimental results show that the proposed algorithm performs better than well-known interval caching and LRU algorithms with respect to the hit ratio and the I/O bandwidth.

Keywords: caching algorithm; interval caching; LRU algorithm; streaming workload; sequential access; buffer caching; I/O bandwidth; cache hit ratio.

DOI: 10.1504/IJNVO.2020.107574

International Journal of Networking and Virtual Organisations, 2020 Vol.22 No.4, pp.402 - 414

Received: 02 Oct 2018
Accepted: 18 Feb 2019
Published online: 01 Jun 2020 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article