Custom parallel caching schemes for hardware-accelerated image compression

Abstract

In an effort to achieve lower bandwidth requirements, video compression algorithms have become increasingly complex. Consequently, the deployment of these algorithms on Field Programmable Gate Arrays (FPGAs) is becoming increasingly desirable, because of the computational parallelism on these platforms as well as the measure of flexibility afforded to designers. Typically, video data is stored in large and slow external memory arrays, but the impact of the memory access bottleneck may be reduced by buffering frequently used data in fast on-chip memories. The order of the memory accesses, resulting from many compression algorithms are dependent on the input data [18]. These data dependent memory accesses complicate the exploitation of data re-use, and subsequently reduce the extent to which an application may be accelerated. In this paper, we present a hybrid memory sub-system which is able to capture data re-use effectively in spite of data dependent memory accesses. This memory sub-system is made up of a custom parallel cache and a scratchpad memory. Further, the framework is capable of exploiting two dimensional spatial locality, which is frequently exhibited in the access patterns of image processing applications. In a case study involving the Quad-tree Structured Pulse Code Modulation (QSDPCM) application, the impact of data dependence on memory accesses is shown to be significant. In comparison with an implementation which only employs an SPM, performance improvements of up to 1.7× and 1.4× are observed through actual implementation on two modern FPGA platforms. These performance improvements are more pronounced for image sequences exhibiting greater inter-frame movements. In addition, reductions of on-chip memory resources by up to 3.2× are achievable using this framework. These results indicate that, on custom hardware platforms,

Optimization of Application-Specific Memories

“…Although a hybrid memory subsystem including both caches and scratchpads is proposed in [1], that work focuses only on an image compression application. We are interested in a general approach for determining custom memory subsystems for applications.…”

FPGA based efficient on-chip memory for image processing algorithms

“…In a recent work, a hybrid architecture that uses a custom parallel cache and a scratchpad memory to allow effective data re-use in spite of data-dependent memory accesses. But this causes cache misses which leads to hardware overhead [18]. The cache memory constitutes a major fraction of the total power requirements of embedded architectures [19,20].…”