Memory size occupation and memory access bandwidth are capital issues for high resolution video codec design because of the large scale of data, and the high power consumption especially for wireless terminals. An adaptive and random access-obeyed reference pictures memory compression (RPMC) scheme based on as small granularity as 2x2 blocks for 2-bit truncation is proposed in this paper to solve the problems. The impact of granularity in RPMC to memory access bandwidth during motion estimation and/or motion compensation is analyzed firstly. Then an adaptive RPMC scheme based on 2x2 block size is proposed, based on min-max scalar quantization (MMSQ). Finally, the results based on HM are provided which show that compared with the common used 4x4 block-based methods, little performance loss is introduced. At the same time, based on the adaptively merge scheme, the average memory access bandwidth is saved than the 4x4 block based method by up to 17%.