Database compression

Abstract

Despite the fact that computer memory costs have decreased dramatically over the past few years, data storage still remains, and will probably always remain, an important cost factor for many large scale database applications. Compressing data in a database system is attractive for two reasons: data storage reduction and performance improvement. Storage reduction is a direct and obvious benefit, while performance improves because smaller amounts of physical data need to be moved for any particular operation on the database. We address several aspects of reversible data compression and compression techniques: general concepts of data compression; a number of compression techniques; a comparison of the effects of compression on common data types; advantages and disadvantages of compressing data; and future research needs.

Performance Improvement of Database Compression for OLTP Workloads

“…We measure space savings, loading performance, and transaction throughput. We define the space savings (SS) according to literature [7], [8].…”

“…Roth and Horn [8] have provided a survey on lossless data compression techniques. Westmann et al [10] have shown how compression can be integrated into a RDBMS.…”

A Selective Compression Strategy for Performance Improvement of Database Compression

“…We define the space savings (SS) according to literature [2,8] in Formula (1). According to Lee [1], if data is too densely stored in compressed pages, page splits will be often incurred by updates.…”

Semantic Database Compression System Based on Augmented Vector Quantization

“…Database compression adds a layer of complexity to the design, implementation, and operation of a database system. Designers are reluctant to accept the additional complexity [1], [2].…”

“…The following data characteristics offer a brilliant environment for the application of database compression techniques [1]: 1) Sparseness, in sparsity database fields tend to have large clusters of zeros, blanks, or missing data indicators. Sparseness is the most important property in determining the overall compression percentage that could be achieved in the database.…”