PCMLogging: Optimizing Transaction Logging and Recovery Performance with PCM

Gao, Shen; Xu, Jianliang; Härder, Theo; He, Bingsheng; Choi, Byron; Hu, Haibo

doi:10.1109/tkde.2015.2453154

Cited by 29 publications

(17 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It requires two (expensive) epoch barriers [9] per log write and partial overwriting to tolerate holes in the log (necessary to improve parallelism), and is thus not implementable on current hardware; the partial overwriting also accelerates device wear-out. PCMLogging [11] employs PCM as both data buffer and log space. Pelley et al [35] demonstrated different uses of NVM in database systems, but also relies on the epoch barrier.…”

Section: Related Workmentioning

confidence: 99%

Scalable logging through emerging non-volatile memory

2014

View full text Add to dashboard Cite

Emerging byte-addressable, non-volatile memory (NVM) is fundamentally changing the design principle of transaction logging. It potentially invalidates the need for flush-beforecommit as log records are persistent immediately upon write. Distributed logging-a once prohibitive technique for single node systems in the DRAM era-becomes a promising solution to easing the logging bottleneck because of the nonvolatility and high performance of NVM.In this paper, we advocate NVM and distributed logging on multicore and multi-socket hardware. We identify the challenges brought by distributed logging and discuss solutions. To protect committed work in NVM-based systems, we propose passive group commit, a lightweight, practical approach that leverages existing hardware and group commit. We expect that durable processor cache is the ultimate solution to protecting committed work and building reliable, scalable NVM-based systems in general. We evaluate distributed logging with logging-intensive workloads and show that distributed logging can achieve as much as ∼3x speedup over centralized logging in a modern DBMS and that passive group commit only induces minuscule overhead.

show abstract

Section: Related Workmentioning

confidence: 99%

Scalable logging through emerging non-volatile memory

2014

View full text Add to dashboard Cite

show abstract

“…Through the use of PCM, the transaction log overhead in disk-based relational databases can be reduced. Gao et al [2011] designed a logging method used in disk-based databases called PCMLogging, in which buffered updates and transaction logs are completely integrated. In this way, the dirty pages cached by PCM can also be used as log.…”

Section: Database Systemsmentioning

confidence: 99%

Rethinking Computer Architectures and Software Systems for Phase-Change Memory

Zhang

2016

J. Emerg. Technol. Comput. Syst.

View full text Add to dashboard Cite

With dramatic growth of data and rapid enhancement of computing powers, data accesses become the bottleneck restricting overall performance of a computer system. Emerging phase-change memory (PCM) is byte-addressable like DRAM, persistent like hard disks and Flash SSD, and about four orders of magnitude faster than hard disks or Flash SSDs for typical file system I/Os. The maturity of PCM from research to production provides a new opportunity for improving the I/O performance of a system. However, PCM also has some weaknesses, for example, long write latency, limited write endurance, and high active energy. Existing processor cache systems, main memory systems, and online storage systems are unable to leverage the advantages of PCM, and/or to mitigate PCM's drawbacks. The reason behind this incompetence is that they are designed and optimized for SRAM, DRAM memory, and hard drives, respectively, instead of PCM memory. There have been some efforts concentrating on rethinking computer architectures and software systems for PCM. This article presents a detailed survey and review of the areas of computer architecture and software systems that are oriented to PCM devices. First, we identify key technical challenges that need to be addressed before this memory technology can be leveraged, in the form of processor cache, main memory, and online storage, to build high-performance computer systems. Second, we examine various designs of computer architectures and software systems that are PCM aware. Finally, we obtain several helpful observations and propose a few suggestions on how to leverage PCM to optimize the performance of a computer system. ACM Reference Format:Chengwen Wu, Guangyan Zhang, and Keqin Li. 2016. Rethinking computer architectures and software systems for phase-change memory.

show abstract

“…Kim suggests that one of the described NVRAM technologies is likely to succeed in 2020 [11]. Some researchers assumed that, in the immediate future, the next-generation memory would became phase-change memory (PCM) [7,18]. Another NVRAM memory technology (3D XPoint, announced by Intel and Micron) was expected to appear on market in 2016 with much better properties than the alternatives [5,10,17].…”

Section: Related Workmentioning

confidence: 99%

Using Redis Supported by Nvram in HPC Applications

Malinowski

2017

csci

View full text Add to dashboard Cite

Nowadays, the efficiency of storage systems is a bottleneck in many modern HPC clusters. High performance in the traditional approach -processing using files -is often difficult to obtain because of a model's complexity and its read/write patterns. An alternative approach is to apply a key-value database, which usually has low latency and scales well. On the other hand, many key-value stores suffer from a limitation of memory capacity and vulnerability to serious failures, which is caused by processing in RAM. Moreover, some research suggests that scientific data models are not applicable to the storage structures of key-value databases. In this paper, the author proposes a resolution to the above-mentioned issues by replacing RAM with NVRAM. A practical example is based on Redis NoSQL. The article also contains three domain-specific APIs that show the idea behind transforming from an HPC data model to Redis structures as well as two micro-benchmarks results.

show abstract

PCMLogging: Optimizing Transaction Logging and Recovery Performance with PCM

Cited by 29 publications

References 34 publications

Scalable logging through emerging non-volatile memory

Scalable logging through emerging non-volatile memory

Rethinking Computer Architectures and Software Systems for Phase-Change Memory

Using Redis Supported by Nvram in HPC Applications

Contact Info

Product

Resources

About