Main Memory Database Recovery

Abstract

Many of today’s applications need massive real-time data processing. In-memory database systems have become a good alternative for these requirements. These systems maintain the primary copy of the database in the main memory to achieve high throughput rates and low latency. However, a database in RAM is more vulnerable to failures than in traditional disk-oriented databases because of the memory volatility. DBMSs implement recovery activities (logging, checkpoint, and restart) for recovery proposes. Although the recovery component looks similar in disk- and memory-oriented systems, these systems differ dramatically in the way they implement their architectural components, such as data storage, indexing, concurrency control, query processing, durability, and recovery. This survey aims to provide a thorough review of in-memory database recovery techniques. To achieve this goal, we reviewed the main concepts of database recovery and architectural choices to implement an in-memory database system. Only then, we present the techniques to recover in-memory databases and discuss the recovery strategies of a representative sample of modern in-memory databases.

High-availability clusters: A taxonomy, survey, and future directions

“…Today's HACs make a distinction between the different layers of an application. In protecting a layer 3 component (i.e., database), a HAC can either manage it by employing a database-specific extension (agent) or utilising replica or mir- roring features that are offered natively by the database [96].…”

“…Subsequently, states are replicated to a standby application or service that is hosted on the secondary node [61]. A more advanced approach is a State Machine Replication (SMR) which creates replicas of client and process states to one or more nodes deterministically [141], which can even support more comprehensive solutions such as databases [142,96]. An example of SMR concerning a HAC is an implementation of a HAC for HPC, which employed SMR to synchronise states between nodes in a symmetric active-active topology [83] class of file systems which, in turn, can influence the configuration of a HAC.…”

Main memory database recovery strategies

“…However, the recovery strategies presented are implemented similarly in other types of MMDBs. Besides, the tutorial introduces modern recovery techniques, such as instant recovery [Magalhães et al 2021b, Magalhães 2021, Magalhães et al 2021a, Sauer 2019].…”

“…Currently, he works as a professor in the Information Systems Course at the Federal University of Piaui. During his doctoral studies, he published some relevant articles in MMDB recovery research area, such as [Magalhães et al 2021b], [Magalhães 2021], and [Magalhães et al 2021a]. He has areas of interest in database and software engineering, working mainly on the following themes: self-tuning databases, cloud databases, and in-memory databases.…”

Query Dictionary for Frequent Non-Indexed Queries in HTAP Databases

“…I N the modern computing world, HTAP generally adopts in-memory techniques [1]. Storing the entire database structure in the memory is the signature characteristic of inmemory databases.…”