Transaction processing in consistency-aware user’s applications deployed on NoSQL databases

Abstract

NoSQL databases are capable of storing and processing big data which is characterized by various properties such as volume, variety and velocity. Such databases are used in a variety of user applications that need large volume of data which is highly available and efficiently accessible. But they do not enforce or require strong data consistency nor do they support transactions. This paper investigates into the transaction processing in consistency-aware applications hosted on MongoDB and Riak which are two representatives of Document and Key-Value NoSQL databases, respectively. It develops new transaction schemes in order to provide NoSQL databases with transactional facilities as well as to analyze the effects of transactions on data consistency and efficiency in user’s applications. The proposed schemes are evaluated using the YCSB + T benchmark which is based on Yahoo! Cloud Services Benchmark (YCSB). Experimental results show that using the proposed schemes, strong consistency can be achieved in MongoDB and Riak without severely affecting their efficiency. We also conduct experiments in order to analyse the level of consistencyof MongoDB and Riak transactional systems.

A literature review on NoSQL database for big data processing

“…From the collected of 18 articles, we found 8 articles [8][9][10][11][12][13][14][15] that were related to general overview of NoSQL databases and Big Data, 5 articles [16][17][18][19][20] that discussed performance comparison and evaluation between different NoSQL databases, 2 articles [21][22] that were associated to NoSQL data model and classifying NoSQL databases based on the Consistency, Availability, tolerance of network Partition of database which is known as CAP theorem, [23] this research has concentrated on the storage aspect of cloud computing systems using NoSQL. Other two [24][25] study reported the SQL query condition transformation to any NoSQL based database using Espresso Heuristic algorithm and analyzed the effects of transaction on data consistency & efficiency. However, the outcomes of the 18 articles on NoSQL used in Big Data processing are summarized in Table 1.…”

“…This study describes the background basics characteristics data model of NoSQL [23] DB-Engine Ranking This research has concentrated on the storage aspect of cloud computing systems, in particular, NoSQL Databases [24][25] Transactional for MongoDB, Riak and NoSQL 's SQL condition based on Espresso Heuristic algorithm To analyzed the effects of transaction on data consistency and efficiency and SQL query condition transformation for any NoSQL Databases…”

“…Of the 18 selected studies, two studies [24,25] focused on the ACID transactions. The primary models of NoSQL do not support ACID transaction but Gonzalez-Aparicio et al [25] developed a new transaction system and implemented into NoSQL databases for MongoDB and Riak for ACID transaction; These transaction system allows join operation, provide high scalability and concurrency of transaction. Other study [24] described the SQL syntax converting into conditional expression of a NoSQL database.…”

“…For example, when transactional and ACID issues are coming in NoSQL database, there is no other option without CAP theorem. Later, Gonzalez-Aparicio et al [25] developed a new transaction system using three components: i) Transmission Processing Engine (TPE), ii) Data Management Store (DMS), and iii) Times Stamp Manager (TSM). Also, they implemented their developed technique into NoSQL databases for MongoDB and Riak; where TPE allows join operation which are not previously supported in NoSQL, whereas DMS and TSM are applied in order to provide high scalability and concurrency of transactions.…”

A Study on the Transparent Price Tracing System in Supply Chain Management Based on Blockchain

“…In this paper, we propose a path-based price tracking system for SCM based on blockchain and smart contracts. Many methods exist to manage data through the system [3][4][5]. The model proposed in this paper manages the information regarding the cost of the SCM using the Ethereum blockchain approach.…”