Importance of Data Distribution on Hive-Based Systems for Query Performance: An Experimental Study

Ciritoglu, Hilmi Egemen; Murphy, John; Thorpe, Christina

doi:10.1109/bigcomp48618.2020.00-47

Cited by 3 publications

(2 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A comparative analysis of the proposed work and existing works of [7] and [8] leads concludes that Spark is the favorable option of the three.…”

Section: Resultsmentioning

confidence: 98%

See 1 more Smart Citation

Aadhaar Data Analysis Comparison in MapReduce, Hive and Spark

R¹,

Ryali²,

Shrivastava³

et al. 2021

Atlantis Highlights in Computer Sciences

View full text Add to dashboard Cite

Aadhaar with a 12-digit unique identification number of every Indian provides demographic and biometric information and is mandatory for various purposes like benefit transfer directly, healthcare, etc. Approximately Aadhaar details need to store 1.3 Billion Indians which attributes to the concept of big data. In this paper, the proposed hybrid model analyses the Aadhaar dataset w.r.t different research interrogations such as count of applicants based on gender, state-wise approved and by age type applicants. In the existing systems, Aadhaar data analyses are done either manually or in primitive SQL platforms which may take days to complete. In this paper, the focus is on Aadhaar data analysis using different distributed computing frameworks like MapReduce, Hive, and Apache Spark on top of Hadoop that could be used for the purpose of better decision-making by all government firms and we provide the valid conclusion that Apache Spark framework is efficient in terms of performance.

show abstract

“…A comparative analysis of the proposed work and existing works of [7] and [8] leads concludes that Spark is the favorable option of the three.…”

Section: Resultsmentioning

confidence: 98%

“…In [8], It uses Hive to manage common queries such as SQL extending its use to structured data and the effects of low latency. Nest can generally be a preferred method in processing large-sized data sets, especially when costs are high, energy efficiency, and rawness are important.…”

Section: Resultsmentioning

confidence: 99%