SSFile: A novel column-store for efficient data analysis in Hadoop-based distributed systems

Son, Jihoon; Ryu, Hyoseok; Yi, Sungmin; Chung, Yon Dohn

doi:10.1016/j.ins.2015.04.014

Cited by 8 publications

(1 citation statement)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This can be considered as good article for ORC and Parquet format comparison, but not for Avro versus Parquet. Son et al (2015) proposes a novel column-store method called SSFile for Hadoopbased distributed systems. SSFile increases the actual amount of data processed per task and supports representative columnar execution techniques for efficient query processing.…”

Section: Analytics and Conclusionmentioning

confidence: 99%

A Systematic Review of SQL-on-Hadoop by Using Compact Data Formats

Plase¹

2017

BJMC

View full text Add to dashboard Cite

There are huge volumes of raw data generated every day. The question is how to store these data in order to provide faster data access. The research direction in Big Data projects using Hadoop Technology, MapReduce kind of framework and compact data formats shows that two data formats (Avro and Parquet) support schema evolution and compression in order to utilize less storage space. In this paper, a systematic review of SQL-on-Hadoop by using Avro and Parquet has been performed over the past seven years (2010-2016) using publications of conference proceedings and journals of IEEEXplore, ACM Digital Library, ScienceDirect. With the help of search strategy followed, 152 research papers have been identified out of which 27 (from year 2013-2016) have been analyzed deeply as relevant papers. At the end, the conclusion has been made that direct comparison by compactness and fastness between Avro and Parquet do not exist in analyzed scientific articles.

show abstract

Section: Analytics and Conclusionmentioning

confidence: 99%