2015
DOI: 10.1360/n112014-00290
|View full text |Cite
|
Sign up to set email alerts
|

大数据系统综述

Abstract: 然而, 传统的数据管理和分析系统是基于关系型数据库管理系统 (RDBMS) 的. 这些系统在处理结 构化数据时性能突出, 但是对半结构化或无结构化数据的处理却无法提供有力的支持. 此外, RDBMS 可以通过增加昂贵的硬件向上扩展 (scale up), 但是无法通过并行增加硬件实现向外扩展 (scale out). 显然, 传统的 RDBMS 无法处理如今大数据的规模和异构性. 为了解决这些挑战, 学术界和产业界从 不同角度提出了大数据系统的解决方案. 而云计算平台可以作为大数据系统的基础设施层以满足特定 的基础设施需求, 例如成本效率、灵活性以及向上或向下扩展的能力. 分布式文件系统 [8] 和 NoSQL 数据库 [9] 适用于数据持久存储和模式自由 (scheme free) 的海量数 据管理. MapReduce [10] 编程框架在处理组聚合 (group-aggregation) 任务, 如网站排名方面, 获得了极 大的成功. Hadoop [11] 则集成了数据存储、数据处理、系统管理和其他模块, 提供了强大的系统级解 决方案, 成为大数据处理的主流. 基于这些革新性的技术和平台, 可以构建多样的大… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Year Published

2017
2017
2020
2020

Publication Types

Select...
3
2
1

Relationship

0
6

Authors

Journals

citations
Cited by 14 publications
(1 citation statement)
references
References 93 publications
(114 reference statements)
0
1
0
Order By: Relevance
“…The WSN then transmits the data from these gateway nodes to a user terminal for analysis and postprocessing. (1)(2)(3) The performance of data acquisition technology in a WSN has a direct impact on accuracy, timeliness, energy consumption, and data postprocessing. (4)(5)(6) For example, a huge amount of sensor data causes a sharp increase in power consumption.…”
Section: Introductionmentioning
confidence: 99%
“…The WSN then transmits the data from these gateway nodes to a user terminal for analysis and postprocessing. (1)(2)(3) The performance of data acquisition technology in a WSN has a direct impact on accuracy, timeliness, energy consumption, and data postprocessing. (4)(5)(6) For example, a huge amount of sensor data causes a sharp increase in power consumption.…”
Section: Introductionmentioning
confidence: 99%