MAP-Vis: A Distributed Spatio-Temporal Big Data Visualization Framework Based on a Multi-Dimensional Aggregation Pyramid Model

Abstract

During the exploration and visualization of big spatio-temporal data, massive volume poses a number of challenges to the achievement of interactive visualization, including large memory consumption, high rendering delay, and poor visual effects. Research has shown that the development of distributed computing frameworks provides a feasible solution for big spatio-temporal data management and visualization. Accordingly, to address these challenges, this paper adopts a proprietary pre-processing visualization scheme and designs and implements a highly scalable distributed visual analysis framework, especially targeted at massive point-type datasets. Firstly, we propose a generic multi-dimensional aggregation pyramid (MAP) model based on two well-known graphics concepts, namely the Spatio-temporal Cube and 2D Tile Pyramid. The proposed MAP model can support the simultaneous hierarchical aggregation of time, space, and attributes, and also later transformation of the derived aggregates into discrete key-value pairs for scalable storage and efficient retrieval. Using the generated MAP datasets, we develop an open-source distributed visualization framework (MAP-Vis). In MAP-Vis, a high-performance Spark cluster is used as a parallel preprocessing platform, while distributed HBase is used as the massive storage for the generated MAP data. The client of MAP-Vis provides a variety of correlated visualization views, including heat map, time series, and attribute histogram. Four open datasets, with record numbers ranging from the millions to the tens of billions, are chosen for system demonstration and performance evaluation. The experimental results demonstrate that MAP-Vis can achieve millisecond-level query response and support efficient interactive visualization under different queries on the space, time, and attribute dimensions.

GeoMapViz: a framework for distributed management and geospatial data visualization based on massive spatiotemporal data streams

“…MapD [18] used a GPU to parallelize, thus speeding up the query and pixelization in visualization, but it was limited to a single machine and had poor scalability. There are also many extended distributed visualization-processing frameworks, such as GeoSparkViz [19], HadoopViz [20], SHAHED [21], MAP_Vis [22], parallelized scatter maps, heatmaps and other map image-rendering pipelines, to realize the organization and visualization of spatiotemporal big data. Most implementations are concentrated in the distributed data-processing platform, using the batchprocessing method of data, which has large data delay and does not support the visualization requirements of high real-time data.…”

Research on Building Space Model Method Based on Big Data Map Visual Design

“…However, these models are only simple time simulation and do not really solve the problem of space-time combination [ 9 ]. Guan proposed a spatiotemporal composite model for the vector model, which divides space into a set of spatiotemporal composite units representing the same time process [ 10 ]. The spatiotemporal object model proposed by Zou Y. introduces the time dimension to make it orthogonal to the two-dimensional space and abstracts the real world into a discrete object set composed of spatiotemporal atoms.…”