Big Data Geospatial Processing for Massive Aerial LiDAR Datasets

Abstract

For years, Light Detection and Ranging (LiDAR) technology has been considered as a challenge when it comes to developing efficient software to handle the extremely large volumes of data this surveying method is able to collect. In contexts such as this, big data technologies have been providing powerful solutions for distributed storage and computing. In this work, a big data approach on geospatial processing for massive aerial LiDAR point clouds is presented. By using Cassandra and Spark, our proposal is intended to support the execution of any kind of heavy time-consuming process; nonetheless, as an initial case of study, we have focused on fast ground-only rasters obtention to generate digital terrain models (DTMs) from massive LiDAR datasets. Filtered clouds obtained from the isolated processing of adjacent zones may exhibit errors located on the boundaries of the zones in the form of misclassified points. Usually, this type of error is corrected through manual or semi-automatic procedures. In this work, we also present an automated strategy for correcting errors of this type, improving the quality of the classification process and the DTMs obtained while minimizing user intervention. The autonomous nature of all computing stages, along with the low processing times achieved, opens the possibility of considering the system as a highly scalable service-oriented solution for on-demand DTM generation or any other geospatial process. Said solution would be a highly useful and unique service for many users in the LiDAR field, and one which could get near to real-time processing with appropriate computational resources.

Video Image Processing Method Based on Cloud Platform Massive Data and Virtual Reality

“…On this basis, many rich big data applications have been established. Hadoop distributed system is mainly divided into two parts: HDFS distributed file system and MapReduce computing framework [8].…”

Digital Twin and CyberGIS for Improving Connectivity and Measuring the Impact of Infrastructure Construction Planning in Smart Cities

“…For real-time visualization and near real-time analysis of streaming data within GIS environments, technologies such as the Internet of Things are required to be interoperable with CyberGIS. The real-time output also depends on reliable "geospatial big data" computation algorithms to deal with volume, variety, and velocity of data [12][13][14][15]. There remains geospatial big data challenges that should be investigated in terms of availability of data on multi-cloud models, data integrity, data standards, and heterogeneity.…”

Validation of a 3D Local-Scale Adaptive Solar Radiation Model by Using Pyranometer Measurements and a High-Resolution Digital Elevation Model

“…There is a wide variety of technologies that allow a massive capture of terrestrial information [ 33 ]. Among the different geospatial data coming from different sensors that allow the massive capture of information, LiDAR data stand out [ 34 ]. LiDAR data, obtained from laser scanners on board different devices, are highly accurate three-dimensional data.…”