Spatial vector data with high-precision and wide-coverage has exploded globally, such as land cover, social media, and other datasets, which provides a good opportunity to enhance the national macroscopic decision-making, social supervision, public services, and emergency capabilities. Simultaneously, it also brings great challenges in management technology for big spatial vector data (BSVD). In recent years, a large number of new concepts, parallel algorithms, processing tools, platforms, and applications have been proposed and developed to improve the value of BSVD from both academia and industry. To better understand BSVD and take advantage of its value effectively, this paper presents a review that surveys recent studies and research work in the data management field for BSVD. In this paper, we discuss and itemize this topic from three aspects according to different information technical levels of big spatial vector data management. It aims to help interested readers to learn about the latest research advances and choose the most suitable big data technologies and approaches depending on their system architectures. To support them more fully, firstly, we identify new concepts and ideas from numerous scholars about geographic information system to focus on BSVD scope in the big data era. Then, we conclude systematically not only the most recent published literatures but also a global view of main spatial technologies of BSVD, including data storage and organization, spatial index, processing methods, and spatial analysis. Finally, based on the above commentary and related work, several opportunities and challenges are listed as the future research interests and directions for reference.
In the era of big data, the explosive growth of Earth observation data and the rapid advancement in cloud computing technology make the global-oriented spatiotemporal data simulation possible. These dual developments also provide advantageous conditions for discrete global grid systems (DGGS). DGGS are designed to portray real-world phenomena by providing a spatiotemporal unified framework on a standard discrete geospatial data structure and theoretical support to address the challenges from big data storage, processing, and analysis to visualization and data sharing. In this paper, the trinity of big Earth observation data (BEOD), cloud computing, and DGGS is proposed, and based on this trinity theory, we explore the opportunities and challenges to handle BEOD from two aspects, namely, information technology and unified data framework. Our focus is on how cloud computing and DGGS can provide an excellent solution to enable big Earth observation data. Firstly, we describe the current status and data characteristics of Earth observation data, which indicate the arrival of the era of big data in the Earth observation domain. Subsequently, we review the cloud computing technology and DGGS framework, especially the works and contributions made in the field of BEOD, including spatial cloud computing, mainstream big data platform, DGGS standards, data models, and applications. From the aforementioned views of the general introduction, the research opportunities and challenges are enumerated and discussed, including EO data management, data fusion, and grid encoding, which are concerned with analysis models and processing performance of big Earth observation data with discrete global grid systems in the cloud environment.Remote Sens. 2020, 12, 62 2 of 15 (CEOS), over 500 EO satellites have been launched in the last half-century, and more than 150 satellites will be launched in the next 12 years [2,3]. China has launched more than 60 satellites since 1970 for comprehensive observation of the Earth's systems, including HuanJing (HJ), FengYun (FY), China-brazil earth resource satellite (CBERS), and GaoFen (GF) series. From the European Space Agency (ESA), in terms of Sentinel family, a total of 50,964,670 products had been downloaded by users since the start of data access operations, with a total data volume of 41. 35 PB [4]. The big Earth observation data (BEOD) has gradually promoted the development of global industries, research institutions, and application sectors, which has had a profound impact on the study of the Earth system [5,6], contributing to human activities, environmental monitoring, and climate changes, and also provided abundant data resource for the construction of digital Earth [7][8][9].BEOD also poses challenges to uses in terms of problem complexity, automatic analysis, and processing efficiency [10][11][12][13]. Fortunately, the rapid advancement of cloud computing technology in recent years provides strong computing power, especially for the efficiency of big geospatial data management and process...
In recent years, remote sensing (RS) research on crop growth status monitoring has gradually turned from static spectrum information retrieval in large-scale to meso-scale or micro-scale, timely multi-source data cooperative analysis; this change has presented higher requirements for RS data acquisition and analysis efficiency. How to implement rapid and stable massive RS data extraction and analysis becomes a serious problem. This paper reports on a Raster Dataset Clean & Reconstitution Multi-Grid (RDCRMG) architecture for remote sensing monitoring of vegetation dryness in which different types of raster datasets have been partitioned, organized and systematically applied. First, raster images have been subdivided into several independent blocks and distributed for storage in different data nodes by using the multi-grid as a consistent partition unit. Second, the “no metadata model” ideology has been referenced so that targets raster data can be speedily extracted by directly calculating the data storage path without retrieving metadata records; third, grids that cover the query range can be easily assessed. This assessment allows the query task to be easily split into several sub-tasks and executed in parallel by grouping these grids. Our RDCRMG-based change detection of the spectral reflectance information test and the data extraction efficiency comparative test shows that the RDCRMG is reliable for vegetation dryness monitoring with a slight reflectance information distortion and consistent percentage histograms. Furthermore, the RDCGMG-based data extraction in parallel circumstances has the advantages of high efficiency and excellent stability compared to that of the RDCGMG-based data extraction in serial circumstances and traditional data extraction. At last, an RDCRMG-based vegetation dryness monitoring platform (VDMP) has been constructed to apply RS data inversion in vegetation dryness monitoring. Through actual applications, the RDCRMG architecture is proven to be appropriate for timely vegetation dryness RS automatic monitoring with better performance, more reliability and higher extensibility. Our future works will focus on integrating more kinds of continuously updated RS data into the RDCRMG-based VDMP and integrating more multi-source datasets based collaborative analysis models for agricultural monitoring.
In order to protect the ecological environment and solve the poverty problem in the western region, China has established an ecological migration (EM) policy. This policy aims to relocate populations from poverty-stricken areas with fragile ecological environments, which inevitably leads to changes in land cover and the ecological environment. The objective of this study was to identify the effects of EM in a typical region (Wuwei), including changes in the land cover and ecological risk (ER). A land cover change monitoring method was implemented for the 2010–2019 period for six land cover classes using random forest, which is an effective supervised machine learning method. The land cover change patterns were analyzed by determining the area changes of the six classes and applying a land use transition matrix, and a landscape ecological risk model based on landscape disturbance and fragility was used. Our results demonstrate that the increase and decrease in the area of cultivated land, unused land, and construction land can be divided into two stages (2010–2015 and 2015–2019). The area of water and perennial snow doubled during the study periods. The major land cover transitions were between unused land and construction land and between unused land and crop land. In addition, the ER value for the Qilian Mountain National Nature Reserve decreased because of the implementation of EM in the study area, indicating that the ecological environment was effectively improved. The results demonstrate the advantage of the proposed approach in understanding the impact of EM on regional land cover changes and the ecological environment so as to provide guidance for follow-up planning and development.
Nowadays, GF-1 (GF is the acronym for GaoFen which means high-resolution in Chinese) remote sensing images are widely utilized in agriculture because of their high spatio-temporal resolution and free availability. However, due to the transferrable rationale of optical satellites, the GF-1 remote sensing images are inevitably impacted by clouds, which leads to a lack of ground object’s information of crop areas and adds noises to research datasets. Therefore, it is crucial to efficiently detect the cloud pixel of GF-1 imagery of crop areas with powerful performance both in time consumption and accuracy when it comes to large-scale agricultural processing and application. To solve the above problems, this paper proposed a cloud detection approach based on hybrid multispectral features (HMF) with dynamic thresholds. This approach combined three spectral features, namely the Normalized Difference Vegetation Index (NDVI), WHITENESS and the Haze-Optimized Transformation (HOT), to detect the cloud pixels, which can take advantage of the hybrid Multispectral Features. Meanwhile, in order to meet the variety of the threshold values in different seasons, a dynamic threshold adjustment method was adopted, which builds a relationship between the features and a solar altitude angle to acquire a group of specific thresholds for an image. With the test of GF-1 remote sensing datasets and comparative trials with Random Forest (RF), the results show that the method proposed in this paper not only has high accuracy, but also has advantages in terms of time consumption. The average accuracy of cloud detection can reach 90.8% and time consumption for each GF-1 imagery can reach to 5 min, which has been reduced by 83.27% compared with RF method. Therefore, the approach presented in this work could serve as a reference for those who are interested in the cloud detection of remote sensing images.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.