Hyperspectral Image Classification With Localized Spectral Filtering-Based Graph Attention Network

Abstract

Abstract. Graph-based deep learning has been proved a promising approach that has an apparent superiority for learning graph data and modeling spatial topological relations between features. In particular, graph attention networks (GATs) are good at efficiently processing the graph-structured hyperspectral data by leveraging masked self-attention layers to address the known shortcomings of previous frameworks based on graph convolutions or their approximations. In this study, we proposed a novel approach that combines localized spectral filtering and GAT for the hyperspectral image classification task. First, we conducted unsupervised t-SNE (t-distributed stochastic neighbor embedding) manifold learning-based feature dimensionality reduction to create localized hyperspectral data cubes. Then, these feature cubes combined with localized adjacent matrices were fed into a shallow graph attention network in a supervised learning manner. Finally, we obtained credible classification results and promising classification performance in distinguishing diversified land covers through reducing the possible redundancy of spectral information and enhancing the expression of local spatial-spectral information. Experiments on two real hyperspectral data sets (that is, Indian Pines-A (IA) and Huanghekou (HH) data sets) demonstrated that the presented approach offers promising classification performance, that is, the GAT using t-SNE acquires superior performance than that of using PCA (principal component analysis), and also proves the great importance of combining spatial- and spectral information for hyperspectral image classification.