MFFCG – Multi feature fusion for hyperspectral image classification using graph attention network

Classification methods that are based on hyperspectral images (HSIs) are playing an increasingly significant role in the processes of target detection, environmental management, and mineral mapping as a result of the fast development of hyperspectral remote sensing technology. Improving classificati...

Full description

Autores:
Aslam Bhatti, Uzair
Huang, Mengxing
NEIRA MOLINA, HAROLD ROBERTO
Marjan, Shah
Baryalai, Mehmood
Tang, Hao
Wu, Guilu
Ullah Bazai, Sibghat
Tipo de recurso:
Article of investigation
Fecha de publicación:
2023
Institución:
Corporación Universidad de la Costa
Repositorio:
REDICUC - Repositorio CUC
Idioma:
eng
OAI Identifier:
oai:repositorio.cuc.edu.co:11323/10346
Acceso en línea:
https://hdl.handle.net/11323/10346
https://repositorio.cuc.edu.co/
Palabra clave:
Feature fusion
3D-CNN
Graph Attention Network
HSI
Rights
openAccess
License
Atribución-NoComercial-SinDerivadas 4.0 Internacional (CC BY-NC-ND 4.0)
Description
Summary:Classification methods that are based on hyperspectral images (HSIs) are playing an increasingly significant role in the processes of target detection, environmental management, and mineral mapping as a result of the fast development of hyperspectral remote sensing technology. Improving classification performance is still a significant problem, however, as a result of the high dimensionality and redundancy of hyperspectral image sets (HSIs), as well as the presence of class imbalance in hyperspectral datasets. In the past few years, convolutional neural networks (CNNs) and graph convolutional networks (GCNs) have achieved good results in HSI classification, but CNNs struggle to achieve good accuracy in low samples, while GCNs have a huge computational cost. To resolve these issues, this paper proposes a Multi-Feature Fusion of 3D-CNN and Graph Attention Network MFFCG. The algorithm consists of two elements: the 3D-CNN, which produces good classification for 3D HSI cube data, and GAT-based encoder and decoder modules that help in improving the classification accuracy of the 3D-CNN. Finally, the multiple features are merged with the help of two neural network models. We further develop two optimized GAT models named GAT1 and GAT2, which are used with different layers of 3D-CNN. Algorithms after merging with 3D-CNN are named MFFCG-1 and MFFCG-2, which produce better classification results then other developed methods. Experiments on three public HSI datasets show that the proposed methods perform better than other state-of-the-art methods using the limited training samples and in low classification time.