Volume XLII-5
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-5, 613-620, 2018
https://doi.org/10.5194/isprs-archives-XLII-5-613-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLII-5, 613-620, 2018
https://doi.org/10.5194/isprs-archives-XLII-5-613-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.

  19 Nov 2018

19 Nov 2018

SPECTRAL-SPATIAL CLASSIFICATION OF HYPERSPECTRAL REMOTE SENSING IMAGES USING VARIATIONAL AUTOENCODER AND CONVOLUTION NEURAL NETWORK

A. Belwalkar, A. Nath, and O. Dikshit A. Belwalkar et al.
  • Dept. of Civil Engineering, Indian Institute of Technology Kanpur, India

Keywords: Hyperspectral, classification, feature extraction, spectral channels, deep learning

Abstract. In this paper, we propose a spectral-spatial feature extraction framework based on deep learning (DL) for hyperspectral image (HSI) classification. In this framework, the variational autoencoder (VAE) is used for extraction of spectral features from two widely used hyperspectral datasets- Kennedy Space Centre, Florida and University of Pavia, Italy. Additionally, a convolutional neural network (CNN) is utilized to obtain spatial features. The spatial and spectral feature vectors are then stacked together to form a joint feature vector. Finally, the joint feature vector is trained using multinomial logistic regression (softmax regression) for prediction of class labels. The classification performance analysis is done through generation of the confusion matrix. The confusion matrix is then used to calculate Cohen’s Kappa (Κ) to get a quantitative measure of classification performance. The results show that the K value is higher than 0.99 for both HSI datasets.