Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network

Ying Li, Haokui Zhang, Qiang Shen

Research output: Contribution to journalArticlepeer-review

888 Citations (SciVal)
216 Downloads (Pure)

Abstract

Recent research has shown that using spectral–spatial information can considerably improve the performance of hyperspectral image (HSI) classification. HSI data is typically presented in the format of 3D cubes. Thus, 3D spatial filtering naturally offers a simple and effective method for simultaneously extracting the spectral–spatial features within such images. In this paper, a 3D convolutional neural network (3D-CNN) framework is proposed for accurate HSI classification. The proposed method views the HSI cube data altogether without relying on any preprocessing or post-processing, extracting the deep spectral–spatial-combined features effectively. In addition, it requires fewer parameters than other deep learning-based methods. Thus, the model is lighter, less likely to over-fit, and easier to train. For comparison and validation, we test the proposed method along with three other deep learning-based HSI classification methods—namely, stacked autoencoder (SAE), deep brief network (DBN), and 2D-CNN-based methods—on three real-world HSI datasets captured by different sensors. Experimental results demonstrate that our 3D-CNN-based method outperforms these state-of-the-art methods and sets a new record.
Original languageEnglish
Article number67
Number of pages21
JournalRemote Sensing
Volume9
Issue number1
DOIs
Publication statusPublished - 13 Jan 2017

Keywords

  • hyperspectral image classification
  • deep learning
  • 2D convolutional neural networks
  • 3D convolutional neural networks
  • 3D structure

Fingerprint

Dive into the research topics of 'Spectral–Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network'. Together they form a unique fingerprint.

Cite this