Abstract

Near Infrared hyperspectral imaging (HSI) offers a fast and non-destructive method for seed quality assessment through combining spectroscopy and imaging. Recently, convolutional neural networks (CNN) have shown to be promising tools for red-green-blue (RGB) image or spectral cereal classification. This paper describes the design and implementation of deep CNN models capable of utilizing both the spatial and spectral dimension of HSI data simultaneously for analysis of bulk grain samples with densely packed kernels. Classification of eight grain samples, including six different wheat varieties, were used as a test case. The study shows that the CNN architecture ResNet, originally designed for RGB images, can be adapted to use the full spatio-spectral dimension of the HSI data through adding a linear down sample layer prior to the conventional ResNet architecture. Using traditional spectral pre-processing methods before passing the data to the CNN does not improve the classification accuracy of the networks, while a channel-wise image standardization improves the accuracy significantly. The modified ResNet applied to the full spatio-spectral dimension has a classification accuracy of up to 99.75 ± 0.02%, outperforming both purely spectral (86.5 ± 0.1%) and purely spatial (98.70 ± 0.01%) based methods in terms of accuracy, indicating that utilizing spatio-spectral correlation can improve sample classification, but also that grain classification is primarily solved using spatial information. The findings reported in this paper demonstrate how CNN networks can be designed to leverage spatio-spectral information in hyperspectral data. The combination of HSI and spatio-spectral CNN networks shows a possible method for fast prediction of bulk grain quality parameters where both spectral and spatial properties of the grains are important.

© 2022 The Author(s)

Minimalistic fully convolution networks (MFCN): pixel-level classification for hyperspectral image with few labeled samples

Buyun Xu, Weijun Hou, Yiwei Wei, Yiting Wang, and Xihai Li
Opt. Express 30(10) 16585-16605 (2022)

Hybrid spatial-spectral generative adversarial network for hyperspectral image classification

Chao Ma, Minjie Wan, Xiaofang Kong, Xiaojie Zhang, Qian Chen, and Guohua Gu
J. Opt. Soc. Am. A 40(3) 538-548 (2023)

Compressive spectral imaging system for soil classification with three-dimensional convolutional neural network

Yue Yu, Tingfa Xu, Ziyi Shen, Yuhan Zhang, and Xi Wang
Opt. Express 27(16) 23029-23048 (2019)

Compressive hyperspectral image classification using a 3D coded convolutional neural network

Hao Zhang, Xu Ma, Xianhong Zhao, and Gonzalo R. Arce
Opt. Express 29(21) 32875-32891 (2021)

Deep OCT image compression with convolutional neural networks

Pengfei Guo, Dawei Li, and Xingde Li
Biomed. Opt. Express 11(7) 3543-3554 (2020)