Abstract

Spectral sensitivity is largely related to sensor imaging, which has drawn widespread attention in computer vision. Accurate estimation becomes increasingly urgent because manufacturers rarely disclose it. In this Letter, we present a novel, compact, inexpensive, and real-time computational system for snapshot spectral sensitivity estimation. A multi-scale camera based on the multi-scale convolutional neural network is first proposed, to the best of our knowledge, to automatically extract multiplexing features of an input image by multiscale deep learning, which is vital to solving the inverse problem in sensitivity estimation. Our network is flexible and can be designed with different convolutional kernel sizes for a given application. We build a dataset with 10,500 raw images and generate an excellent pre-trained model. Commercial cameras are adopted to test model validity; the results show that our system can achieve estimation accuracy as high as 91.35%. We provide a method for system design, propose a deep learning network, build a dataset, demonstrate training process, and present experimental results with high precision. This simple and effective method provides an accurate approach for precise estimation of spectral sensitivity and is suitable for computational applications such as pathological digital stain, virtual/augmented reality display, and high-quality image acquisition.

© 2021 Optical Society of America

CVNet: confidence voting convolutional neural network for camera spectral sensitivity estimation

Tianyue He, Qican Zhang, Mingwei Zhou, and Junfei Shen
Opt. Express 29(13) 19655-19674 (2021)

Deep-learning-based adaptive camera calibration for various defocusing degrees

Jing Zhang, Bin Luo, Zhuolong Xiang, Qican Zhang, Yajun Wang, Xin Su, Jun Liu, Lu Li, and Wei Wang
Opt. Lett. 46(22) 5537-5540 (2021)

Deep-learning-based approach for strain estimation in phase-sensitive optical coherence elastography

Bo Dong, Naixing Huang, Yulei Bai, and Shengli Xie
Opt. Lett. 46(23) 5914-5917 (2021)

Direct object detection with snapshot multispectral compressed imaging in a short-wave infrared band

Naike Wei, Yingying Sun, Tingting Jiang, and Qiong Gao
Opt. Lett. 49(8) 1941-1944 (2024)

Snapshot temporal compressive microscopy using an iterative algorithm with untrained neural networks

Mu Qiao, Xuan Liu, and Xin Yuan
Opt. Lett. 46(8) 1888-1891 (2021)