Abstract
Temporal focusing multiphoton excitation microscopy (TFMPEM) can rapidly provide 3D imaging in neuroscience; however, due to the widefield illumination and the use of camera detector, the strong scattering of emission photons through biotissue will degrade the image quality and reduce the penetration depth. As a result, TFMPEM images suffers from poor spatial resolution and low signal-to-noise ratio (SNR), burying weak fluorescent signals of small structures such as neurons in calyx part, especially for deep layers under fast acquisition rate. In the study, we present a prediction learning model with depth information to overcome. First, a point-scanning multiphoton excitation microscopy (PSMPEM) image as the gold standard was precisely registered to the corresponding TFMPEM image via a linear affine transformation and an unsupervised VoxelMorph network. Then, a multi-stage 3D U-Net model with cross-stage feature fusion mechanism and self-supervised attention module has been developed to restore shallow layers of drosophila mushroom body under cross-modality training. Furthermore, a convolutional long short-term memory (ConvLSTM)-based network with PhyCell, which is designed to forecast the deeper information according to previous 3D information, is introduced for the prediction of depth information.
© 2023 SPIE
PDF ArticleMore Like This
Xin Qin, Qian Hu, Xiaoli Huo, and Jiuyu Xie
W4G.7 Optical Fiber Communication Conference (OFC) 2023
Chris Xu
SWB1 Optical Sensors (Sensors) 2010
Tzu-Wei Lin, Chia-Yuan Chang, Chun-Yu Lin, and Shean-Jen Chen
BT1A.4 Bio-Optics: Design and Application (BODA) 2015