Abstract

To quantify the architecture and select the ideal ideotype, it is vital to accurately measure the dimension of each part of the mantis shrimp. Point clouds have become increasingly popular in recent years as an efficient solution. However, the current manual measurement is labor intensive and costly and has high uncertainty. Automatic organ point cloud segmentation is a prerequisite and core step for phenotypic measurements of mantis shrimps. Nevertheless, little work focuses on mantis shrimp point cloud segmentation. To fill this gap, this paper develops a framework for automated organ segmentation of mantis shrimps from multiview stereo (MVS) point clouds. First, a Transformer-based MVS architecture is applied to generate dense point clouds from a set of calibrated phone images and estimated camera parameters. Next, an improved point cloud segmentation (named ShrimpSeg) that exploits both local and global features based on contextual information is proposed for organ segmentation of mantis shrimps. According to the evaluation results, the per-class intersection over union of organ-level segmentation is 82.4%. Comprehensive experiments demonstrate the effectiveness of ShrimpSeg, outperforming other commonly used segmentation methods. This work may be helpful for improving shrimp phenotyping and intelligent aquaculture at the level of production-ready.

© 2023 Optica Publishing Group

Optical counting platform of shrimp larvae using masked k-means and a side window filter

Kun Qian and Hong-chao Duan
Appl. Opt. 63(6) A7-A15 (2024)

TDNet: transformer-based network for point cloud denoising

Xueli Xu, Guohua Geng, Xin Cao, Kang Li, and Mingquan Zhou
Appl. Opt. 61(6) C80-C88 (2022)

PointCartesian-Net: enhancing 3D coordinates for semantic segmentation of large-scale point clouds

Yuan Zhou, Qi Sun, Jin Meng, Qinglong Hu, Jiahang Lyu, Zhiwei Wang, and Shifeng Wang
J. Opt. Soc. Am. A 38(8) 1194-1200 (2021)

UMA-Net: an unsupervised representation learning network for 3D point cloud classification

Jie Liu, Yu Tian, Guohua Geng, Haolin Wang, Da Song, Kang Li, Mingquan Zhou, and Xin Cao
J. Opt. Soc. Am. A 39(6) 1085-1094 (2022)

Development of a multispectral fluorescence LiDAR for point cloud segmentation of plants

Kexin Zheng, Hongze Lin, Xuekai Hong, Hao Che, Xiaorui Ma, Xiaopeng Wei, and Liang Mei
Opt. Express 31(11) 18613-18629 (2023)