Abstract

Efficient and quick extraction of unknown objects in cluttered 3D scenes plays a significant role in robotics tasks such as object search, grasping, and manipulation. This paper describes a geometric-based unsupervised approach for the segmentation of cluttered scenes into objects. The proposed method first over-segments the raw point clouds into supervoxels to provide a more natural representation of 3D point clouds and reduce the computational cost with a minimal loss of geometric information. Then the fully connected local area linkage graph is used to distinguish between planar and nonplanar adjacent patches. Then the initial segmentation is completed utilizing the geometric features and local surface convexities. After the initial segmentation, many subgraphs are generated, each of which represents an individual object or part of it. Finally, we use the plane extracted from the scene to refine the initial segmentation result under the framework of global energy optimization. Experiments on the Object Cluttered Indoor Dataset dataset indicate that the proposed method can outperform the representative segmentation algorithms in terms of weighted overlap and accuracy, while our method has good robustness and real-time performance.

© 2020 Optical Society of America

Fast and precise 6D pose estimation of textureless objects using the point cloud and gray image

Wang Pan, Feng Zhu, Yingming Hao, and Limin Zhang
Appl. Opt. 57(28) 8154-8165 (2018)

PointCartesian-Net: enhancing 3D coordinates for semantic segmentation of large-scale point clouds

Yuan Zhou, Qi Sun, Jin Meng, Qinglong Hu, Jiahang Lyu, Zhiwei Wang, and Shifeng Wang
J. Opt. Soc. Am. A 38(8) 1194-1200 (2021)

Hyperspectral lidar point cloud segmentation based on geometric and spectral information

Biwu Chen, Shuo Shi, Jia Sun, Wei Gong, Jian Yang, Lin Du, Kuanghui Guo, Binhui Wang, and Bowen Chen
Opt. Express 27(17) 24043-24059 (2019)

Simple and efficient registration of 3D point cloud and image data for an indoor mobile mapping system

Hao Ma, Keke Liu, Jingbin Liu, Hongyu Qiu, Dong Xu, Zemin Wang, Xiaodong Gong, and Sheng Yang
J. Opt. Soc. Am. A 38(4) 579-586 (2021)

Reconstruction-based 6D pose estimation for robotic assembly

Zhongchen Shi, Kai Xu, Zhang Li, Banglei Guan, Gang Wang, and Yang Shang
Appl. Opt. 59(31) 9824-9835 (2020)