Abstract

Due to the scale ambiguity problem, the performance of monocular depth estimation (MDE) is inherently restricted. Multi-camera systems, especially those equipped with active depth cameras, have addressed this problem at the expense of increased hardware costs and space. In this Letter, we adopt a similar but cost-effective solution using only single-pixel depth guidance with a single-photon avalanche diode. To this end, we design a single-pixel guidance module (SPGM) that combines the global information from the single-pixel depth guidance with the spatial information from the image at the feature level. By integrating SPGMs into an MDE network, we introduce PhoMoNet, the first, to the best of our knowledge, end-to-end MDE network with single-pixel depth guidance. Experimental results show the effectiveness and superiority of PhoMoNet over state-of-the-art MDE networks on synthetic and real-world datasets.

© 2023 Optica Publishing Group

228 × 304 200-mW lidar based on a single-point global-depth d-ToF sensor and RGB-guided super-resolution neural network

Miao Sun, Yifan Wu, Lebei Cui, Hengwei Yu, Jie Li, Jian Qian, Jier Wang, Lei Qiu, Patrick Yin Chiang, and Shenglong Zhuo
Opt. Lett. 48(13) 3415-3418 (2023)

SPADnet: deep RGB-SPAD sensor fusion assisted by monocular depth estimation

Zhanghao Sun, David B. Lindell, Olav Solgaard, and Gordon Wetzstein
Opt. Express 28(10) 14948-14962 (2020)

Image-free single-pixel object detection

Lintao Peng, Siyu Xie, Tong Qin, Lu Cao, and Liheng Bian
Opt. Lett. 48(10) 2527-2530 (2023)

Unsupervised demosaicking network using the recurrent renovation and the pixel-wise guidance

Jinyang Li, Jia Hao, Geng Tong, Shahid Karim, Xu Sun, and Yiting Yu
Opt. Lett. 47(16) 4008-4011 (2022)

DBPFNet: a dual-band polarization image fusion network based on the attention mechanism and atrous spatial pyramid pooling

Yunan Wu, Jun Chang, Ning Ma, Yining Yang, Zhongye Ji, and Yi Huang
Opt. Lett. 48(19) 5125-5128 (2023)