Abstract

Human skin classification is an essential task for several machine vision applications such as human-machine interfaces, people/object tracking, and classification. In this paper, we describe a hybrid CMOS/memristor vision sensor architecture embedding skin detection over a wide dynamic range. In-sensor RGB to $rg$-chromaticity color-space conversion is executed on-the-fly through a pixel-level automatic exposure time control. Each pixel of the array delivers two pre-filtered analog signals, the $r$ and $g$ values, suitable for being efficiently classified as skin or non-skin through an analog memristive neural network (NN), without the need for any further signal processing. Moreover, we study the NN performance and theorize how it should be added in the hardware. The skin classifier is organized in an array of column-level memristor-based NN to exploit the nano-scale device characteristics and non-volatile analog memory capabilities, making the proposed sensor architecture highly flexible, customizable for various use-case scenarios, and low-power. The output is a skin bitmap that is robust against variations of the illuminant color and intensity.

© 2024 Optica Publishing Group

Always-on low-power optical system for skin-based touchless machine control

Michela Lecca, Massimo Gottardi, Elisabetta Farella, and Bojan Milosevic
J. Opt. Soc. Am. A 33(6) 1015-1024 (2016)

Effective cross-sensor color constancy using a dual-mapping strategy

Shuwei Yue and Minchen Wei
J. Opt. Soc. Am. A 41(2) 329-337 (2024)

Improving RGB illuminant estimation exploiting spectral average radiance

Ilaria Erba, Marco Buzzelli, Jean-Baptiste Thomas, Jon Yngve Hardeberg, and Raimondo Schettini
J. Opt. Soc. Am. A 41(3) 516-526 (2024)

Nighttime color constancy using robust gray pixels

Cheng Cheng, Kai-Fu Yang, Xue-Mei Wan, Leanne Lai Hang Chan, and Yong-Jie Li
J. Opt. Soc. Am. A 41(3) 476-488 (2024)

Enhancing 3D human pose estimation with NIR single-pixel imaging and time-of-flight technology: a deep learning approach

Carlos Osorio Quero, Daniel Durini, Jose Rangel-Magdaleno, Jose Martinez-Carranza, and Ruben Ramos-Garcia
J. Opt. Soc. Am. A 41(3) 414-423 (2024)