Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Underwater active polarization descattering based on a single polarized image

Open Access Open Access

Abstract

Active polarization imaging techniques have tremendous potential for a variety of underwater applications. However, multiple polarization images as input are necessary for almost all methods, thereby limiting the range of applicable scenarios. In this paper, via taking full advantage of the polarization feature of target reflective light, the cross-polarized backscatter image is reconstructed via introducing an exponential function for the first time, only based on mapping relations of co-polarized image. Compared with rotating the polarizer, the result performs a more uniform and continuous distribution of grayscale. Furthermore, the relationship of degree of polarization (DOP) between the whole scene and backscattered light is established. This leads to an accurate estimation of backscattered noise and high-contrast restored images. Besides, single-input greatly simplifies the experimental process and upgrades efficiency. Experimental results demonstrate the advancement of the proposed method for objects with high polarization under various turbidities.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Due to the striking advantages of high sensitivity, fast imaging speed, and high spatial resolution, underwater optical imaging technologies have been widely used in re-source exploration, fishery monitoring, underwater archaeology, and underwater warfare [13]. However, the image quality is often severely degraded by the scattering and absorption effects in scattering mediums, which results from the nonuniform distribution of the intensity or polarization properties [47]. With further technological developments, polarization imaging shows great application potential, several studies have shown remarkable improvement by mining the uniqueness and difference of the polarization information of the scattered light field. At the same time, the new polarization regulation technology with plasmonic nanostructures array and metasurfaces [8,9] provided more possibilities for imaging miniaturization and integrated applications. For better utilization of polarization features, Schechner et al. presented a passive underwater polarization imaging model in 2005 [10], this is the first study to introduce underwater image formation model for descattering. Then some recent works, including the polarization parameter optimization by the network [11], and polarization descattering without prior knowledge [12] in response to more improvements. The effectiveness of these optimizations is proven by massive experimental results. To adapt to deep underwater dark environments, the introduction of an active light source can reduce the effect of absorption and modulate the incident polarization signal. Treibitz [13] et al. proposed an active polarization descattering model in turbid water to further improve the imaging contrast and clarity. Furthermore, the correlation parameter PCE (Peak-to-correlation energy) was applied to determine the brightest and darkest polarization images [14,15], which is meaningful to obtain accurate polarization parameters, but one limitation is time-consuming. On the other hand, to meet different types of targets and improve imaging quality, Li [16] et al. put forward underwater image restoration approach via Stokes decomposition, this method requires orthogonal polarization illuminations. Wei [17] et al. deduced the DOP and angle of polarization (AOP) by exploiting Stokes vectors, besides, the nonuniform of polarization information was also considered [18]. Zhao [19] et al. obtained the DOP of target and backscattered light based on a genetic algorithm but ignored the difference in global pixel positions. In addition, Hu [11,20] et al. firstly introduced deep learning to recover polarimetric underwater images. After that, a physics-informed neural network [21] and light weight convolutional neural network [22] were further used to obtain clear de-scattered images. It is worth noting that some algorithms based on Mueller matrix [23,24] and polarimetric purity excellent metrics [25] all show excellent effect in identification. It can be found from the implementation process of previous methods that multiple polarization images needing to be as input to obtain the brightest and darkest orthogonal polarized images, Stokes vectors images, or training data, which means the process of acquiring images is complicated and time-consuming. Therefore, further simplifying the acquisition process of polarization imaging and ensuring imaging clarity are what we expect.

By mining the polarization feature of target and backscattered light, the brightest backscatter image is reconstructed through a fitting method based on moving least squares, and the darkest backscatter image is also obtained by introducing an exponential function, only based on a co-polarized image. These measures avoid the influence of non-uniformity from the light source and polarization state analyzer (PSA). Meanwhile, we establish the link of DOP between the whole scene and backscattered information, finally obtaining more accurate DOP spatial information of backscattered noise. Furthermore, via introducing image quality feedback parameter contrast, a wonderful recovery result is achieved. Compared with other approaches available in terms of imaging process, the proposed method only needing single-input improves efficiency of decattering. Finally, the feasibility and the superiority are also verified by actual imaging experiments. More importantly, our method provides a novel notion for polarization descattering imaging, particularly for reflective targets with polarization.

2. Active polarization descattering based on a single polarized image

2.1 Theory

Regarding physical modeling, underwater optical images are composed of the target, the forward scattered, and the backscattered information [13]. Ignoring the forward scatter part of the total signal which is responsible for image blurring, the total intensity $I(x,y)$ can be described as:

$$I\textrm{(}x, y\textrm{) = }D\textrm{(}x, y\textrm{) + }B\textrm{(}x, y\textrm{)}$$
Where $D(x,y)$ is the target information, and $B(x,y)$ corresponds to the backscattered information. The cross-linear polarized image is gated with a given polarization illumination and detection in the orthogonal state. A co-linear polarized mage is also obtained with detection in the same state as the illumination. The brightest image ${I_{\max }}(x,y)$ and the darkest image ${I_{\min }}(x,y)$ are corresponding to the co-linear and the cross-linear polarization respectively, and expressed as:
$${I_{\max }}(x,y) = {D_{\max }}(x,y) + {B_{\max }}(x,y)$$
$${I_{\min }}(x,y) = {D_{\min }}(x,y) + {B_{\min }}(x,y)$$

The intensity of target and the backscattered light can be expressed as:

$$D(x,y) = {D_{\max }}(x,y) + {D_{\min }}(x,y)$$
$$B(x,y) = {B_{\max }}(x,y) + {B_{\min }}(x,y)$$

The degree of linear polarization (DOLP) of the whole scene image can be described as:

$$\textrm{DOLP} = \frac{{{I_{\max }}(x,y) - {B_{\min }}(x,y)}}{{{I_{\max }}(x,y) + {B_{\min }}(x,y)}}$$

The degree of linear polarization (DOLP) of target and backscattered information can be described as:

$${p_{\textrm{D }}}(x,y) = \frac{{{D_{\max }}(x,y) - {D_{\min }}(x,y)}}{{{D_{\max }}(x,y) + {D_{\min }}(x,y)}}$$
$${p_{\textrm{B }}}(x,y) = \frac{{{B_{\max }}(x,y) - {B_{\min }}(x,y)}}{{{B_{\max }}(x,y) + {B_{\min }}(x,y)}}$$

2.2 Brightest and darkest backscatter images

The spatial distribution of the brightest backscatter ${B_{\max }}$ and the darkest backscatter ${B_{\min }}$ are vital for obtaining the DOP of backscattering. Therefore, we try to find the law of backscattered light in orthogonal polarization analysis by experiments, and the setup is depicted in Fig. 1. The light source utilized is an LD Laser emitting at a wavelength of 532 nm. The emitted light is collimated through a beam expander before passing through a polarization state generator (PSG) to produce a linearly polarized light beam with a horizontal orientation. The acquisition of polarized images is facilitated by a rotatable polarization state analyzer (PSA) in conjunction with an 8-bit digital monochrome CCD camera.

 figure: Fig. 1.

Fig. 1. Schematic diagram of underwater polarization imaging experimental device

Download Full Size | PDF

The turbid water was contained within a high-permeability glass sink, and the walls are covered with black light-absorbing material to reduce the impact of specular reflection. The choice of skim milk as a turbid solute is motivated by its widespread use as a simulation of turbid aquatic environments in prior studies [18]. According to Mie scattering theory, the scattering coefficient in the case of independent scattering is affected by the particle sizes and scatterer concentration. So, the adjustment of scattering effect can be achieved by controling the volumes of milk solution. With regard to the targets, the differences between reflective objects and diffuse objects are mainly reflected in the direction and polarization of the reflected signal. Most of specular reflected light is the same polarization as the incident light for highly reflective targets [26]. While the signal reflected from diffuse target is transformed into other linear polarization, elliptical polarization, and partial polarization light, and the propagation direction is random [27]. Here, we selected metal signs and smooth transfer labels, which perform polarization-maintain and reflection characteristics. Besides, the turbid water with four turbidities (from 140 ml to 200 ml) was also used to simulate different scattering environments. As shown in Fig. 2(a)-(d) of two types object, it can be found that target information is fully preserved in co-polarized images, while cross-polarized image contains nothing. Meanwhile, as the scattering is exacerbated, the target information in co-polarized image is gradually covered by noise light.

 figure: Fig. 2.

Fig. 2. The co-polarized and cross-polarized images with two types of targets under different turbidities (a) co-polarized images of metal sign (b) cross-polarized images of metal sign (c) co-polarized images of transfer lable (d) cross-polarized images of transfer lable. The adding amount of skimmed milk is 140 ml, 160 ml, 180 ml, and 200 ml respectively

Download Full Size | PDF

Considering the distribution law of backscattered and target light in the full scene, we introduced location sampling to explore the variation of the gray value. For the target scenario of metal signs, we drew red and blue horizontal solid lines in the background (BG) and target area (TA) of co-polarized images respectively, as shown in Fig. 2(a). Meanwhile, the red and blue horizontal dotted lines were marked in cross-polarized images to distinguish differences, as shown in Fig. 2(b). Then, to verify the randomness of gray value distribution, the direction of the red and blue lines were taken as vertical in the target scenario of transfer lable, as can be seen in Fig. 2(c) and (d). Then, the grayscale values lying on the lines of the images were captured and then processed through Matlab ‘loess’ local regression, doing so is more conducive to analyzing trends.

As given in Fig. 3(a) and (b), for the lowly scattering environment, the gray appears a more drastic trend in the target area of co-polarized images than in the background area due to direct reflected light from the target. On the contrary, the brightness after cross-polarized analysis is weak and the curves are flat to the approximate level. The reason for this is that less scattering cannot fully convert backscattered light to cross-polarization direction. With more scattering, it can be seen from the 140ml-column images of Fig. 3 that the variation of the red and blue solid curve tends to be flattened, and the gradient of curves change is gradually consistent. The phenomenon mainly stems from the fact that a large amount of backscattered noise is not fully filtered out. Besides, we also find that the intensity of the cross-polarized image is higher compared with lowly scattering. Other than this, there is an interesting phenomenon, the grayscale values of cross-polarized target area and cross-polarized background are approximately coincident, as shown in the red and blue dotted curves of Fig. 3, especially in highly scattering.

 figure: Fig. 3.

Fig. 3. The approximate varying trend of gray value with co-polarized and cross-polarized images under different scattering effects. (a) metal sign as the target (b) transfer lable as the target. The adding amount of skimmed milk is 140 ml, 160 ml, 180 ml, and 200 ml respectively.

Download Full Size | PDF

Based on experimental results, the intensity of target light can be further expressed as:

$$D(x,y) \approx {D_{\max }}(x,y)$$

So, the total intensity of the full scene is:

$$I(x,y) = {I_{\max }}(x,y) + {I_{\min }}(x,y) = {I_{\max }}(x,y) + {B_{\min }}(x,y)$$

Since the total backscattered light is continuously distributed in space, the data of local background area is usually used for surface fitting based on the least squares method in previous studies, ignoring the discrete data contained in the target area [28]. Besides, the selection of the combined area maybe causes discontinuous surface and low smoothness, resulting in estimation errors. We adopt the moving least squares method (MLS) [29], where the weight function is defined through the introduction of compact support. The ${B_{\max }}(x,y)$ is reconstructed, and the approximation function expression is expresses as Eq. (11) and (12).

$${\hat{B}_{\max }}(x,y) = \sum\limits_{mov = 1}^m {{p_{\textrm{mov}}}} (x,y){a_{mov }}(x,y) = {p^T}(x,y)a(x,y)\quad x,y \in \sum$$
$$p{(x,\textrm{y})^T} = {[1,x,y]^\textrm{T}},\quad m = 3$$

As in Eq. (11), the $p(x,y) = {[{p_1}({x_i},{y_i}),{p_2}({x_i},{y_i}),{p_3}({x_i},{y_i})]^T}$ a basis function, which is a k-order complete polynomial. The m is the number of terms of the basis function. Where $a(x,y) = {[{a_1}({x_i},{y_i}),{a_2}({x_i},{y_i}),{a_3}({x_i},{y_i})]^T}$ is the coefficient to be solved is a function of (x, y), it can be obtained from weighted least squares fitting of local approximation as Eq. (13). The J is a defined fonctionelle that requires a minimum value and the w is weight function with compact support property.

$$J = \sum\limits_{i = 1}^n w \left( {\sqrt {{{({x - {x_i}} )}^2} + {{({y - {y_i}} )}^2}} } \right){\left[ {\sum\limits_{\textrm{mov } = 1}^m {{p_{\textrm{mov }}}} ({{x_i},{y_i}} )\cdot {a_{mov}}(x,y) - {{\hat{B}}_{\max }}({{x_i},{y_i}} )} \right]^2}$$

The data collection $\Sigma $ includes the continuous data of the background region and the discrete data which are the dark pixels of the target area. Here, the delineation of target and background regions is achieved by adopting histogram stretching to the co-polarized image, which expands the difference between foreground and background gray levels [30].

As we know, the LD source shows Gaussian characteristics during transmission in scattering medium. Meanwhile, it can be seen from Fig. 3 that the non-uniform of cross-polarized backscatter is similar to that of co-polarized image and the trend of grayscale values changing with position is consistent. Thereforce, we considered the cross-polarized backscatter image can be constructed based on mapping relations about the co-polarized image as the input image. Based on the above analysis and precedent of an exponential function used to reconstruct polarization information [31], introducing a relationship between ${B_{\min }}(x,y)$ and ${B_{\max }}(x,y)$ through an exponential function is a feasible approach. It can be expressed as Eq. (14).

$${\hat{B}_{\min }}(x,y) = b \cdot \textrm{exp} (b \cdot {\hat{B}_{\max }}/255) \cdot 255$$

The ${\hat{B}_{\max }}/255$ is transformed to (0, 1) and can be used to simulate the non-uniform distribution, and the b is the coefficient to be optimized. Thereby, the mapping relation based on ${B_{\max }}(x,y)$ is established. It is worth noting that the ${B_{\min }}(x,y)$ should satisfy the following Eq. (15):

$$\left\{ \begin{array}{l} 0 < b < 1\\ \max ({{\hat{B}}_{\min }}(x,y)) < \min ({{\hat{B}}_{\max }}(x,y)) \end{array} \right.$$

The boundary condition for the coefficient b is (0, 1) and the maximum value of ${B_{\min }}(x,y)$ should be less than the minimum value of ${B_{\max }}(x,y)$.

2.3 Estimation and removal of backscattered light

By reconfiguring the brightest backscatter and the darkest backscatter image, according to Eq. (6) and (9), the DOLP of the whole scene can also be expressed:

$$\textrm{DOLP} = \frac{{{D_{\max }}(x,y) + ({B_{\max }}(x,y) - {B_{\min }}(x,y))}}{{{D_{\max }}(x,y) + ({B_{\max }}(x,y) + {B_{\min }}(x,y))}}$$

It can be obtained from Eq. (8) that

$${p_B}(x, y) = \textrm{DOLP} - \frac{{{I_{\max }} - {{\hat{B}}_{\max }}}}{{{{\hat{B}}_{\max }} + {{\hat{B}}_{\min }}}}(1 - \textrm{DOLP})$$

The function relationship of degree of linear polarization (DOLP) between the whole scene and backscattered information is established, as shown in Eq. (17). According to the definition of degree of polarization, the values of DOLP are always less than 1. Meanwhile, the ${I_{\max }}(x,y)$ is always greater than ${\hat{B}_{\max }}(x,y)$. From this, it can be deduced as:

$$\left\{ \begin{array}{l} {p_B}(x,y) = \textrm{DOLP}(x,y),\textrm{ }(x,y) \in \textrm{background}\\ {p_B}(x,y) < \textrm{DOLP}(x,y),\textrm{ }(x,y) \in \textrm{target - area} \end{array} \right.$$

It can be noted that the distribution ${p_B}(x,y)$ and $\textrm{DOLP}(x,y)$ is consistent at background area, while the ${p_B}(x,y)$ is less than DOLP that of the full scene at target area.

Based on Eq. (2), Eq. (3), Eq. (7), and (8) and ${p_B}(x, y)$, this leads to the expression for the target estimation $D$ without backscattered noise as Eq. (19).

$$D = {\hat{B}_{\min }} \cdot \frac{{({{p_{\textrm{B }}} + 1} )}}{{({p_{\textrm{B }}} - 1)}} + {I_{\max }}$$

According to Eq. (19), the target information $D$ can be restructured only from one measurement ${I_{\max }}$, for highly reflective target, the degree of linear polarization (DOLP) of target ${p_D} \simeq 1$.

It can be seen from Eq. (19) that ${\hat{B}_{\min }}$ affects the descattering of final target information. Therefore, considering the effect to express the details, the widely used underwater image evaluation parameter contrast is selected [10,32] as a feedback parameter, the calculation process is as follows Eq. (20).

$$\textrm{contrast} = \frac{\sigma }{{\bar{I}}} = \frac{{\sqrt {\frac{1}{{M \times N}}\sum\limits_{i = 1}^M {\sum\limits_{j = 1}^N {{{[{I(i,j) - \bar{I}} ]}^2}} } } }}{{\frac{1}{{M \times N}}\sum\limits_{i = 1}^M {\sum\limits_{j = 1}^N {I(i,j)} } }}$$
where $\bar{I}$ is the average gray value of the pixels in the whole image, $\sigma $ is the standard deviation, M${\times} $N represents the size of the image, and I (i, j) is the gray value of the pixel located at (i, j).

The optimal coefficient b is restricted through Eq. (14) and (18), and then the target image D with minimal noise light is finally obtained by iterative calculation. In this work, only the co-polarized image with the incident polarization direction is necessary for recovery instead of obtaining a set of orthogonal polarized images or Stokes vectors images. The flowchart of underwater polarization descattering is shown in Fig. 4.

 figure: Fig. 4.

Fig. 4. Flowchart of underwater polarization reconstruction based on the input of a single polarized image

Download Full Size | PDF

3. Results and discussion

3.1 Estimation of the DOLP of backscattered light

As shown in Fig. 5, we conducted polarization imaging experiments with smooth coin in strongly scattering water, the aim is to make a comparison between two methods used to obtain cross-polarized image. One is obtained via rotating the polarizers and the other is fitting based on co-polarized image as in Eq. (14). It can be seen from Fig. 5(a) that the grayscale values exhibit a high degree of dispersion in cross-polarized images because of rotating the polarizer, and the maximum difference of grayscale value under different pixels is greater than 4. The reason is that the polarization direction of backscattered light is mostly concentrated at a small angle near the incident polarization direction. On the other hand, the inconsistency of the camera's response to weak signals and the non-uniformity of light sources also leads to discrete data in background. On the contrary, the gray distribution of cross-polarized image via fitting in our method is more continuous as Fig. 5(b), which overcomes the impact of non-uniformity.

 figure: Fig. 5.

Fig. 5. Comparison of key parameters during target image restoration (a) 3D mesh of cross-polarized image by rotating the polarizers (b) 3D mesh of cross-polarized image by fitting in our method (c) 3D mesh of DOLP in full scene (d) 3D mesh of ${p_B}(x,y)$(e) the target image via classic descattering model [13] (f) the recovered image through our method. The additional amount of skimmed milk is 220 ml.

Download Full Size | PDF

For active polarization descattering model, the background areas of the co-polarized and cross-polarized images are selected to obtain the DOLP of the backscattered light [13], which is usually assumed to be a constant. However, it can be noted from Fig. 5(c) that the difference of DOLP values in the diagonal background area comes to 0.1. As a consequence, determining the optimal DOLP of backscattered light becomes difficult. In addition, the discontinuity from cross-polarized images as in Fig. 5(c) will also lead to the appearance of an annular shielding area in the recovered target image as shown in Fig. 5(e). In contrast, as shown in Fig. 5(d), the DOLP distribution of backscattered light is more continuous in the full area and the result in Fig. 5(f) also proves that our method can effectively recover the target information.

3.2 Qualitative comparison for recovered images

Underwater descattering techniques that have been developed to restore the image quality can be classified into two categories, non-physical and physical model-based methods [7]. The classic active polarization imaging methods [13] (Treibitz) and revised polarization imaging model based on Stokes parameters [17] (Wei) belong to the second class. Contrast limited adaptive histogram equalization (CLAHE) [33] belongs to the first class. These methods are classic and representative. Where CLAHE and our method only require the input of a single image, Treibitz’s and Wei’s methods both require more than two polarized images as inputs. To verify the feasibility of the proposed method, the target selected in the experiments is a stainless steel metal sign with a smooth finish, imaging experiments were carried out in lowly and highly scattering water by adding different volumes of skim milk.

As shown in Fig. 6, at lowly scattering environment, the target information of intensity imaging is partially lost. Wei’s and our method show better contrast, which is reflected in the black-and-white contrast between the letters and the background. However, there exist some difference, which is incarnated in that the proposed method has a purer black background. It is mainly derived from precise estimation of backscattered light. Although, the other two methods show an improved effect, the image is still covered with a layer of mist. At highly scattering environment, the intensity image is completely submerged by noise light, and the target image enhanced by CLAHE method is ambiguous. Through Treibitz’s method, the restored results demonstrate better imaging contrast, but there are extremely low brightness values in local areas. The reason for this phenomenon is the DOLP estimation of the local pixel exceeds the actual value. Besides, via Wei’s method, the brightness of the whole scene image is more uniform than other approaches, but the background noise is not well removed. In contrast, our method filters out stray light in background areas and restores the target information well.

 figure: Fig. 6.

Fig. 6. Restoration results of different underwater imaging methods and comparison of local features (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is a stainless steel metal sign with a smooth finish

Download Full Size | PDF

The effect of recovering local details is typically characterized the advancement of imaging methods. Taking the letter “XJTU” in target as an example, from the enlarged image of local details, it can be concluded that noise is growing with the superposition of scattering. For other polarization imaging methods, including Treibitz’s and Wei’s methods, the imaging performance is satisfactory at lowly scattering, but more scattering would destabilize the imaging stability. It is reflected in the boundary of the target letter is no longer clear. Despite this, the black letters “XJTU” on the sign can be distinguished and fits well to its shape with our method. Meanwhile, it is worth noting that the attenuation of target information is exacerbated due to scattering, finally reflected in a small amount of noise in the restored image.

3.3 Suppression effect of noise light for different methods

The major reason for the decline of imaging contrast is the spatial aliasing of noise light and target light. Therefore, the suppression effect of noise under fully retaining target information is a reasonable measure of underwater imaging methods. We continued to select the rectangular laboratory sign as the target and conducted experiments in two scattering environments same as in section 3.2. Making a comparison with the final results via different methods, it can be seen that good imaging clarity is still maintained well by our method, and the characteristics of the elements stand out and are easy to identify as shown in Fig. 7.

 figure: Fig. 7.

Fig. 7. Restoration results of different underwater imaging methods (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is a rectangular laboratory sign.

Download Full Size | PDF

In order to characterize the resolution ability of the target elements more intuitively, the four letters “XJTU” in the upper part of the target in Fig. 7 were chosen as the feature area, and we made a horizontal midline to discover the gray value distribution. The results are shown in Fig. 8(a) and (b), from which it can be observed that the ratio of the peak to the trough of the quasi-rectangular wave represents the degree of noise filtering. Under lowly scattering, as shown in Fig. 8(a), due to black letters, the different peak of the rectangular wave is consistent through Wei’s and our method. However, the maximum peak-to-valley ratio with our method is more than 6 times, and Wei’s method achieves more than 2 times, much higher than other methods. Under highly scattering, for intensity imaging or CLAHE methods, it can be observed from Fig. 8(b) that the curves can be hardly observed the peak-to-valley changes of the rectangular wave, which means that the target information has been approximately submerged. On the contrary, the remaining three methods all achieve the discrimination between black letters and white background, but the peak-to-valley ratio of our method is the highest. Besides, the brightness uniformity of the target image with Wei’s method is best, and the effect of our method is second only to it.

 figure: Fig. 8.

Fig. 8. The pixel gray value with the spatial position in horizontal midline (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is an ectangular laboratory sign. At the top of the figure, we give the pseudo-color image of the sample target images corresponding to the pixel position of the curve

Download Full Size | PDF

It should be noted that there is no comprehensive evaluation criterion for image quality, with subjective judgment required in most cases. No-reference evaluation metrics are used to characterize the imaging quality, and then we calculated the value of the measure of, contrast [34], the underwater image sharpness measure (UISM), and the underwater image quality measure (UIQM) according to Eq. (21)–(24) [2].

$$\textrm{UISM} = \sum\limits_{c = 1}^3 {{\lambda _c}} \textrm{EME}$$
$$\textrm{EME} = \frac{2}{{{k_1}{k_2}}}\sum\limits_{l = 1}^{k1} {\sum\limits_{k = 1}^{{k_2}} {\log } } \left( {\frac{{{I_{\max ,k,l}}}}{{{I_{\min ,k,l}} + q}}} \right)$$
$$\textrm{UIConM} = \frac{1}{{{k_1}{k_2}}} \otimes \sum\limits_{l = 1}^{{k_1}} {\sum\limits_{k = 1}^{{k_2}} {\frac{{{I_{\max ,k,l}}\Theta {I_{\min ,k,l}}}}{{{I_{\max ,k,l}} \oplus {I_{\min ,k,l}}}}} } \times \log \left( {\frac{{{I_{\max ,k,l}}\Theta {I_{\min ,k,l}}}}{{{I_{\max ,k,l}} \oplus {I_{\min ,k,l}}}}} \right)$$
$$\textrm{UIQM} = {c_1} \times \textrm{UISM} + {c_2} \times \textrm{UIConM}$$
Where c1 = 0.2953 and c2 = 3.5753 are the results of multiple linear regression.

As shown in Table 1, Treibitz’s and our method both achieve better imaging contrast, and our method is the highest, which represents an advantage in backscattered noise suppression. Wei’s method and the proposed method perform better human eye vision. It is reflected in the maximum image sharpness (UISM) and image quality (UIQM) with our method. This comparison further proves that the proposed method can handle scattering noise problems in underwater imaging and improve vision. More importantly, a single polarized image as input significantly promotes the efficiency of imaging.

Tables Icon

Table 1. Using contrast, UISM, UIQM to evaluate the results of different methods, the higher the score, the better the enhancement effect

3.4 Influence of turbidity on recovered image

Considering the influence of turbidity on the imaging, the volume of skim milk changing from 140 ml to 220 ml at 20 ml intervals is simulate different scattering effect. To ensure the credibility of the experiments, the observed target is replaced by signs with small holes and small letters. These features of target are conducive to measure the clarity of the image. Here, intensity imaging is used as a reference, and contrast is regarded as an imaging evaluation parameter. The curves of the imaging contrast with intensity imaging, Treibitz’s active descattering, and our imaging method under different turbidities are shown in Fig. 9. Meanwhile, to more intuitively reflect the imaging clarity of the results as the scattering intensifies, the recovered images are added below the corresponding curve.

 figure: Fig. 9.

Fig. 9. The contrast of target images with intensity imaging, Treibitz‘s and our method under different turbidity

Download Full Size | PDF

The results show that backscattered noise is gradually increasing due to multiple scattering as the skim milk rises. This leads to a reduction in imaging contrast for all three imaging methods. However, it is worth noting that the magnitude of the decline is different. Intensity imaging contrast always far lower than other imaging methods, especially at 180 ml, target information is completely overwhelmed. The enhancement with Treibitz’s imaging method is also limited at different levels of scattering. A major reason is that multiple scattering causes errors in estimating the polarization of backscattered light. In contrast, the proposed method is the most effective, especially, the small hole of metal sign is visible in the recovered images. Besides, under highly scattering environment, such as 220 ml, the overall brightness of the final restoration results of our method and Treibitz’s methods both darken. The cause for this is the loss of target information that the detector can receive, mainly derived from transport attenuation. On the whole, the developed method presents robustness to the water turbidity increase.

4. Conclusion

In this study, a novel underwater polarization desacttering method based on a single polarization image is developed. Based on the polarization feature of target reflected light, we adopt histogram stretching to input image and obtain co-polarized backscatter image via MLS method. Meanwhile, the spatial distribution of cross-polarized backscatter image is reconstructed through introducing a specific exponential function based on mapping relations. These measures overcome the challenges posed by non-uniform due to illumination and PSA. Furthermore, the link of degree of polarization between the whole scene and backscattered information is established, which leads to the removal of backscattered noise and higher contrast target images. Compared with previous methods, single-input simplifies the polarization imaging process and is suitable for practical imaging scenarios. The experiment results under various turbidities conditions, with variety of target types, demonstrate the effectiveness and superiority of the proposed method.

The reflective polarization feature of targets is considered as polarization maintaining or depolarizing in the current study. Fully combining the specific polarization characteristics of the target is the direction of our future study.

Funding

National Natural Science Foundation of China (61890961, 62127813, 62201568); Natural Science Basic Research Program of Shaanxi Province (2018JM6008, 2022JQ-693).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. J. S. Jaffe, “Underwater Optical Imaging: The Past, the Present, and the Prospects,” IEEE J. Oceanic Eng. 40(3), 683–700 (2015). [CrossRef]  

2. K. A. Panetta, E. J. Wharton, and S. S. Agaian, “Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure,” IEEE Trans. Syst., Man, Cybern. B 38(1), 174–188 (2008). [CrossRef]  

3. J. Watson, “Underwater visual inspection and measurement using optical holography,” Opt. Lasers Eng. 16(4-5), 375–390 (1992). [CrossRef]  

4. F. Liu, P. Han, Y. Wei, K. Yang, S. Huang, X. Li, G. Zhang, L. Bai, and X. Shao, “Deeply seeing through highly turbid water by active polarization imaging,” Opt. Lett. 43(20), 4903–4906 (2018). [CrossRef]  

5. R. Schettini and S. Corchs, “Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods,” EURASIP J. Adv. Signal Process. 2010(1), 746052 (2010). [CrossRef]  

6. J. K. Lotsberg and J. J. Stamnes, “Impact of particulate oceanic composition on the radiance and polarization of underwater and backscattered light,” Opt. Express 18(10), 10432–10445 (2010). [CrossRef]  

7. X. B. Li, Y. L. Han, H. Y. Wang, T. G. Liu, S. C. Chen, and H. F. Hu, “Polarimetric Imaging Through Scattering Media: A Review,” Front. Physiol. 10, 24 (2019). [CrossRef]  

8. J. Wei, Y. Chen, Y. Li, W. Li, J. Xie, C. Lee, K. S. Novoselov, and C.-W. Qiu, “Geometric filterless photodetectors for mid-infrared spin light,” Nat. Photonics 17(2), 171–178 (2023). [CrossRef]  

9. N. A. Rubin, A. Zaidi, A. H. Dorrah, Z. J. Shi, and F. Capasso, “Jones matrix holography with metasurfaces,” Sci. Adv. 7(33), 7488 (2021). [CrossRef]  

10. Y. Y. Schechner and N. Karpel, “Recovery of Underwater Visibility and Structure by Polarization Analysis,” IEEE J. Oceanic Eng. 30(3), 570–587 (2005). [CrossRef]  

11. H. Hu, Y. Zhang, X. Li, Y. Lin, Z. Cheng, and T. Liu, “Polarimetric underwater image recovery via deep learning,” Opt. Lasers Eng. 133, 106152 (2020). [CrossRef]  

12. H. Wang, H. Hu, J. Jiang, X. Li, W. Zhang, Z. Cheng, and T. Liu, “Automatic underwater polarization imaging without background region or any prior,” Opt Express 29(20), 31283–31295 (2021). [CrossRef]  

13. T. Treibitz and Y. Y. Schechner, “Active polarization descattering,” IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 385–399 (2009). [CrossRef]  

14. P. Han, F. Liu, Y. Wei, and X. Shao, “Optical correlation assists to enhance underwater polarization imaging performance,” Opt. Lasers Eng. 134, 106256 (2020). [CrossRef]  

15. H. Zhang, M. Ren, H. Wang, J. Yao, and Y. Zhang, “Fast processing of underwater polarization imaging based on optical correlation,” Appl. Opt. 60(15), 4462–4468 (2021). [CrossRef]  

16. X. Liu, X. Li, and S.-C. Chen, “Enhanced polarization demosaicking network via a precise angle of polarization loss calculation method,” Opt. Lett. 47(5), 1065–1068 (2022). [CrossRef]  

17. Y. Wei, P. Han, F. Liu, and X. Shao, “Enhancement of underwater vision by fully exploiting the polarization information from the Stokes vector,” Opt. Express 29(14), 22275–22287 (2021). [CrossRef]  

18. Y. Wei, P. Han, F. Liu, and X. Shao, “Estimation and removal of backscattered light with nonuniform polarization information in underwater environments,” Opt. Express 30(22), 40208–40220 (2022). [CrossRef]  

19. Y. Z. Zhao, W. J. He, H. Ren, Y. H. Li, and Y. G. Fu, “Polarization descattering imaging through turbid water without prior knowledge,” Opt. Lasers Eng. 148, 106777 (2022). [CrossRef]  

20. X. B. Li, L. Yan, P. F. Qi, L. P. Zhang, F. Goudail, T. G. Liu, J. S. Zhai, and H. F. Hu, “Polarimetric Imaging via Deep Learning: A Review,” Remote Sens. 15(6), 1540 (2023). [CrossRef]  

21. H. F. Hu, Y. L. Han, X. B. Li, L. B. Jiang, L. Che, T. G. Liu, and J. S. Zhai, “Physics-informed neural network for polarimetric underwater imaging,” Opt. Express 30(13), 22512–22522 (2022). [CrossRef]  

22. Q. M. Ren, Y. F. Xiang, G. C. Wang, J. Gao, Y. Wu, and R. P. Chen, “The underwater polarization dehazing imaging with a lightweight convolutional neural network,” Optik 251, 168381 (2022). [CrossRef]  

23. F. Liu, S. C. Zhang, P. L. Han, F. Y. Chen, L. Zhao, Y. Y. Fan, and X. P. Shao, “Depolarization index from Mueller matrix descatters imaging in turbid water,” Chin. Opt. Let. 20(2), 111101 (2022).

24. H. Wang, H. Hu, J. Jiang, J. Li, X. Li, W. Zhang, Z. Cheng, and T. Liu, “Polarization differential imaging in turbid water via Mueller matrix and illumination modulation,” Opt. Commun. 499, 127274 (2021). [CrossRef]  

25. X. B. Li, L. P. Zhang, P. F. Qi, Z. W. Zhu, J. U. Xu, T. G. Liu, J. S. Zhai, and H. F. Hu, “Are Indices of Polarimetric Purity Excellent Metrics for Object Identification in Scattering Media?” Remote Sens. 14(17), 4148 (2022). [CrossRef]  

26. X. Ni and R. Alfano, “Time-resolved backscattering of circularly and linearly polarized light in a turbid medium,” Opt. Lett. 29(23), 2773–2775 (2004). [CrossRef]  

27. H. Li, J. Zhu, J. Deng, F. Guo, J. Sun, Y. Zhang, and X. Hou, “Influence mechanism of the particle size on underwater active polarization imaging of reflective targets,” Opt. Express 31(5), 7212–7225 (2023). [CrossRef]  

28. H. Hu, L. Zhao, X. Li, H. Wang, and T. Liu, “Underwater Image Recovery Under the Nonuniform Optical Field Based on Polarimetric Imaging,” IEEE Photonics J. 10(1), 1–9 (2018). [CrossRef]  

29. R. Scitovski, Š. Ungar, and D. Jukić, “Approximating surfaces by moving total least squares method,” Appl. Math. Comput. 93(2-3), 219–232 (1998). [CrossRef]  

30. K. Zuiderveld, “Contrast Limited Adaptive Histogram Equalization,” Graphics Gems, 474–485 (1994).

31. B. Huang, T. Liu, H. Hu, J. Han, and M. Yu, “Underwater image recovery considering polarization effects of objects,” Opt. Express 24(9), 9826–9838 (2016). [CrossRef]  

32. X. Li, H. Hu, L. Zhao, H. Wang, Y. Yu, L. Wu, and T. Liu, “Polarimetric image recovery method combining histogram stretching for underwater imaging,” Sci. Rep. 8(1), 12430 (2018). [CrossRef]  

33. G. Ulutas and B. Ustubioglu, “Underwater image enhancement using contrast limited adaptive histogram equalization and layered difference representation,” Multimed. Tools Appl. 80(10), 15067–15091 (2021). [CrossRef]  

34. Yang Liming, Liang Jian, Zhang Wenfei, Ju Haijuan, and Ren Liyong, “Underwater polarimetric imaging for visibility enhancement utilizing active unpolarized illumination - ScienceDirect,” Opt. Commun. 438, 96–101 (2019). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (9)

Fig. 1.
Fig. 1. Schematic diagram of underwater polarization imaging experimental device
Fig. 2.
Fig. 2. The co-polarized and cross-polarized images with two types of targets under different turbidities (a) co-polarized images of metal sign (b) cross-polarized images of metal sign (c) co-polarized images of transfer lable (d) cross-polarized images of transfer lable. The adding amount of skimmed milk is 140 ml, 160 ml, 180 ml, and 200 ml respectively
Fig. 3.
Fig. 3. The approximate varying trend of gray value with co-polarized and cross-polarized images under different scattering effects. (a) metal sign as the target (b) transfer lable as the target. The adding amount of skimmed milk is 140 ml, 160 ml, 180 ml, and 200 ml respectively.
Fig. 4.
Fig. 4. Flowchart of underwater polarization reconstruction based on the input of a single polarized image
Fig. 5.
Fig. 5. Comparison of key parameters during target image restoration (a) 3D mesh of cross-polarized image by rotating the polarizers (b) 3D mesh of cross-polarized image by fitting in our method (c) 3D mesh of DOLP in full scene (d) 3D mesh of ${p_B}(x,y)$(e) the target image via classic descattering model [13] (f) the recovered image through our method. The additional amount of skimmed milk is 220 ml.
Fig. 6.
Fig. 6. Restoration results of different underwater imaging methods and comparison of local features (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is a stainless steel metal sign with a smooth finish
Fig. 7.
Fig. 7. Restoration results of different underwater imaging methods (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is a rectangular laboratory sign.
Fig. 8.
Fig. 8. The pixel gray value with the spatial position in horizontal midline (a) lowly scattering corresponding to adding 160 ml skim milk (b) highly scattering corresponding to adding 220 ml skim milk. The target is an ectangular laboratory sign. At the top of the figure, we give the pseudo-color image of the sample target images corresponding to the pixel position of the curve
Fig. 9.
Fig. 9. The contrast of target images with intensity imaging, Treibitz‘s and our method under different turbidity

Tables (1)

Tables Icon

Table 1. Using contrast, UISM, UIQM to evaluate the results of different methods, the higher the score, the better the enhancement effect

Equations (24)

Equations on this page are rendered with MathJax. Learn more.

I ( x , y ) =  D ( x , y ) +  B ( x , y )
I max ( x , y ) = D max ( x , y ) + B max ( x , y )
I min ( x , y ) = D min ( x , y ) + B min ( x , y )
D ( x , y ) = D max ( x , y ) + D min ( x , y )
B ( x , y ) = B max ( x , y ) + B min ( x , y )
DOLP = I max ( x , y ) B min ( x , y ) I max ( x , y ) + B min ( x , y )
p ( x , y ) = D max ( x , y ) D min ( x , y ) D max ( x , y ) + D min ( x , y )
p ( x , y ) = B max ( x , y ) B min ( x , y ) B max ( x , y ) + B min ( x , y )
D ( x , y ) D max ( x , y )
I ( x , y ) = I max ( x , y ) + I min ( x , y ) = I max ( x , y ) + B min ( x , y )
B ^ max ( x , y ) = m o v = 1 m p mov ( x , y ) a m o v ( x , y ) = p T ( x , y ) a ( x , y ) x , y
p ( x , y ) T = [ 1 , x , y ] T , m = 3
J = i = 1 n w ( ( x x i ) 2 + ( y y i ) 2 ) [ mov  = 1 m p mov  ( x i , y i ) a m o v ( x , y ) B ^ max ( x i , y i ) ] 2
B ^ min ( x , y ) = b exp ( b B ^ max / 255 ) 255
{ 0 < b < 1 max ( B ^ min ( x , y ) ) < min ( B ^ max ( x , y ) )
DOLP = D max ( x , y ) + ( B max ( x , y ) B min ( x , y ) ) D max ( x , y ) + ( B max ( x , y ) + B min ( x , y ) )
p B ( x , y ) = DOLP I max B ^ max B ^ max + B ^ min ( 1 DOLP )
{ p B ( x , y ) = DOLP ( x , y ) ,   ( x , y ) background p B ( x , y ) < DOLP ( x , y ) ,   ( x , y ) target - area
D = B ^ min ( p + 1 ) ( p 1 ) + I max
contrast = σ I ¯ = 1 M × N i = 1 M j = 1 N [ I ( i , j ) I ¯ ] 2 1 M × N i = 1 M j = 1 N I ( i , j )
UISM = c = 1 3 λ c EME
EME = 2 k 1 k 2 l = 1 k 1 k = 1 k 2 log ( I max , k , l I min , k , l + q )
UIConM = 1 k 1 k 2 l = 1 k 1 k = 1 k 2 I max , k , l Θ I min , k , l I max , k , l I min , k , l × log ( I max , k , l Θ I min , k , l I max , k , l I min , k , l )
UIQM = c 1 × UISM + c 2 × UIConM
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.