Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Efficient rendering by parallelogram-approximation for full analytical polygon-based computer-generated holography using planar texture mapping

Open Access Open Access

Abstract

We have developed a full analytical method with texture mapping for polygon-based computer-generated holography. A parallel planar projection mapping for holographic rendering along with affine transformation and self-similar segmentation is derived. Based on this method, we further propose a parallelogram-approximation to reduce the number of polygons used in the polygon-based technique. We demonstrate that the overall method can reduce the computational effort by 50% as compared to an existing method without sacrificing the reconstruction quality based on high precision rendering of complex textures. Numerical and optical reconstructions have shown the effectiveness of the overall scheme.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Polygon-based computer-generated holography (CGH) is a practical technique for obtaining computer-generated holograms, which can reproduce the light field distribution of three-dimensional (3D) objects. The method divides any 3D object into polygons, and then superimposes the diffracted light field distribution of each polygon on the hologram plane. Since the number of polygons is much smaller than the number of point sources in point-based holography, the amount of computation is greatly reduced. There are two classical polygon-based CGH methods [1]: the FFT-based or the traditional method [27], and the analytical method based on the affine transformation [813]. In the former case, we need to perform discrete 2D Fourier transform on each polygon, and then resample the spectrum on the plane that is parallel to the hologram plane. In the latter case, the spectrum of each polygon is obtained via affine transformation analytically, and sampling only needs to be performed on a plane that is parallel to the hologram plane [12,14]. Since the FFT method requires pre-generated images of the individual polygons that make up the 3D object, it is only necessary to change the amplitude of the generated polygon images when adding rendering information such as textures and illumination [5,6].

While the computational time in the analytical method in principle is faster than that in the FFT-based method, texture rendering in the analytical method seems to be the computational bottleneck. Texture mapping is a technology to improve the quality of computer images. In computer graphics, any 3D object is usually composed of polygons. In computer graphics texture mapping can generate non-constant amplitude inside each polygon and improve the image quality and the creation of realistic 3D images without increasing the number of polygons used for the 3D object. In recent years, some texture mappings have been applied to fully analytic polygon-based methods. For example, Kim et al. [9] have employed for the first time a self-similar partitioning scheme in a fully analytical method, where a single polygon is partitioned into sub-triangles of similar shape with different constant amplitudes, adding rendering information while maintaining the principle of a fully analytical framework. They have shown the feasibility of the proposed scheme for texture mapping, but have not demonstrated their idea concretely through experiments and simulations. Lee et al. [15] have proposed the scheme of representing texture functions using Fourier series, and based on this, the texture functions are convolved with the spectrum of the polygon, which saves the generation step of a large number of sub-triangles as compared with the method by Kim et al. They have produced some improvement on the efficiency of texture rendering. However, this scheme requires the texture information to be periodic as it is generated through Fourier series. Ji et al. [16] have introduced the concept of texture mapping in a spherical polar coordinate system and improved the segmentation step based on Kim et al.'s self-similar segmentation scheme [9]. In addition, they have proposed an adaptive segmentation method, which reduces the number of sub-triangles needed. The method is not limited by whether the texture information is periodic or not while maintaining the full analytical framework. However, this scheme is difficult to work effectively in high precision rendering of complex textures, and the efficiency of this scheme changes with the texture information and is not stable as compared to that of Kim et al.

Recently we have proposed the use of planar projection texture mapping to generate a full affine transformed computer-generated hologram [17]. Here, we report a full-version of the proposed technique along with additional numerical and optical reconstructions to substantiate the proposed idea. A self-similar segmentation scheme proposed by Kim et al. is employed to add texture information to the object's light field distribution along with our proposed parallel planar texture mapping. We further propose a parallelogram-approximation within the framework of self-similar segmentation scheme and affine transformation to replace most of the sub-triangles with sub-parallelograms. The result of which indicates a steady reduction of the computational effort by almost 50% under the premise of high-precision texture rendering. In Section 2, we develop the theory of polygon-based method based on affine transformation. In Section 3, we discuss texture mapping through the use of self-similar segmentation for a full analytical formulism. In Section 4, we show numerical and optical reconstructions to verify the usefulness of our proposed technique. Finally, in Section 5, we make some concluding remarks.

2. Theory of full analytical polygon-based method based on affine transformation

In the polygon-based method, the total light field distribution ${U_O}({x,y} ) $ of any object composed of polygons (we use triangles in our development) on the hologram plane is composed of the polygon field $ {U_i}({x,y} ) $ of n arbitrary tilted triangle apertures that make up the object (see Fig. 1):

$${U_O}({x,y} )= \mathop \sum \nolimits_{i = 1}^n {U_i}({x,y} ). $$

 figure: Fig. 1.

Fig. 1. 3D object and its light field distribution on the hologram plane.

Download Full Size | PDF

Equation (1) can be rewritten as

$${U_O}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n {A_i}({{f_x},{f_y}} )} \right\},$$
where ${\mathrm{{\cal F}}^{ - 1}}$ represents inverse Fourier transform with ${f_x}$ and ${f_y}$ denoting spatial frequencies corresponding to the x and y coordinates, respectively. ${A_i}({{f_x},{f_y}} )\; $ is the angular spectrum of the $i$th tilted triangle (polygon) on the hologram plane. Let us assume that the surface function of the $i$th tilted triangle, which represents the transparency function of the aperture, is given by
$$sur{f_i}({x,y;z({x,y} )} )= \left\{ {\begin{array}{{cc}} 1&{,inside{\; }of{\; }{\mathrm{\Phi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Phi }_i}} \end{array}} \right.,$$
where ${\mathrm{\Phi }_i}$ is the area enclosed by the $i$th arbitrary triangle and different from the angular-spectrum layer-oriented method [18], $z({x,y} )$ is the distance between a point on the tilted plane and the hologram plane. Then the spectrum ${A_i}({{f_x},{f_y}} ) $ of the arbitrary tilted triangle on the hologram plane is given by [3,13,19]
$$\scalebox{0.95}{$\displaystyle{A_i}({{f_x},{f_y}} )= \mathop {\int\!\!\!\int }\nolimits_{{\mathrm{\Phi }_i}}^{\; } sur{f_i}({x,y;z({x,y} )} )\textrm{exp}\left[ { - \textrm{j}2\mathrm{\pi }\left( {{f_x}x + {f_y}y + z({x,y} )\sqrt {\frac{1}{{{\lambda^2}}} - {f_x}^2 - {f_y}^2} - \frac{{z({x,y} )}}{\lambda }} \right)} \right]dxdy,$}$$
where $\lambda $ is the wavelength of light. The inclusion of the term $z({x,y} )/\; \lambda $ is due to the suppression of the so-called carrier frequency term being introduced as the polygon field propagates in a direction angled to the z-axis [20]. For a full analytical approach, we need to find the spectrum of the tilted triangle given by Eq. (4) analytically and this can be done using the affine transformation. Let us define a primary (also called unit) triangle with its coordinates of the vertices given by $({0,0} )$, $({1,0} )$, and $({0,1} )$ on the ${x_p}{y_p}$-plane and so its surface function $sur{f_p}({{x_p},{y_p}} )$ is given by
$$sur{f_p}({{x_p},{y_p}} )= \left\{ {\begin{array}{{cc}} 1&{,inside{\; }of{\; }{\mathrm{\Psi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Psi }_i}} \end{array}} \right.,$$
where ${\mathrm{\Psi }_i}$ is the area enclosed by the unit triangle shown in Fig. 2(a).

 figure: Fig. 2.

Fig. 2. Mapping between (unit) primitive and arbitrary triangles: (a) unit triangle (b) arbitrary triangle.

Download Full Size | PDF

An affine transform maps input coordinates $({x_p},{y_p}) $ into output coordinates $({x,y,z} )$ according to

$$\left[ {\begin{array}{{c}} x\\ y\\ z \end{array}} \right] = \left[ {\begin{array}{{c}} {\begin{array}{{ccc}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{{ccc}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{{ccc}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{{c}} {{x_p}}\\ {{y_p}}\\ 1 \end{array}} \right].$$
Assuming the coordinates of the vertices of the $i$th arbitrary triangle from the 3D object are $({{x_{i1}},{y_{i1}},{z_{i1}}} )$, $({{x_{i2}},{y_{i2}},{z_{i2}}} )$, and $({{x_{i3}},{y_{i3}},{z_{i3}}} )$ on the $xyz - $ coordinates as illustrated in Fig. 2(b), we have the following mapping:
$$\begin{array}{{c}} {({x_p},{y_p}) = ({0,0} )\to ({x,y,z} )= ({{x_{i1}},{y_{i1}},{z_{i1}}} ),}\\ {({x_p},{y_p}) = ({1,0} )\to ({x,y,z} )= ({{x_{i2}},{y_{i2}},{z_{i2}}} ),\; }\\ {({x_p},{y_p}) = ({0,1} )\to ({x,y,z} )= ({{x_{i3}},{y_{i3}},{z_{i3}}} ).} \end{array}$$
Upon substituting the above mappings into Eq. (6), we have
$$\left[ {\begin{array}{{@{}c@{}}} {{x_{i1}}}\\ {{y_{i1}}}\\ {{z_{i1}}} \end{array}} \right] = \left[ {\begin{array}{{@{}c@{}}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 0\\ 0\\ 1 \end{array}} \right],\left[ {\begin{array}{@{}c@{}} {{x_{i2}}}\\ {{y_{i2}}}\\ {{z_{i2}}} \end{array}} \right] = \left[ {\begin{array}{@{}c@{}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 1\\ 0\\ 1 \end{array}} \right],\left[ {\begin{array}{@{}c@{}} {{x_{i3}}}\\ {{y_{i3}}}\\ {{z_{i3}}} \end{array}} \right] = \left[ {\begin{array}{@{}c@{}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 0\\ 1\\ 1 \end{array}} \right].$$
Solving for $a^{\prime}s$, Eq. (6) becomes
$$\left[ \begin{matrix} x \\ y \\ z \end{matrix} \right] = \left[ \begin{matrix} {\left( {x_{i2}-x_{i1}} \right)} & {\left( {x_{i3}-x_{i1}} \right)} & {x_{i1}} \\ {\left( {y_{i2}-y_{i1}} \right)} & {\left( {y_{i3}-y_{i1}} \right)} & {y_{i1}} \\ {\left( {z_{i2}-z_{i1}} \right)} & {\left( {z_{i3}-z_{i1}} \right)} & {z_{i1}} \end{matrix} \right] \left[ \begin{matrix} {x_p} \\ {y_p} \\ 1 \end{matrix} \right].$$
Substituting the mapping relationship of equation Eq. (8) into Eq. (4), we get
$${A_i}({{f_x},{f_y}} )= \mathrm{{\cal J}} \cdot p \cdot \mathop {\int\!\!\!\int }\nolimits_{{\mathrm{\Psi }_i}}^{\; } sur{f_i}({{x_p},{y_p}} )\cdot \textrm{exp}({ - j2\pi {f_{xMi}} \cdot {x_p}} )\cdot \textrm{exp}({ - j2\pi {f_{yMi}} \cdot {y_p}} )d{x_p}d{y_p},$$
where $\mathrm{{\cal J}\;\ }$ is the Jacobian generated during the integral mapping, p is a phase shift factor that does not participate in the integration, $({{f_{xM}},{f_{yM}}} )$ is the result of the spatial mapping shown in Eq. (9) reflected in the frequency domain:
$$\mathrm{{\cal J}} = \left|{\begin{array}{{cc}} {\frac{{\partial {x_p}}}{{\partial x}}}&{\frac{{\partial {x_p}}}{{\partial y}}}\\ {\frac{{\partial {y_p}}}{{\partial x}}}&{\frac{{\partial {y_p}}}{{\partial y}}} \end{array}} \right|\approx \left|{\begin{array}{{cc}} {({{x_{i2}} - {x_{i1}}} )}&{({{y_{i2}} - {y_{i1}}} )}\\ {({{x_{i3}} - {x_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )} \end{array}} \right|= |{{x_{i2}}{y_{i3}} + {x_{i1}}{y_{i1}} + {x_{i1}}{y_{i2}} - {x_{i3}}{y_{i2}}} |,$$
$${f_{xMi}} = ({{x_{i2}} - {x_{i1}}} ){f_x} + ({{y_{i2}} - {y_{i1}}} ){f_y} + ({{z_{i2}} - {z_{i1}}} ){f_z} - ({{z_{i2}} - {z_{i1}}} )/\lambda ,$$
$${f_{yMi}} = ({{x_{i3}} - {x_{i1}}} ){f_x} + ({{y_{i3}} - {y_{i1}}} ){f_y} + ({{z_{i3}} - {z_{i1}}} ){f_z} - ({{z_{i3}} - {z_{i1}}} )/\lambda ,$$
$$p = \textrm{exp}[{ - j2\pi ({{x_{i1}}{f_x} + {y_{i1}}{f_y} + {z_{i1}}{f_z} - {z_{i1}}/\lambda } )} ],$$
and ${f_z} = \sqrt {1/{\lambda ^2} - {f_x}^2 - {f_y}^2} .$

As shown in Fig. 2, ${\mathrm{\Psi }_i}$ enclosed by the unit triangle is mapped to the area ${\mathrm{\Phi }_i}$ enclosed by the arbitrary triangle under the linear mapping of coordinate systems from $({{x_p},{y_p}} )$ to $({x,y,z} )$, so that the surface function $sur{f_i}({{x_p},{y_p}} )$ can be replaced by $sur{f_p}({{x_p},{y_p}} )$ in Eq. (9).

By re-arranging Eq. (9), we get

$${A_i}\left( {{f_x},{f_y}} \right) = {{\cal J}} \cdot p \cdot \mathop {\int\!\!\!\int }\nolimits_{{{\Psi }_i}}^{\; } sur{f_p}\left( {{x_p},{y_p}} \right) \cdot \textrm{exp} \left( { - j2\pi {f_{xMi}} \cdot {x_p}} \right) \cdot \textrm{exp}\left( { - j2\pi {f_{yMi}} \cdot {y_p}} \right)d{x_p}d{y_p}.$$

Now, the spectrum of the unit triangle can be evaluated analytically as follows:

$$\begin{array}{ll} {A_p}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )&= \mathop {\int\!\!\!\int }\nolimits_{\mathrm{\Psi }_i} sur{f_p}({{x_p},{y_p}} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ &= \mathop \smallint \nolimits_0^1 \mathop \smallint \nolimits_0^{ - {x_p} + 1} 1 \cdot \textrm{exp}({ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} )d{x_p}d{y_p}\\ &= \frac{{\textrm{exp}({ - j2\pi {f_x}^\mathrm{^{\prime}}} )- 1}}{{4{\pi ^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} ({ - j2\pi {f_x}^\mathrm{^{\prime}}} )- \textrm{exp} ({ - j2\pi {f_y}^\mathrm{^{\prime}}} )}}{{4{\pi ^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}\; . \end{array}$$

Comparing Eq. (10) and Eq. (11), we have

$${A_i}({{f_x},{f_y}} )= \mathrm{{\cal J}} \cdot p \cdot {A_p}({{f_{xMi}},{f_{yMi}}} ).$$
We have just obtained the spectrum ${A_i}({{f_x},{f_y}} )$ of any triangle indirectly represented by the spectrum ${A_p}({{f_{xM}},{f_{yM}}} )$ of the unit triangle. By substituting Eq. (2) into Eq. (12), we can get the light field distribution $\; {U_O}({x,y} )$ analytically:
$${U_O}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_p}({{f_{xMi}},{f_{yMi}}} )} ]} \right\}.$$

3. Texture mapping

The mathematical expression of the light field distribution of an object consisting of triangles in the full analytic polygon-based method has been obtained in Eq. (13). However, the light field distribution of an object described by Eq. (13) is composed of triangular apertures described by a constant surface function given by Eq. (5), which makes the reconstruction effect very monotonous and far from satisfying the needs of practical 3D display. Therefore, it is necessary to perform additional rendering of the field distribution ${U_O}({x,y} )$ in order to pursue a better object field reconstruction effect; among them, rendering the object with texture mapping is an effective method to improve the reconstructed 3D object.

3.1 Texture mapping based on planar projection mapping

Texture is an important part of the object information. In computer graphics, this information is usually stored in a 2D Cartesian coordinates $({{x_t},{y_t}} )$, which is commonly referred to as texture coordinates, and the texture function $T({{x_t},{y_t}} )$ is assigned to object point ${P_O}({x,y,z} )$ through the mapping relationship between coordinate system $({{x_t},{y_t}} )$ and coordinate system $({x,y,z} )$. This process is reflected in the polygon-based method by mapping the texture function $T({{x_t},{y_t}} )$ to the surface function of each arbitrary triangle $sur{f_i}({x,y;z} )$. To complete the above operations, it is necessary to determine the corresponding relationship between the two coordinate systems $({{x_t},{y_t}} )$ and $({x,y,z} )$.

Our scheme of projected texture mapping is shown in Fig. 3. First, we set the position of a light point source $ L({{x_L},{y_L},{z_L}} )$ and the texture location $({{z_t}} ) ;\; {z_t}$ is a constant which sets the location of the texture, if the hologram located in the $z = 0$ plane. To facilitate the calculation, light point source $L({{x_L},{y_L},{z_L}} )$ is located in $({0,0,{z_L}} )$. For any point ${P_O}({x,y,z} ) $ on the object, we find $d = |{z - {z_L}} |$, ${d_t} = |{{z_t} - {z_L}} |$, ${d_t} = d - {d_o}$. Using similar triangles from the figure, we have $d/{d_t} = x/{x_t} = y/{y_t}$ We can then finally write the perspective projection geometry relationship as follows:

$${x_t} = x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}};{y_t} = y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}}.$$

 figure: Fig. 3.

Fig. 3. $(a )$ Side view of projected texture mapping, $(b )$ Perspective view of the mapping.

Download Full Size | PDF

As it turns out, perspective projection can be regarded as a generalization of orthogonal projection. When the position ${z_L}$ of the point light source tends to infinity ${z_L} \to \infty $ (see Fig. 3)

$${x_t} = x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}} \to x{\; };{\; \; }{y_t} = y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}} \to y{\; },$$
which show orthogonal projection relationships. Perspective projection is more powerful than orthogonal projection, and so this article chooses perspective projection method instead of orthogonal projection.

For each arbitrary triangle under the coordinate system $({x,y,z} )$, there is a texture triangle corresponding to it under the texture coordinate system $({{x_t},{y_t}} )$, and both meet the mapping relationship in Eq. (14). The purpose of surface function mapping is to replace the constant surface function of any triangle originally described by Eq. (3) with the texture function in the interval ${\mathrm{\Omega }_i}$ enclosed by the corresponding texture triangle, as shown in Fig. 4.

 figure: Fig. 4.

Fig. 4. Mapping of surface function.

Download Full Size | PDF

According to the mapping result given by Eq. (14), the surface function with projection texture information of arbitrary triangle $sur{f_i}({x,y;z} )$ can be rewritten as:

$$sur{f_{Ti}}({x,y;z} )= \left\{ {\begin{array}{{cc}} {T\left( {x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}},y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}}} \right)}&{,inside{\; }of{\; }{\mathrm{\Phi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Phi }_i}} \end{array}} \right.$$

3.2 Full analytical polygon-based method rendering based on self-similar segmentation

In the previous subsection, we have succeeded in replacing the surface function of an arbitrary triangle by its corresponding texture function T through the projection mapping relation Eq. (14). Theoretically, we only need to substitute $sur{f_i}({x,y;z} )$ in Eq. (3) to $sur{f_{Ti}}({x,y;z} )$ to reconstruct the object-light field with texture information. Kim et al. [9] first proposed to partition an arbitrary triangle into sub-triangles similar to itself and assign a different constant surface function to each sub-triangle that constitutes an arbitrary triangle in order to add rendering information while maintaining a fully resolved framework. Their work has been only applied to occlusion issues and random phase addition during CGH generation. In our work, we also employ their idea of dividing each arbitrary triangle into smaller similar triangles with uniform amplitudes according to the texture mapping function. But our approach is through the division of the unit triangle along with affine transformation to achieve texture rendering. We call this method as self-similar segmentation.

As shown in Fig. 5(a), $\; M$ is the degree of sub-division. The unit triangle has the unit sides divided with $1/M$ long, giving ${M^2}$ self-similar sub-triangles. We also denote $({m,\; n} )$ as an index value along the two unit-lengths. The index value describes the position of the sub-triangle. There are Forward sub-triangles, ${\mathrm{\Psi }_{F,i}}({m,n} )$, and Reverse sub-triangles, ${\mathrm{\Psi }_{R,i}}({m,n} )$ as shown in Fig. 5(a). ${\mathrm{\Psi }_{u,i}}$ and ${\mathrm{\Psi }_{l,i}}$ are the area enclosed by the sub-triangles. For example, ${\mathrm{\Psi }_{F,i}}({0,0} )$ and ${\mathrm{\Psi }_{R,i}}({0,0} )$ denotes the red and blue sub-triangle within the unit triangle. Note that the index values $m + n \le M - 1$ for ${\mathrm{\Psi }_{F,i}}({m,n} )$ and $m + n \le M - 2$ for ${\mathrm{\Psi }_{R,i}}({m,n} ).$ According to these guidelines, for example, when $M = 4$, we have eight ${\mathrm{\Psi }_{F,i}}({m,n} )^{\prime}s$ and ${\mathrm{\Psi }_{R,i}}{({m,n} )^{\prime}}s$, as illustrated in Fig. 5(a). Through affine transformation, ${\mathrm{\Psi }_{F,i}}({m,n} )$ and ${\mathrm{\Psi }_{R,i}}({m,n} )$ map into ${\mathrm{\Phi }_{F,i}}({m,n} )$ and ${\mathrm{\Phi }_{R,i}}({m,n} )$, respectively within the ${i^{th}}$ arbitrary triangle, as shown in Fig. 5(b).

 figure: Fig. 5.

Fig. 5. Triangle composed of ${M^2}$ similar sub-triangles. $(a )$ unit triangle divided into ${M^2}$ similar sub-triangles $(b )$ arbitrary triangle divided into ${M^2}$ sub-triangles.

Download Full Size | PDF

In order to maintain a full analytical framework, we need to find the spectrum of the sub-triangles ${\mathrm{\Psi }_{F,i}}({m,n} )$ and ${\mathrm{\Psi }_{R,i}}({m,n} )$. Assuming the surface functions of the Forward and Reverse sub-triangles are $sur{f_{p,F}}({{x_p},{y_p},m,n} )$ and $sur{f_{p,R}}({{x_p},{y_p},m,n} ) $ as follows:

$$\begin{array}{{c}} {sur{f_{p,F}}({{x_p},{y_p},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_F}({m,n} )}&{,inside{\; }of\; {\mathrm{\Psi }_{F,i}}({m,n} )}\\ 0&{,outside{\; }of\; {\mathrm{\Psi }_{F,i}}({m,n} )} \end{array};} \right.}\\ {sur{f_{p,R}}({{x_p},{y_p},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_R}({m,n} )}&{,inside{\; }of\; {\mathrm{\Psi }_{R,i}}({m,n} )}\\ 0&{,outside{\; }of\; {\mathrm{\Psi }_{R,i}}({m,n} )} \end{array}} \right.;} \end{array}$$
where $ren{d_F}({m,n} )$ and $ren{d_R}({m,n} )$ are the corresponding rendering information, which have constant amplitude function depending on the index $({m,n} ).$

In principle, we just need to find the spectrum of ${\mathrm{\Psi }_{F,i}}({0,0} )$ analytically, and the rest of spectrum of other self-similar sub-triangles can be found by simply through the operations of translation and rotation. For a general index value $({m,n} )$ and with the help of Fig. 6(a) and Fig. 6(b) to establish the integral limits, we can find the spectrum of ${\mathrm{\Psi }_{F,i}}({m,n} )$ and ${\mathrm{\Psi }_{R,i}}({m,n} )$ with rendering information, respectively, as follows:

$$\begin{aligned} \begin{array}{{c}} {{A_{p,T,F}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} ) = \mathop \smallint \nolimits_{m/M}^{\frac{{m + 1}}{M}} \; \; \; \; \; \mathop \smallint \nolimits_{n/M}^{{\; } - {x_p} + \frac{{m + n + 1}}{M}} ren{d_F}({m,n} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}} \end{array}\\ = ren{d_F}({m,n} )\cdot \left[ {\frac{{\textrm{exp} \left( { - j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - 1}}{{4{\pi^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} \left( { - j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - \textrm{exp} \left( { - j2\pi \frac{1}{M}{f_y}^\mathrm{^{\prime}}} \right)}}{{4{\pi^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}} \right]\\ \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ = \frac{1}{M}{A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,n} )\cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right], \end{aligned}$$
where we have used Eq. (11) to reach the final step of the final answer, and similarly
$$\begin{array}{l} {A_{p,T,R}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )= \mathop \smallint \nolimits_{\frac{m}{M}}^{\frac{{m + 1}}{M}} \mathop \smallint \nolimits_{ - {x_p} + \frac{{m + n + 1}}{M}}^{\frac{{n + 1}}{M}} ren{d_R}({m,n} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ = ren{d_R}({m,n} )\left[ {\frac{{\textrm{exp} \left( {j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - 1}}{{4{\pi^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} \left( {j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - \textrm{exp} \left( {j2\pi \frac{1}{M}{f_y}^\mathrm{^{\prime}}} \right)}}{{4{\pi^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}} \right]\\ \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ = \frac{1}{M}{A_p}\left( { - \frac{{{f_x}^\mathrm{^{\prime}}}}{M}, - \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_R}({m,n} )\cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]. \end{array}$$

 figure: Fig. 6.

Fig. 6. Integral limits for the calculation of spectrum: (${\boldsymbol a}$) for Forward sub-triangle ${\mathrm{\Psi }_{F,i}}({m,n} )$, (${\boldsymbol b}$) for downward-oriented sub-triangle ${\mathrm{\Psi }_{R,i}}({m,n} ).$ When $({m,n} )= ({0,0} )$, we have the red and blue sub-triangle within the unit triangle.

Download Full Size | PDF

Neglecting any constants and by summing all the spectra of Forward and Reverse sub-triangles by using Eqs. (17) and (18), we have the spectrum of the unit triangle with rendering information $ren{d_F}({m,n} )$ and $ren{d_R}({m,n} ):$

$$\begin{aligned}& {A_{p,T}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 1} \mathop \sum \nolimits_{n = 0}^{M - 1} {A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,n} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ &\quad+ \mathop \sum \nolimits_{m = 0}^{M - 2} \mathop \sum \nolimits_{n = 0}^{M - 2} {A_p}\left( { - \frac{{{f_x}^\mathrm{^{\prime}}}}{M}, - \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_R}({m,n} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]. \end{aligned}$$
Replacing ${A_p}({{f_{xMi}},{f_{yMi}}} )$ in Eq. (13) with ${A_{p,T}}({{f_{xMi}},{f_{yMi}}} )$ with rendering information given by Eq. (19), we have the light field distribution with texture:
$${U_{O,T}}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_{p,T}}({{f_{xMi}},{f_{yMi}}} )} ]} \right\}.$$
Now, we only need to figure out the relationship between the rendering information $ren{d_F}({m,n} )$, $ren{d_R}({m,n} )$ and the texture function $T$ to obtain the light field distribution of the object with texture rendering information.

Since the method uses a self-similar set of sub-triangles instead of using the whole unit triangle, we can consider that it is equivalent to sampling the texture function T by sub-triangles during the texture mapping process. Figure 7 shows the coordinates of the vertices of $({m,n} )$ sub-triangles (Forward in red and Reverse in blue) and their corresponding barycenters, ${B_{p,F}} = [{({3m + 1} )/3M,({3n + 1} )/3M} ]$, ${B_{p,R}} = [{({3m + 2} )/3M,({3n + 2} )/3M} ]$, respectively.

 figure: Fig. 7.

Fig. 7. Coordinates of sub-triangles and their barycenters.

Download Full Size | PDF

Through affine transformation [See Eq. (6)], we can find the barycenters in the arbitrary triangle, ${B_F}({m,n} ) $ and ${B_R}({m,n} )$, respectively as follows:

$$\begin{array}{l} {\; }{B_F}({m,n} )\; = \left[ {\begin{array}{{c}} {{x_F}({m,n} )}\\ {{y_F}({m,n} )}\\ {{z_F}({m,n} )} \end{array}} \right] = \left[ {\begin{array}{{ccc}} {({{x_{i2}} - {x_{i1}}} )}&{({{x_{i3}} - {x_{i1}}} )}&{{x_{i1}}}\\ {({{y_{i2}} - {y_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )}&{{y_{i1}}}\\ {({{z_{i2}} - {z_{i1}}} )}&{({{z_{i3}} - {z_{i1}}} )}&{{z_{i1}}} \end{array}} \right]\left[ {\begin{array}{{c}} {\frac{{3m + 1}}{{3M}}}\\ {\frac{{3n + 1}}{{3M}}}\\ 1 \end{array}} \right]\\ \begin{array}{{c}} \; \\ {{B_R}({m,n} )= \left[ {\begin{array}{{c}} {{x_R}({m,n} )}\\ {{y_R}({m,n} )}\\ {{z_R}({m,n} )} \end{array}} \right] = \left[ {\begin{array}{{ccc}} {({{x_{i2}} - {x_{i1}}} )}&{({{x_{i3}} - {x_{i1}}} )}&{{x_{i1}}}\\ {({{y_{i2}} - {y_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )}&{{y_{i1}}}\\ {({{z_{i2}} - {z_{i1}}} )}&{({{z_{i3}} - {z_{i1}}} )}&{{z_{i1}}} \end{array}} \right]\left[ {\begin{array}{{c}} {\frac{{3m + 2}}{{3M}}}\\ {\frac{{3n + 2}}{{3M}}}\\ 1 \end{array}} \right]} \end{array} \end{array}, $$
thereby giving
$$\begin{array}{{c}} {ren{d_F}({m,n} )= T\left( {{x_F}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,n} )- {z_L}} |}},{y_F}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,n} )- {z_L}} |}}} \right)}\\ {ren{d_R}({m,n} )= T\left( {{x_R}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_R}({m,n} )- {z_L}} |}},{y_R}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_R}({m,n} )- {z_L}} |}}} \right)} \end{array}. $$
The situation is illustrated in Fig. 8. Using ${B_F}({m,n} )$ and ${B_R}({m,n} )$, and according to Eq. (15), we have the rending information as a function of the texture function:

 figure: Fig. 8.

Fig. 8. Barycenter of sub-triangles and sampling of the texture function ($a$) Barycenter of sub-triangles (red and purple dots for Forward and Reverse sub-triangles, respectively) in the unit triangle ($b$) Barycenter of sub-triangles in the arbitrary triangle.

Download Full Size | PDF

So far, we have obtained the result of adding texture information to the object light field using Kim et al.’s [9] segmentation method but through an affine transformation for full analytical formalism. However, the computation time remains higher if M increases. To solve this problem, we propose a self-similar segmentation method using a parallelogram-approximation.

3.3 Full analytical polygon-based method rendering based on self -similar segmentation using a parallelogram-approximation

As shown in Fig. 9, the two sub-triangles ${\mathrm{\Psi }_{F,i}}({m,n} )$ and ${\mathrm{\Psi }_{R,i}}({m,n} )$ are replaced by a parallelogram ${\mathrm{\Theta }_i}({m,n} )$, where ${\mathrm{\Theta }_i}({m,n} )$ is the area enclosed by the sub-parallelogram. So, we have ${\mathrm{\Psi }_{F,i}}({m,n} )+ {\mathrm{\Psi }_{R,i}}({m,n} )= {\mathrm{\Theta }_i}({m,n} ).$ This step allows us to reduce the number of polygons. After affine transform using Eq. (8), i.e., linear mapping as shown in the figure, ${\mathrm{\Phi }_{F,i}}({m,n} )$ and ${\mathrm{\Phi }_{R,i}}({m,n} )$ have become ${\mathrm{\Xi }_i}({m,n} )$ in the arbitrary triangle, an area enclosed by sub-parallelogram in the arbitrary triangle. Hence, we have ${\mathrm{\Phi }_{F,i}}({m,n} )+ {\mathrm{\Phi }_{R,i}}({m,n} )= {\mathrm{\Xi }_i}({m,n} ).$ In general, there are a total of M Forward sub-triangles and $({M - 1} )\cdot M/2$ sub-parallelograms. As before, $({m,\; n} ) $ can be used to describe the relative positions of sub-parallelograms. The index value of the sub-parallelograms is less than $M - 2$ and of the sub-triangle is less than $M - 1.$

 figure: Fig. 9.

Fig. 9. Mapping between unit triangle and arbitrary triangle under self-similar segmentation using parallelogram-approximation. $(a )$ Forward and Reverse sub-triangles giving a parallelogram. $(b )$ Arbitrary triangle obtained by linear mapping of parallelogram after parallelogram- approximation.

Download Full Size | PDF

The expression for the spectrum of the Forward sub-triangles ${A_{p,T,F}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )$ has been obtained in Eq. (17), and so we only need to obtain the spectrum of the sub-parallelograms analytically to obtain a full analytical formalism.

Similar to that shown in Fig. 6, in Fig. 10, we show the boundaries of the sub-parallelogram for integration to obtain the spectrum.

 figure: Fig. 10.

Fig. 10. Integral limits of a sub- parallelogram ${\mathrm{\Theta }_i}({m,n} )$.

Download Full Size | PDF

We denote the surface function of the sub-parallelogram as $sur{f_{p,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )$, and its constant amplitude will be replaced with the corresponding rendering information $ren{d_P}({m,n} )$ as

$$sur{f_{p,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_P}({m,n} )}&{,inside{\; }of{\; }{\mathrm{\Theta }_i}({m,n} )}\\ 0&{,outside{\; }of{\; }{\mathrm{\Theta }_i}({m,n} )} \end{array}\; } \right., $$
The spectrum of the sub-parallelogram with rendering information ${A_{p,T,P}}$ can be obtained as
$$\scalebox{0.8}{$\begin{aligned} {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )&= \mathop \smallint \nolimits_{\frac{m}{M}}^{\frac{{m + 1}}{M}} \mathop \smallint \nolimits_{\frac{n}{M}}^{\; \frac{{n + 1}}{M}} ren{d_P}({m,n} )\cdot \textrm{exp} [{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ &= ren{d_P}({m,n} )\frac{{\left\{ {\textrm{exp}\left( { - j2\pi \frac{{{f_x}^\mathrm{^{\prime}}}}{M}} \right) + \textrm{exp}\left( { - j2\pi \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) - \textrm{exp} \left[ { - j2\pi \frac{{({{f_y}^\mathrm{^{\prime}} + {f_x}^\mathrm{^{\prime}}} )}}{M}} \right] - 1} \right\}}}{{4{\pi ^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} \cdot \textrm{exp} \left[ { - j2\pi \frac{{({n{f_y}^\mathrm{^{\prime}} + m{f_x}^\mathrm{^{\prime}}} )}}{M}} \right] \end{aligned}$}$$
and the total contribution due to all the sub-parallelograms is
$${A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 2} \mathop \sum \nolimits_{n = 0}^{M - 2} {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} ).$$
Now, the contribution due to the Forward sub-triangles, according to earlier expression found in Eq. (17), is
$${A_{p,T,u,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 1} {A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,{n_F}} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{{M - m - 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right],$$
where ${n_F} = M - m - 1$ is the index value of the sub-triangles. Finally, the sum of Eqs. (25) and (26) gives us the spectrum of the arbitrary triangle with texture under a parallelogram-approximation:
$${A_{p,T}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= {A_{p,T,F,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )+ {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} ).$$
Substituting ${A_p}({{f_{xMi}},{f_{yMi}}} )$ in Eq. (13) with ${A_{p,T}}({{f_{xMi}},{f_{yMi}}} )$ with texture information, we have the distribution of the object light field for each arbitrary triangle consisting of Forward sub-triangles and parallelograms:
$${U_{O,T,Po}}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_{p,T}}({{f_{xMi}},{f_{yMi}}} )} ].$$
The rendering information expression of Forward sub-triangle can be obtained directly from Eq. (22) by replacing n by ${n_F}$ to give $ren{d_F}({m,{n_F}} )$, while the rendering information $ren{d_P}({m,n} ) $ for sub-parallelograms can be derived similar to what we have obtained for sub-triangles earlier in Eq. (21)and the expressions are
$$\begin{array}{l} ren{d_F}({m,{n_F}} )= T\left( {{x_F}({m,{n_F}} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,{n_F}} )- {z_L}} |}},{y_F}({m,{n_F}} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,{n_F}} )- {z_L}} |}}} \right)\\ ren{d_P}({m,n} )= T\left( {{x_P}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_P}({m,n} )- {z_L}} |}},{y_P}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_P}({m,n} )- {z_L}} |}}} \right) \end{array}, $$
where, $\left[ {\begin{array}{{c}} {{x_P}({m,n} )}\\ {{y_P}({m,n} )}\\ {{z_P}({m,n} )} \end{array}} \right] = \left[ {\begin{array}{{ccc}} {({{x_{i2}} - {x_{i1}}} )}&{({{x_{i3}} - {x_{i1}}} )}&{{x_{i1}}}\\ {({{y_{i2}} - {y_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )}&{{y_{i1}}}\\ {({{z_{i2}} - {z_{i1}}} )}&{({{z_{i3}} - {z_{i1}}} )}&{{z_{i1}}} \end{array}} \right]\left[ {\begin{array}{{c}} {\frac{{2m + 1}}{{2M}}}\\ {\frac{{2n + 1}}{{2M}}}\\ 1 \end{array}} \right]$.

4. Simulations and experimental results

4.1 Numerical reconstruction of light field without texture information

We first use the complex object “Alex”, which is composed of a triangular mesh as shown in Fig. 11(a), as the data source to verify the validity of the mathematical expression of the object light field derived from linear mapping given by Eq. (13). The numerical simulations here use the Lambert diffuse reflection illumination model [21] to add shading information to the light field to enrich the appearance of the reconstructed image, and the result is shown in Fig. 11(b).

 figure: Fig. 11.

Fig. 11. 3D object “Alex” with 7243 polygons using mesh regularization. $(a )$ 3D mesh of Alex from a publicly accessible geometric surface from the 3D Scanning Laboratory in Stony Brook [22] $(b )$ numerical reconstruction of “Alex” light field distribution without texture mapping

Download Full Size | PDF

Lambert illumination model assumes that a parallel beam of light in a certain direction produces diffuse reflection shadow information that does not change in intensity with the observation direction after illuminating the object. This shading information is obtained by the dot product of the unit normal vector of the i-th polygon ${\hat{n}_{pi}}$ and the unit normal vector of the illumination light ${\hat{n}_L}$, which is added as a constant to Eq. (13) for each polygon of the 3D object. It is worth noting that Eq. (13) is the complex amplitude distribution of the light field, and so this intensity constant for each polygon should be

$${I_i} = \left\{ {\begin{array}{{cc}} {\sqrt {|{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L}} |} }&{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L} < 0}\\ 0&{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L} > 0} \end{array}} \right.$$
Unlike the continuous shading algorithm proposed by Park et al [23]. that incorporates linear interpolation expressions into the spectrum of a primitive triangle, the Lambert lighting model used in the present paper requires a sufficiently higher number of polygons to present the effect of continuous lighting. In passing, we want to point out that Fan et al. [24] have recently proposed the use of triangular self-similar partitioning method to achieve continuous shading.

For numerical simulations, we have generated the holograms with a resolution of 1024 × 1024 pixels with pixel pitch of 8$\mu m$, and wavelength of 0.532$\mu m$. The size of the object is 5.947$mm \times $ 3.234$mm \times $ 7.854$mm\; ({L \times W \times H} )$, and the hardware includes CPU: Intel Core i5-4590 @ 3.3 GHz, GPU: NVIDIA GTX 950,8G-byte RAM under the environment of MATLAB 2019b. Figure 11(b) proves the validity of the light field calculation formula of Eq. (13). Most importantly, we can observe that the numerical reconstruction obtained by this formula has no visible black lines typically resulted from the joining of the polygons in the original 3D data set.

4.2 Comparison of computational complexity and similarity between two different segmentation methods

In modern computer graphics, in order to make 3D objects easy to handle in subsequent texture rendering, it is common to use the technology of mesh regularization (so called remeshing) [25] so that the polygons that make up the object are similar in size. The polygon model “Alex” also goes through this process. This allows the algorithm proposed in the present paper to set sub-division level M as a constant.

Since Kim et al.'s segmentation method uses sub-triangles of equal size, the number of sub-triangles constituting an arbitrary triangle is ${M^2}$. Our proposed scheme replaces most sub-triangles with parallelograms, and so the number of sub-polygons constituting a triangle is $({M - 1} )\cdot M/2 + M$ as previously described. Figure 12(a) plots the number of sub-polygons as a function of M for the two methods for 3D object “Alex.”. In high-precision reconstruction with a high degree of subdivision M, our proposed method can steadily reduce the computational effort by nearly 50% as compared with that obtained from Kim et al.’s. Figure 12(b) compares the calculation time for the two methods. We also see that our proposed method is more computational efficient by a factor of two.

 figure: Fig. 12.

Fig. 12. Comparisons between our proposed method and Kim et al.’s. $a$) Number of sub-polygons vs. M, $b$) Calculation time vs. $M$

Download Full Size | PDF

In the next numerical simulations, we have used the complex texture shown in Fig. 13(a) to render the light field distribution of “Alex” with the two self-similar segmentation methods. The size of the texture is 5.183$\textrm{mm} \times $ 5.183$\textrm{mm}\; \textrm{with}\; {\textrm{z}_\textrm{t}} = $17.278$\textrm{mm }$ and $({{x_L},{y_L},{z_L}} )= ({0,0,32.9406} )\textrm{mm}.$ We have calculated the numerical reconstruction of the two algorithms for M = 4, 8 and 16. We also compare the two results using structural similarity (SSIM).

 figure: Fig. 13.

Fig. 13. Testing texture $({\boldsymbol a} )$ “metal sheet” $({\boldsymbol b} )$ “ wallpaper “ from wildtextures.com

Download Full Size | PDF

As shown in Fig. 14, the reconstruction results of the two methods approach to each other as the subdivision accuracy increases based on the value of SSIM. This means that our proposed method can reduce the computational effort while not changing the reconstruction quality even with rendering. In order to ensure an accurate representation of surface morphological features in a 3D scene, it is usually necessary to have a larger number of polygons with smaller areas to describe the corresponding 3D scene.

 figure: Fig. 14.

Fig. 14. Numerical reconstruction of texture mapping rendering of the “Alex” light field distribution using two methods with different subdivision degree M

Download Full Size | PDF

The use of many polygons for a 3D object is a complex model. Since the polygons that make up a complex model are smaller, the required M to achieve the same texture information rendering is smaller than that of a simple model with several polygons. In other words, the rendering of complicated texture information for a simple model requires a higher M to guarantee the number of equivalent sampling points required in the rendering process so that the texture information is rendered as distortion-free as possible. Hence, a complex model and a model of low-polygons have about the same efficiency. It is worth noting that the acceleration algorithm proposed in this paper is only applicable to the high-precision rendering case when the subdivision degree M is large enough; when the sub-division degree is insufficient, the acceleration algorithm of parallelogram approximation will further deteriorate the reconstruction results.

As shown in Fig. 15 for a simple plane with texture, the reconstruction results of texture rendering by self-similar segmentation are unsatisfactory due to the insufficient sub-division degree M, e.g., M = 50. The objective evaluation results of SSIM indicate that the reconstruction results are further deteriorated by parallelogram approximation in the case of insufficient M. To ensure a high SSIM value, simple models such as a simple plane also require a larger M value to ensure rendering accuracy, which will result in a large number of sub-triangles. These conclusions apply to the parallelogram approximation used in the present investigation.

 figure: Fig. 15.

Fig. 15. Numerical reconstruction of texture mapping rendering of the “Single triangle” distribution using two methods with different subdivision degree M

Download Full Size | PDF

However, in practical calculations, we usually encounter 3D objects composed of polygons of different sizes; when reconstructing the light field of such models by the full analytical texture rendering polygon-based algorithm with self-similar segmentation, the larger polygons usually require a higher degree of subdivision to maintain the same rendering accuracy as the smaller polygons. If we use a constant degree of subdivision M for all triangles for texture rendering, the final result will either lead to insufficient rendering accuracy for the larger triangles (as M is not large enough) but too many subdivisions for the smaller triangles. To solve this problem, one can employ a processing method that adaptively selects different values of the degree of sub-division M based on the area of polygons of different sizes, for example. This is an area of research worth investigating in the future.

4.3 Optical reconstruction

We have rendered the light field distribution of “Alex” with different texture mappings and performed optical reconstruction. The model of the spatial light modulator (SLM) is HOLOEYE PLUTO2 (NIR-011) with resolution of 1920 × 1080 (Full HD 1080p) and with pixel pitch of 8$\mu m.$ The active area is 15.36 mm × 8.64 mm. The wavelength of the light wave emitted by the laser is 0.532$\mu m$. The image receiver is MMRY UC900C Charge-coupled device. The schematic diagram of the optical setup is shown in Fig. 16. The light beam from the laser is first expanded by the beam expander (BE), and is then collimated by the collimator lenses (CL). The polarizing beam splitter (PBS) allows the light field to be phase-modulated by the spatial light modulator (SLM), which reconstructs the hologram.

 figure: Fig. 16.

Fig. 16. Schematic diagram of optical reconstructions

Download Full Size | PDF

The reconstructed image is to be imaged by the lens to the charge-coupled device (CCD). The screen (S) is used to block any unwanted light. The results of numerical and optical reconstructions are shown in Fig. 17.

 figure: Fig. 17.

Fig. 17. Numerical and optical reconstructions of texture mapping with different texture information for the light field distribution of “Alex"$(a )$Texture-wood; stone; wallpaper; 20 ${\times} $ 20 checkerboard grid, $(b)$ Numerical reconstructions of different texture mappings, $(c)$ Optical reconstruction of different texture mappings

Download Full Size | PDF

5. Concluding remarks

We have developed a full analytical polygon-based holographic generation method with texture rendering. A self-similar segmentation method is proposed along with an affine transformation. We have also proposed a texture mapping based on planar projection mapping for the full analytical polygon-based method and a self-similar segmentation method using parallelogram approximation. We have compared our method with that of Kim et al. and our method has shown to steadily reduce nearly 50% of the computational effort in high precision texture rendering. In addition, the proposed method is more computational efficient by a factor of two. The proposed method is validated by simulations and optical experiments. We believe the method proposed also has greater potential in subsequent adaptive segmentation.

Funding

National Natural Science Foundation of China (62275113); Yunnan Provincial Science and Technology Department (Xing Dian Talent Support Program); Yunnan Provincial Science and Technology Department (202201AU070159).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. Y. Zhang and T.-C. Poon, Modern Information Optics with MATLAB, Cambridge University, Cambridge, U.K. (2023).

2. K. Matsushima, H. Schimmel, and F. Wyrowski, “Fast calculation method for optical diffraction on tilted planes by use of the angular spectrum of plane waves,” J. Opt. Soc. Am. A 20(9), 1755–1762 (2003). [CrossRef]  

3. Y. Pan, Y. Wang, J. Liu, X. Li, J. Jia, and Z. Zhang, “Analytical brightness compensation algorithm for traditional polygon-based method in computer-generated holography,” Appl. Opt. 52(18), 4391–4399 (2013). [CrossRef]  

4. H. Nishi, K. Matsushima, and S. Nakahara, “Rendering of specular surfaces in polygon-based computer-generated holograms,” Appl. Opt. 50(34), H245–H252 (2011). [CrossRef]  

5. K. Matsushima, “Formulation of the rotational transformation of wave fields and their application to digital holography,” Appl. Opt. 47(19), D110–D116 (2008). [CrossRef]  

6. K. Matsushima, “Computer-generated holograms for three-dimensional surface objects with shade and texture,” Appl. Opt. 44(22), 4607–4614 (2005). [CrossRef]  

7. K. Matsushima, H. Nishi, and S. Nakahara, “Simple wave-field rendering for photorealistic reconstruction in polygon-based high-definition computer holography,” J. Electron. Imag. 21(2), 1 (2012). [CrossRef]  

8. L. Ahrenberg, P. Benzie, M. Magnor, and J. Watson, “Computer generated holograms from three dimensional meshes using an analytic light transport model,” Appl. Opt. 47(10), 1567–1574 (2008). [CrossRef]  

9. H. Kim, J. Hahn, and B. Lee, “Mathematical modeling of triangle-mesh-modeled three-dimensional surface objects for digital holography,” Appl. Opt. 47(19), D117–D127 (2008). [CrossRef]  

10. Y. Pan, Y. Wang, J. Liu, X. Li, and J. Jia, “Improved full analytical polygon-based method using Fourier analysis of the three-dimensional affine transformation,” Appl. Opt. 53(7), 1354–1362 (2014). [CrossRef]  

11. Y.-P. Zhang, F. Wang, T.-C. Poon, S. Fan, and W. Xu, “Fast generation of full analytical polygon-based computer-generated holograms,” Opt. Express 26(15), 19206–19224 (2018). [CrossRef]  

12. Y. Zhang, H. Fan, F. Wang, X. Gu, X. Qian, and T.-C. Poon, “Polygon-based computer-generated holography: a review of fundamentals and recent progress [Invited],” Appl. Opt. 61(5), B363–B374 (2022). [CrossRef]  

13. H. Fan, B. Zhang, Y. Zhang, F. Wang, W. Qin, Q. Fu, and T-C. Poon, “Fast 3D Analytical Affine Transformation for Polygon-Based Computer-Generated Holograms,” Appl. Sci. 12(14), 6873 (2022). [CrossRef]  

14. D. Pi, J. Liu, and Y. Wang, “Review of computer-generated hologram algorithms for color dynamic holographic three-dimensional display,” Light: Sci. Appl. 11(1), 231 (2022). [CrossRef]  

15. W. Lee, D. Im, J. Paek, J. Hahn, and H. Kim, “Semi-analytic texturing algorithm for polygon computer generated holograms,” Opt. Express 22(25), 31180–31191 (2014). [CrossRef]  

16. Y-M Ji, H. Yeom, and J-H. Park, “Efficient texture mapping by adaptive mesh division in mesh-based computer-generated hologram,” Opt. Express 24(24), 28154–28169 (2016). [CrossRef]  

17. Q.-Y. Fu, Y. Zhang, B. Zhang, and T-C. Poon, “Texture Mapping Based on Planar Projection Mapping in fully analytic polygon-based computer-generated holography,” Paper JTu4B. 51, FiO + LS (2022). [CrossRef]  

18. Y. Zhao, L. Cao, H. Zhang, D. Kong, and G. Jin, “Accurate calculation of computer-generated holograms using angular-spectrum layer-oriented method,” Opt. Express 23(20), 25440–25449 (2015). [CrossRef]  

19. F. Wang, T. Shimobaba, Y. Zhang, T. Kakue, and T. Ito, “Acceleration of polygon-based computer-generated holograms using look-up tables and reduction of the table size via principal component analysis,” Opt. Express 29(22), 35442–35455 (2021). [CrossRef]  

20. K. Matsushima, Introduction to Computer Holography: Creating Computer-Generated Holograms as the Ultimate 3D Images, Series in Display Science and Technology, Springer (2020).

21. D. Hearn, M. P. Baker, and W. Carithers, “Computer Graphics with OpenGL.” Prentice Hall Professional Technical Reference (2003).

22. . Stony Brook University 3D Scanning Laboratory, https://www3.cs.stonybrook.edu/∼gu/software/holoimage/index.html.

23. J. H. Park, S. B. Kim, H. J. Yeom, H. J. Kim, H. Zhang, B. Li, Y. M. Ji, S. H. Kim, and S. B. Ko, “Continuous shading and its fast update in fully analytic triangular-mesh-based computer generated hologram,” Opt. Express 23(26), 33893–33901 (2015). [CrossRef]  

24. F. Wang, T. Ito, and T. Shimobaba, “High-speed rendering pipeline for polygon-based holograms,” Photonics Res. 11(2), 313 (2023). [CrossRef]  

25. D. -M. Yan and P. Wonka, “Non-Obtuse Remeshing with Centroidal Voronoi Tessellation,” in IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 9, pp. 2136–2144, 1 Sept. (2016).

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (17)

Fig. 1.
Fig. 1. 3D object and its light field distribution on the hologram plane.
Fig. 2.
Fig. 2. Mapping between (unit) primitive and arbitrary triangles: (a) unit triangle (b) arbitrary triangle.
Fig. 3.
Fig. 3. $(a )$ Side view of projected texture mapping, $(b )$ Perspective view of the mapping.
Fig. 4.
Fig. 4. Mapping of surface function.
Fig. 5.
Fig. 5. Triangle composed of ${M^2}$ similar sub-triangles. $(a )$ unit triangle divided into ${M^2}$ similar sub-triangles $(b )$ arbitrary triangle divided into ${M^2}$ sub-triangles.
Fig. 6.
Fig. 6. Integral limits for the calculation of spectrum: (${\boldsymbol a}$) for Forward sub-triangle ${\mathrm{\Psi }_{F,i}}({m,n} )$, (${\boldsymbol b}$) for downward-oriented sub-triangle ${\mathrm{\Psi }_{R,i}}({m,n} ).$ When $({m,n} )= ({0,0} )$, we have the red and blue sub-triangle within the unit triangle.
Fig. 7.
Fig. 7. Coordinates of sub-triangles and their barycenters.
Fig. 8.
Fig. 8. Barycenter of sub-triangles and sampling of the texture function ($a$) Barycenter of sub-triangles (red and purple dots for Forward and Reverse sub-triangles, respectively) in the unit triangle ($b$) Barycenter of sub-triangles in the arbitrary triangle.
Fig. 9.
Fig. 9. Mapping between unit triangle and arbitrary triangle under self-similar segmentation using parallelogram-approximation. $(a )$ Forward and Reverse sub-triangles giving a parallelogram. $(b )$ Arbitrary triangle obtained by linear mapping of parallelogram after parallelogram- approximation.
Fig. 10.
Fig. 10. Integral limits of a sub- parallelogram ${\mathrm{\Theta }_i}({m,n} )$.
Fig. 11.
Fig. 11. 3D object “Alex” with 7243 polygons using mesh regularization. $(a )$ 3D mesh of Alex from a publicly accessible geometric surface from the 3D Scanning Laboratory in Stony Brook [22] $(b )$ numerical reconstruction of “Alex” light field distribution without texture mapping
Fig. 12.
Fig. 12. Comparisons between our proposed method and Kim et al.’s. $a$) Number of sub-polygons vs. M, $b$) Calculation time vs. $M$
Fig. 13.
Fig. 13. Testing texture $({\boldsymbol a} )$ “metal sheet” $({\boldsymbol b} )$ “ wallpaper “ from wildtextures.com
Fig. 14.
Fig. 14. Numerical reconstruction of texture mapping rendering of the “Alex” light field distribution using two methods with different subdivision degree M
Fig. 15.
Fig. 15. Numerical reconstruction of texture mapping rendering of the “Single triangle” distribution using two methods with different subdivision degree M
Fig. 16.
Fig. 16. Schematic diagram of optical reconstructions
Fig. 17.
Fig. 17. Numerical and optical reconstructions of texture mapping with different texture information for the light field distribution of “Alex"$(a )$Texture-wood; stone; wallpaper; 20 ${\times} $ 20 checkerboard grid, $(b)$ Numerical reconstructions of different texture mappings, $(c)$ Optical reconstruction of different texture mappings

Equations (36)

Equations on this page are rendered with MathJax. Learn more.

$${U_O}({x,y} )= \mathop \sum \nolimits_{i = 1}^n {U_i}({x,y} ). $$
$${U_O}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n {A_i}({{f_x},{f_y}} )} \right\},$$
$$sur{f_i}({x,y;z({x,y} )} )= \left\{ {\begin{array}{{cc}} 1&{,inside{\; }of{\; }{\mathrm{\Phi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Phi }_i}} \end{array}} \right.,$$
$$\scalebox{0.95}{$\displaystyle{A_i}({{f_x},{f_y}} )= \mathop {\int\!\!\!\int }\nolimits_{{\mathrm{\Phi }_i}}^{\; } sur{f_i}({x,y;z({x,y} )} )\textrm{exp}\left[ { - \textrm{j}2\mathrm{\pi }\left( {{f_x}x + {f_y}y + z({x,y} )\sqrt {\frac{1}{{{\lambda^2}}} - {f_x}^2 - {f_y}^2} - \frac{{z({x,y} )}}{\lambda }} \right)} \right]dxdy,$}$$
$$sur{f_p}({{x_p},{y_p}} )= \left\{ {\begin{array}{{cc}} 1&{,inside{\; }of{\; }{\mathrm{\Psi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Psi }_i}} \end{array}} \right.,$$
$$\left[ {\begin{array}{{c}} x\\ y\\ z \end{array}} \right] = \left[ {\begin{array}{{c}} {\begin{array}{{ccc}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{{ccc}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{{ccc}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{{c}} {{x_p}}\\ {{y_p}}\\ 1 \end{array}} \right].$$
$$\begin{array}{{c}} {({x_p},{y_p}) = ({0,0} )\to ({x,y,z} )= ({{x_{i1}},{y_{i1}},{z_{i1}}} ),}\\ {({x_p},{y_p}) = ({1,0} )\to ({x,y,z} )= ({{x_{i2}},{y_{i2}},{z_{i2}}} ),\; }\\ {({x_p},{y_p}) = ({0,1} )\to ({x,y,z} )= ({{x_{i3}},{y_{i3}},{z_{i3}}} ).} \end{array}$$
$$\left[ {\begin{array}{{@{}c@{}}} {{x_{i1}}}\\ {{y_{i1}}}\\ {{z_{i1}}} \end{array}} \right] = \left[ {\begin{array}{{@{}c@{}}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 0\\ 0\\ 1 \end{array}} \right],\left[ {\begin{array}{@{}c@{}} {{x_{i2}}}\\ {{y_{i2}}}\\ {{z_{i2}}} \end{array}} \right] = \left[ {\begin{array}{@{}c@{}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 1\\ 0\\ 1 \end{array}} \right],\left[ {\begin{array}{@{}c@{}} {{x_{i3}}}\\ {{y_{i3}}}\\ {{z_{i3}}} \end{array}} \right] = \left[ {\begin{array}{@{}c@{}} {\begin{array}{@{}ccc@{}} {{a_1}}&{{a_2}}&{{c_1}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_3}}&{{a_4}}&{{c_2}} \end{array}}\\ {\begin{array}{@{}ccc@{}} {{a_5}}&{{a_6}}&{{c_3}} \end{array}} \end{array}} \right]\left[ {\begin{array}{@{}c@{}} 0\\ 1\\ 1 \end{array}} \right].$$
$$\left[ \begin{matrix} x \\ y \\ z \end{matrix} \right] = \left[ \begin{matrix} {\left( {x_{i2}-x_{i1}} \right)} & {\left( {x_{i3}-x_{i1}} \right)} & {x_{i1}} \\ {\left( {y_{i2}-y_{i1}} \right)} & {\left( {y_{i3}-y_{i1}} \right)} & {y_{i1}} \\ {\left( {z_{i2}-z_{i1}} \right)} & {\left( {z_{i3}-z_{i1}} \right)} & {z_{i1}} \end{matrix} \right] \left[ \begin{matrix} {x_p} \\ {y_p} \\ 1 \end{matrix} \right].$$
$${A_i}({{f_x},{f_y}} )= \mathrm{{\cal J}} \cdot p \cdot \mathop {\int\!\!\!\int }\nolimits_{{\mathrm{\Psi }_i}}^{\; } sur{f_i}({{x_p},{y_p}} )\cdot \textrm{exp}({ - j2\pi {f_{xMi}} \cdot {x_p}} )\cdot \textrm{exp}({ - j2\pi {f_{yMi}} \cdot {y_p}} )d{x_p}d{y_p},$$
$$\mathrm{{\cal J}} = \left|{\begin{array}{{cc}} {\frac{{\partial {x_p}}}{{\partial x}}}&{\frac{{\partial {x_p}}}{{\partial y}}}\\ {\frac{{\partial {y_p}}}{{\partial x}}}&{\frac{{\partial {y_p}}}{{\partial y}}} \end{array}} \right|\approx \left|{\begin{array}{{cc}} {({{x_{i2}} - {x_{i1}}} )}&{({{y_{i2}} - {y_{i1}}} )}\\ {({{x_{i3}} - {x_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )} \end{array}} \right|= |{{x_{i2}}{y_{i3}} + {x_{i1}}{y_{i1}} + {x_{i1}}{y_{i2}} - {x_{i3}}{y_{i2}}} |,$$
$${f_{xMi}} = ({{x_{i2}} - {x_{i1}}} ){f_x} + ({{y_{i2}} - {y_{i1}}} ){f_y} + ({{z_{i2}} - {z_{i1}}} ){f_z} - ({{z_{i2}} - {z_{i1}}} )/\lambda ,$$
$${f_{yMi}} = ({{x_{i3}} - {x_{i1}}} ){f_x} + ({{y_{i3}} - {y_{i1}}} ){f_y} + ({{z_{i3}} - {z_{i1}}} ){f_z} - ({{z_{i3}} - {z_{i1}}} )/\lambda ,$$
$$p = \textrm{exp}[{ - j2\pi ({{x_{i1}}{f_x} + {y_{i1}}{f_y} + {z_{i1}}{f_z} - {z_{i1}}/\lambda } )} ],$$
$${A_i}\left( {{f_x},{f_y}} \right) = {{\cal J}} \cdot p \cdot \mathop {\int\!\!\!\int }\nolimits_{{{\Psi }_i}}^{\; } sur{f_p}\left( {{x_p},{y_p}} \right) \cdot \textrm{exp} \left( { - j2\pi {f_{xMi}} \cdot {x_p}} \right) \cdot \textrm{exp}\left( { - j2\pi {f_{yMi}} \cdot {y_p}} \right)d{x_p}d{y_p}.$$
$$\begin{array}{ll} {A_p}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )&= \mathop {\int\!\!\!\int }\nolimits_{\mathrm{\Psi }_i} sur{f_p}({{x_p},{y_p}} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ &= \mathop \smallint \nolimits_0^1 \mathop \smallint \nolimits_0^{ - {x_p} + 1} 1 \cdot \textrm{exp}({ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} )d{x_p}d{y_p}\\ &= \frac{{\textrm{exp}({ - j2\pi {f_x}^\mathrm{^{\prime}}} )- 1}}{{4{\pi ^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} ({ - j2\pi {f_x}^\mathrm{^{\prime}}} )- \textrm{exp} ({ - j2\pi {f_y}^\mathrm{^{\prime}}} )}}{{4{\pi ^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}\; . \end{array}$$
$${A_i}({{f_x},{f_y}} )= \mathrm{{\cal J}} \cdot p \cdot {A_p}({{f_{xMi}},{f_{yMi}}} ).$$
$${U_O}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_p}({{f_{xMi}},{f_{yMi}}} )} ]} \right\}.$$
$${x_t} = x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}};{y_t} = y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}}.$$
$${x_t} = x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}} \to x{\; };{\; \; }{y_t} = y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}} \to y{\; },$$
$$sur{f_{Ti}}({x,y;z} )= \left\{ {\begin{array}{{cc}} {T\left( {x \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}},y \cdot \frac{{|{{z_t} - {z_L}} |}}{{|{z({x,y} )- {z_L}} |}}} \right)}&{,inside{\; }of{\; }{\mathrm{\Phi }_i}}\\ 0&{,outside{\; }of{\; }{\mathrm{\Phi }_i}} \end{array}} \right.$$
$$\begin{array}{{c}} {sur{f_{p,F}}({{x_p},{y_p},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_F}({m,n} )}&{,inside{\; }of\; {\mathrm{\Psi }_{F,i}}({m,n} )}\\ 0&{,outside{\; }of\; {\mathrm{\Psi }_{F,i}}({m,n} )} \end{array};} \right.}\\ {sur{f_{p,R}}({{x_p},{y_p},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_R}({m,n} )}&{,inside{\; }of\; {\mathrm{\Psi }_{R,i}}({m,n} )}\\ 0&{,outside{\; }of\; {\mathrm{\Psi }_{R,i}}({m,n} )} \end{array}} \right.;} \end{array}$$
$$\begin{aligned} \begin{array}{{c}} {{A_{p,T,F}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} ) = \mathop \smallint \nolimits_{m/M}^{\frac{{m + 1}}{M}} \; \; \; \; \; \mathop \smallint \nolimits_{n/M}^{{\; } - {x_p} + \frac{{m + n + 1}}{M}} ren{d_F}({m,n} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}} \end{array}\\ = ren{d_F}({m,n} )\cdot \left[ {\frac{{\textrm{exp} \left( { - j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - 1}}{{4{\pi^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} \left( { - j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - \textrm{exp} \left( { - j2\pi \frac{1}{M}{f_y}^\mathrm{^{\prime}}} \right)}}{{4{\pi^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}} \right]\\ \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ = \frac{1}{M}{A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,n} )\cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right], \end{aligned}$$
$$\begin{array}{l} {A_{p,T,R}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )= \mathop \smallint \nolimits_{\frac{m}{M}}^{\frac{{m + 1}}{M}} \mathop \smallint \nolimits_{ - {x_p} + \frac{{m + n + 1}}{M}}^{\frac{{n + 1}}{M}} ren{d_R}({m,n} )\cdot \textrm{exp}[{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ = ren{d_R}({m,n} )\left[ {\frac{{\textrm{exp} \left( {j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - 1}}{{4{\pi^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} - \frac{{\textrm{exp} \left( {j2\pi \frac{1}{M}{f_x}^\mathrm{^{\prime}}} \right) - \textrm{exp} \left( {j2\pi \frac{1}{M}{f_y}^\mathrm{^{\prime}}} \right)}}{{4{\pi^2}({{f_x}^\mathrm{^{\prime}} - {f_y}^\mathrm{^{\prime}}} ){f_y}^\mathrm{^{\prime}}}}} \right]\\ \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ = \frac{1}{M}{A_p}\left( { - \frac{{{f_x}^\mathrm{^{\prime}}}}{M}, - \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_R}({m,n} )\cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}}} \right] \cdot \textrm{exp} \left[ { - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]. \end{array}$$
$$\begin{aligned}& {A_{p,T}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 1} \mathop \sum \nolimits_{n = 0}^{M - 1} {A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,n} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{n}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]\\ &\quad+ \mathop \sum \nolimits_{m = 0}^{M - 2} \mathop \sum \nolimits_{n = 0}^{M - 2} {A_p}\left( { - \frac{{{f_x}^\mathrm{^{\prime}}}}{M}, - \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_R}({m,n} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{{m - 1}}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{{n + 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right]. \end{aligned}$$
$${U_{O,T}}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\left\{ {\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_{p,T}}({{f_{xMi}},{f_{yMi}}} )} ]} \right\}.$$
$$\begin{array}{l} {\; }{B_F}({m,n} )\; = \left[ {\begin{array}{{c}} {{x_F}({m,n} )}\\ {{y_F}({m,n} )}\\ {{z_F}({m,n} )} \end{array}} \right] = \left[ {\begin{array}{{ccc}} {({{x_{i2}} - {x_{i1}}} )}&{({{x_{i3}} - {x_{i1}}} )}&{{x_{i1}}}\\ {({{y_{i2}} - {y_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )}&{{y_{i1}}}\\ {({{z_{i2}} - {z_{i1}}} )}&{({{z_{i3}} - {z_{i1}}} )}&{{z_{i1}}} \end{array}} \right]\left[ {\begin{array}{{c}} {\frac{{3m + 1}}{{3M}}}\\ {\frac{{3n + 1}}{{3M}}}\\ 1 \end{array}} \right]\\ \begin{array}{{c}} \; \\ {{B_R}({m,n} )= \left[ {\begin{array}{{c}} {{x_R}({m,n} )}\\ {{y_R}({m,n} )}\\ {{z_R}({m,n} )} \end{array}} \right] = \left[ {\begin{array}{{ccc}} {({{x_{i2}} - {x_{i1}}} )}&{({{x_{i3}} - {x_{i1}}} )}&{{x_{i1}}}\\ {({{y_{i2}} - {y_{i1}}} )}&{({{y_{i3}} - {y_{i1}}} )}&{{y_{i1}}}\\ {({{z_{i2}} - {z_{i1}}} )}&{({{z_{i3}} - {z_{i1}}} )}&{{z_{i1}}} \end{array}} \right]\left[ {\begin{array}{{c}} {\frac{{3m + 2}}{{3M}}}\\ {\frac{{3n + 2}}{{3M}}}\\ 1 \end{array}} \right]} \end{array} \end{array}, $$
$$\begin{array}{{c}} {ren{d_F}({m,n} )= T\left( {{x_F}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,n} )- {z_L}} |}},{y_F}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,n} )- {z_L}} |}}} \right)}\\ {ren{d_R}({m,n} )= T\left( {{x_R}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_R}({m,n} )- {z_L}} |}},{y_R}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_R}({m,n} )- {z_L}} |}}} \right)} \end{array}. $$
$$sur{f_{p,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )= \left\{ {\begin{array}{{cc}} {ren{d_P}({m,n} )}&{,inside{\; }of{\; }{\mathrm{\Theta }_i}({m,n} )}\\ 0&{,outside{\; }of{\; }{\mathrm{\Theta }_i}({m,n} )} \end{array}\; } \right., $$
$$\scalebox{0.8}{$\begin{aligned} {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} )&= \mathop \smallint \nolimits_{\frac{m}{M}}^{\frac{{m + 1}}{M}} \mathop \smallint \nolimits_{\frac{n}{M}}^{\; \frac{{n + 1}}{M}} ren{d_P}({m,n} )\cdot \textrm{exp} [{ - j2\pi ({{x_p}{f_x}^\mathrm{^{\prime}} + {y_p}{f_y}^\mathrm{^{\prime}}} )} ]d{x_p}d{y_p}\\ &= ren{d_P}({m,n} )\frac{{\left\{ {\textrm{exp}\left( { - j2\pi \frac{{{f_x}^\mathrm{^{\prime}}}}{M}} \right) + \textrm{exp}\left( { - j2\pi \frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) - \textrm{exp} \left[ { - j2\pi \frac{{({{f_y}^\mathrm{^{\prime}} + {f_x}^\mathrm{^{\prime}}} )}}{M}} \right] - 1} \right\}}}{{4{\pi ^2}{f_x}^\mathrm{^{\prime}}{f_y}^\mathrm{^{\prime}}}} \cdot \textrm{exp} \left[ { - j2\pi \frac{{({n{f_y}^\mathrm{^{\prime}} + m{f_x}^\mathrm{^{\prime}}} )}}{M}} \right] \end{aligned}$}$$
$${A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 2} \mathop \sum \nolimits_{n = 0}^{M - 2} {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}},m,n} ).$$
$${A_{p,T,u,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= \mathop \sum \nolimits_{m = 0}^{M - 1} {A_p}\left( {\frac{{{f_x}^\mathrm{^{\prime}}}}{M},\frac{{{f_y}^\mathrm{^{\prime}}}}{M}} \right) \cdot ren{d_F}({m,{n_F}} )\cdot \textrm{exp}\left[ { - j2\pi \left( {\frac{m}{M}} \right){f_x}^\mathrm{^{\prime}} - j2\pi \left( {\frac{{M - m - 1}}{M}} \right){f_y}^\mathrm{^{\prime}}} \right],$$
$${A_{p,T}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )= {A_{p,T,F,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} )+ {A_{p,T,P}}({{f_x}^\mathrm{^{\prime}},{f_y}^\mathrm{^{\prime}}} ).$$
$${U_{O,T,Po}}({x,y} )= {\mathrm{{\cal F}}^{ - 1}}\mathop \sum \nolimits_{i = 1}^n [{\mathrm{{\cal J}} \cdot p \cdot {A_{p,T}}({{f_{xMi}},{f_{yMi}}} )} ].$$
$$\begin{array}{l} ren{d_F}({m,{n_F}} )= T\left( {{x_F}({m,{n_F}} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,{n_F}} )- {z_L}} |}},{y_F}({m,{n_F}} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_F}({m,{n_F}} )- {z_L}} |}}} \right)\\ ren{d_P}({m,n} )= T\left( {{x_P}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_P}({m,n} )- {z_L}} |}},{y_P}({m,n} )\cdot \frac{{|{{z_t} - {z_L}} |}}{{|{{z_P}({m,n} )- {z_L}} |}}} \right) \end{array}, $$
$${I_i} = \left\{ {\begin{array}{{cc}} {\sqrt {|{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L}} |} }&{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L} < 0}\\ 0&{{{\hat{n}}_{pi}} \cdot {{\hat{n}}_L} > 0} \end{array}} \right.$$
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.