Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

3D reconstruction of the specular surface using an iterative stereoscopic deflectometry method

Open Access Open Access

Abstract

Phase measuring deflectometry (PMD) is an effective technique for three-dimensional measurement of specular surfaces. However, the ambiguity of monoscopic PMD and the time-consuming searching process of stereoscopic PMD are challenges for specular surface reconstruction. To solve it, we propose an iterative reconstruction algorithm for the stereoscopic phase measuring deflectometry system free of the time-consuming searching process for each pixel. An arbitrary seed point on the specular surface is accurately obtained via a coarse-to-fine optimization means without any other expensive and complicate auxiliaries. Then, a plane with the height of seed point is set as the initial surface form for the iteration, in which the pinhole model is used to find the linear relation to update the surface form. The converging height is the output as the final result. Simulations and experiments verify the feasibility and efficiency of our proposed method based on the stereoscopic phase measuring deflectometry system. The accuracy and robustness are comprehensively evaluated as well.

© 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

Three-dimensional (3D) reconstruction is of great significance in industrial applications. Fringe projection (structured light) is widely used in the reconstruction of diffuse surfaces [13]. But for the surface with specular properties, such as metal polished surface, mirror surface and transparent glass, structured light projection method cannot work well. Due to the reflective property of the surface of high-gloss objects, the measurement of their 3D surface morphology is always a challenge. The existing optical non-contact methods for measuring mirror objects are mainly divided into interferometry and deflectometry [4,5]. The interferometry obtains the distance information with the phenomenon of interference [6,7]. It has high measurement accuracy and resolution, but it is unable to measure objects with large curvature surface. Even for the free-form specular surface, it is difficult to reconstruct. Moreover, the complicated operation and the exorbitant price limit its application. The phase measuring deflectometry can break the limit and restore the 3D morphology of the specular object via geometric relationship between the deflection of the light and the surface under test (SUT). The PMD has become a research hotspot due to its advantages of simple principle, low cost, high dynamic range and full-field measurement in measuring mirror objects [810]. For a typical PMD system, the fringe patterns generated by software are displayed on a screen, namely a liquid crystal display (LCD), then the camera (CCD) captures the deformed reflected patterns, which is decoded to extract phase information for the corresponding pixels between the LCD and CCD. The PMD is a specular 3D measurement technique based on slope calculation, then slope integration [1113] is adopted to recover the 3D shape data of the SUT. The above principle is applicable for both monoscopic PMD (mono-PMD) and stereoscopic PMD (stereo-PMD), but different challenges are encountered in each case.

For a mono-PMD system, the height-normal ambiguity is ubiquitous due to the fact that the phase information is modulated by both the height and the slope of the SUT. To solve the ambiguity, different techniques have been investigated. One classical solution is to either move the screen [14,15] or apply a plate beam splitter to realize the parallel design of two LCD screens, which was named as direct PMD (DPMD) [16,17]. The DPMD determines the ray from the LCD to the SUT and obtains the surface directly by triangulation. However, such physical displacement deteriorates the measurement precision if we consider component displacement errors, so it has strict requirements on operating accuracy. Similar to DPMD system, Li et al. proposed a bi-plane PMD scheme, where the bi-plane is obtained by directly covering a transparent panel above the LCD screen [18]. Another solution is assuming a prior height distribution, rough shape and position of the measured surface is required to be estimated. Su et al. developed a software-configurable optical test system to measure telescope mirrors based on the advanced model [19,20]. Huang et al. further improved mono-PMD by applying a well-established mathematical model [21]. Moreover, Graves et al. presented a novel model-free iterative data-processing approach for deflectometry tests of unknown surfaces with a seed point located by a coordinate measurement machine (CMM) [22,23]. Similarity, Li et al. recovered the specular surface with the help of a confocal white-light distance sensor or the laser sources [24]. The auxiliary equipments are expensive and need to be carefully calibrated with the PMD system. In addition, some calibration optimization algorithms [2527] and error compensation [2830] means can also relieve ambiguity and improve accuracy.

For the stereo-PMD system, matching corresponding points is the major challenge. Different from traditional binocular vision, the feature consistency cannot be acquired from the images. The correspondence is searched by the consistency of two normal vectors that calculated by the Snell's law. One method is searching correspondences along the epipolar line on the image [31] and another common solution is searching the surface point in 3D space [8,3234]. Recently, Zhang et al. proposed a novel method to find the correspondence by minimizing the phase difference on the LCD instead of the angular difference of two normal vectors [35]. However, it spends a lot of time to find the correspondence for each pixel.

In consideration of the need of auxiliary to position the seed point in the mono-PMD as well as the time-consuming of the stereo-PMD, we propose a novel iterative reconstruction algorithm for stereo-PMD without the expensive and complicated auxiliary. An arbitrary seed point on the SUT is accurately obtained via a coarse-to-fine optimization means. Then a flat surface with the height of seed point is defined as the initial input for the iteration, in which the coordinate of the seed point is used to define the piston of the SUT because the integration algorithms reconstruct the relative surface rather than the absolute height. The pinhole model is used to established a liner relation to update the SUT iteratively, avoiding the complex surface segmentation in model-free framework [22,23]. Finally, the converging surface is output as the result of the SUT.

The outline of this paper is as follows. Section 2 introduces the principle of the proposed method in details. The simulation is carried out in MATLAB to verify the feasibility of the method in section 3. Section 4 shows the practicability of the method through actual measurements. The conclusion is given by the last section.

2. Principle

As shown in Fig. 1, the general stereo-PMD system consists of two cameras symbolled as Ol and Or, an LCD screen and the SUT. Structured light patterns (SLPs) displayed on the screen are reflected by the specular surface, and captured by both cameras. In other words, the cameras capture the virtual image of the real screen. The correspondence between each camera pixels and the screen pixels are matched by decoding the SLPs. As for the correspondence of the pixels p and q in two cameras, the same surface point M shows different features in two cameras, which is the distinct difference from binocular vision. Therefore, we turn to 3D space instead of the 2D image. To find the correspondence, the angular difference of two normal vectors nl and nr is treated as the cost function for matching.

 figure: Fig. 1.

Fig. 1. The general stereo-PMD system.

Download Full Size | PDF

2.1 Position of the seed point

Different from the previous works [2224] which positions the seed point with auxiliary equipment in mono-PMD system, we use the normal consistence of the stereo-PMD to locate the seed point. The seed point is used for initialization and determining the piston of the SUT in iteration, therefore, the precision should be guaranteed. To this end, a coarse-to-fine optimization algorithm is investigated to avoid the local converge. For the first step, the classical stereo-PMD technique proposed by Knauer et al. [8] is applied to get the coarse position. As shown in Fig. 1. Space points are searched along the probe ray by left camera. Suppose M to be the seed point on the SUT, viewed at pixel p on left camera and pixel q on right camera. The corresponding screen point p’ and q’ on the LCD are located by the phase information. Assuming the stereo-PMD system has been calibrated, the incident rays l, r and reflected rays m, s of each camera can be acquired. Two normal vectors at the point M are calculated by the Snell's law respectively:

$$\left\{ \begin{array}{l} \textrm{ }{{\boldsymbol n}_{\boldsymbol l}}{\boldsymbol = }\frac{{{\boldsymbol m - l}}}{{||{{\boldsymbol m - l}} ||}}\\ \textrm{ }{{\boldsymbol n}_{\boldsymbol r}}{\boldsymbol = }\frac{{{\boldsymbol s - r}}}{{||{{\boldsymbol s - r}} ||}} \end{array} \right..$$

The angle α of nl and nr is:

$$\alpha = {\cos ^{ - 1}}({{\boldsymbol n}_{\boldsymbol l}} \cdot {{\boldsymbol n}_{\boldsymbol r}}).$$

Theoretically, the angle α should be zero when the searched point is actually on the SUT in condition that the system calibration and phase information is precise enough. Practically, the normal vectors calculated from these two cameras cannot exactly have the same direction due to various errors. Suppose the searching domain is [M1, M2] with evenly nodes of this region, and a series of α is obtained by Eq. (2). The corresponding surface point of the minimum α is marked as Mcoarse. Then to improve the accuracy, Mcoarse is set as the initial input for a nonlinear optimization. The objective function is further minimizing the α and converging to the fine-toned point Mfine in the neighborhood of Mcoarse­. Mfine­ is regarded as the seed point for the following iterative reconstruction. The procedure is shown as Fig. 2.

 figure: Fig. 2.

Fig. 2. The flowchart of the coarse-to-fine algorithm to position the seed point.

Download Full Size | PDF

2.2 Iterative reconstruction algorithm

To reconstruct the specular surface, the iterative sense in mono-PMD is referred. Consider the left camera and the LCD as a mono-PMD system in Fig. 3. A ray from the pixel point P = (xp, yp, zp) goes through the camera optical center Ol­ = (xc, yc, zc), reflected by the SUT at T = (xt, yt, zt), and hits the screen at point S = (xs, ys, zs). The coordinates are all unified to the world coordinate system {w} via the system calibration. Then the x-slope sx and y-slope sy are calculated by Eq. (3) [25]:

$$\left\{ \begin{array}{l} {s_x} = \frac{{\frac{{{x_t} - {x_c}}}{{{d_{t2c}}}} + \frac{{{x_t} - {x_s}}}{{{d_{t2s}}}}}}{{\frac{{{z_c} - {z_t}}}{{{d_{t2c}}}} + \frac{{{z_s} - {z_t}}}{{{d_{t2s}}}}}}\\ {s_y} = \frac{{\frac{{{y_t} - {y_c}}}{{{d_{t2c}}}} + \frac{{{y_t} - {y_s}}}{{{d_{t2s}}}}}}{{\frac{{{z_c} - {z_t}}}{{{d_{t2c}}}} + \frac{{{z_s} - {z_t}}}{{{d_{t2s}}}}}} \end{array} \right., $$
where dt2c and dt2s are the distance from the measured point T to the camera center Ol­ and corresponding screen pixel S, respectively. The surface height to be measured is marked as h. To start with, a plane with the height of the seed point Mfine is regarded as the initial surface form (h°) of SUT. The probe rays l = (xl, yl, zl) can be calculated by the camera intrinsic parameters and transformed to the world coordinate system. The intersection of the rays and the initial plane is marked as T°= ($x_t^0,y_t^0,z_t^0$), which is calculated by Eq. (4):
$$\left\{ \begin{array}{l} x_t^\textrm{0} = (z_t^\textrm{0} - {z_c})\frac{{{x_l}}}{{{z_l}}} + {x_c}\\ y_t^\textrm{0} = (z_t^\textrm{0} - {z_c})\frac{{{y_l}}}{{{z_l}}} + {y_c} \end{array} \right., $$
where $z_t^0 = {h^0}$ is substituted into Eq. (4) and the coordinates of intersected points with respect to each camera pixel are acquired. Then the slope data of the guessed surface can be calculated by Eq. (3) and used for integral reconstruction. Modal method is one of the integral reconstructions with slope information, such as radial basis functions, Chebyshev polynomials or Zernike polynomials [13,21]. Zernike polynomials is chosen for reconstruction due to its widespread application in optical metrology. The SUT can be described as:
$$h(x,y) = \sum\limits_{i = 1}^N {{c_i}{Z_i}(x,y) + {c_0}}, $$
where ci and Zi are i-th term of the coefficients and the Zernike polynomials. The constant term c0 indicates the piston of the surface. To obtain the coefficients in Eq. (5), the analytic derivatives of h should be equal to the measured slope data:
$$\left\{ \begin{array}{l} \frac{{\partial h(x,y)}}{{\partial x}} = {s_x}\\ \frac{{\partial h(x,y)}}{{\partial y}} = {s_y} \end{array} \right..$$

 figure: Fig. 3.

Fig. 3. The iteration starts with initial plane form h° of Mfine’ s height and ends up with the final surface form hn+1.

Download Full Size | PDF

The number of basis function N is adjustable to approach the SUT. The Eq. (6) is overdetermined and can be solved in a least-squares sense. Using the solved coefficients ci, we can apply the interpolant with Eq. (5) to reconstruct the SUT. The seed point Mfine = (xm, ym, zm) is used to calculate the c0 as follows:

$$h({x_m},{y_m}) = {z_m}\textrm{ } \Rightarrow \textrm{ }{c_\textrm{0}}\textrm{ = }{z_m} - \sum\limits_{i = 1}^n {{c_i}{Z_i}({x_m},{y_m})} .$$

The reconstruction height h is regarded as the updated SUT for the next loop. Similar to Eq. (4), for the n-th iteration, the surface point ${T^n} = (x_t^n,y_t^n,z_t^n)$ is updated as:

$$\left\{ \begin{array}{l} x_t^n = ({h^n} - {z_c})\frac{{{x_l}}}{{{z_l}}} + {x_c}\\ y_t^n = ({h^n} - {z_c})\frac{{{y_l}}}{{{z_l}}} + {y_c} \end{array} \right..$$

Then the slope calculation with Eq. (3) and the integral reconstruction with Zernike polynomials are executed repeatedly. The converging height hn+1 is output as the final result of the SUT as shown in Fig. 3. The iterative flowchart is shown in Fig. 4.

 figure: Fig. 4.

Fig. 4. The flowchart of the iterative algorithm.

Download Full Size | PDF

3. Simulation

To verify the feasibility of the proposed stereo-PMD iterative algorithm, a numerical simulation is conducted to reconstruct a concave and a convex surface. The stereo-PMD model is established as shown in Fig. 5. The intrinsic parameters of a real calibrated camera are assigned to the two simulated pinhole camera models. The resolution is 2080×1552 pixels with the pixel pitch of 2.5 um. The lens has a focal length of 12 mm. The optical axes of the two cameras are set to be parallel with a distance of 80 mm. The world coordinate system is located at center of the common field of view (FOV) with a distance of 450 mm to the red camera in Fig. 5. The screen is put on the proper position and the relationship with respect to the cameras are assigned.

 figure: Fig. 5.

Fig. 5. The simulation of stereo-PMD model.

Download Full Size | PDF

Once the system parameters of the simulation model are determined, a concave and a convex sphere surface with a radius of curvature (ROC) of 500 mm are generated as the SUT (Fig. 6(a) and Fig. 6(d)). Their peak and valley are positioned at the coordinate axis center, respectively. The range size is a square with sides of 50 mm. To simplify the simulation process, the reverse ray tracing is applied to find the correspondence between the screen points with each camera pixel. The probe rays’ directions are determined by intrinsic parameters with pinhole model, and the corresponding points on the SUT and the screen are obtained by the intersection of the line and plane with ray tracing method. Then the proposed iterative method shown in the flowchart of Fig. 4 is used for reconstruction. The absolute errors between the reconstruction results and the real SUT are shown in Fig. 6(b) and Fig. 6(e), and the root mean square (RMS) is 9e-4 nm and 1e-3 nm, respectively. The fitted ROC is equal to the real ROC of 500 mm.

 figure: Fig. 6.

Fig. 6. Simulated surfaces (a, d) are reconstructed by the proposed method. The errors without noise (b, e) and with noise (c, f).

Download Full Size | PDF

Then, to better compare with the real situation, the performance with measurement noise on phase is also investigated under the same simulation condition. Normally distributed random noise with standard deviation of 0.1 pixel is added onto the analytical phase map. The reconstructed errors with noise are shown in Fig. 6(c) and Fig. 6(f). The errors of RMS are 0.9 nm and 1.5 nm, respectively. From the simulated results, it is proved that the proposed method is feasible to perform specular surface measurement in the stereo-PMD system.

4. Experiment

To verify the performance of the proposed method in practice, a stereo-PMD system is established as shown in Fig. 7. The system consists of a 13.3-inch portable display and two industrial cameras (FLIR BFS-U3-32S4M-C). The display has a resolution of 1920 × 1080 and the pixel pitch is 0.1534 mm. Both the cameras have the resolution of 2048 × 1536 pixels and the pixel size is 3.45 um, the focal length of the lens is 12 mm. Distance from the SUT to the cameras is about 260 mm. To be fair, each measurement is conducted in MATLAB 2016b of the same PC platform (Intel Core i7-4790CPU @3.60GHz 16GB RAM).

 figure: Fig. 7.

Fig. 7. The established stereo-PMD system.

Download Full Size | PDF

The system should be calibrated before the measurement. Three terms are considered for system calibration, such as camera parameter calibration and system geometric calibration as well as the gamma nonlinearity calibration. Previous work [36] of mono-PMD calibration is extended to this stereo-PMD system. Due to the nonlinear response of digital devices such as screens and cameras, a nonlinear response curve of screen and camera is obtained experimentally [30]. Then, image intensity will be compensated for the captured patterns to reduce the phase error.

After the stereo-PMD system is calibrated, two concave and two convex reflective mirrors with different ROC and diameter (Φ) are measured with the proposed method. The SLPs are sequentially displayed on the LCD and simultaneously captured by two cameras. Two of horizontal and vertical patterns captured by both cameras are shown in Fig. 8. Firstly, the gamma correction is conducted for the sinusoidal patterns with the gamma calibration. Then captured SLPs are decoded for horizontal and vertical phase maps to match the CCD pixel with the LCD pixel. To facilitate calculation, systematic calibration parameters are used to position these corresponding points and transform to the world coordinate system. An arbitrary pixel in left camera is chosen as the correspondence of the seed point Mfine, which is positioned by the procedure in section 2.1. At last, the SUT is reconstructed via the iterative algorithm illustrated in section 2.2.

 figure: Fig. 8.

Fig. 8. (a) and (b) are the vertical and horizontal patterns captured by the left camera; (c) and (d) are the vertical and horizontal patterns captured by the right camera.

Download Full Size | PDF

A concave mirror of Φ = 25 mm with ROC = 304.8 mm is reconstructed in the first row (a-c) of Fig. 9. The 3D model is shown in Fig. 9(a) with the z-axis zoom in and the Fig. 9(b) is the planform of the result. By fitting the point cloud with a sphere, the fitted radius is 303.6 mm. The fitting error map is given in Fig. 9(c), the peak and valley (PV) and the RMS are 380 nm and 69 nm respectively. As we notice that the error map is bended at the edge, where such situation appears in other measurements. We attribute it to the decoding error as the fringe information is not accurate at boundary. Therefore, parts of edges are cut out and the range of result is smaller than the real SUT.

 figure: Fig. 9.

Fig. 9. The comparison of the proposed method (the first row) with classical stereo-PMD method (the second row). The first and second column are the results from axonometric view and top view, respectively. The third column shows the error map.

Download Full Size | PDF

For comparison, above concave mirror is also reconstructed by the classical stereo-PMD method, in which the correspondence of each pixel of two cameras should be established. In this case, the searching process of space points spends a large amount of time. The result is shown in the second row (d-f) of Fig. 9. The fitted ROC is 303.8 mm and the RMS is 89 nm. Though the accuracy is very close, the computing time is sharply decreased with our method. In the experiment, it takes 1779 seconds to complete the measurement while our proposed method takes only 72 seconds. Apparently, our method performs well in both precision and speed.

Then a concave mirror of Φ = 50 mm with large ROC = 1000.0 mm is measured. The result is shown in the first row (a-c) of Fig. 10. The fitted radius is 1006.2mm, as the ROC is so large that little surface error can lead to large radius error. Even though, it is within the ROC tolerance ${\pm} $ 2% provided by the manufacture. The error map is given in Fig. 10(c). The PV and RMS are 1200 nm and 197 nm, respectively.

 figure: Fig. 10.

Fig. 10. The results of the other three SUT. First column is from the axonometric view while the second column from the top view. The third column is the error map.

Download Full Size | PDF

Later on, two circular convex mirrors with different ROC of 105.0 mm and 456.0 mm are measured as well. The second and third row of Fig. 10 represent the results and error maps of two convex SUT, respectively. The reconstructed RMS of errors are 275 nm and 456 nm.

For convenience, the nominal ROC and the measured ROC as well as the fitting errors of the four SUT are listed in Table 1.

Tables Icon

Table 1. Reconstruction Results and Errors of Four SUT.

Apart from the reconstruction accuracy, the robustness of the system is evaluated by repeated measurements as well. Each SUT is measured three times and the average surface is obtained by averaging the three results. As shown in Fig. 11, the first column represents the average surface and the difference between the average shape and individual result is given by the remaining three columns. The PV and RMS of each difference map (piston, tip and tilt removed) illustrate the robustness of the proposed method.

 figure: Fig. 11.

Fig. 11. Repeated measurements of the four SUT. The first column is the average surface from the top view while the rest columns indicate the difference between the average shape and individual results.

Download Full Size | PDF

5. Conclusion

In this paper, a novel iterative algorithm for stereo-PMD is proposed to measure the specular surface. On the one hand, the ambiguity of the mono-PMD is resolved and free of the other detection auxiliary equipment with high cost. On the other hand, the time-consuming searching process in stereo-PMD system is avoided and reconstruction is accelerated. For general mono-PMD technique, the iterative reconstruction with prior shape model or a seed point depends on the user input. Whereas in our method, the seed point is obtained and input to the iteration loop automatically. In addition, not the plane of x-o-y but the height of the seed point is set as the initial surface form, which decreases the number of the iteration apparently, especially when the SUT is far away from the plane of x-o-y. Meanwhile the accuracy of the proposed algorithm is well illustrated by the Table 1. The fitted ROC of four SUT are closed to the nominal ROC with manufacturing tolerance of ±2%. For the concave of Φ = 25 mm, the reconstructed accuracy is approaching nanoscale. Compare with the classical stereo-PMD, the proposed method stands out in both efficiency and accuracy. Moreover, the robustness of the system is also proved by the repeated measurements. The PMD measurement principle depends on the basic Law of Reflection, and the surface normal is determined by performing an inverse ray tracing from the camera pixel to the LCD pixel. The method can be applied for surfaces like mirrors, metal polished and other material surfaces as long as they satisfy the Law of reflection. But for the transparent objects like glass, lights can travel through the front surface by refraction and reach to the back surface, complex light paths make it hard to reconstruction. Further study will focus on the measurement of the transparent glasses as well as the registration for the stereo-PMD and multi-camera PMD system.

Funding

National Natural Science Foundation of China (61775172); Key-Area Research and Development Program of Guangdong Province (2019B010149002, 2020B090925001); Natural Science Foundation of Shenzhen City (JSGG20191129114035610).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. S. Zhang, “Recent progresses on real-time 3D shape measurement using digital fringe projection techniques,” Opt. Lasers Eng. 48(2), 149–158 (2010). [CrossRef]  

2. Z. Song, R. Chung, and X. T. Zhang, “An accurate and robust strip-edge-based structured light means for shiny surface micromeasurement in 3-D,” IEEE Trans. Ind. Electron. 60(3), 1023–1032 (2013). [CrossRef]  

3. C. Zuo, S. Feng, L. Huang, T. Tao, W. Yin, and Q. Chen, “Phase shifting algorithms for fringe projection profilometry: A review,” Opt. Lasers Eng. 109, 23–59 (2018). [CrossRef]  

4. G. Häusler, C. Faber, E. Olesch, and S. Ettl, “Deflectometry vs. interferometry,” Proc. SPIE 8788, 87881C (2013). [CrossRef]  

5. C. Faber, E. Olesch, R. Krobot, and G. Häusler, “Deflectometry challenges interferometry: the competition gets tougher!” Proc. SPIE 8493, 84930R (2012). [CrossRef]  

6. X. Jiang, K. Wang, F. Gao, and H. Muhamedsalih, “Fast surface measurement using wavelength scanning interferometry with compensation of environmental noise,” Appl. Opt. 49(15), 2903–2909 (2010). [CrossRef]  

7. T. Zhang, F. Gao, and X. Jiang, “Surface topography acquisition method for double-sided near-right-angle structured surfaces based on dual-probe wavelength scanning interferometry,” Opt. Express 25(20), 24148–24156 (2017). [CrossRef]  

8. M. C. Knauer, J. Kaminski, and G. Hausler, “Phase measuring deflectometry: a new approach to measure specular free-form surfaces,” Opt. Metrol. Prod. Eng. 5457, 366 (2004). [CrossRef]  

9. L. Huang, M. Idir, C. Zuo, and A. Asundi, “Review of phase measuring deflectometry,” Opt. Lasers Eng. 107, 247–257 (2018). [CrossRef]  

10. J. Balzer and S. Werling, “Principles of shape from specular reflection,” Measurement 43(10), 1305–1317 (2010). [CrossRef]  

11. A. Talmi and E. N. Ribak, “Wavefront reconstruction from its gradients,” J. Opt. Soc. Am. A 23(2), 288–297 (2006). [CrossRef]  

12. H. Ren, F. Gao, and X. Jiang, “Least-squares method for data reconstruction from gradient data in deflectometry,” Appl. Opt. 55(22), 6052–6059 (2016). [CrossRef]  

13. I. Mochi and K. A. Goldberg, “Modal wavefront reconstruction from its gradient,” Appl. Opt. 54(12), 3780–3785 (2015). [CrossRef]  

14. Y. Tang, X. Su, F. Wu, and Y. Liu, “A novel phase measuring deflectometry for aspheric mirror test,” Opt. Express 17(22), 19778–19784 (2009). [CrossRef]  

15. Y. L. Xiao, S. Li, Q. Zhang, J. Zhong, X. Su, and Z. You, “Optical fringe-reflection deflectometry with bundle adjustment,” Opt. Lasers Eng. 105, 132–140 (2018). [CrossRef]  

16. Z. Zhang, Y. Wang, S. Huang, Y. Liu, C. Chang, F. Gao, and X. Jiang, “Three-dimensional shape measurements of specular objects using phase-measuring deflectometry,” Sensors 17(12), 2835 (2017). [CrossRef]  

17. P. Zhao, N. Gao, Z. Zhang, F. Gao, and X. Jiang, “Performance analysis and evaluation of direct phase measuring deflectometry,” Opt. Lasers Eng. 103, 24–33 (2018). [CrossRef]  

18. C. Li, Y. Li, Y. Xiao, X. Zhang, and D. Tu, “Phase measurement deflectometry with refraction model and its calibration,” Opt. Express 26(26), 33510–33522 (2018). [CrossRef]  

19. P. Su, R. E. Parks, L. Wang, R. P. Angel, and J. H. Burge, “Software configurable optical test system: A computerized reverse Hartmann test,” Appl. Opt. 49(23), 4404–4412 (2010). [CrossRef]  

20. P. Su, Y. Wang, J. H. Burge, K. Kaznatcheev, and M. Idir, “Non-null full field X-ray mirror metrology using SCOTS: a reflection deflectometry approach,” Opt. Express 20(11), 12393–12406 (2012). [CrossRef]  

21. L. Huang, J. Xue, B. Gao, C. McPherson, J. Beverage, and M. Idir, “Modal phase measuring deflectometry,” Opt. Express 24(21), 24649–24664 (2016). [CrossRef]  

22. L. R. Graves, H. Choi, W. Zhao, C. J. Oh, P. Su, D. W. Kim, and T. Su, “Model-free optical surface reconstruction from deflectometry data,” Proc. SPIE 10742, 107420Y (2018). [CrossRef]  

23. L. R. Graves, H. Choi, W. Zhao, C. J. Oh, P. Su, T. Su, and D. W. Kim, “Model-free deflectometry for freeform optics measurement using an iterative reconstruction technique,” Opt. Lett. 43(9), 2110–2113 (2018). [CrossRef]  

24. W. Li, M. Sandner, A. Gesierich, and J. Burke, “Absolute optical surface measurement with deflectometry,” Proc. SPIE 8494, 84940G (2012). [CrossRef]  

25. T. Zhou, K. Chen, H. Wei, and Y. Li, “Improved system calibration for specular surface measurement by using reflections from a plane mirror,” Appl. Opt. 55(25), 7018–7028 (2016). [CrossRef]  

26. Z. Niu, X. Zhang, J. Ye, Y. Zhu, M. Xu, and X. Jiang, “Flexible one-shot geometric calibration for off-axis deflectometry,” Appl. Opt. 59(13), 3819–3824 (2020). [CrossRef]  

27. X. Xu, X. Zhang, Z. Niu, W. Wang, Y. Zhu, and M. Xu, “Self-calibration of in situ monoscopic deflectometric measurement in precision optical manufacturing,” Opt. Express 27(5), 7523–7536 (2019). [CrossRef]  

28. H. Yue, Y. Wu, B. Zhao, Z. Ou, Y. Liu, and Y. Liu, “A carrier removal method in phase measuring deflectometry based on the analytical carrier phase description,” Opt. Express 21(19), 21756–21765 (2013). [CrossRef]  

29. L. Song, H. Yue, H. Kim, Y. Wu, Y. Liu, and Y. Liu, “A study on carrier phase distortion in phase measuring deflectometry with non-telecentric imaging,” Opt. Express 20(22), 24505–24515 (2012). [CrossRef]  

30. M. T. Nguyen, P. Kang, Y. S. Ghim, and H. G. Rhee, “Nonlinearity response correction in phase-shifting deflectometry,” Meas. Sci. Technol. 29(4), 045012 (2018). [CrossRef]  

31. C. Li, X. Zhang, and D. Tu, “Posed relationship calibration with parallel mirror reflection for stereo deflectometry,” Opt. Eng. 57(03), 1–10 (2018). [CrossRef]  

32. Y. Xu, F. Gao, and X. Jiang, “Enhancement of measurement accuracy of optical stereo deflectometry based on imaging model analysis,” Opt. Lasers Eng. 111, 1–7 (2018). [CrossRef]  

33. Y.-C. Leung and L. Cai, “3D reconstruction of specular surface by combined binocular vision and zonal wavefront reconstruction,” Appl. Opt. 59(28), 8526–8539 (2020). [CrossRef]  

34. H. Ren, F. Gao, and X. Jiang, “Iterative optimization calibration method for stereo deflectometry,” Opt. Express 23(17), 22060–22068 (2015). [CrossRef]  

35. H. Zhang, I. Šics, J. Ladrera, M. Llonch, J. Nicolas, and J. Campos, “Displacement-free stereoscopic phase measuring deflectometry based on phase difference minimization,” Opt. Express 28(21), 31658–31674 (2020). [CrossRef]  

36. H. Han, S. Wu, and Z. Song, “An accurate calibration means for the phase measuring deflectometry system,” Sensors 19(24), 5377 (2019). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (11)

Fig. 1.
Fig. 1. The general stereo-PMD system.
Fig. 2.
Fig. 2. The flowchart of the coarse-to-fine algorithm to position the seed point.
Fig. 3.
Fig. 3. The iteration starts with initial plane form h° of Mfine’ s height and ends up with the final surface form hn+1.
Fig. 4.
Fig. 4. The flowchart of the iterative algorithm.
Fig. 5.
Fig. 5. The simulation of stereo-PMD model.
Fig. 6.
Fig. 6. Simulated surfaces (a, d) are reconstructed by the proposed method. The errors without noise (b, e) and with noise (c, f).
Fig. 7.
Fig. 7. The established stereo-PMD system.
Fig. 8.
Fig. 8. (a) and (b) are the vertical and horizontal patterns captured by the left camera; (c) and (d) are the vertical and horizontal patterns captured by the right camera.
Fig. 9.
Fig. 9. The comparison of the proposed method (the first row) with classical stereo-PMD method (the second row). The first and second column are the results from axonometric view and top view, respectively. The third column shows the error map.
Fig. 10.
Fig. 10. The results of the other three SUT. First column is from the axonometric view while the second column from the top view. The third column is the error map.
Fig. 11.
Fig. 11. Repeated measurements of the four SUT. The first column is the average surface from the top view while the rest columns indicate the difference between the average shape and individual results.

Tables (1)

Tables Icon

Table 1. Reconstruction Results and Errors of Four SUT.

Equations (8)

Equations on this page are rendered with MathJax. Learn more.

{   n l = m l | | m l | |   n r = s r | | s r | | .
α = cos 1 ( n l n r ) .
{ s x = x t x c d t 2 c + x t x s d t 2 s z c z t d t 2 c + z s z t d t 2 s s y = y t y c d t 2 c + y t y s d t 2 s z c z t d t 2 c + z s z t d t 2 s ,
{ x t 0 = ( z t 0 z c ) x l z l + x c y t 0 = ( z t 0 z c ) y l z l + y c ,
h ( x , y ) = i = 1 N c i Z i ( x , y ) + c 0 ,
{ h ( x , y ) x = s x h ( x , y ) y = s y .
h ( x m , y m ) = z m     c 0  =  z m i = 1 n c i Z i ( x m , y m ) .
{ x t n = ( h n z c ) x l z l + x c y t n = ( h n z c ) y l z l + y c .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.