Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Super-resolution imaging method assisted by a left-handed medium slab based on a neural network

Open Access Open Access

Abstract

In this study, a super-resolution imaging method is proposed that combines the physical properties of a left-handed medium (LHM) slab and the mathematical methods of a neural network. Firstly, for the problem of super-resolution information loss in the received scattering field in general scenes, the LHM slab is used to construct a perfect lens to recover the evanescent wave component that carries super-resolution information. Secondly, the compressed sensing (CS) method is applied to image the sparse targets under the LHM environment. However, the perfect focus only occurs in spot or line positions. Therefore, the imaging width of conventional methods is limited and a more powerful mathematical method is needed. Finally, the neural network method is introduced to relax the limitations of target imaging width due to its strong non-linear fitting capability. The simulation results demonstrate that the imaging resolution can reach λ/10 with the assistance of LHM, while the CS method can realize super-resolution imaging of λ/20 based on prior information of spatially sparse targets. In addition, the neural network method proposed in this paper relaxes the limitation of targets, realizing super-resolution imaging of λ/20 for general targets.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Electromagnetic (EM) inverse scattering imaging is a process to reconstruct the electrical parameters and spatial distribution of targets from the received scattering field. In recent years, this technique has been widely applied, including nondestructive testing [1], urban riot security checks, targets’ through-wall imaging [2], and ground-penetrating radar [3].

Traditional EM inverse scattering imaging methods, such as the back projection (BP) method, linear sampling method (LSM) [4], and the contrast source inversion (CSI) [5] method, struggle to break the Rayleigh limit and realize super-resolution imaging of subwavelength targets. At present, super-resolution imaging is an active research field, and its principal methods can be divided broadly into mathematical methods and physical methods. Most physical super-resolution methods attempt to use evanescent waves, such as near-field imaging [6] and super-oscillation [7]. In these approaches, lenses, slabs, or meta-surfaces are arranged near the objects to recover the evanescent wave component [812]. The evanescent wave is the high-order spectral component of the electric field, which contains fine information of targets [13]. Physical methods use a variety of approaches to enable the receivers to receive as much fine information carried by the evanescent wave component as possible; however, these techniques cannot be conveniently applied to all practical situations. For example, the recovery range of a perfect lens is limited to the position of symmetric points [11,13]. The imaging area is thus limited, making this approach challenging to apply to wide-range target imaging.

Mathematical methods include the regularization method, compressed sensing (CS) method, neural network method, etc. The CS method [14,15] uses sparse priori information combined with an iterative optimization algorithm to solve the inverse scattering problem (ISP), thus imaging targets with spatial sparsity [16] and improving the imaging resolution to a certain extent. However, the CS method is not suitable for targets without sparse characteristics. With the help of LHM, the restriction on the target sparsity can be relaxed to some extent. However, the CS method still cannot image the wide-range targets even under the LHM environment. Therefore, a more powerful mathematical method is needed.

With the development of deep learning, the neural network approach, as a powerful mathematical method, has been used to solve the electromagnetic ISP. Neural networks mainly use nonlinear characteristics to realize inverse scattering imaging. In 2019, Li et al. [17,18] proposed a DNN-based nonlinear electromagnetic inverse scattering method (DeepNIS), including a multilayer complex-valued residual convolutional neural network (CNN) module, which served to approximately characterize the multi-scattering physical mechanism. Wei et al. applied the U-Net framework [19] to the ISP and proposed three imaging schemes [20] to illustrate the relationship between deep learning (DL) and nonlinear electromagnetic inverse scattering problems (EMISPs). Their research team subsequently proposed a new approach based on the U-Net framework to solve the ISP with phaseless data by using contrast sources as inputs [21]. However, information loss usually occurs during the process of receiving the scattered field, and it is difficult to recover this part of the super-resolution information during follow-up processing or network training.

Therefore, by combining the physical method of left-handed material (LHM) slab assistance and the neural network method, this study proposes a new super-resolution imaging method. Different from conventional methods such as CS method, there are no restrictions imposed on the targets as well as wide-range targets can be imaged, improving the imaging resolution and efficiency at the same time. The main innovations of this paper are listed as follows:

  • (1) An inverse scattering imaging model based on the LHM slab is proposed. A LHM slab is used to construct a perfect lens to assist in recovering the evanescent wave component in the target near field, thereby improving the super-resolution information carried by the received scattered field.
  • (2) For target scatterers with spatial sparsity, we combine the LHM slab and CS method to obtain a precise mask of the target position, which provides strong priori information for reconstructing the target contrast distribution. In addition, we theoretically analyze the successful reconstruction conditions of the LHM slab-based CS method.
  • (3) For general targets, a neural network is used to extract the imaging features with the assistance of the LHM slab, with the super-resolution information carried by the evanescent wave component obtained through network training. Accordingly, the evanescent wave component is obtained carrying fine detail information of the target in the early stage, thus reducing the pressure of network training and realizing super-resolution imaging of the target.

2. Inverse scattering reconstruction model based on the LHM slab

2.1 Mathematical model of the inverse scattering problem

Consider the inverse scattering theory for a two-dimensional (2D) situation with a LHM slab. As shown in Fig. 1, the whole xoy-plane is divided into three regions according to the horizontal coordinate, namely Region 1, Region 2, and Region 3, the x-coordinate range of which is x < d1, d1 ≤ x ≤ d2, x > d2, respectively. The target scatterers are distributed in region D, and the characteristic parameters of the target remain unchanged along the z-axis. Region D is a rectangular part of region 3, which we also call the computational domain, or region of interest (ROI). The radiation sources and receivers are evenly distributed in region C, which is several wavelength distances away from the region D. Region C is a rectangular part of region 1, which is also called the observation domain. The LHM slab is placed in region 2.

 figure: Fig. 1.

Fig. 1. Diagram of electromagnetic inverse scattering model

Download Full Size | PDF

The relative permittivity and conductivity of the target can be expressed as εr and σ. Assume that there are Nt radiation sources located at ρp, where p = 1,2,…,Nt and ρp belongs to region C. For each radiation source, there are Nr receivers located at ρq to receive the scattered field, where q = 1,2,…,Nr. Based on the volume equivalence principle, the electromagnetic scattering problem can be expressed in the form of an integral equation as:

$$E_z^{tot}({\rho} )= E_z^{inc}({\rho } )+ k_0^2\int_D {{G_0}({{\rho },{\rho^{\prime}}} )\chi ({\rho } )E_z^{tot}({{\rho^{\prime}}} )d\rho ^{\prime}} \textrm{ },\textrm{ }{\rho } \in D$$
where ρ´ and ρ represent the source point and field point of region D, $E_z^{tot}$ and $E_z^{inc}$ represent the total electric field and incident electric field of region D, G0(ρ, ρ´) represents the green function from region D to D.

The target contrast distribution can be expressed as:

$$\chi = ({{\varepsilon_r} - 1} )- j\frac{\sigma }{{\omega {\varepsilon _0}}}$$

Equation (1) is called the state equation. The scattered field in region C can be written as:

$$E_z^{sca}({\rho } )= \int_C {G({{\rho },{\rho^{\prime}}} )\chi ({{\rho^{\prime}}} )E_z^{tot}({{\rho^{\prime}}} )d{\rho ^{\prime}}} \textrm{ },\textrm{ }{\rho } \in C$$
where G(ρ, ρ´) represents the Green function from ρ´ of region D to the receivers at ρ of region C. Equation (3) is called the measurement equation. For convenience, Eqs. (1) and (3) can be expressed in operator form as follows:
$${E^{tot}} = {E^{inc}} + {G_D}\chi {E^{tot}}$$
$${E^{sca}} = {G_C}\chi {E^{tot}}$$
where GC and GD represent the mapping operators from region D to C and from region D to D respectively, and $w = \chi {E^{tot}}$ represents the contrast source. In free space, GC and GD can be obtained directly with the Hankel function; however, the calculations in this paper are under the background of LHMs, and it is necessary to calculate GC and GD, which is described in Section 2.2. The EMISP in this paper is to reconstruct the electrical parameters and spatial distribution of target scatterers in the ROI based on received scattering field.

2.2 Solution of the forward scattering process with a LHM slab

In this paper, a perfect lens made of LHM is chosen to realize the recovery of far-field fine image information. We first briefly introduce the negative refractive property of LHM. When both the permittivity ε and magnetic permeability µ are negative, the wave vector k is opposite to the direction of the power flow, then we have k = ω(εµ)1/2 < 0. According to the law of causation [22], we can finally get the refractive index n = (εµ)1/2 < 0. In this way we can use the LHM slab to construct the perfect lens and focus the electromagnetic wave. First, the forward scattering process with the existence of a LHM slab must be considered, i.e., the solution of the state equation in Eq. (4).

2.2.1 Numerical solution of the state equation

As shown in Fig. 1, in the 2D case, the radiation source is an infinitely long line source along the z-axis. The LHM slab is located from x = d1 to d2, and d = d2d1 (d2 > d1). We first calculate the state Eq. (4), i.e., the incident field distribution in region D.

We assume that the radiation source is a line source with amplitude I located at ρ0 = (x0,y0). The incident wave propagates along the direction ρ, thus the incident electric field of region 1 can be expressed in the form of a spectral domain integral:

$$E_{1z}^{inc} ={-} \int\limits_{ - \infty }^{ + \infty } {\frac{{\omega {\mu _0}}}{{4\pi {k_{1x}}}}({{e^{ - j{k_{1x}}({x - {x_0}} )}} + R{e^{j{k_{1x}}({x - 2{d_1} + {x_0}} )}}} ){e^{ - j{k_y}({y - {y_0}} )}}d{k_y}}$$
where 0 < x ≤ d1, k1x is the propagation constant along the x-direction in region 1, and R is the reflection coefficient through both surfaces of the LHM slab [8]:
$$R = {R_{12}} + \frac{{{T_{12}}{T_{21}}{R_{23}}{e^{ - j{k_{2x}}2({{d_2} - {d_1}} )}}}}{{1 - {R_{21}}{R_{23}}{e^{ - j{k_{2x}}2({{d_2} - {d_1}} )}}}}$$
where Rij and Tij are The Fresnel reflection coefficient and transmission coefficient at the boundary of region i to j.

Furthermore, the incident electric field of region 3 produced by the radiation source can be expressed in the form of a spectral domain integral as:

$$E_{3z}^{inc} ={-} \int\limits_{ - \infty }^{ + \infty } {\frac{{\omega {\mu _0}}}{{4\pi {k_{1x}}}}T{e^{ - j{k_{1x}}[{x - {x_0} - ({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}d{k_y}}$$
where x > d2 and T is the transmission through both surfaces of the slab [8]:
$$T = \frac{{{T_{12}}{T_{23}}{e^{ - j{k_{2x}}({{d_2} - {d_1}} )}}}}{{1 - {R_{21}}{R_{23}}{e^{ - j2{k_{2x}}({{d_2} - {d_1}} )}}}}$$

For the propagating wave component |ky|<|ki|, the wave number in the propagating direction can be expressed as ${k_{1x}} = {(k_1^2 - k_y^2)^{{1 / 2}}}$ in a normal medium and ${k_{2x}} ={-} {(k_2^2 - k_y^2)^{{1 / 2}}}$ in the LHM. For the evanescent wave component |ky|>|ki|, the wave number in the propagation direction is ${k_{1x}} ={-} j{(k_y^2 - k_1^2)^{{1 / 2}}}$ in a normal medium and ${k_{2x}} ={-} j{(k_y^2 - k_2^2)^{{1 / 2}}}$ in the LHM.

The electric field distribution obtained from Eq. (8) is the incident electric field of region D produced by the radiation source. To solve state Eq. (4), we must also solve the scattering electric field of region D. Based on the volume equivalence principle, the scattered field generated by the target can be considered as the radiation field of the equivalent current Jeq, as shown in Fig. 2. The target’s equivalent current Jeq(ρ´) can be written as:

$${\boldsymbol J}_{eq}^{} = j\omega ({\varepsilon - {\varepsilon_0}} ){\boldsymbol E}_D^{tot} = j\omega \chi {\varepsilon _0}({{{\boldsymbol E}^{inc}} + {\boldsymbol E}_{Jeq}^{sca}} )$$
where EDtot is the total electric field of region D, consisting of the incident electric field Einc generated by the radiation source, which can be obtained from Eq. (8), and the scattered electric field EJeqsca generated by the equivalent current Jeq, including the direct wave conponents of the field point and the reflected wave components of the LHM slab boundary x = d2.

 figure: Fig. 2.

Fig. 2. Diagram of equivalent current scattering

Download Full Size | PDF

The target is located in region 3, and the scattering field of region 3 generated by the equivalent current Jeq can be expressed as:

$${\boldsymbol E}_{Jeq}^{sca} ={-} \frac{{\omega {\mu _0}}}{4}\int\!\!\!\int\limits_{s^{\prime}} {{{\boldsymbol J}_{eq}}({{\boldsymbol{\rho}}^{\prime}} )H_0^{(2)}({k_0}\rho )ds^{\prime}} \textrm{ + }\int_{ - \infty }^{ + \infty } {d{k_y}{\psi _{{{J}_{eq}}}}R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}}$$
where ρ=|ρρ´|. The first term of Eq. (11) is the direct wave at ρ generated by Jeq(ρ´), which can be solved by the Hankel function because region 3 is free space. The second term is the wave component reflected from the d2 boundary of the LHM slab, where ΨJeq is the spectrum domain representation of the equivalent current Jeq. Substituting Eq. (11) into (10):
$$\frac{{\omega {\mu _0}}}{4}\int\!\!\!\int\limits_{s^{\prime}} {{{\boldsymbol J}_{eq}}({{\boldsymbol{\rho}^{\prime}}} )H_0^{(2)}({k_0}\rho )ds^{\prime}} + \frac{{{\boldsymbol J}_{eq}^{}({{\boldsymbol{\rho}^{\prime}}} )}}{{j\omega ({\varepsilon - {\varepsilon_0}} )}} - \int\limits_{ - \infty }^{ + \infty } {d{k_y}{\psi _{{{J}_{eq}}}}R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} = {{\boldsymbol E}^{inc}}({\boldsymbol{\rho}} )$$
where ρ=|ρρ´|. Equation (12) can be solved by the method of moments (MOM) approach. Firstly, a square grid with side length Δ is chosen to discretize region D. Region D is thus divided into Rn rows and Cn columns, representing a total of N = Rn × Cn grids, as shown in Fig. 2.

Secondly, the equivalent current is expressed as the pulse basis function, i.e., ${{\boldsymbol J}_{eq}}({\boldsymbol{\rho}^{\prime}}) = \sum\nolimits_{n = 1}^{{N_{eq}}} {\alpha ({{{\boldsymbol{\rho}^{\prime}}}_n}) \cdot \Pi ({{{\boldsymbol{\rho}^{\prime}}}_n})}$, where α(ρ´n) is the undetermined coefficient of the equivalent current and Neq is the number of discrete grids occupied by the target. By substituting the basis function into Eq. (12) and using the point matching function δ(ρρm) as the weight function, we obtain:

$$\sum\limits_{n = 1}^{{N_{eq}}} {\alpha ({{{{\boldsymbol{\rho}^{\prime}}}_n}} )} \cdot \left[ \begin{array}{l} \frac{{\omega {\mu_0}}}{4}\int\!\!\!\int\limits_{{{s^{\prime}}_n}} {H_0^{(2)}({k_0}|{{{\boldsymbol{\rho}}_m} - {{{\boldsymbol{\rho}^{\prime}}}_n}} |)d{{s^{\prime}}_n}} + \frac{{\delta ({{{\boldsymbol{\rho}}_m} - {{{\boldsymbol{\rho}^{\prime}}}_n}} )}}{{j\omega [{\varepsilon ({{{{\boldsymbol{\rho}^{\prime}}}_n}} )- {\varepsilon_0}} ]}}\\ - \int_{ - \infty }^{ + \infty } {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{3x}}}} \cdot {\Delta^2}} \right)R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} \end{array} \right] = {{\boldsymbol E}^{inc}}({{{\boldsymbol{\rho}}_m}} )$$

The electric field generated by the unit-amplitude contrast source at ρ´n in region D can be obtained from Eq. (13). Based on state Eq. (4), the matrix GD is used to represent the discretized operator, and the n´-th column element ${g}_{n^{\prime}}^D$ can be expressed as:

$$\scalebox{0.9}{$\displaystyle{\boldsymbol g}_{n^{\prime}}^D = j\omega {\varepsilon _0} \cdot \left[ { - \frac{{\omega {\mu_0}}}{4}\int\!\!\!\int\limits_{{{s^{\prime}}_n}} {H_0^{(2)}({k_0}|{{\boldsymbol \rho } - {{{\boldsymbol \rho^{\prime}}}_n}} |)d{{s^{\prime}}_n}} + \int\limits_{ - \infty }^{ + \infty } {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{3x}}}} \cdot {\Delta^2}} \right)R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} } \right]$}$$
where ${{\boldsymbol G}_D} = [{g}_1^D\textrm{ } \cdots \textrm{ }{g}_{n^{\prime}}^D\textrm{ } \cdots \textrm{ }{g}_N^D\textrm{ }]$ is a matrix of size $N \times N$. According to Eq. (13) the amplitude coefficient α(ρ´n) of the equivalent current Jeq(ρ´n) can be solved, and the scattering field of region D can be obtained from Eq. (11). Overall, with the above steps, the forward calculation of the state equation can be achieved.

2.2.2 Solution of the measurement equation

In Eq. (5), GC is the measurement matrix, which represents the electric field distribution of region C as generated by the unit-amplitude contrast source. There are Nr receivers placed in region C; thus, GC is a matrix of size Nr × N.

The scattered electric field received by the receivers located at (xr,yr) in region 1 is equivalent to the superposition of the electric field generated by linear current sources with a magnitude of α(ρ´n) in region 1. Based on measurement Eq. (5) and the equivalent current amplitude coefficient α(ρ´n) solved by Equation(13), the received scattered electric field at position (xr,yr) can be expressed as:

$$E_{}^{sca}({{x_r},{y_r}} )={-} \sum\limits_{n = 1}^{{N_{eq}}} {\alpha ({{{x^{\prime}}_n},{{y^{\prime}}_n}} )\cdot \int_{ - \infty }^{ + \infty } {d{k_y}\frac{{\omega {\mu _0}}}{{4\pi {k_{3x}}}}{\Delta ^2}T{e^{j{k_{1x}}({{x_r} - {{x^{\prime}}_n} + {d_2} - {d_1}} )}}{e^{ - j{k_y}({{y_r} - {{y^{\prime}}_n}} )}}} }$$

Accordingly, the n´-th column in the observation matrix GC can be expressed as:

$${\boldsymbol g}_{n^{\prime}}^C ={-} \int\limits_{ - \infty }^{ + \infty } {d{k_y}({j\omega {\varepsilon_0}{\Delta^2}} )\cdot \frac{{\omega {\mu _0}}}{{4\pi {k_{3x}}}}T{e^{j{k_{0x}}[{{x_r} - {{x^{\prime}}_n} - ({{d_1} - {d_2}} )} ]}}{e^{ - j{k_y}({{y_r} - {{y^{\prime}}_n}} )}}}$$
where the observation matrix GC for a LHM slab is obtained, i.e., ${{\boldsymbol G}_C} = [{g}_1^C\textrm{ } \cdots \textrm{ }{g}_{n^{\prime}}^C\textrm{ } \cdots \textrm{ }{g}_N^C]$. The received scattered field with the assistance of a LHM slab can thus be obtained by solving Eq. (15).

3. Imaging methods with the existence of a LHM slab

Based on the above forward scattering process, the scattered field in the presence of a LHM slab is received, and the evanescent wave component is supplemented using physical methods. The measured scattered field data is used to reconstruct the electrical parameters and spatial distribution of targets. choose different imaging methods to realize the reconstruction targets.

3.1 BP method and CSI method

Back-projection (BP) method is an imaging method based on matching filtering, with low imaging accuracy and large reconstruction error, but its simple calculation process makes it a common method to solve the initial value of contrast distribution. Due to the strong nonlinearity of ISP, the process of solving contrast distribution ${{\chi }_0}$ is generally divided into two steps. Taking the q-th radiation as example, we first obtain the initial value of contrast source with BP method.

$${{\boldsymbol w}_{q,0}} = \frac{{{{||{{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}} ||}^\textrm{2}}}}{{{{||{{\boldsymbol G}_C^{}{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}} ||}^\textrm{2}}}}{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}$$
where the subscript q represents the q-th radiation. Then the initial value of contrast distribution ${{\chi }_0}$ can be solved based on the result of Eq. (17).

Contrast source inversion (CSI) method is a kind of classical nonlinear inverse scattering method, which not only makes use of measurement equation to reconstruct the contrast source, but also adds the error constraint of the state equation as a regularization term into the cost function. Thus, the cost function of CSI method is the sum of measurement error and state error [5]:

$$F = \frac{{\sum\nolimits_q {||{{\boldsymbol e}_q^{sca} - {\boldsymbol G}_C^{}{{\boldsymbol w}_q}} ||_C^2} }}{{\sum\nolimits_q {||{{\boldsymbol e}_q^{sca}} ||_C^2} }} + \frac{{\sum\nolimits_q {||{diag({\boldsymbol \chi } )\cdot {\boldsymbol e}_q^{inc} - {{\boldsymbol w}_q} + diag({\boldsymbol \chi } )\cdot {\boldsymbol G}_D^{}{{\boldsymbol w}_q}} ||_D^2} }}{{\sum\nolimits_q {||{diag({\boldsymbol \chi } )\cdot {e}_q^{inc}} ||_D^2} }}$$

Obviously, F is a quadratic function of wq and has a higher degree of nonlinearity about ${\chi }$. Obtained by Eq. (17), wq,0 is used as the initial value of CSI iteration, and the contrast distribution is iteratively solved.

3.2 Compressed sensing method

Faced with the ISP, only optimization algorithms such as the CSI method can be used to iteratively update the contrast source for the reason that the number of measurement equations is far less than the number of unknowns. Generally, the Region D will define as a large area to ensure that the target is within it; thus, the target distribution is sparse compared to the size of the Region D. On this basis, we can apply the CS method to solve EMISPs. However, CS theory is only suitable for linear models, so we use contrast source $w = \chi {E^{tot}}$ as an intermediate variable and apply the CS method to solve EMISPs. Additionally, based on the multi-measurement vector (MMV) model, the joint sparse (JS) method is used to reconstruct the JS contrast source W [16].

We use the JS reconstruction algorithm to precisely recover W under the MMV model, from which the exact position of the target can be extracted as strong prior information. We can then obtain the mask of the target location and add it to the subsequent iterative CSI solutions to achieve perfect reconstruction of the target’s contrast distribution.

Based on the MMV analysis, the JS contrast source is sparse. Accordingly, the objective function can describe the number of rows containing non-zero elements, and the JS ISP can be expressed as [16]:

$${\boldsymbol W} = \arg \mathop {\min }\limits_{W} {||{{\boldsymbol w}_{\textrm{norm2}}^{}} ||_0} \qquad s.t.\qquad ||{{{\boldsymbol E}^s} - {{\boldsymbol G}^W}{\boldsymbol W}} ||_F^2 \le \delta$$
where ‖·‖F represents the Frobenius norm of the matrix, ${{\boldsymbol w}_{\textrm{norm2}}} = {\left[ {\left\| {{{\boldsymbol w}_1}} \right\|_2^2\textrm{ } \cdots \textrm{ }\left\| {{{\boldsymbol w}_L}} \right\|_2^2} \right]^T}$, and the superscript T represents the transpose operator. $\delta $ represents the noise threshold, while Es, GW, and W represent the scattered field, JS observation matrix, and JS contrast source under the MMV model, respectively. The hyperbolic tangent function gγ is used to approximate the l0 norm and γ is the function’s shape parameter. In addition, a regularization parameter is introduced to transform the constrained optimization problem into an unconstrained optimization problem and Eq. (19) can be rewritten as:
$${\boldsymbol W} = \arg \mathop {\min }\limits_{W} \sum\limits_{l = 1}^L {{g_\gamma }({||{{\boldsymbol w}_l^{}} ||_2^2} )} + \frac{\alpha }{2}||{{{\boldsymbol E}^s} - {{\boldsymbol G}^W}{\boldsymbol W}} ||_F^2.$$
where $\alpha $ represents the regularization parameter and wl(l = 1,2,…,L) represents the l-th row of the contrast source. To make $\sum\nolimits_{l = 1}^L {{g_\gamma }({||{{{\boldsymbol w}_l}} ||_2^2} )}$ approximate the l2/l0 mixed norm and finally obtain the global optimal solution, we gradually decrease γ during the iterative process and obtain the corresponding optimal value of Wγ,opt for each γ. In addition, we estimate the number of targets in advance according to the MDL criterion [23] and select the closest result to the real target as the optimal solution Wγ,opt, i.e.,
$${{\boldsymbol W}_{\textrm{opt}}} = \arg \mathop {\min }\limits_{{{W}_{\gamma ,\textrm{opt}}}} |{{N_{true}} - {N_e}({{{\boldsymbol W}_{\gamma ,\textrm{opt}}}} )} |$$
where Ntrue represents the true grid number occupied by the target and Ne represents the estimated grid number of targets. The accurate reconstructed contrast source Wopt provides the position information of the target. This strong prior information can be combined with subsequent quantitative imaging methods to obtain satisfactory reconstruction results. Specifically, location information can be integrated into other imaging methods by constructing a mask ${M_{\textrm{JS}}} \in {{\mathbb R}^{L \times 1}}$. For quantitative reconstruction algorithms in iterative form, such as CSI, we can multiply each iteration result elementwise with the mask:
$${{\boldsymbol \chi }_{M,n - 1}} = {{\boldsymbol \chi }_{n - 1}} \odot {M_{\textrm{JS}}}$$
where ⊙ indicates the multiplication of elements. Equation (22) can be considered as a process to reduce the number of unknowns, which forces the value of the reconstructed contrast at the position of the target to be non-zero while the rest of the positions are forced to be zero-valued. As long as the mask has sufficiently high accuracy, a perfect reconstruction of the contrast distribution will be achieved through further iteration.

3.3 Neural network method

In the above traditional methods, the LHM slab’s assistance in recovering the evanescent wave component has been analyzed. However, the iterative process is very time-consuming with a limited imaging range of targets. Even if the source and receiver arrays are widened laterally, there is still little improvement in the resolution for normal-width targets. Moreover, the CS method is a linear solution method and only sparse targets can be handled. In contrast, the neural network method has a strong advantage in solving nonlinear problems by learning the complex nonlinearity of scattering process and extract high-dimensional features. In the following, the physical method of LHM-assisted recovery of evanescent wave components and the mathematical neural network method are combined to realize super-resolution imaging of target scatterers.

During network training, we directly use the network to extract super-resolution information carried by the evanescent wave components. Based on the BP method, the initial value of the contrast distribution calculated from the scattered field with the existence of a LHM slab is taken as the network input, and the true contrast distribution of the spatial targets is taken as the training label. The training process can be expressed as the minimization problem of the objective function:

$${{\boldsymbol \chi }_k} = \mathop {\arg \min }\limits_{\chi } \sum\nolimits_q {||{{\boldsymbol e}_q^{sca} - {{\boldsymbol G}_C}{{\boldsymbol \chi }_{k - 1}}{\boldsymbol e}_q^{tot}} ||_2^2}$$

In Eq. (23), parameters such as ${\boldsymbol e}_q^{sca}$ and ${{\boldsymbol G}_C}$ have been calculated in the presence of a LHM slab in Section 2.2, which includes the recovered evanescent wave component. The output of the network is the target contrast distribution, and the cost function is the mean square error (MSE) function, which is calculated at the network’s output layer. The cost function calculation is represented by specific physical parameter symbols; for example, the network’s output is denoted as $\hat{{\boldsymbol \chi }}$, and the label is denoted as ${{\boldsymbol \chi }^{std}}$. The MSE cost function can thus be expressed as:

$$loss({\hat{{\boldsymbol \chi }}} )= \frac{1}{{2K}}\sum\limits_{k = 1}^K {||{\hat{{\boldsymbol \chi}}(k )- {{\boldsymbol \chi}^{std}}(k )} ||_2^2}$$
where K represents the number of sample groups. During the training process, both the radiation sources and the receivers are configured in the form of arrays; accordingly, we use U-net as the training network [20]. The U-net architecture, as presented in Fig. 3, is composed of two main parts: the contracting path (left side) and the expansive path (right side). The contracting path is responsible for reducing the spatial dimensions of the input, through repeatedly applying 3 × 3 convolutions, and followed by batch normalization (BN) and rectified linear unit (ReLU) activation. Additionally, a 2 × 2 max pooling operation is performed to down-sample the feature maps.

 figure: Fig. 3.

Fig. 3. Convolutional neural network structure diagram

Download Full Size | PDF

On the other hand, the expansive path aims to recover the spatial information lost during the contracting path, whose structure corresponds to the contracting path. Instead of using max pooling for down-sampling in the contracting path, the expansive path employs a 3 × 3 up-convolution, also known as transposed convolution or deconvolution. Moreover, the expansive path utilizes two concatenations. These concatenations involve combining the feature maps from the contracting path with the correspondingly cropped feature maps from the expansive path. This step helps to preserve important local information and improve spatial resolution. The specific structure of which is shown in Fig. 3.

4. Simulation results and analysis

4.1 Description of the experimental configuration

In this paper, the incident wave is set to a 2D TMz cylindrical wave with a frequency of f = 3 GHz and a wavelength of λ=0.1 m. The x-coordinate of the center region C is x = 0, 4λ away from that of region D, and the radiation sources and receivers are evenly distributed in array form in region C. The LHM slab is located between regions C and D, and the x-axis values occupied by it range from d1 to d2 = 3λ. The relative dielectric constant and the relative permeability of the LHM slab are set to εr2= –1 and µr2= –1. In practice, loss will inevitably occur due to the presence of a LHM slab, so the conductivity σ is set as 10−20S/m.

The target can be located anywhere in region D, whose size is λ×λ and center is at d3 = 4λ, and the target’s relative dielectric constant is between 1.5 and 3. Considering the grid's discrete accuracy is λ/20, we obtain region D with a discrete size of 20 × 20. The radiation sources and receivers are evenly distributed in region C, which forms a rectangle centered at the coordinate origin. Its longitudinal height is the same as that of region D and its width is related to the target distribution range. The distribution of the radiation source and receiving station are specified in different experiments. We mainly use the received scattered field at the receiving station to reconstruct the target.

4.2 Experiment results of traditional methods

4.2.1 Imaging results of narrow-range targets by traditional methods

First, we discuss the accuracy of super-resolution imaging with the assistance of a LHM slab. Region C of this experiment is a rectangular region centered at the coordinate origin, with a width of λ/5 and a length of λ, and transmitters and receivers are evenly distributed in it. Two grid targets are placed lengthwise at x = 4λ, where the target distance is dt. The CSI method is used to image the targets, results of which are shown in Fig. 4.

 figure: Fig. 4.

Fig. 4. The accuracy of super-resolution imaging

Download Full Size | PDF

As shown in Fig. 4, Fig. 4(a)-(d) illustrate the true contrast distribution of the targets, dt of which are λ/20, λ/10, λ/10, and λ, respectively, and Fig. 4(e)-(h) are the CSI results after 600 iterations. When the distance ${d_t}$ between the two target grids is less than dt/10, the CSI method with a LHM slab cannot distinguish the two grids even after 600 iterations. However, when without the LHM slab, it can hardly reconstruct the target until the two grids of the target are about λ apart. By comparing Fig. 4(f) and Fig. 4(g), the CSI method with a LHM slab performs much better than the free space configuration. Therefore, we conclude that the imaging effect can be greatly improved with the assistance of a LHM slab, and the imaging resolution can reach λ/10.

4.2.2 Imaging results of wide-range targets by traditional methods

In Section 4.2.1, we use traditional methods to image narrow-range targets. Based on the results, the imaging effect with a LHM slab assistance is very good, and super-resolution imaging for the scenes can be performed satisfying the complementary medium request. However, not all imaging targets meet the conditions of narrow range and spatial sparsity; accordingly, in this section, we further improve the inverse scattering imaging method. First, we use traditional methods to image different targets. Region C of this experiment is a square region centered at the coordinate origin, both the width and length of which are λ, and transmitters and receivers are evenly distributed in it. The imaging scenes are the same as those described in section 4.2.1 except that the horizontal distribution range of targets has been extended. The imaging results are displayed in Fig. 5.

 figure: Fig. 5.

Fig. 5. Reconstruction results of targets by the traditional methods

Download Full Size | PDF

Figure 5(a)-(c) illustrate the standard contrast distribution of targets, Fig. 5(d)-(f) show the reconstruction results of the CSI method after 600 iterations with a LHM slab, and Fig. 5(g)-(i) show the reconstruction results of the CS method with a LHM slab. Figure 5(a), (b), (c) are different kinds of targets respectively, a strip-shaped target with a spacing of λ/20, an array-shaped target with the same spacing of λ/20 and a digit-shaped target based on the MNIST dataset [24].

When we use CSI method to reconstruct the above targets, the final results after 600 iterations are shown in Fig. 5(d), (e), (f), which take 31.01 seconds, 89.42 seconds and 344.88 seconds respectively, closely related to the complexity of the target. It can be found that CSI method can hardly realize the reconstruction, no matter in the position, shape or parameters of targets. Figure 5(g), (h), (i) are the reconstruction results of CS method. With the help of spatial position mask, we can easily reconstruct targets with sparse space characteristics, like Fig. 5(g). However, for other targets without such sparsity, there still exit some errors in the reconstructed shape and parameters, such as Fig. 5(h), (i). It takes 31.01 seconds, 89.42 seconds and 344.88 seconds for the reconstruction with CS method, respectively. The reasons for the reconstruction failure are analyzed in section 4.2.3a.

Our findings indicate that even if the observation domain is widened to encompass more radiation sources and receivers, traditional methods still cannot reconstruct the target. The CSI method can only make a rough image of the target shape with blurred edges and missing or redundant mesh. Once the grid number occupied by the target exceeds the upper limit of the grid number satisfying the space-sparsity condition, the CS method cannot generate a mask or image the target. At this point, even if the evanescent wave component is recovered with the assistance of LHM, it is still challenging for traditional methods to achieve the requirements of super-resolution imaging. Therefore, it is necessary to estimate the sparsity of the target, i.e., determine what kind of target can be successfully solved by traditional methods, to select the most appropriate imaging scheme.

4.2.3 Results analysis of traditional methods

  • (a) Successful reconstruction conditions of the CS method

In this section, we discuss the successful reconstruction condition [25,26] in CS method, which can be measured by the correlation of the measurement matrix GC, which can be expressed as the column vector ${{\boldsymbol G}_C} = [\begin{array}{{cccc}} {{\boldsymbol g}_1^C}&{{\boldsymbol g}_2^C}& \cdots &{{\boldsymbol g}_N^C} \end{array}]$. The degree of linear correlation between columns can be determined by ${Err _{\textrm{corr }}}$ [25] [26]:

$${\textrm{Err} _{\textrm{corr }}} = ||{{\boldsymbol G}_{\boldsymbol C}^{\textrm{sur }}{c} - {\boldsymbol g}_i^{}} ||$$
where c is the coefficient vector, gi is the corresponding column vector of the central grid, ${\boldsymbol G}_C^{sur}$ is the sub-matrix formed by the corresponding vector of the surrounding grids. Figure 6 shows the linear correlation error calculated by Eq. (25) for a grid discrete length of λ/20.The four line segments from bottom to top represent, respectively, Errcorr of free space, Errcorr of the propagation wave with a LHM slab, Errcorr of a LHM slab, and Errcorr of the evanescent wave with a LHM slab.

 figure: Fig. 6.

Fig. 6. Linear dependent error corresponding to the rectangular substructure

Download Full Size | PDF

Without the assistance of LHM, the correlation error corresponding to the rectangular substructure in free space is found to be very small, indicating a strong correlation between grids. In this case, it is difficult to distinguish between adjacent grids. While with the assistance of the LHM slab, the magnitude of the correlation error greatly increases, thus indicating that the LHM helps to recover super-resolution information, consistent with the experimental results presented in Section 4.2.1. In the case where the correlation error corresponding to the evanescent wave component is very large, the evanescent wave component carries sufficient super-resolution information and can easily be used to distinguish adjacent grids. The method proposed in this paper primarily uses the evanescent wave component to achieve super-resolution imaging.

Due to the significant variability in the longitudinal values, we present ${Err _{\textrm{corr }}}$ in logarithmic form in Fig. 6. As shown in the locally enlarged detail diagram in Fig. 6, the linear correlation error between the columns in GC of the evanescent wave component with the assistance of the LHM slab gradually decreases with increasing distance when x > 4λ. This change occurs because when the distance to the target is very close, the evanescent wave component carries extensive super-resolution information and can easily distinguish the adjacent grids; thus, the correlation between grids in this case is very weak. However, with increasing distance, the information carried by the evanescent wave decreases exponentially, and the correlation between grids gradually strengthens, hence the linear correlation error decreases with increasing distance.

Based on the analysis of Spark(GC) above, when the discretization size is λ/20, Spark(GC)≈5 in free space. Accordingly, the CS method can be successfully reconstructed when the occupied grid number target x < 4. With the assistance of LHM, when the number of objects x < 14, the CS method can be successfully reconstructed. Note that the analysis conducted here is only in the physical sense, and in reality, Spark (GC) may not be exactly equal to the above inference. However, the analysis from a purely physical perspective successfully explains the influence of LHMs on the target number in successful reconstruction, which has a range of implications for subsequent algorithm improvement.

  • (b) Analysis results of the imaging effect of wide-range targets

As discussed in sections 4.2.1 and 4.2.2, the transverse imaging resolution of a target can be improved to some extent by broadening the array of radiation sources and receivers. However, when the transverse distribution range of the observation domain is widened to a certain extent, the imaging of the target cannot be further improved. We accordingly analyze this phenomenon based on the properties of the complementary medium [27].

When the thickness of the LHM slab is d=|d2–d1|, according to Eq. (8), the property of the complementary medium without loss can be expressed as:

$$E_{3z}^{}({{x_0} + 2d} )= E_{1z}^{}({{x_0}} )\textrm{ }({0 < {x_0} \le {d_1}} )$$

Equation (26) shows that the electric field received at (x0 + 2d,y0) is equal to the electric field at (x0,y0) generated by the irradiated source. It has previously been proven that the cancellation property is effective for a complementary medium with any parameter distribution [27,28]. Thus, for different combinations of normal media and LHMs, the receivers in the far field can be configured to perfectly receive the super-resolution information of the target’s near field, as shown in Fig. 7.

 figure: Fig. 7.

Fig. 7. Schematic diagram of spectral domain analysis in complementary media. (a) Lossless medium, (b) lossy medium, and (c) focusing of multiple radiation sources.

Download Full Size | PDF

In the case of lossless LHM, the theoretical focus point is shown in Fig. 7(a). As shown, due to the negative refraction characteristic of the LHM, various spectral components are focused at x = d3. When the spectral domain component |ky|>|k1|, ky is the evanescent wave component, such as ky = ±k1b, etc. This type of component carries target super-resolution information in the propagation process and decreases exponentially as the propagation distance increases. The LHM slab amplifies the amplitude of the wave component. When the spectral domain component |ky|<|k1|, ky is the propagating wave component, such as ky = ±k1a, etc. In this instance, the LHM performs phase compensation for this wave component type. However, as shown in Fig. 7(b), it is impossible to achieve a truly lossless environment in practice, and the attenuation of higher-order spectral components is more pronounced during the propagation process. In this case, it is difficult for each order spectral component to focus perfectly at the theoretical position x = d3.

Figure 7(c) shows two groups of radiation sources, receivers, and targets, which separately satisfy the complementarity theorem. Positions x = d3 and x = d´3 correspond to the locations of the radiation sources, receivers, and targets, thus satisfying the position correspondence of the complementarity theorem. The analysis performed for a lossless medium, based on Eq. (8), can be expressed as:

$$\scalebox{0.8}{$\displaystyle E_{3z}^{inc} = \int\limits_{ - {k_1}}^{ + {k_1}} {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{1x}}}}} \right){e^{ - j\sqrt {k_1^2 - k_y^2} [{x - {x_0} - 2({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}} + \int\limits_{ {\pm} {k_1}}^\infty {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{1x}}}}} \right){e^{ - \sqrt {k_y^2 - k_1^2} [{x - {x_0} - 2({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}}$}$$

For the propagating wave component, ${k_{1x}} = {(k_1^2 - k_y^2)^{1/2}}$, and for the evanescent wave component, ${k_{1x}} ={-} j{(k_y^2 - k_1^2)^{1/2}}$. As shown, the second term of Eq. (27) is the evanescent wave component, which decreases exponentially with increasing x while x ≥ d2. When the corresponding target is reached, the field component of x = d3 (or d´3) is equal to the field component of x = d0 (or d´0). Thus, when the two radiation sources (A and B) are placed horizontally side-by-side at x = d0 and x = d´0, the evanescent wave component arriving at x = d3 will be generated simultaneously. The evanescent wave amplitude of source B will be greater than that of source A; however, it does not carry the corresponding super-resolution information of source A and will thus negatively affect the focus of the target located at x = d3. The focus of a perfect lens holds only at that point or column. When the source array is further broadened laterally, this negative influence will become increasingly significant, and even the magnitude of the non-active component amplitude will cover the effective field component. Therefore, super-resolution imaging of wide-range targets cannot be improved by broadening the source and receiver array. The experimental results presented in Section 4.2.2 are consistent with these theoretical analysis results.

For targets that do not meet the successful reconstruction condition, with the assistance of LHM to recover the evanescent wave component, we extract the shape, position, and parameter information of the target from the received scattered field by using the powerful nonlinear fitting ability of the neural network method and finally realize super-resolution reconstruction of general targets. The results of this analysis are presented in the next section.

4.3 Experimental results of the neural network method

In this paper, a convolutional neural network is used for training, the input of which is the initial target contrast values calculated by the BP method. We use the MNIST dataset, taking handwritten digits as target scatterers, where the target contrast can take any value between 0.5 and 2. Region D is the square centered at (d3,0) with a side length of λ, so the size of region D after discretization is 20 × 20. The number of radiation sources and receivers in region C is 10 × 10, forming a square centered at (0,0) with side length λ. We use the initial target contrast value calculated by the BP method as the network input, so the input size and output size are both 20 × 20. A total of 25 000 datasets were used for this training process, 80% of which were used as training sets and 20% were used as verification sets. A further 1000 datasets are used as test sets. The error curve of the training process is shown in Fig. 8.

 figure: Fig. 8.

Fig. 8. Network training error curve

Download Full Size | PDF

In this paper, the workstation used for network training has an Intel Xeon Gold 6230R CPU @ 2.10 GHz. As shown in Fig. 8, the network training process tends to converge after 20 epochs. To ensure imaging accuracy, we took the network results after the 30th training epoch for imaging. The training time for 30 epochs is around seven hours. Note that the datasets used for network training all were ideal, i.e., without noise.

First, a discrete distributed target is used to determine the neural network’s reconstruction resolution based on the LHM slab. Figure 9(a) and (b) show the labels of the discretely distributed target and the super-resolution reconstruction result. Besides, the reconstruction time is about 0.016 seconds. Compared with the traditional methods of Fig. 5, the reconstruction speed is greatly improved. Overall, the results demonstrate that the neural network method can essentially achieve super-resolution imaging of the target with a resolution of λ/20.

 figure: Fig. 9.

Fig. 9. Imaging resolution of network method

Download Full Size | PDF

Second, the trained network is used to image the target scatterers in the test sets, with the imaging results displayed in Fig. 10. As shown in Fig. 10, the neural network method can perform super-resolution imaging on general targets without spatial sparsity. Figure 10(a)-(d) are labels of different targets, and Fig. 10(e)-(h), Fig. 10(i)-(l) and Fig. 10(m)-(p) are reconstruction results of the neural network method under the condition of no noise, 40 dB and 30 dB respectively. In this experiment, the time required to reconstruct 1000 test sets in different conditions is around 13 seconds, and the average time for each target is 0.013seconds.

 figure: Fig. 10.

Fig. 10. Neural network method reconstruction results

Download Full Size | PDF

Next, the statistical error of the imaging is quantitatively expressed. The MSE calculation for the relative dielectric constant of the target can be expressed as [29]:

$$\textrm{E}({{\varepsilon }_r^{}} )= \sqrt {\frac{1}{{{N_{std}}}}\sum\limits_{({p,q} )\in D} {{{\left|{\frac{{\hat{\varepsilon }_{r;p,q}^{} - \varepsilon_{r;p,q}^{std}}}{{\varepsilon_{r;p,q}^{std}}}} \right|}^2}} }$$
where Nstd denotes the number of standard grids occupied by the target, $\hat{\varepsilon }_{r;p,q}^{}$ denotes the relative dielectric constant of the target output by the network, and $\varepsilon _{r;p,q}^{std}$ denotes the relative dielectric constant of the standard target. The quantitative errors of the imaging results calculated from Eq. (28) are presented in Table 1.

Tables Icon

Table 1. The imaging error calculated under different SNRs

In summary, under the condition of no noise, the contour of the imaging result is essentially consistent with that of the target with only slight errors in the reconstruction parameters. When the SNR is 40 dB, the imaging results show some edge blur but the neural network method can still image the targets successfully. However, when the signal-to-noise ratio is 30 dB or less, the edge blur effect in the imaging results will be worsened. This indicates that the neural network method proposed in this paper has a certain anti-noise ability, whereas the CS method is extremely sensitive to noise—even a small noise content in the scattered field will cause large interference during mask generation. Based on the analysis in this paper, LHMs are used to assist the recovery of evanescent wave component, and the BP method is used to calculate the initial value of the target contrast distribution, reducing the influence of noise to a certain extent. Overall, the neural network super-resolution imaging method based on LHM proposed in this paper has some anti-noise performance.

In addition, we tested the generalization performance of the method proposed in this paper. To do so, we used the trained network to reconstruct letter-shaped targets, the results of which are shown in Fig. 11.

 figure: Fig. 11.

Fig. 11. Imaging results of the neural network method

Download Full Size | PDF

Figure 11 includes the reconstruction results of the neural network under two different scenarios, where Fig. 11(a)-(d) are the labels of targets’ contrast distribution, Fig. 11(e)-(h) are the reconstruction results with a LHM slab and Fig. 11(i)-(l) are the reconstruction results of free space. Compared with Fig. 11(i)-(l), the results of free space, Fig. 11(e)-(h) have a more accurate imaging effect, which indicates that the network trained with the assistance of a LHM slab has a better generalization performance. The quantitative errors are shown in Table 2 based on Eq. (28).

Tables Icon

Table 2. The imaging error of letter-shaped targets

In conclusion, the trained network can accurately image the letter-shaped targets, indicating that the neural network method proposed in this paper has good generalization performance while also achieving accurate imaging.

5. Conclusion and discussion

To overcome the limitations of traditional methods, such as the CSI method’s long calculation time and low imaging accuracy and the CS method’s requirement for targets with spatial sparsity, this paper proposes a super-resolution LHM slab-assisted imaging method based on a neural network. For simple targets with spatial sparsity, using a LHM slab to recover the evanescent wave components can effectively improve the imaging accuracy of traditional methods. For a more complex target, this paper takes advantage of the physical characteristics of LHMs by fully collecting the scattered field carrying super-resolution information of the target before network training and also utilizes the powerful nonlinear fitting ability of the neural network method to obtain the inverse scattering process from the received scattered field to calculate the target contrast distribution. This study’s experimental results show that the proposed method can achieve efficient and accurate super-resolution imaging of the target with good generalization ability and some anti-noise performance.

It should be noted that it is difficult for target imaging with the assistance of a LHM slab to achieve 360-degree of all-round reconstruction. Therefore, the inverse scattering imaging scene with a cylinder-shaped LHM will be considered, which is further applicable to the super-resolution imaging of targets in general scenes.

Funding

Hunan graduate research innovation project (CX20220073).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. F. Ben Hassen, Y. Boukari, and H. Haddar, “Application of the linear sampling method to identify cracks with impedance boundary conditions,” Inverse Probl. Sci. Eng. 21(2), 210–234 (2013). [CrossRef]  

2. Y. Chu, K. Xu, Y. Zhong, X. Ye, T. Zhou, X. Chen, and G. Wang, “Fast Microwave Through Wall Imaging Method With Inhomogeneous Background Based on Levenberg–Marquardt Algorithm,” IEEE Trans. Microwave Theory Techn. 67(3), 1138–1147 (2019). [CrossRef]  

3. L. Di Donato and L. Crocco, “Model-Based Quantitative Cross-Borehole GPR Imaging via Virtual Experiments,” IEEE Trans. Geosci. Remote Sensing 53(8), 4178–4185 (2015). [CrossRef]  

4. Y. Gan, C. Yin, Q. Fan, and A. Li, “A Fast Inverse Scattering Imaging Method by Applying Virtual Experiments to T-Matrix Scheme,” IEEE Access 8, 195122–195131 (2020). [CrossRef]  

5. P. M. van den Berg and R. E. Kleinman, “A contrast source inversion method,” Inverse Probl. 13(6), 1607–1620 (1997). [CrossRef]  

6. S. A. Ramakrishna, J. B. Pendry, M. C. K. Wiltshire, and W. J. Stewart, “Imaging the near field,” J. Mod. Opt. 50(9), 1419–1430 (2003). [CrossRef]  

7. F. Yin, C. Chen, W. Chen, W. Qiao, and J. Guan, “Superresolution quantitative imaging based on superoscillatory field,” Opt. Express 28(5), 7707–7720 (2020). [CrossRef]  

8. J. B. Pendry, “Negative Refraction Makes a Perfect Lens,” Phys. Rev. Lett. 85(18), 3966–3969 (2000). [CrossRef]  

9. Q. Cheng, T. J. Cui, and W. B. Lu, “Lossy and retardation effects on the localization of EM waves using a left-handed medium slab,” Phys. Lett. A 336(2-3), 235–244 (2005). [CrossRef]  

10. Lei Zhao and Tie Jun Cui, “Enhancement of resolution in electromagnetic imaging of lossy dielectric objects using a slab of left-handed material,” in 2006 IEEE Antennas and Propagation Society International Symposium (IEEE, 2006), pp. 1069–1072.

11. L. Zhao and T. J. Cui, “Super-resolution imaging of dielectric objects using a slab of left-handed material,” Appl. Phys. Lett. 89(14), 141904 (2006). [CrossRef]  

12. Ran Zhao, He-lin Yang, Nan Wu, and Da-gang Xie, “Near-field EM scattering by coated objects with Left-Handed Materials,” in Proceedings of 2011 Cross Strait Quad-Regional Radio Science and Wireless Technology Conference (IEEE, 2011), pp. 44–47.

13. T. J. Cui, Z.-C. Hao, X. X. Yin, W. Hong, and J. A. Kong, “Study of lossy effects on the propagation of propagating and evanescent waves in left-handed materials,” Phys. Lett. A 323(5-6), 484–494 (2004). [CrossRef]  

14. E. J. Candes and M. B. Wakin, “An Introduction To Compressive Sampling,” IEEE Signal Process. Mag. 25(2), 21–30 (2008). [CrossRef]  

15. G. Oliveri, P. Rocca, and A. Massa, “A Bayesian-Compressive-Sampling-Based Inversion for Imaging Sparse Scatterers,” IEEE Trans. Geosci. Remote Sensing 49(10), 3993–4006 (2011). [CrossRef]  

16. Q. Fan, C. Yin, and H. Liu, “Accurate Recovery of Sparse Objects With Perfect Mask Based on Joint Sparse Reconstruction,” IEEE Access 7, 73504–73515 (2019). [CrossRef]  

17. L. G. Wang, M. Wang, W. Zhong, and L. Li, “Complex-Valued Deep Convolutional Networks for Nonlinear Electromagnetic Inverse Scattering,” in 2018 IEEE International Conference on Computational Electromagnetics (ICCEM) (IEEE, 2018), pp. 1–2.

18. L. Li, L. G. Wang, F. L. Teixeira, C. Liu, A. Nehorai, and T. J. Cui, “DeepNIS: Deep Neural Network for Nonlinear Electromagnetic Inverse Scattering,” IEEE Trans. Antennas Propagat. 67(3), 1819–1825 (2019). [CrossRef]  

19. C. Dong, C. C. Loy, K. He, and X. Tang, “Image Super-Resolution Using Deep Convolutional Networks,” IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016). [CrossRef]  

20. Z. Wei and X. Chen, “Deep-Learning Schemes for Full-Wave Nonlinear Inverse Scattering Problems,” IEEE Trans. Geosci. Remote Sensing 57(4), 1849–1860 (2019). [CrossRef]  

21. K. Xu, L. Wu, X. Ye, and X. Chen, “Deep Learning-Based Inversion Methods for Solving Inverse Scattering Problems With Phaseless Data,” IEEE Trans. Antennas Propagat. 68(11), 7457–7470 (2020). [CrossRef]  

22. R. W. Ziolkowski and A. D. Kipple, “Causality and double-negative metamaterials,” Phys. Rev. E 68(2), 026615 (2003). [CrossRef]  

23. L. Huang and H. C. So, “Source Enumeration Via MDL Criterion Based on Linear Shrinkage Estimation of Noise Subspace Covariance Matrix,” IEEE Trans. Signal Process. 61(19), 4806–4821 (2013). [CrossRef]  

24. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proc. IEEE 86(11), 2278–2324 (1998). [CrossRef]  

25. J. Chen and X. Huo, “Theoretical Results on Sparse Representations of Multiple-Measurement Vectors,” IEEE Trans. Signal Process. 54(12), 4634–4643 (2006). [CrossRef]  

26. M. E. Davies and Y. C. Eldar, “Rank Awareness in Joint Sparse Recovery,” IEEE Trans. Inf. Theory 58(2), 1135–1146 (2012). [CrossRef]  

27. J. B. Pendry and S. A. Ramakrishna, “Focusing light using negative refraction,” J. Phys.: Condens. Matter 15(37), 6345–6364 (2003). [CrossRef]  

28. R. Ruppin, “Comment on Focusing light using negative refraction,” J. Phys.: Condens. Matter 16(47), 8807–8809 (2004). [CrossRef]  

29. R. Song, Y. Huang, X. Ye, K. Xu, C. Li, and X. Chen, “Learning-Based Inversion Method for Solving Electromagnetic Inverse Scattering With Mixed Boundary Conditions,” IEEE Trans. Antennas Propagat. 70(8), 6218–6228 (2022). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (11)

Fig. 1.
Fig. 1. Diagram of electromagnetic inverse scattering model
Fig. 2.
Fig. 2. Diagram of equivalent current scattering
Fig. 3.
Fig. 3. Convolutional neural network structure diagram
Fig. 4.
Fig. 4. The accuracy of super-resolution imaging
Fig. 5.
Fig. 5. Reconstruction results of targets by the traditional methods
Fig. 6.
Fig. 6. Linear dependent error corresponding to the rectangular substructure
Fig. 7.
Fig. 7. Schematic diagram of spectral domain analysis in complementary media. (a) Lossless medium, (b) lossy medium, and (c) focusing of multiple radiation sources.
Fig. 8.
Fig. 8. Network training error curve
Fig. 9.
Fig. 9. Imaging resolution of network method
Fig. 10.
Fig. 10. Neural network method reconstruction results
Fig. 11.
Fig. 11. Imaging results of the neural network method

Tables (2)

Tables Icon

Table 1. The imaging error calculated under different SNRs

Tables Icon

Table 2. The imaging error of letter-shaped targets

Equations (28)

Equations on this page are rendered with MathJax. Learn more.

$$E_z^{tot}({\rho} )= E_z^{inc}({\rho } )+ k_0^2\int_D {{G_0}({{\rho },{\rho^{\prime}}} )\chi ({\rho } )E_z^{tot}({{\rho^{\prime}}} )d\rho ^{\prime}} \textrm{ },\textrm{ }{\rho } \in D$$
$$\chi = ({{\varepsilon_r} - 1} )- j\frac{\sigma }{{\omega {\varepsilon _0}}}$$
$$E_z^{sca}({\rho } )= \int_C {G({{\rho },{\rho^{\prime}}} )\chi ({{\rho^{\prime}}} )E_z^{tot}({{\rho^{\prime}}} )d{\rho ^{\prime}}} \textrm{ },\textrm{ }{\rho } \in C$$
$${E^{tot}} = {E^{inc}} + {G_D}\chi {E^{tot}}$$
$${E^{sca}} = {G_C}\chi {E^{tot}}$$
$$E_{1z}^{inc} ={-} \int\limits_{ - \infty }^{ + \infty } {\frac{{\omega {\mu _0}}}{{4\pi {k_{1x}}}}({{e^{ - j{k_{1x}}({x - {x_0}} )}} + R{e^{j{k_{1x}}({x - 2{d_1} + {x_0}} )}}} ){e^{ - j{k_y}({y - {y_0}} )}}d{k_y}}$$
$$R = {R_{12}} + \frac{{{T_{12}}{T_{21}}{R_{23}}{e^{ - j{k_{2x}}2({{d_2} - {d_1}} )}}}}{{1 - {R_{21}}{R_{23}}{e^{ - j{k_{2x}}2({{d_2} - {d_1}} )}}}}$$
$$E_{3z}^{inc} ={-} \int\limits_{ - \infty }^{ + \infty } {\frac{{\omega {\mu _0}}}{{4\pi {k_{1x}}}}T{e^{ - j{k_{1x}}[{x - {x_0} - ({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}d{k_y}}$$
$$T = \frac{{{T_{12}}{T_{23}}{e^{ - j{k_{2x}}({{d_2} - {d_1}} )}}}}{{1 - {R_{21}}{R_{23}}{e^{ - j2{k_{2x}}({{d_2} - {d_1}} )}}}}$$
$${\boldsymbol J}_{eq}^{} = j\omega ({\varepsilon - {\varepsilon_0}} ){\boldsymbol E}_D^{tot} = j\omega \chi {\varepsilon _0}({{{\boldsymbol E}^{inc}} + {\boldsymbol E}_{Jeq}^{sca}} )$$
$${\boldsymbol E}_{Jeq}^{sca} ={-} \frac{{\omega {\mu _0}}}{4}\int\!\!\!\int\limits_{s^{\prime}} {{{\boldsymbol J}_{eq}}({{\boldsymbol{\rho}}^{\prime}} )H_0^{(2)}({k_0}\rho )ds^{\prime}} \textrm{ + }\int_{ - \infty }^{ + \infty } {d{k_y}{\psi _{{{J}_{eq}}}}R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}}$$
$$\frac{{\omega {\mu _0}}}{4}\int\!\!\!\int\limits_{s^{\prime}} {{{\boldsymbol J}_{eq}}({{\boldsymbol{\rho}^{\prime}}} )H_0^{(2)}({k_0}\rho )ds^{\prime}} + \frac{{{\boldsymbol J}_{eq}^{}({{\boldsymbol{\rho}^{\prime}}} )}}{{j\omega ({\varepsilon - {\varepsilon_0}} )}} - \int\limits_{ - \infty }^{ + \infty } {d{k_y}{\psi _{{{J}_{eq}}}}R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} = {{\boldsymbol E}^{inc}}({\boldsymbol{\rho}} )$$
$$\sum\limits_{n = 1}^{{N_{eq}}} {\alpha ({{{{\boldsymbol{\rho}^{\prime}}}_n}} )} \cdot \left[ \begin{array}{l} \frac{{\omega {\mu_0}}}{4}\int\!\!\!\int\limits_{{{s^{\prime}}_n}} {H_0^{(2)}({k_0}|{{{\boldsymbol{\rho}}_m} - {{{\boldsymbol{\rho}^{\prime}}}_n}} |)d{{s^{\prime}}_n}} + \frac{{\delta ({{{\boldsymbol{\rho}}_m} - {{{\boldsymbol{\rho}^{\prime}}}_n}} )}}{{j\omega [{\varepsilon ({{{{\boldsymbol{\rho}^{\prime}}}_n}} )- {\varepsilon_0}} ]}}\\ - \int_{ - \infty }^{ + \infty } {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{3x}}}} \cdot {\Delta^2}} \right)R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} \end{array} \right] = {{\boldsymbol E}^{inc}}({{{\boldsymbol{\rho}}_m}} )$$
$$\scalebox{0.9}{$\displaystyle{\boldsymbol g}_{n^{\prime}}^D = j\omega {\varepsilon _0} \cdot \left[ { - \frac{{\omega {\mu_0}}}{4}\int\!\!\!\int\limits_{{{s^{\prime}}_n}} {H_0^{(2)}({k_0}|{{\boldsymbol \rho } - {{{\boldsymbol \rho^{\prime}}}_n}} |)d{{s^{\prime}}_n}} + \int\limits_{ - \infty }^{ + \infty } {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{3x}}}} \cdot {\Delta^2}} \right)R{e^{ - j{k_{3x}}({x - 2{d_2} + {{x^{\prime}}_n}} )}}{e^{ - j{k_y}({y - {{y^{\prime}}_n}} )}}} } \right]$}$$
$$E_{}^{sca}({{x_r},{y_r}} )={-} \sum\limits_{n = 1}^{{N_{eq}}} {\alpha ({{{x^{\prime}}_n},{{y^{\prime}}_n}} )\cdot \int_{ - \infty }^{ + \infty } {d{k_y}\frac{{\omega {\mu _0}}}{{4\pi {k_{3x}}}}{\Delta ^2}T{e^{j{k_{1x}}({{x_r} - {{x^{\prime}}_n} + {d_2} - {d_1}} )}}{e^{ - j{k_y}({{y_r} - {{y^{\prime}}_n}} )}}} }$$
$${\boldsymbol g}_{n^{\prime}}^C ={-} \int\limits_{ - \infty }^{ + \infty } {d{k_y}({j\omega {\varepsilon_0}{\Delta^2}} )\cdot \frac{{\omega {\mu _0}}}{{4\pi {k_{3x}}}}T{e^{j{k_{0x}}[{{x_r} - {{x^{\prime}}_n} - ({{d_1} - {d_2}} )} ]}}{e^{ - j{k_y}({{y_r} - {{y^{\prime}}_n}} )}}}$$
$${{\boldsymbol w}_{q,0}} = \frac{{{{||{{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}} ||}^\textrm{2}}}}{{{{||{{\boldsymbol G}_C^{}{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}} ||}^\textrm{2}}}}{\boldsymbol G}_C^H{\boldsymbol e}_q^{sca}$$
$$F = \frac{{\sum\nolimits_q {||{{\boldsymbol e}_q^{sca} - {\boldsymbol G}_C^{}{{\boldsymbol w}_q}} ||_C^2} }}{{\sum\nolimits_q {||{{\boldsymbol e}_q^{sca}} ||_C^2} }} + \frac{{\sum\nolimits_q {||{diag({\boldsymbol \chi } )\cdot {\boldsymbol e}_q^{inc} - {{\boldsymbol w}_q} + diag({\boldsymbol \chi } )\cdot {\boldsymbol G}_D^{}{{\boldsymbol w}_q}} ||_D^2} }}{{\sum\nolimits_q {||{diag({\boldsymbol \chi } )\cdot {e}_q^{inc}} ||_D^2} }}$$
$${\boldsymbol W} = \arg \mathop {\min }\limits_{W} {||{{\boldsymbol w}_{\textrm{norm2}}^{}} ||_0} \qquad s.t.\qquad ||{{{\boldsymbol E}^s} - {{\boldsymbol G}^W}{\boldsymbol W}} ||_F^2 \le \delta$$
$${\boldsymbol W} = \arg \mathop {\min }\limits_{W} \sum\limits_{l = 1}^L {{g_\gamma }({||{{\boldsymbol w}_l^{}} ||_2^2} )} + \frac{\alpha }{2}||{{{\boldsymbol E}^s} - {{\boldsymbol G}^W}{\boldsymbol W}} ||_F^2.$$
$${{\boldsymbol W}_{\textrm{opt}}} = \arg \mathop {\min }\limits_{{{W}_{\gamma ,\textrm{opt}}}} |{{N_{true}} - {N_e}({{{\boldsymbol W}_{\gamma ,\textrm{opt}}}} )} |$$
$${{\boldsymbol \chi }_{M,n - 1}} = {{\boldsymbol \chi }_{n - 1}} \odot {M_{\textrm{JS}}}$$
$${{\boldsymbol \chi }_k} = \mathop {\arg \min }\limits_{\chi } \sum\nolimits_q {||{{\boldsymbol e}_q^{sca} - {{\boldsymbol G}_C}{{\boldsymbol \chi }_{k - 1}}{\boldsymbol e}_q^{tot}} ||_2^2}$$
$$loss({\hat{{\boldsymbol \chi }}} )= \frac{1}{{2K}}\sum\limits_{k = 1}^K {||{\hat{{\boldsymbol \chi}}(k )- {{\boldsymbol \chi}^{std}}(k )} ||_2^2}$$
$${\textrm{Err} _{\textrm{corr }}} = ||{{\boldsymbol G}_{\boldsymbol C}^{\textrm{sur }}{c} - {\boldsymbol g}_i^{}} ||$$
$$E_{3z}^{}({{x_0} + 2d} )= E_{1z}^{}({{x_0}} )\textrm{ }({0 < {x_0} \le {d_1}} )$$
$$\scalebox{0.8}{$\displaystyle E_{3z}^{inc} = \int\limits_{ - {k_1}}^{ + {k_1}} {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{1x}}}}} \right){e^{ - j\sqrt {k_1^2 - k_y^2} [{x - {x_0} - 2({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}} + \int\limits_{ {\pm} {k_1}}^\infty {d{k_y}\left( { - \frac{{\omega {\mu_0}}}{{4\pi {k_{1x}}}}} \right){e^{ - \sqrt {k_y^2 - k_1^2} [{x - {x_0} - 2({{d_2} - {d_1}} )} ]}}{e^{ - j{k_y}({y - {y_0}} )}}}$}$$
$$\textrm{E}({{\varepsilon }_r^{}} )= \sqrt {\frac{1}{{{N_{std}}}}\sum\limits_{({p,q} )\in D} {{{\left|{\frac{{\hat{\varepsilon }_{r;p,q}^{} - \varepsilon_{r;p,q}^{std}}}{{\varepsilon_{r;p,q}^{std}}}} \right|}^2}} }$$
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.