Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Holistic random encoding for imaging through multimode fibers

Open Access Open Access

Abstract

The input numerical aperture (NA) of multimode fiber (MMF) can be effectively increased by placing turbid media at the input end of the MMF. This provides the potential for high-resolution imaging through the MMF. While the input NA is increased, the number of propagation modes in the MMF and hence the output NA remains the same. This makes the image reconstruction process underdetermined and may limit the quality of the image reconstruction. In this paper, we aim to improve the signal to noise ratio (SNR) of the image reconstruction in imaging through MMF. We notice that turbid media placed in the input of the MMF transforms the incoming waves into a better format for information transmission and information extraction. We call this transformation as holistic random (HR) encoding of turbid media. By exploiting the HR encoding, we make a considerable improvement on the SNR of the image reconstruction. For efficient utilization of the HR encoding, we employ sparse representation (SR), a relatively new signal reconstruction framework when it is provided with a HR encoded signal. This study shows for the first time to our knowledge the benefit of utilizing the HR encoding of turbid media for recovery in the optically underdetermined systems where the output NA of it is smaller than the input NA for imaging through MMF.

© 2015 Optical Society of America

1. Introduction

Multimode fibers (MMF) support multimode propagation of light such that the light travels not only along the cylindrical axis of the core, single mode if it does, but also along multiple different paths with non-zero wave vector components in traverse directions.

The use of MMF for imaging has drawn great interests recently [1–7]. Current endoscopic imaging systems in clinics are based on bundles of fibers where each fiber transfers the signal corresponding to a single pixel of the final image. The multiple propagation characteristic of MMF allows a complex image to be transferred through not a bundle of fibers but only with a single fiber. This enables the miniaturization of imaging systems. Thus, MMF is expected to become a significantly important part for minimally invasive endoscopic imaging where a fiber with needle-like dimensions can transfer complex images. However, there is an intrinsic limitation in imaging through MMF on the spatial image resolution which is imposed by the low numerical aperture (NA) of available MMF [4–7]; the typical NA of MMFs with large number of propagation modes range from 0.2 to 0.5 [5] whereas the NA of optical lenses reaches up to 0.95 in air and higher than 1.6 with special oil immersions.

It has been demonstrated that the problem of the low resolution given by the low NA of MMFs can be relaxed by the use of turbid media in conjunction with MMFs [6,7]. Wave propagation through turbid media, such as white paint, ground glass, and biological tissue, produces complex speckle patterns in the image plane due to multiple scattering of waves in the media. Multiple scattering of waves, referring to the phenomenon where the light waves are forced to deviate from a straight trajectory due to refractive index inhomogeneity through which they pass. It is obvious that this multiple scattering process hinders accurate transferring of images through turbid media. Recently, interesting results were reported that the multiple scattering process in turbid media can be used for overcoming the resolution limit determined by the NA of the optical systems [8,9]. The NA of an optical system sets the maximum incident angle θmax of the incoming waves that can be accepted by the system. In wide-field imaging, the multiple scattering through turbid media changes the directions of input waves and some of the waves with large incident angles beyond the acceptance angle of a usual lens can be redirected to the detector [8]. Thus, the effective input NA of the lens becomes increased. In point scanning imaging, multiple scattering is combined with wave-front shaping and makes it possible to focus the light beam to a point smaller than the diffraction limit given by the NA [9]. These resolution improvements by turbid media can be made with the same principle in imaging through MMF when it is used with turbid media. It was found that waves with larger incident angles than the acceptance angle of the MMF can be transferred in the wide-field imaging [7], and a smaller focusing point can be made in point scanning imaging [6].

Here, we show that the redirection of waves is not the only useful characteristic of turbid media. Multiple scattering in turbid media scrambles the waves in a seemingly randomized, a deterministic but complex, manner and this brings forth other positive effects as well. Random scrambling of different modes of waves converts the object wave into a speckle pattern. The object cannot be directly observed looking at the speckle pattern with bare eyes, and thus some form of an inverse operation is necessary such as descrambling for imaging or wave-front shaping for focusing [8–12]. Thus, random scrambling gives an impression that it is only a hindrance; on the contrary, this traditional perspective can be challenged and improved.

Waves scattered from an object are made of the superposition of multiple different modes. Those modes travel through the turbid medium and become scrambled. We note that each mode of the scrambled waves in fact contains holistic information of the object. A signal mode is holistic in the sense that the mode contains the information of the whole modes of the incoming waves. Each mode of incoming waves propagates though the turbid medium is scattered and redirected into many different modes at the output of the turbid media. One mode is scattered into almost all the modes of the output waves. This is to mean that a single output mode is made out of the superposition of many if not all incoming waves. In addition, each mode of the incoming waves went through a propagation path completely different from other modes. Thus, each output mode offers an independent view of the same object. In this sense, the random scrambling can be viewed as a beneficial encoding process, which provides multiple independent outlooks of the whole waves from an object. We will refer to this signal transforming process in turbid media as holistic random (HR) encoding.

In this paper, we aim to make an efficient use of the HR encoding of the multiple scattering in turbid media and improve the image quality in wide-field imaging through MMF. We consider an imaging system through MMF where a turbid medium is placed at the input end of the MMF. In this case, the imaging system becomes underdetermined because the output NA of the MMF is smaller than the input NA of it. The information of object waves is transferred to a less number of wave modes than that of the input wave modes. Considering that the degree of freedom of a signal is reduced, it is not easy to transmit information of the object waves without loss. To compound the matter, the recovery of the object waves is not easy as well since the dimension (the number of elements) of the observed signal is smaller than that of the original signal to be estimated. Here, we show that the HR encoding of the turbid media enables much improved information transmission and signal reconstruction. We employ sparse representation (SR) framework [13–21] and show that the object information can be extracted at an improved fidelity when the signal is HR encoded. In many literatures, SR has been shown to provide superb estimation of the original signal from a smaller number of measurements than the dimension of the original signal [13–21]. Previously, SR was shown to be beneficial in imaging through turbid media [11,12]. In [11], SR was shown to suppress speckles in reconstructed images. It was shown in [12] that SR recovers the image well in the situation where the number of pixels in the CCD array is smaller than that the pixels of the original image. This paper provides the first result that SR can be used to improve the image reconstruction quality in imaging through MMF when the imaging system is underdetermined due to the use of turbid media at the input end of the MMF.

This paper is organized as follows: Section 2 describes the system for imaging through MMF, and Section 3 investigates the HR encoding by the multiple scattering in turbid media and links it to the SR framework for image reconstruction. Experimental results are discussed in Section 4, and Section 5 concludes the paper.

2. System description

2.1 Experimental set-up

We consider an imaging system where the object wave propagates through a single MMF with 1 m of length (NA of 0.22; Thorlabs, M14L01) and recorded at the CCD array. The input facet of the MMF is randomly coated by ZnO nanoparticles.

The experimental schematic of the imaging is depicted in Fig. 1. Figure 1(a) describes the calibration stage where the transmission matrix (TM) of the coated MMF is measured. TM is a collection of responses of the coated MMF to a set of incoming plane waves (λ=633nm) with N different incident angles to the input facet of the coated MMF. We used N=4000 different angles for our TM. For preparation of the plane waves, no object is presented in the object plane. The incident angle of the plane wave is controlled by a galvanometer.

 figure: Fig. 1

Fig. 1 Experimental schematics of imaging through turbid media coated MMF. (a) Recording of the TM. OP: object plane, MMF: multimode fiber, BS: beam splitter, SB: sample beam, RB: reference beam. The photo in the red box shows the image of the input surface of the turbid media coated MMF. (b) Recording of the distorted object wave. (c) The recorded TM. Only the intensities are shown in the image but the phases are estimated as well; thus the columns are complex valued vectors. (d) The recorded distorted object wave. Again, only the intensity is shown here. Scale bar: 10 μm.

Download Full Size | PDF

The transferring of an object wave is described in [Fig. 1(b)]. Once the TM is measured and becomes available, the response of the coated MMF to the object wave is measured at the CCD. The object wave is distorted in the coated MMF due to the multiple scattering in the turbid medium of ZnO nanoparticles and the interference among waves with different propagation modes inside the MMF. For the object, we use a sample similar to USAF target.

Now with the TM and the distorted object image, the object wave is recovered by computation. Here, all the measurements are post processed by the off-axis holography [8] to obtain the E-field images; the baseline method considered in this paper follows the turbid lens imaging (TLI) system in [8]. We use MMF with the NA of 0.22 in the experiment. We fix the NA of the sub-systems followed by the MMF slightly larger, 0.24, than 0.22. By doing this, we can capture the most of the signal from the MMF even though there are some experimental mismatches, for example, the error in the alignment on the optical axis.

2.2 Image recovery using transmission matrices

The object wave Uo(x,y) is decomposed into a set of plane waves with different propagation directions as follows

Uo(x,y)=kAo(k)P(x,y;k)
where k:=kxix+kyiy+kziz is the wave vector (kx/2π=sinθx/λ, ky/2π=sinθy/λ, kz/2π=sinθz/λ, and (θx,θy,θz) is the angle of propagation), ix, iy, and iz are unit vectors in x, y, and z directions (the optical axis is in the z direction), respectively, P(x,y;k) is the plane wave with the propagation direction k, and Ao(k) is the angular spectrum of the object wave. The distorted object wave Ur(x,y) after propagation through the coated MMF is expressed as
Ur(x,y)=kAo(k)F(x,y;k)
where F(x,y;k) is the response wave of the coated MMF for a single plane wave P(x,y;k). Now using the vector notations, the distorted object wave can be expressed as follows
r=Fa
where rM and aN are the vectorized versions of Ur(x,y) and Ao(k), and FM×N is the TM each column of which is the vectorized version of the F(x,y;k); there are N different propagation directions (modes) k considered.

From the distorted object wave, the angular spectrum of the object wave is estimated in [7] by using the pseudo inversion (PINV) method,

a^pinv=F1r
where F1 is the PINV matrix of F. Using the estimated angular spectrum, the object wave in the object plane can be reconstructed.

3. Imaging through MMF in conjunction with turbid media

Recall that the input facet of the MMF is coated by a turbid medium. Due to the multiple scattering process through the turbid medium, some of those waves whose incident angles to the medium are larger than the acceptance angle determined by the NA of the MMF, θz>θmax, are redirected, θzθz, and are coupled to the MMF, θzθmax. This introduces more modes of the object (the green arrows in [Fig. 2(b)]) to the detector. The NA of a MMF is proportional to the square root of the number of modes captured by the MMF. As a result, it was shown in experiments [7] that the effective NA of the input side of the MMF increases.

 figure: Fig. 2

Fig. 2 Acceptance angle, exit angle, and their corresponding modes of waves for (a) intact MMF and (b) coated MMF. In (b), more modes of input waves (green arrows) can be captured in coated MMF. But, the number of modes of output waves is the same as that of intact MMF.

Download Full Size | PDF

However, we notice that the increase in the effective NA causes the image capturing system to be underdetermined where the input NA is larger than the output NA (Fig. 2). Larger number of modes of the object waves than the available propagation modes in the MMF is captured. This gives a challenge in the recovery of the object. In general, the output signal of an underdetermined system does not convey all the information of the input signal. Besides, even in the cases where there are no information losses, it is also well known from the linear algebra [22] that the correct estimation of a signal in the underdetermined systems is not easy for it has more than one solution. Note that the use of another turbid medium in the output facet does not change the situation because the number of propagation modes inside the MMF is still the same.

3.1 HR encoding

Multiple scattering in turbid media provides HR encoding to the incoming wave. HR encoding provides the two kinds of encoding, holistic encoding and random encoding. We define “holistic encoding” to be a signal transforming process which makes each component of the transformed signal to contain all the components of the original signal with a certain format, especially in this paper, a weighted summation of them. We also define “random encoding” to be a multiplexing process where the contributions of a component of the original signal to components of the output signal are modeled by independent random variables.

Now, we show that the waves Uo(x,y) scattered from an object is HR encoded in the turbid medium. 1) Holistic encoding: Each input mode P(x,y;k)of the incoming waves Uo(x,y) experiences multiple scattering in the turbid medium. The object wave Ut(x,y) after propagation through the turbid medium (refer to [Fig. 2(b)]) is expressed as

Ut(x,y)=kKAo(k)T(x,y;k)
where K is the set of modes k which propagate through the coated MMF and reach to the detector and T(x,y;k) is the response wave of the turbid medium to P(x,y;k). The response wave T(x,y;k) at the output of the turbid medium for a single plane wave P(x,y;k) has many modes of waves. This is because the multiple scattering process in the turbid medium changes the directions of the waves in a randomized manner. T(x,y;k) is expressed as
T(x,y;k)=kKt(k;k)P(x,y;k)
where k is the wave vector after propagation through the turbid medium, K is the set of modes k which propagate through the MMF and reach to the detector, t(k;k) is the contribution of a mode k of input waves to a mode k of output waves, and P(x,y;k) is the plane wave with the propagation direction k.

Here, t(k;k) is well approximated by independent and identically distributed (i.i.d.) complex valued Gaussian random variable. It was found in [23,24] that the output waves of a turbid medium at a spatial plane (x,y) when a mode of waves is transmitted through the medium, t(x,y;k), are i.i.d. complex valued Gaussian random variables provided that the number of independent scatters is large; t(x,y;k) and t(k;k) are a two-dimensional Fourier transform pair. This has been also supported in the experiments [12,25]. The distribution of the eigenvalues of the TM composed of t(x,y;k) was close to that of i.i.d. Gaussians [25]. The coherence (μ0 in Sec 3.2) of the TM of t(x,y;k) behaved similarly to that of i.i.d. Gaussians [12]. We know that the Fourier transform of a Gaussian random matrix is another Gaussian random matrix. Thus, the contribution t(k;k) follows i.i.d. complex valued Gaussian, too.

Using [Eq. (6)], the object wave Ut(x,y) in [Eq. (5)] can be expressed as

Ut(x,y)=kKAt(k)P(x,y;k)
where the angular spectrum At(k) of P(x,y;k) is
At(k)=kKt(k;k)Ao(k).
Here, the probability that t(k;k)=0 is very small; the probability approaches zero for the event that a realization of complex Gaussian random variable equals to 0. Thus, the angular spectrum At(k) of a mode k of the output waves is now the combination of the angular spectrum Ao(k) of all the modes k. Therefore, a mode of the output waves contains holistic information of the input waves.

2) Random encoding: As it was discussed in the previous paragraph, t(k;k) for kK are approximated by independent random variables. Thus, the angular spectrum At(k) of each mode k of the output waves shows an independent view of the same object Uo(x,y).

This HR encoding has a couple of desirable aspects to send information of object waves in underdetermined systems. i) The information of all the input modes is transferred no matter how few modes are in the output waves, if it is more than one. It is because each output mode captures information about all the input modes of the object wave. ii) It sends information of the object waves in an efficient manner. The information of a mode is not redundant to that of other modes as each output mode captures unique information about the object wave. Due to these two aspects, the HR encoded signal is expected to be appropriate for information transmission in underdetermined systems. In the literature, it is shown that HR encoded signals can transmit enough information for a certain kind of signals in underdetermined systems [16–18].

Now, let us see the effect of HR encoding on the object wave after propagation through the MMF. The HR encoded waves Ut(x,y) at the output of the turbid medium are propagated through the MMF. The object wave Ur(x,y) after propagation through the MMF ([Fig. 2(b)]) is expressed as

Ur(x,y)=kKAt(k)Fintact(x,y;k)
where Fintact(x,y;k) is the response wave of the intact MMF to P(x,y;k). Fintact(x,y;k) usually has more than one propagation modes of waves in MMF. This is because that it is almost infeasible to match a mode of incoming waves to only a single propagation mode in MMF. Fintact(x,y;k) is expressed as
Fintact(x,y;k)=kKfintact(k;k)P(x,y;k)
where k is the wave vector after propagation through the MMF, K is the set of modes k which are captured at the detector, fintact(k;k) is the contribution of a mode k of input waves to a mode k of output waves, and P(x,y;k) is the plane wave with the propagation direction k. Using [Eq. (8)], [Eq. (9)], and [Eq. (10)], the object wave Ur(x,y) can be rewritten as
Ur(x,y)=kKAr(k)P(x,y;k)
where the angular spectrum Ar(k) is
Ar(k)=kKC(k;k)Ao(k),
and the weight C(k;k) is
C(k;k)=kKt(k;k)fintact(k;k).
Please recall that a larger number of modes k of the incoming waves than that of propagation modes k in the intact MMF (equivalently k) are captured with the help of the turbid medium in the coated MMF, |K|>|K|. We see that the angular spectrum Ao(k) for kK of the object waves Uo(x,y) are transferred through waves P(x,y;k) with a smaller number of propagations modes kK in [Eq. (12)]. Thus, the reconstruction of the Ao(k)(or equivalently Uo(x,y)) from the Ar(k) (or Ur(x,y)) is an underdetermined problem.

We see that the signal is still holistically encoded in the output waves Ur(x,y) in [Eq. (12)]. Every component of the angular spectrum Ao(k) of the input waves is contained in each single components of the angular spectrum Ar(k) of the output waves. The random encoding property of Ut(x,y) is not inherited to Ur(x,y) since C(k;k) is not independent for different k. But, we will see that the correlation between C(k;k) with different k is small in [Fig. 4(c)]. This is desirable for image recovery (Sec 3.2). A further explanation on C(k;k) is given in Sec 3.3. Please note that we use P(x,y;k) for the modes of the output waves of the MMF and for the propagation modes in the MMF interchangeably without distinction as they are one-to-one mapped.

3.2 Sparse representation

SR is a signal representation framework, which has received great interests since it can be used to estimate a signal even in the underdetermined systems [13–21]. HR encoding increases the oversampling ratio of the underdetermined systems in which a signal is estimated correctly [16–18]. It is well known that there are two conditions for successful application of the SR framework for recovery of original signal from its HR encoded one. First, the signal a is compressible. A compressible signal means that the signal a is well approximated with a small number of nonzero elements in a, say K where K = N. The object signals of interest in this paper are natural signals and we have many research results showing that they are compressible. It is well known that most natural images are well approximated with only a few elements in the Wavelet domain [15]. Not only with the Wavelet domain, if the signal is represented with a few elements in any other orthogonal signal bases, the signal is compressible [16]. Second, the measurement matrix F needs to be incoherent. We say a matrix is incoherent if the cross-correlations of columns of the matrix are small. This follows the conventional meaning for incoherence of a matrix in [14,17,20]. Note that this incoherence is different from that in optics which is typically a phase relationship among waves. The incoherence of a measurement matrix can be measured in its Gram matrix D=F*F. We assume that the norm of each column of F is normalized to be one. The amplitude |dij| of the off-diagonal elements of D indicates the cross-correlation of different ith and jth columns of the measurement matrix where dij is the (i,j)th element of D and || denotes the absolute value of the complex number.

Several different measures are used for incoherence of a measurement matrix. The simplest one is i) the largest off-diagonal element in the Gram matrix, μ0maxi,j|oij| where oij is the (i,j)th element of O = D-I [14,17,20]. But, this does not characterize the incoherence of a measurement matrix well for it only considers the most extreme case [20]. The other two measures are ii) the size of the smallest group of off-diagonal elements in a single row of the Gram matrix which have the sum greater than one, μ1mini(min|J|s.t.jJ|oij|1) where |J| is the cardinality of an index set J [14], and iii) the maximum value of the summation of M off-diagonal elements in a single row of the Gram matrix, μ2max|J|=MmaxiJjJ|oij| [20]. Those two measures provide somewhat more of the general behavior of a measurement matrix. However, they still do not provide an overall behavior of the measurement matrix as they also reflect extreme cases by taking the minimum size or the maximum sum; actually, the two measures are designed to provide theoretical bounds of M which guarantee the successful estimation of sparse signals, which are signals with small numbers of nonzero elements, in the SR framework.

In this paper, we aim to use μ3|{oij||oij|>α}|/(N2N) the fraction of the off-diagonal elements of a Gram matrix whose absolute values are comparable, |oij|>α where α is the degree of comparableness (0<α<1), to the value of the diagonal elements as the measure of incoherence. The rationale for this is i) that it does not take any extreme values, ii) that it is coherent to the previous three measures, μ0, μ1, and μ2, as more number of large off-diagonal elements is likely to lead to values of the three measures which indicate the matrix is less incoherent, and iii) that the use of fractions is appropriate to compare the incoherence of the two different Gram matrices with different size; this is the case we consider in this paper. It is desirable to have smaller μ3. Construction of an incoherent measurement matrix in a deterministic manner for an underdetermined system is known to be difficult. Fortunately, in the literature, it is shown analytically or empirically that many kinds of randomly generated matrices are incoherent [16–19]. That is, we can make good measurement matrices by using random generation, without a careful precise matrix design.

Now we aim to explain how SR framework can be utilized to recover the signal successfully in our turbid lens based MMF imaging. The current state-of-the-art SR systems can recover a signal with K nonzero elements, the so-called K-sparse signal, correctly with just M=O(Klog(N/K)) number of random measurements [17].

The estimation in SR can be done by finding solution of the following problem [17]

a^SR=argminaΨ*a1subjecttor=Fa,
where Ψ is the sparsifying basis in which the signal a can be approximated with just a small number of nonzero elements, ()* denotes the conjugate transpose of a matrix, and 1 denotes the L1 norm, that is, the sum of the absolute values of the vector elements.

3.3 Effect of the random scrambling of turbid media on TM

As it was discussed in Sec 3.1, turbid media provide HR encoding to the object waves. In this subsection, we show that HR encoding provides incoherent TM to MMF. We focus on how improved the coated MMF is compared to the intact MMF in terms of incoherence. As we have discussed in Sec 3.2, we will use μ3 as the measure of incoherence.

TM is a collection of responses F(x,y;k) of the MMF to a set of incoming plane waves P(x,y;k) with N different modes k (Sec 2.2). Let us consider first the TM of an intact MMF without a turbid medium deposited. For an intact MMF, the response of the MMF F(x,y;k) is Fintact(x,y;k) in [Eq. (10)]; here, k and k are the same. The TM of the MMF consists of Fintact(x,y;k) with different modes k. As it was told in Section 3.1, Fintact(x,y;k) is a superposition of waves P(x,y;k) for more than one propagation modes k in MMF. Fintact(x,y;k) in [Eq. (10)] can be written as

Fintact(x,y;k)=kSintact(k)fintact(k;k)P(x,y;k)
where Sintact(k):={k|fintact(k;k)0} is the set of excited propagation modes in the MMF when plane waves P(x,y;k) with the mode k are inserted; Sintact(k)K. We found that a small number of propagation modes in the MMF are excited when waves with a single mode are inserted ([Fig. 3(c)]); this is serious especially when the incident angles θz of the incoming waves are small. With a small number of propagation modes P(x,y;k), there are not many incoherent Fintact(x,y;k) available because they are the combinations of the few plane waves whose modes k are included in Sintact(k); it is analogous to generating incoherent vectors which are linear combinations of a small number of basis columns. Thus, it is not easy to fill up the columns of the TM with incoherent Fintact(x,y;k) for k with small incident angles. This results in a not incoherent TM.

 figure: Fig. 3

Fig. 3 (a) Recorded responses Fintact(x,y;ki), (b) Amplitude of the autocorrelation for the response, RFF;intact(x,y;ki), and (c) Angular spectrum of the response, fintact(k;ki), of intact MMF. Among the responses of all the incident angles covering the NA of 0.22, the 1st, the 101st, the 201st, and the 1001st of them are presented. Only the intensities are shown here. Scale bar: 10 μm.

Download Full Size | PDF

We show in [Fig. 3(a)] some of the Fintact(x,y;k) with several k, respectively. We consider discrete incident angles ki for 1i2000. Among the responses Fintact(x,y;ki) of all the considered incident angles ki, we show ki with i = 1, 101, 201, and 1001. The incident angle changes with the pattern of a spiral starting from the center. A small index i of the response means that it is for that with a small incident angle θz. We see that the responses Fintact(x,y;ki) of smaller incident angles (i = 1, 101, 201) are not complex due to lack of the available propagation modes P(x,y;k) ([Fig. 3(c)]). Here, we mean by complex that the value in each pixel (x,y) of the response Fintact(x,y;ki) changes enough from those in its neighboring pixels. This can be seen in the autocorrelation of Fintact(x,y;ki), RFF;intact(x,y;ki)|x·y·Fintact(x·,y·;ki)Fintact*(x·+x,y·+y;ki)| in [Fig. 3(b)]. It looks complex around i = 1001. But it is also made of plane waves with only several different modes, not all the modes considered. Compared to RFF(x,y;ki) in [Fig. 4(b)], RFF;intact(x,y;ki) has more non-ignorable values at those with x0 or y0.

 figure: Fig. 4

Fig. 4 (a) Recorded responses F(x,y;ki), (b) Amplitude of the autocorrelation for the response, RFF(x,y;ki), and (c) Angular spectrum of the response, C(k;ki), of coated MMF. Among the responses of all the incident angles covering the NA of 0.22, the 1st, the 101st, the 201st, and the 1001st of them are presented. Only the intensities are shown here. Scale bar: 10 μm.

Download Full Size | PDF

Now consider the TM of the coated MMF with a turbid medium deposited in the input facet. The response F(x,y;k) of the coated MMF to P(x,y;k) can be obtained in two steps. First, the response T(x,y;k) of the turbid medium to P(x,y;k) is obtained. Second, the response F(x,y;k) of the intact MMF to T(x,y;k) is obtained. T(x,y;k) is available in [Eq. (6)]. F(x,y;k) is derived as

F(x,y;k)=(a)kKt(k;k)Fintact(x,y;k)=(b)kKkKt(k;k)fintact(k;k)P(x,y;k)=kScoated(k)C(k;k)P(x,y;k)
where (a) is from [Eq. (6)] and the fact that Fintact(x,y;k) is the response wave of the intact MMF to P(x,y;k), (b) is from [Eq. (10)], and Scoated(k):={k|C(k;k)0} denotes the set of excited propagation modes in the MMF when plane waves P(x,y;k) with the mode k are inserted. Here, different from that of the intact MMF, the number of excited modes in the coated MMF for F(x,y;k) is not small ([Fig. 4(c)]). We can easily see in [Eq. (13)] that Scoated(k)=kSintact(k), the set of excited modes in the coated MMF is the union of all the sets of excited modes in the intact MMF. This is because the random scrambling in the turbid medium varies the directions of the waves. This makes the MMF to have incoming waves with a variety of incident angles, and the propagation modes corresponding to those incident angles are all excited. Now, F(x,y;k) are made by combining many P(x,y;k) with a variety of k. Thus, there are many possible incoherent F(x,y;k) patterns. It is easier to find many incoherent interference patterns out of them. As a result, it becomes easier to compose the TM with many incoherent interference patterns. In [Fig. 4(a)] and [Fig. 4(c)], we see that the responses of the coated MMF to plane waves with the considered incident angles θz are complex enough to be speckle patterns.

Having more propagation modes in the coated MMF surely provides a better situation for the TM to be incoherent. But, this does not always mean that the TM would be incoherent. For an incoherent TM, the way of combining of the propagation modes C(k;k) needs to be incoherent for the beams of light with different incident angles k. It would serve no point if the way of combining the propagation modes was the same for all the incident beams considered, then, as the TM would be completely coherent. We can see in [Eq. (13)] that the way of combining becomes different if t(k;k) is different from each other for k. For two different modes ki and kj (kikj), it is found that the contributions t(k;ki) and t(k;kj) are uncorrelated if the angle difference of the two modes is not too small, cos1(kikj)δ for a certain small δ [26]. Please be reminded that a random matrix generation gives an incoherent TM (Sec. 3.2). Now, with the incoherent combinations of the coated MMF, we expect the TM to be more incoherent than that of the intact MMF.

We compare the incoherence μ3 (0μ31) of the TMs of the intact MMF and the coated MMF in Fig. 5. The respective number of rows and that of columns of TM are 2025 and 2000 for the intact MMF and 2025 and 4000 for the coated MMF. We consider several values of α for 1α0. Please note that it is desirable to have smaller μ3 for superior incoherence. μ3 of the intact MMF starts to have nonzero value from α=0.75 and becomes larger as α decreases. The start of nonzero value of μ3 for the coated MMF is at α=0.65 and μ3 becomes larger as α decreases. For 0.65α0.45, the ratios of the μ3 of the intact MMF and that of the coated MMF tend to increase (4 at α=0.66 and 6.55 at α=0.45). For 0.4α0.1, the ratios tend to decrease (6.09 at α=0.4 and 4.5 at α=0.1). Regardless of the tendency, the ratios are considerable for 0.65α0.1. At α=0.05, the μ3 for the coated MMF is larger than that of the intact MMF, and they become the same at α=0. Though the μ3 for the intact MMF is better at α=0.05, the incoherence here is not meaningful because α=0.05 is not comparable to 1. In all the values of α which are reasonably comparable to 1 (0.75α0.1), it is found that the coated MMF has superior incoherence than the intact MMF does.

 figure: Fig. 5

Fig. 5 The incoherence of TMs for intact MMF (M = 2025 and N = 2000) and coated MMF (M = 2025 and N = 4000). The incoherence of them is plotted in log scale.

Download Full Size | PDF

4. Results

We now aim to compare the object image reconstruction capabilities with and without efficiently utilizing the HR encoding effect. For the conventional object wave reconstruction, we use PINV (Section 2.2). For the proposed reconstruction, we use the SR framework which is reported to take advantage of the HR encoding effect in a satisfactory manner [19]. For the sparse recovery in the SR framework, we use the alternating direction method [21] for its efficiency. For the sparsifying basis in the sparse recovery, we use the Fourier basis directly, Ψ=I. For a fair comparison between the two reconstructions, the reconstructed images are normalized so that their norms become one. For the TM measurements, N = 2000 and N = 4000 incident angles of the incoming waves are considered and the responses of them are captured respectively for the intact MMF and the coated MMF. The TMs cover the NA of 0.22 (0θz12.71) and the NA of 0.4 (0θz23.58). The dimension of M, the number of pixels in the CCD used in our experiment, corresponding to the output NA of 0.24 (Sec. 2.1) is 2025 (M = 2025). Thus, the TMs have the dimensions (M×N) 2025×2000 and 2025×4000 for the intact fiber and for the coated fiber, respectively.

Figure 6 shows the reconstructed images when the image is transferred through the MMF without depositing the turbid medium on the input facet of the fiber, hence there is no HR encoding effect as it should be. It is seen that the smallest structures in the object image cannot be resolved for both reconstructions. This is reasonable since higher modes of object waves which have incident angles beyond the acceptance angle of the intact MMF are not captured. Here, both PINV and SR are shown to reconstruct the given signal well without significant perturbations; the system is not underdetermined. We found some image quality improvements when the SR is employed. For example, pay attention to the quality of reconstruction of the alphanumeric numbers 2, 3, and 4 at the image shown in Fig. 6. The number 2 at the upper left corner of the image becomes reconstructed and the numbers 3 and 4 becomes clearer. However, the improvement overall by SR is not very significant. The signal-to-noise ratio (SNR) is increased from 9.27 to 10.61; just a 14% increment. Here, the SNR was calculated as SNR=|S¯sigS¯bg|/σbg where S¯sig is the mean of the signal patterns, S¯bg is the mean of the background, and σbg is the standard deviation of the background.

 figure: Fig. 6

Fig. 6 Reconstruction for imaging through intact MMF. (a) Recovered amplitude image using PINV. (b) Recovered amplitude image using SR. (c) Cross sections of them. Images are averaged over 1000 samples. Scale bar: 10 μm. SNRs are calculated in the cross sections.

Download Full Size | PDF

Now, consider the recovered images when the turbid medium is used. It is found in Fig. 7 that the structures in the patterns are significantly improved in terms of resolution. This is true regardless of the use of recovery routines PINV or SR. Both methods deliver much improved reconstruction fidelity compared to those of the intact MMF. This is because higher mode waves are introduced through the turbid medium. However, as it was already discussed, the use of turbid medium makes the system underdetermined. This makes the reconstruction of the object image difficult. As a result, it is shown that the reconstructed image by PINV becomes significantly perturbed by speckles. The SNR also becomes reduced considerably compared to that with the intact MMF.

 figure: Fig. 7

Fig. 7 Reconstruction for imaging through coated MMF. (a) Recovered amplitude image using PINV. (b) Recovered amplitude image using SR. (c) Cross sections of them. Images are averaged over 2000 samples. Scale bar: 10 μm. SNRs are calculated in the cross sections.

Download Full Size | PDF

We now show the results employing the SR framework for object wave recovery. As discussed earlier, the point here is to see if it will bring forth improved quality in reconstruction via efficient utilization of the HR encoding process offered by the use of turbid medium. As expected, in contrast to the case of PINV, SR is shown to improve the reconstruction significantly well. The speckle is successfully removed in the reconstructed image. We can also see all the small scale structures in the recovered image. The SNR becomes increased from 4.31 to 6.51; a 51% increment. With these, we have verified that the SR framework can exploit the HR encoding process of the turbid medium and improve the quality of the image reconstruction.

5. Conclusion

In conclusion, we demonstrated that the random scattering in the turbid media can be exploited for improving the quality of image reconstruction in MMF imaging. Random scattering through turbid medium provides random encoding of the object signal in holistic and incoherent manner. This encoding can be efficiently utilized in the signal recovery process within the proposed sparse representation framework. As a result, the perturbation is significantly reduced, the image contrast becomes sharper, and the fine details within the image can be captured.

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MEST) (Do-Yak Research Program, No. 2013-035295).

References and links

1. Y. Choi, C. Yoon, M. Kim, T. D. Yang, C. Fang-Yen, R. R. Dasari, K. J. Lee, and W. Choi, “Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber,” Phys. Rev. Lett. 109(20), 203901 (2012). [CrossRef]   [PubMed]  

2. T. Čižmár and K. Dholakia, “Exploiting multimode waveguides for pure fibre-based imaging,” Nat. Commun. 3, 1027 (2012). [CrossRef]   [PubMed]  

3. I. N. Papadopoulos, S. Farahi, C. Moser, and D. Psaltis, “Focusing and scanning light through a multimode optical fiber using digital phase conjugation,” Opt. Express 20(10), 10583–10590 (2012). [CrossRef]   [PubMed]  

4. C. Yoon, Y. Choi, M. Kim, J. Moon, D. Kim, and W. Choi, “Experimental measurement of the number of modes for a multimode optical fiber,” Opt. Lett. 37(21), 4558–4560 (2012). [CrossRef]   [PubMed]  

5. S. Bianchi, V. P. Rajamanickam, L. Ferrara, E. Di Fabrizio, C. Liberale, and R. Di Leonardo, “Focusing and imaging with increased numerical apertures through multimode fibers with micro-fabricated optics,” Opt. Lett. 38(23), 4935–4938 (2013). [CrossRef]   [PubMed]  

6. I. N. Papadopoulos, S. Farahi, C. Moser, and D. Psaltis, “Increasing the imaging capabilities of multimode fibers by exploiting the properties of highly scattering media,” Opt. Lett. 38(15), 2776–2778 (2013). [CrossRef]   [PubMed]  

7. Y. Choi, C. Yoon, M. Kim, J. Yang, and W. Choi, “Disorder-mediated enhancement of fiber numerical aperture,” Opt. Lett. 38(13), 2253–2255 (2013). [CrossRef]   [PubMed]  

8. Y. Choi, T. D. Yang, C. Fang-Yen, P. Kang, K. J. Lee, R. R. Dasari, M. S. Feld, and W. Choi, “Overcoming the diffraction limit using multiple light scattering in a highly disordered medium,” Phys. Rev. Lett. 107(2), 023902 (2011). [CrossRef]   [PubMed]  

9. I. M. Vellekoop, A. Lagendijk, and A. P. Mosk, “Exploiting disorder for perfect focusing,” Nat. Photonics 4(5), 320–322 (2010). [CrossRef]  

10. A. P. Mosk, A. Lagendijk, G. Lerosey, and M. Fink, “Controlling waves in space and time for imaging and focusing in complex media,” Nat. Photonics 6(5), 283–292 (2012). [CrossRef]  

11. H. Jang, C. Yoon, E. Chung, W. Choi, and H.-N. Lee, “Speckle suppression via sparse representation for wide-field imaging through turbid media,” Opt. Express 22(13), 16619–16628 (2014). [CrossRef]   [PubMed]  

12. A. Liutkus, D. Martina, S. Popoff, G. Chardon, O. Katz, G. Lerosey, S. Gigan, L. Daudet, and I. Carron, “Imaging with nature: compressive imaging using a multiply scattering medium,” Sci. Rep. 4, 5552 (2014). [CrossRef]   [PubMed]  

13. A. M. Bruckstein, D. L. Donoho, and M. Elad, “From sparse solutions of systems of equations to sparse modeling of signals and images,” SIAM Rev. 51(1), 34–81 (2009). [CrossRef]  

14. D. L. Donoho and M. Elad, “Optimally sparse representation in general (nonorthogonal) dictionaries via l minimization,” Proc. Natl. Acad. Sci. U.S.A. 100(5), 2197–2202 (2003). [CrossRef]   [PubMed]  

15. M. Aharon, M. Elad, and A. Bruckstein, “K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation,” IEEE Ttrans. Signal Process. 54, 4311–4322 (2006).

16. E. J. Candès and T. Tao, “Near-optimal signal recovery from random projections: universal encoding strategies?” IEEE Trans. Inf. Theory 52(12), 5406–5425 (2006). [CrossRef]  

17. E. J. Candès, Y. C. Eldar, D. Needell, and P. Randall, “Compressed sensing with coherent and redundant dictionaries,” Appl. Comput. Harmon. Anal. 31(1), 59–73 (2011). [CrossRef]  

18. H. Rauhut, “Compressive sensing and structured random matrices,” Theoretical Foundations and Numerical Methods for Sparse Recovery, ser. Radon Series on Computational and Applied Mathematics, H. Rauhut, Ed. Berlin, Germany: De Gruyter. 9, 1–94 (2010).

19. E. J. Candès, J. K. Romberg, and T. Tao, “Stable signal recovery from incomplete and inaccurate measurements,” Commun. Pure Appl. Math. 59(8), 1207–1223 (2006). [CrossRef]  

20. J. A. Tropp, “Greed is good: algorithmic results for sparse approximation,” IEEE Trans. Inf. Theory 50(10), 2231–2242 (2004). [CrossRef]  

21. J. Yang and Y. Zhang, “Alternating direction algorithms for L1-problems in compressive sensing,” SIAM J. Sci. Comput. 33(1), 250–278 (2011). [CrossRef]  

22. G. Strang, in Linear Algebra and Its Applications, 4ed, (Thomson Brooks/Cole, 2006)

23. J. W. Goodman, “Some fundamental properties of speckle,” J. Opt. Soc. Am. 66(11), 1145–1150 (1976). [CrossRef]  

24. A. Goetschy and A. D. Stone, “Filtering random matrices: the effect of incomplete channel control in multiple scattering,” Phys. Rev. Lett. 111(6), 063901 (2013). [CrossRef]   [PubMed]  

25. S. M. Popoff, G. Lerosey, R. Carminati, M. Fink, A. C. Boccara, and S. Gigan, “Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media,” Phys. Rev. Lett. 104(10), 100601 (2010). [CrossRef]   [PubMed]  

26. I. Freund, M. Rosenbluh, and S. Feng, “Memory effects in propagation of optical waves through disordered media,” Phys. Rev. Lett. 61(20), 2328–2331 (1988). [CrossRef]   [PubMed]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1
Fig. 1 Experimental schematics of imaging through turbid media coated MMF. (a) Recording of the TM. OP: object plane, MMF: multimode fiber, BS: beam splitter, SB: sample beam, RB: reference beam. The photo in the red box shows the image of the input surface of the turbid media coated MMF. (b) Recording of the distorted object wave. (c) The recorded TM. Only the intensities are shown in the image but the phases are estimated as well; thus the columns are complex valued vectors. (d) The recorded distorted object wave. Again, only the intensity is shown here. Scale bar: 10 μm.
Fig. 2
Fig. 2 Acceptance angle, exit angle, and their corresponding modes of waves for (a) intact MMF and (b) coated MMF. In (b), more modes of input waves (green arrows) can be captured in coated MMF. But, the number of modes of output waves is the same as that of intact MMF.
Fig. 3
Fig. 3 (a) Recorded responses F intact (x,y; k i ) , (b) Amplitude of the autocorrelation for the response, R FF;intact (x,y; k i ) , and (c) Angular spectrum of the response, f intact ( k ; k i ) , of intact MMF. Among the responses of all the incident angles covering the NA of 0.22, the 1st, the 101st, the 201st, and the 1001st of them are presented. Only the intensities are shown here. Scale bar: 10 μm.
Fig. 4
Fig. 4 (a) Recorded responses F(x,y; k i ) , (b) Amplitude of the autocorrelation for the response, R FF (x,y; k i ) , and (c) Angular spectrum of the response, C( k ; k i ) , of coated MMF. Among the responses of all the incident angles covering the NA of 0.22, the 1st, the 101st, the 201st, and the 1001st of them are presented. Only the intensities are shown here. Scale bar: 10 μm.
Fig. 5
Fig. 5 The incoherence of TMs for intact MMF (M = 2025 and N = 2000) and coated MMF (M = 2025 and N = 4000). The incoherence of them is plotted in log scale.
Fig. 6
Fig. 6 Reconstruction for imaging through intact MMF. (a) Recovered amplitude image using PINV. (b) Recovered amplitude image using SR. (c) Cross sections of them. Images are averaged over 1000 samples. Scale bar: 10 μm. SNRs are calculated in the cross sections.
Fig. 7
Fig. 7 Reconstruction for imaging through coated MMF. (a) Recovered amplitude image using PINV. (b) Recovered amplitude image using SR. (c) Cross sections of them. Images are averaged over 2000 samples. Scale bar: 10 μm. SNRs are calculated in the cross sections.

Equations (16)

Equations on this page are rendered with MathJax. Learn more.

U o (x,y)= k A o (k)P(x,y;k)
U r (x,y)= k A o (k)F(x,y;k)
r=Fa
a ^ pinv = F 1 r
U t (x,y)= kK A o (k)T(x,y;k)
T(x,y;k)= k K t( k ;k)P(x,y; k )
U t (x,y)= k K A t ( k )P(x,y; k )
A t ( k )= kK t( k ;k) A o (k) .
U r (x,y)= k K A t ( k ) F intact (x,y; k )
F intact (x,y; k )= k K f intact ( k ; k )P(x,y; k )
U r (x,y)= k K A r ( k )P(x,y; k )
A r ( k )= kK C( k ;k) A o (k) ,
C( k ;k)= k K t( k ;k) f intact ( k ; k ) .
a ^ SR = argmin a Ψ * a 1 subject to r=Fa,
F intact (x,y;k)= k S intact (k) f intact ( k ;k)P(x,y; k )
F(x,y;k) = (a) k K t( k ;k) F intact (x,y; k ) = (b) k K k K t( k ;k) f intact ( k ; k ) P(x,y; k ) = k S coated (k) C( k ;k)P(x,y; k )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.