Blind deconvolution
In electrical engineering and applied mathematics, blind deconvolution is deconvolution without explicit knowledge of the impulse response function used in the convolution. This is usually achieved by making appropriate assumptions of the input to estimate the impulse response by analyzing the output. Blind deconvolution is not solvable without making assumptions on input and impulse response. Most of the algorithms to solve this problem are based on assumption that both input and impulse response live in respective known subspaces. However, blind deconvolution remains a very challenging non-convex optimization problem even with this assumption.
In image processing
In image processing, blind deconvolution is a deconvolution technique that permits recovery of the target scene from a single or set of "blurred" images in the presence of a poorly determined or unknown point spread function (PSF).[2] Regular linear and non-linear deconvolution techniques utilize a known PSF. For blind deconvolution, the PSF is estimated from the image or image set, allowing the deconvolution to be performed. Researchers have been studying blind deconvolution methods for several decades, and have approached the problem from different directions.
Most of the work on blind deconvolution started in early 1970s. Blind deconvolution is used in astronomical imaging and medical imaging.
Blind deconvolution can be performed iteratively, whereby each iteration improves the estimation of the PSF and the scene, or non-iteratively, where one application of the algorithm, based on exterior information, extracts the PSF. Iterative methods include maximum a posteriori estimation and expectation-maximization algorithms. A good estimate of the PSF is helpful for quicker convergence but not necessary.
Examples of non-iterative techniques include SeDDaRA,[3] the cepstrum transform and APEX. The cepstrum transform and APEX methods assume that the PSF has a specific shape, and one must estimate the width of the shape. For SeDDaRA, the information about the scene is provided in the form of a reference image. The algorithm estimates the PSF by comparing the spatial frequency information in the blurred image to that of the target image.
Limitation of Blind deconvolution is that both input image and blur kernel must live in fixed subspace. That means input image, represented by w, has to be written as w=Bh, where B is random matrix of size L by K (K<L) and h is of size K by 1, whereas blur kernel, if represented by x, has to be written as x=Cm, where C is random matrix of size L by N (N<L) and m is of size N by 1.Observed image, if represented by y, given by y=w*x, can only be reconstructed if L >=K +N.
Examples
Any blurred image can be given as input to blind deconvolution algorithm, it can deblur the image, but essential condition for working of this algorithm must not be violated as discussed above. In the first example (picture of shapes), recovered image was very fine, exactly similar to original image because L > K + N. In the second example (picture of a girl), L < K + N, so essential condition is violated, hence recovered image is far different from original image.
In signal processing
Seismic data
In the case of deconvolution of seismic data, the original unknown signal is made of spikes hence is possible to characterize with sparsity constraints[4] or regularizations such as l1 norm/l2 norm norm ratios,[5] suggested by W. C. Gray in 1978.[6]
Audio deconvolution
Audio deconvolution (often referred to as dereverberation) is a reverberation reduction in audio mixtures. It is part of audio processing of recordings in ill-posed cases such as the cocktail party effect. One possibility is to use ICA.[7]
In general
Suppose we have a signal transmitted through a channel. The channel can usually be modeled as a linear shift-invariant system, so the receptor receives a convolution of the original signal with the impulse response of the channel. If we want to reverse the effect of the channel, to obtain the original signal, we must process the received signal by a second linear system, inverting the response of the channel. This system is called an equalizer.
If we are given the original signal, we can use a supervising technique, such as finding a Wiener filter, but without it, we can still explore what we do know about it to attempt its recovery. For example, we can filter the received signal to obtain the desired spectral power density. This is what happens, for example, when the original signal is known to have no auto correlation, and we "whiten" the received signal.
Whitening usually leaves some phase distortion in the results. Most blind deconvolution techniques use higher-order statistics of the signals, and permit the correction of such phase distortions. We can optimize the equalizer to obtain a signal with a PSF approximating what we know about the original PSF.
High-order statistics
Blind deconvolution algorithms often make use of high-order statistics, with moments higher than two. This can be implicit or explicit.[8]
See also
- Channel model
- Inverse problem
- Regularization (mathematics)
- Blind equalization
- Maximum a posteriori estimation
- Maximum likelihood
External links
References
- Barmby, Pauline; McLaughlin, Dean E.; Harris, William E.; Harris, Gretchen L. H.; Forbes, Duncan A. (2007). "Structural Parameters for Globular Clusters in M31 and Generalizations for the Fundamental Plane" (PDF). The Astronomical Journal. 133 (6): 2764–2786. arXiv:0704.2057. Bibcode:2007AJ....133.2764B. doi:10.1086/516777.
- Lam, Edmund Y.; Goodman, Joseph W. (2000). "Iterative statistical approach to blind image deconvolution". Journal of the Optical Society of America A. 17 (7): 1177–1184. Bibcode:2000JOSAA..17.1177L. doi:10.1364/JOSAA.17.001177.
- Caron, James N.; Namazi, Nader M.; Rollins, Chris J. (2002). "Noniterative blind data restoration by use of an extracted filter function". Applied Optics. 41 (32): 6884–9. Bibcode:2002ApOpt..41.6884C. doi:10.1364/AO.41.006884. PMID 12440543.
-
Broadhead, Michael (2010). "Sparse seismic deconvolution by method of orthogonal matching pursuit". Cite journal requires
|journal=
(help) - Barmby, P.; McLaughlin, D. E.; Harris, W. E.; Harris, G. L. H.; Forbes, D. A. (2015). "Euclid in a Taxicab: Sparse Blind Deconvolution with Smoothed l1/l2 Regularization". IEEE Signal Processing Letters. 22 (5): 539–543. arXiv:1407.5465. Bibcode:2015ISPL...22..539R. doi:10.1109/LSP.2014.2362861.
-
Gray, W. C. (1978). "Variable norm deconvolution" (PDF). Archived from the original (PDF) on 2015-04-09. Cite journal requires
|journal=
(help) - Koldovsky, Zbynek; Tichavsky, Petr (2007). "Time-domain blind audio source separation using advanced ICA methods". The Proceedings of the 8th Annual Conference of the International Speech Communication Association (Interspeech 2007). pp. 846–849.
- Cardoso, J.-F. (1991). "Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors". [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing. 5. pp. 3109–3112. CiteSeerX 10.1.1.8.9380. doi:10.1109/ICASSP.1991.150113. ISBN 978-0-7803-0003-3.