Wavelet transform

In mathematics, a wavelet series is a representation of a square-integrable (real- or complex-valued) function by a certain orthonormal series generated by a wavelet. This article provides a formal, mathematical definition of an orthonormal wavelet and of the integral wavelet transform.

An example of the 2D discrete wavelet transform that is used in JPEG2000.

For broader coverage of this topic, see Wavelet.

Definition

A function ${\displaystyle \psi \,\in \,L^{2}(\mathbb {R} )}$ is called an orthonormal wavelet if it can be used to define a Hilbert basis, that is a complete orthonormal system, for the Hilbert space ${\displaystyle L^{2}\left(\mathbb {R} \right)}$ of square integrable functions.

The Hilbert basis is constructed as the family of functions ${\displaystyle \{\psi _{jk}:\,j,\,k\,\in \,\mathbb {Z} \}}$ by means of dyadic translations and dilations of ${\displaystyle \psi \,}$,

${\displaystyle \psi _{jk}(x)=2^{\frac {j}{2}}\psi \left(2^{j}x-k\right)\,}$

for integers ${\displaystyle j,\,k\,\in \,\mathbb {Z} }$.

If under the standard inner product on ${\displaystyle L^{2}\left(\mathbb {R} \right)}$,

${\displaystyle \langle f,g\rangle =\int _{-\infty }^{\infty }f(x){\overline {g(x)}}dx}$

this family is orthonormal, it is an orthonormal system:

${\displaystyle {\begin{aligned}\langle \psi _{jk},\psi _{lm}\rangle &=\int _{-\infty }^{\infty }\psi _{jk}(x){\overline {\psi _{lm}(x)}}dx\\&=\delta _{jl}\delta _{km}\end{aligned}}}$

where ${\displaystyle \delta _{jl}\,}$ is the Kronecker delta.

Completeness is satisfied if every function ${\displaystyle f\,\in \,L^{2}\left(\mathbb {R} \right)}$ may be expanded in the basis as

${\displaystyle f(x)=\sum _{j,k=-\infty }^{\infty }c_{jk}\psi _{jk}(x)}$

with convergence of the series understood to be convergence in norm. Such a representation of f is known as a wavelet series. This implies that an orthonormal wavelet is self-dual.

The integral wavelet transform is the integral transform defined as

${\displaystyle \left[W_{\psi }f\right](a,b)={\frac {1}{\sqrt {|a|}}}\int _{-\infty }^{\infty }{\overline {\psi \left({\frac {x-b}{a}}\right)}}f(x)dx\,}$

The wavelet coefficients ${\displaystyle c_{jk}}$ are then given by

${\displaystyle c_{jk}=\left[W_{\psi }f\right]\left(2^{-j},k2^{-j}\right)}$

Here, ${\displaystyle a=2^{-j}}$ is called the binary dilation or dyadic dilation, and ${\displaystyle b=k2^{-j}}$ is the binary or dyadic position.

Principle

The fundamental idea of wavelet transforms is that the transformation should allow only changes in time extension, but not shape. This is affected by choosing suitable basis functions that allow for this. Changes in the time extension are expected to conform to the corresponding analysis frequency of the basis function. Based on the uncertainty principle of signal processing,

${\displaystyle \Delta t\Delta \omega \geq {\frac {1}{2}}}$

where ${\displaystyle t}$ represents time and ${\displaystyle \omega }$ angular frequency (${\displaystyle \omega =2\pi f}$, where ${\displaystyle f}$ is temporal frequency).

The higher the required resolution in time, the lower the resolution in frequency has to be. The larger the extension of the analysis windows is chosen, the larger is the value of ${\displaystyle \Delta t}$.

When ${\displaystyle \Delta t}$ is large,

1. Bad time resolution
2. Good frequency resolution
3. Low frequency, large scaling factor

When ${\displaystyle \Delta t}$ is small

1. Good time resolution
2. Bad frequency resolution
3. High frequency, small scaling factor

In other words, the basis function ${\displaystyle \psi }$ can be regarded as an impulse response of a system with which the function ${\displaystyle x(t)}$ has been filtered. The transformed signal provides information about the time and the frequency. Therefore, wavelet-transformation contains information similar to the short-time-Fourier-transformation, but with additional special properties of the wavelets, which show up at the resolution in time at higher analysis frequencies of the basis function. The difference in time resolution at ascending frequencies for the Fourier transform and the wavelet transform is shown below. Note however, that the frequency resolution is decreasing for increasing frequencies while the temporal resolution increases. This consequence of the Fourier uncertainty principle is not correctly displayed in the Figure.

This shows that wavelet transformation is good in time resolution of high frequencies, while for slowly varying functions, the frequency resolution is remarkable.

Another example: The analysis of three superposed sinusoidal signals ${\displaystyle y(t)\;=\;\sin(2\pi f_{0}t)\;+\;\sin(4\pi f_{0}t)\;+\;\sin(8\pi f_{0}t)}$ with STFT and wavelet-transformation.

Wavelet compression

Wavelet compression is a form of data compression well suited for image compression (sometimes also video compression and audio compression). Notable implementations are JPEG 2000, DjVu and ECW for still images, CineForm, and the BBC's Dirac. The goal is to store image data in as little space as possible in a file. Wavelet compression can be either lossless or lossy.[1] Wavelet coding is a variant of discrete cosine transform (DCT) coding that uses wavelets instead of DCT's block-based algorithm.[2]

Using a wavelet transform, the wavelet compression methods are adequate for representing transients, such as percussion sounds in audio, or high-frequency components in two-dimensional images, for example an image of stars on a night sky. This means that the transient elements of a data signal can be represented by a smaller amount of information than would be the case if some other transform, such as the more widespread discrete cosine transform, had been used.

Discrete wavelet transform has been successfully applied for the compression of electrocardiograph (ECG) signals[3] In this work, the high correlation between the corresponding wavelet coefficients of signals of successive cardiac cycles is utilized employing linear prediction.

Wavelet compression is not good for all kinds of data: transient signal characteristics mean good wavelet compression, while smooth, periodic signals are better compressed by other methods, particularly traditional harmonic compression (frequency domain, as by Fourier transforms and related).

See Diary Of An x264 Developer: The problems with wavelets (2010) for discussion of practical issues of current methods using wavelets for video compression.

Method

First a wavelet transform is applied. This produces as many coefficients as there are pixels in the image (i.e., there is no compression yet since it is only a transform). These coefficients can then be compressed more easily because the information is statistically concentrated in just a few coefficients. This principle is called transform coding. After that, the coefficients are quantized and the quantized values are entropy encoded and/or run length encoded.

A few 1D and 2D applications of wavelet compression use a technique called "wavelet footprints".[4][5]

Comparison with Fourier transform and time-frequency analysis

Transform	Representation	Input
Fourier transform	${\displaystyle {\hat {f}}(\xi )=\int _{-\infty }^{\infty }f(x)e^{-2\pi ix\xi }\,dx}$	${\displaystyle \xi }$ frequency
Time-frequency analysis	${\displaystyle X(t,f)}$	${\displaystyle t}$ time; ${\displaystyle f}$ frequency
Wavelet transform	${\displaystyle X(a,b)={\frac {1}{\sqrt {a}}}\int _{-\infty }^{\infty }{\overline {\Psi \left({\frac {t-b}{a}}\right)}}x(t)\,dt}$	${\displaystyle a}$ scaling; ${\displaystyle b}$ time shift factor

Wavelets have some slight benefits over Fourier transforms in reducing computations when examining specific frequencies. However, they are rarely more sensitive, and indeed, the common Morlet wavelet is mathematically identical to a short-time Fourier transform using a Gaussian window function.[6] The exception is when searching for signals of a known, non-sinusoidal shape (e.g., heartbeats); in that case, using matched wavelets can outperform standard STFT/Morlet analyses.[7]

Other practical applications

The wavelet transform can provide us with the frequency of the signals and the time associated to those frequencies, making it very convenient for its application in numerous fields. For instance, signal processing of accelerations for gait analysis,[8] for fault detection,[9] for design of low power pacemakers and also in ultra-wideband (UWB) wireless communications.[10][11][12]

1. Discretizing of the ${\displaystyle c-\tau }$ axis

   Applied the following discretization of frequency and time:

   ${\displaystyle {\begin{aligned}c_{n}&=c_{0}^{n}\\\tau _{m}&=m\cdot T\cdot c_{0}^{n}\end{aligned}}}$

   Leading to wavelets of the form, the discrete formula for the basis wavelet:

   ${\displaystyle \Psi (k,n,m)={\frac {1}{\sqrt {c_{0}^{n}}}}\cdot \Psi \left[{\frac {k-mc_{0}^{n}}{c_{0}^{n}}}T\right]={\frac {1}{\sqrt {c_{0}^{n}}}}\cdot \Psi \left[\left({\frac {k}{c_{0}^{n}}}-m\right)T\right]}$

   Such discrete wavelets can be used for the transformation:

   ${\displaystyle Y_{DW}(n,m)={\frac {1}{\sqrt {c_{0}^{n}}}}\cdot \sum _{k=0}^{K-1}y(k)\cdot \Psi \left[\left({\frac {k}{c_{0}^{n}}}-m\right)T\right]}$

2. Implementation via the FFT (fast Fourier transform)

   As apparent from wavelet-transformation representation (shown below)

   ${\displaystyle Y_{W}(c,\tau )={\frac {1}{\sqrt {c}}}\cdot \int _{-\infty }^{\infty }y(t)\cdot \Psi \left({\frac {t-\tau }{c}}\right)\,dt}$

   where ${\displaystyle c}$ is scaling factor, ${\displaystyle \tau }$ represents time shift factor

   and as already mentioned in this context, the wavelet-transformation corresponds to a convolution of a function ${\displaystyle y(t)}$ and a wavelet-function. A convolution can be implemented as a multiplication in the frequency domain. With this the following approach of implementation results into:

   • Fourier-transformation of signal ${\displaystyle y(k)}$ with the FFT
   • Selection of a discrete scaling factor ${\displaystyle c_{n}}$
   • Scaling of the wavelet-basis-function by this factor ${\displaystyle c_{n}}$ and subsequent FFT of this function
   • Multiplication with the transformed signal YFFT of the first step
   • Inverse transformation of the product into the time domain results in ${\displaystyle Y_{W}(c,\tau )}$ for different discrete values of ${\displaystyle \tau }$ and a discrete value of ${\displaystyle c_{n}}$
   • Back to the second step, until all discrete scaling values for ${\displaystyle c_{n}}$are processed
   There are many different types of wavelet transforms for specific purposes. See also a full list of wavelet-related transforms but the common ones are listed below: Mexican hat wavelet, Haar Wavelet, Daubechies wavelet, triangular wavelet.

See also

• Continuous wavelet transform
• Discrete wavelet transform
• Complex wavelet transform
• Constant-Q transform
• Stationary wavelet transform
• Dual wavelet
• Multiresolution analysis
• MrSID, the image format developed from original wavelet compression research at Los Alamos National Laboratory (LANL).
• ECW, a wavelet-based geospatial image format designed for speed and processing efficiency
• JPEG 2000, a wavelet-based image compression standard
• DjVu format uses wavelet-based IW44 algorithm for image compression
• scaleograms, a type of spectrogram generated using wavelets instead of a short-time Fourier transform.
• Wavelet
• Haar wavelet
• Daubechies wavelet
• Morlet wavelet
• Gabor wavelet
• Chirplet transform
• Time-frequency representation
• S transform
• Set partitioning in hierarchical trees
• Short-time Fourier transform

References

• Meyer, Yves (1992). Wavelets and Operators. Cambridge: Cambridge University Press. ISBN 0-521-42000-8.
• Chui, Charles K. (1992). An Introduction to Wavelets. San Diego: Academic Press. ISBN 0-12-174584-8.
• Akansu, Ali N.; Haddad, Richard A. (1992). Multiresolution Signal Decomposition: Transforms, Subbands, Wavelets. San Diego: Academic Press. ISBN 978-0-12-047141-6.

1. JPEG 2000, for example, may use a 5/3 wavelet for lossless (reversible) transform and a 9/7 wavelet for lossy (irreversible) transform.
2. Hoffman, Roy (2012). Data Compression in Digital Systems. Springer Science & Business Media. p. 124. ISBN 9781461560319. Basically, wavelet coding is a variant on DCT-based transform coding that reduces or eliminates some of its limitations. (...) Another advantage is that rather than working with 8 × 8 blocks of pixels, as do JPEG and other block-based DCT techniques, wavelet coding can simultaneously compress the entire image.
3. A. G. Ramakrishnan and S. Saha, "ECG coding by wavelet-based linear prediction," IEEE Trans. Biomed. Eng., Vol. 44, No. 12, pp. 1253-1261, 1977.
4. N. Malmurugan, A. Shanmugam, S. Jayaraman and V. V. Dinesh Chander. "A New and Novel Image Compression Algorithm Using Wavelet Footprints"
5. Ho Tatt Wei and Jeoti, V. "A wavelet footprints-based compression scheme for ECG signals". Ho Tatt Wei; Jeoti, V. (2004). "A wavelet footprints-based compression scheme for ECG signals". 2004 IEEE Region 10 Conference TENCON 2004. A. p. 283. doi:10.1109/TENCON.2004.1414412. ISBN 0-7803-8560-8.
6. Bruns, Andreas (2004). "Fourier-, Hilbert- and wavelet-based signal analysis: are they really different approaches?". Journal of Neuroscience Methods. 137 (2): 321–332. doi:10.1016/j.jneumeth.2004.03.002. PMID 15262077.
7. Krantz, Steven G. (1999). A Panorama of Harmonic Analysis. Mathematical Association of America. ISBN 0-88385-031-1.
8. Martin, E. (2011). "Novel method for stride length estimation with body area network accelerometers". 2011 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems. pp. 79–82. doi:10.1109/BIOWIRELESS.2011.5724356. ISBN 978-1-4244-8316-7.
9. Liu, Jie (2012). "Shannon wavelet spectrum analysis on truncated vibration signals for machine incipient fault detection". Measurement Science and Technology. 23 (5): 1–11. Bibcode:2012MeScT..23e5604L. doi:10.1088/0957-0233/23/5/055604.
10. Akansu, A. N.; Serdijn, W. A.; Selesnick, I. W. (2010). "Emerging applications of wavelets: A review" (PDF). Physical Communication. 3: 1–18. doi:10.1016/j.phycom.2009.07.001.
11. Sheybani, E.; Javidi, G. (December 2009). "Dimensionality Reduction and Noise Removal in Wireless Sensor Network Datasets". 2009 Second International Conference on Computer and Electrical Engineering. 2: 674–677. doi:10.1109/ICCEE.2009.282. ISBN 978-1-4244-5365-8.
12. Sheybani, E. O.; Javidi, G. (May 2012). "Multi-resolution filter banks for enhanced SAR imaging". 2012 International Conference on Systems and Informatics (ICSAI2012): 2702–2706. doi:10.1109/ICSAI.2012.6223611. ISBN 978-1-4673-0199-2.

External links

• Amara Graps (June 1995). "An Introduction to Wavelets". IEEE Computational Science & Engineering.
• Robi Polikar (2001-01-12). "The Wavelet Tutorial".
• Concise Introduction to Wavelets by René Puschinger