Multidimensional sampling

In digital signal processing, multidimensional sampling is the process of converting a function of a multidimensional variable into a discrete collection of values of the function measured on a discrete set of points. This article presents the basic result due to Petersen and Middleton[1] on conditions for perfectly reconstructing a wavenumber-limited function from its measurements on a discrete lattice of points. This result, also known as the Petersen–Middleton theorem, is a generalization of the Nyquist–Shannon sampling theorem for sampling one-dimensional band-limited functions to higher-dimensional Euclidean spaces.

In essence, the Petersen–Middleton theorem shows that a wavenumber-limited function can be perfectly reconstructed from its values on an infinite lattice of points, provided the lattice is fine enough. The theorem provides conditions on the lattice under which perfect reconstruction is possible.

As with the Nyquist–Shannon sampling theorem, this theorem also assumes an idealization of any real-world situation, as it only applies to functions that are sampled over an infinitude of points. Perfect reconstruction is mathematically possible for the idealized model but only an approximation for real-world functions and sampling techniques, albeit in practice often a very good one.

Preliminaries

Fig. 1: A hexagonal sampling lattice ${\displaystyle \Lambda }$ and its basis vectors v₁ and v₂

Fig. 2: The reciprocal lattice ${\displaystyle \Gamma }$ corresponding to the lattice ${\displaystyle \Lambda }$ of Fig. 1 and its basis vectors u₁ and u₂ (figure not to scale).

The concept of a bandlimited function in one dimension can be generalized to the notion of a wavenumber-limited function in higher dimensions. Recall that the Fourier transform of an integrable function ${\displaystyle f(\cdot )}$ on n-dimensional Euclidean space is defined as:

${\displaystyle {\hat {f}}(\xi )={\mathcal {F}}(f)(\xi )=\int _{\Re ^{n}}f(x)e^{-2\pi i\langle x,\xi \rangle }\,dx}$

where x and ξ are n-dimensional vectors, and ${\displaystyle \langle x,\xi \rangle }$ is the inner product of the vectors. The function ${\displaystyle f(\cdot )}$ is said to be wavenumber-limited to a set ${\displaystyle \Omega }$ if the Fourier transform satisfies ${\displaystyle {\hat {f}}(\xi )=0}$ for ${\displaystyle \xi \notin \Omega }$.

Similarly, the configuration of uniformly spaced sampling points in one-dimension can be generalized to a lattice in higher dimensions. A lattice is a collection of points ${\displaystyle \Lambda \subset \Re ^{n}}$ of the form ${\displaystyle \Lambda =\left\{\sum _{i=1}^{n}a_{i}v_{i}\;|\;a_{i}\in \mathbb {Z} \right\}}$ where {v₁, ..., v_n} is a basis for ${\displaystyle \Re ^{n}}$. The reciprocal lattice ${\displaystyle \Gamma }$ corresponding to ${\displaystyle \Lambda }$ is defined by

${\displaystyle \Gamma =\left\{\sum _{i=1}^{n}a_{i}u_{i}\;|\;a_{i}\in \mathbb {Z} \right\}}$

where the vectors ${\displaystyle u_{i}}$ are chosen to satisfy ${\displaystyle \langle u_{i},v_{j}\rangle =\delta _{ij}}$. That is, if the vectors ${\displaystyle u_{i}}$ form columns of a matrix ${\displaystyle A}$ and ${\displaystyle v_{i}}$ the columns of a matrix ${\displaystyle B}$, then ${\displaystyle A=B^{-T}}$. An example of a sampling lattice in two dimensional space is a hexagonal lattice depicted in Figure 1. The corresponding reciprocal lattice is shown in Figure 2. The reciprocal lattice of a square lattice in two dimensions is another square lattice. In three dimensional space the reciprocal lattice of a face-centered cubic (FCC) lattice is a hexagonal close-packed (HCP) lattice or a body centered cubic (BCC) lattice.

The theorem

Let ${\displaystyle \Lambda }$ denote a lattice in ${\displaystyle \Re ^{n}}$ and ${\displaystyle \Gamma }$ the corresponding reciprocal lattice. The theorem of Petersen and Middleton[1] states that a function ${\displaystyle f(\cdot )}$ that is wavenumber-limited to a set ${\displaystyle \Omega \subset \Re ^{n}}$ can be exactly reconstructed from its measurements on ${\displaystyle \Lambda }$ provided that the set ${\displaystyle \Omega }$ does not overlap with any of its shifted versions ${\displaystyle \Omega +x}$ where the shift x is any nonzero element of the reciprocal lattice ${\displaystyle \Gamma }$. In other words, ${\displaystyle f(\cdot )}$ can be exactly reconstructed from its measurements on ${\displaystyle \Lambda }$ provided that ${\displaystyle \Omega \cap \{x+y:y\in \Omega \}=\phi }$ for all ${\displaystyle x\in \Gamma \setminus \{0\}}$.

Reconstruction

Fig. 3: Support of the sampled spectrum ${\displaystyle {\hat {f}}_{s}(\cdot )}$ obtained by hexagonal sampling of a two-dimensional function wavenumber-limited to a circular disc. The blue circle represents the support ${\displaystyle \Omega }$ of the original wavenumber-limited field, and the green circles represent the repetitions. In this example the spectral repetitions do not overlap and hence there is no aliasing. The original spectrum can be exactly recovered from the sampled spectrum.

The generalization of the Poisson summation formula to higher dimensions [2] can be used to show that the samples, ${\displaystyle \{f(x):x\in \Lambda \}}$, of the function ${\displaystyle f(\cdot )}$ on the lattice ${\displaystyle \Lambda }$ are sufficient to create a periodic summation of the function ${\displaystyle {\hat {f}}(\cdot )}$. The result is:

${\displaystyle {\hat {f}}_{s}(\xi )\ {\stackrel {\mathrm {def} }{=}}\sum _{y\in \Gamma }{\hat {f}}\left(\xi -y\right)=\sum _{x\in \Lambda }|\Lambda |f(x)\ e^{-i2\pi \langle x,\xi \rangle },}$

(Eq.1)

where ${\displaystyle |\Lambda |}$ represents the volume of the parallelepiped formed by the vectors {v₁, ..., v_n}. This periodic function is often referred to as the sampled spectrum and can be interpreted as the analogue of the discrete-time Fourier transform (DTFT) in higher dimensions. If the original wavenumber-limited spectrum ${\displaystyle {\hat {f}}(\cdot )}$ is supported on the set ${\displaystyle \Omega }$ then the function ${\displaystyle {\hat {f}}_{s}(\cdot )}$ is supported on periodic repetitions of ${\displaystyle \Omega }$ shifted by points on the reciprocal lattice ${\displaystyle \Gamma }$. If the conditions of the Petersen-Middleton theorem are met, then the function ${\displaystyle {\hat {f}}_{s}(\xi )}$ is equal to ${\displaystyle {\hat {f}}(\xi )}$ for all ${\displaystyle \xi \in \Omega }$, and hence the original field can be exactly reconstructed from the samples. In this case the reconstructed field matches the original field and can be expressed in terms of the samples as

${\displaystyle f(x)=\sum _{y\in \Lambda }|\Lambda |f(y){\check {\chi }}_{\Omega }(y-x)}$,

(Eq.2)

where ${\displaystyle {\check {\chi }}_{\Omega }(\cdot )}$ is the inverse Fourier transform of the characteristic function of the set ${\displaystyle \Omega }$. This interpolation formula is the higher-dimensional equivalent of the Whittaker–Shannon interpolation formula.

As an example suppose that ${\displaystyle \Omega }$ is a circular disc. Figure 3 illustrates the support of ${\displaystyle {\hat {f}}_{s}(\cdot )}$ when the conditions of the Petersen-Middleton theorem are met. We see that the spectral repetitions do not overlap and hence the original spectrum can be exactly recovered.

Implications

Aliasing

Main article: Aliasing

Fig. 4: Support of the sampled spectrum ${\displaystyle {\hat {f}}_{s}(\cdot )}$ obtained by hexagonal sampling of a two-dimensional function wavenumber-limited to a circular disc. In this example, the sampling lattice is not fine enough and hence the discs overlap in the sampled spectrum. Thus the spectrum within ${\displaystyle \Omega }$ represented by the blue circle cannot be recovered exactly due to the overlap from the repetitions (shown in green), thus leading to aliasing.

Fig. 5: Spatial aliasing in the form of a Moiré pattern.

Fig. 6: Properly sampled image of brick wall.

The theorem gives conditions on sampling lattices for perfect reconstruction of the sampled. If the lattices are not fine enough to satisfy the Petersen-Middleton condition, then the field cannot be reconstructed exactly from the samples in general. In this case we say that the samples may be aliased. Again, consider the example in which ${\displaystyle \Omega }$ is a circular disc. If the Petersen-Middleton conditions do not hold, the support of the sampled spectrum will be as shown in Figure 4. In this case the spectral repetitions overlap leading to aliasing in the reconstruction.

A simple illustration of aliasing can be obtained by studying low-resolution images. A gray-scale image can be interpreted as a function in two-dimensional space. An example of aliasing is shown in the images of brick patterns in Figure 5. The image shows the effects of aliasing when the sampling theorem's condition is not satisfied. If the lattice of pixels is not fine enough for the scene, aliasing occurs as evidenced by the appearance of the Moiré pattern in the image obtained. The image in Figure 6 is obtained when a smoothened version of the scene is sampled with the same lattice. In this case the conditions of the theorem are satisfied and no aliasing occurs.

S. P. Efimov from Bauman Moscow State Technical University in 1978 y. found an approach to ease the restrictions for spectrum domain.[3] He considered N identical sampling lattices to be shifted arbitrarily to each other. Optimal sampling is valid for spectrum domain that shifted versions of is close-packed N times on reciprocal lattice. Therefore, ring can be overlapped by a set of hexagons instead of one. JWST telescope array consists from 18 hexagons. Sampling on 18 shifted lattices is possible for 2-d Fourier transform of the array signal (i. e. for emitted signal).

Optimal sampling lattices

One of the objects of interest in designing a sampling scheme for wavenumber-limited fields is to identify the configuration of points that leads to the minimum sampling density, i.e., the density of sampling points per unit spatial volume in ${\displaystyle \Re ^{n}}$. Typically the cost for taking and storing the measurements is proportional to the sampling density employed. Often in practice, the natural approach to sample two-dimensional fields is to sample it at points on a rectangular lattice. However, this is not always the ideal choice in terms of the sampling density. The theorem of Petersen and Middleton can be used to identify the optimal lattice for sampling fields that are wavenumber-limited to a given set ${\displaystyle \Omega \subset \Re ^{d}}$. For example, it can be shown that the lattice in ${\displaystyle \Re ^{2}}$ with minimum spatial density of points that admits perfect reconstructions of fields wavenumber-limited to a circular disc in ${\displaystyle \Re ^{2}}$ is the hexagonal lattice.[4] As a consequence, hexagonal lattices are preferred for sampling isotropic fields in ${\displaystyle \Re ^{2}}$.

Optimal sampling lattices have been studied in higher dimensions.[5] Generally, optimal sphere packing lattices are ideal for sampling smooth stochastic processes while optimal sphere covering lattices[6] are ideal for sampling rough stochastic processes.

Since optimal lattices, in general, are non-separable, designing interpolation and reconstruction filters requires non-tensor-product (i.e., non-separable) filter design mechanisms. Box splines provide a flexible framework for designing such non-separable reconstruction FIR filters that can be geometrically tailored for each lattice.[7][8] Hex-splines[9] are the generalization of B-splines for 2-D hexagonal lattices. Similarly, in 3-D and higher dimensions, Voronoi splines[10] provide a generalization of B-splines that can be used to design non-separable FIR filters which are geometrically tailored for any lattice, including optimal lattices.

Explicit construction of ideal low-pass filters (i.e., sinc functions) generalized to optimal lattices is possible by studying the geometric properties of Brillouin zones (i.e., ${\displaystyle \Omega }$ in above) of these lattices (which are zonotopes).[11] This approach provides a closed-form explicit representation of ${\displaystyle {\check {\chi }}_{\Omega }(\cdot )}$ for general lattices, including optimal sampling lattices. This construction provides a generalization of the Lanczos filter in 1-D to the multidimensional setting for optimal lattices.[11]

Applications

The Petersen–Middleton theorem is useful in designing efficient sensor placement strategies in applications involving measurement of spatial phenomena such as seismic surveys, environment monitoring and spatial audio-field measurements.

References

1. D. P. Petersen and D. Middleton, "Sampling and Reconstruction of Wave-Number-Limited Functions in N-Dimensional Euclidean Spaces", Information and Control, vol. 5, pp. 279–323, 1962.
2. E. M. Stein and G. Weiss, "Introduction to Fourier Analysis on Euclidean Spaces", Princeton University Press, Princeton, 1971.
3. Efimov, Sergei (1978). "Reconstruction of a field with finite-spectrum by samples of signals of filters". Problemy Peredaci Informacii. 14 (2): 53–60.
4. D. R. Mersereau, “The processing of hexagonally sampled two-dimensional signals,” Proceedings of the IEEE, vol. 67, no. 6, pp. 930 – 949, June 1979.
5. Kunsch, H. R.; Agrell, E.; Hamprecht, F. A. (2005). "Optimal Lattices for Sampling". IEEE Transactions on Information Theory. 51 (2): 634. doi:10.1109/TIT.2004.840864.
6. J. H. Conway, N. J. A. Sloane. Sphere packings, lattices and groups. Springer, 1999.
7. A. Entezari. Optimal sampling lattices and trivariate box splines. [Vancouver, BC.]: Simon Fraser University, 2007. <http://summit.sfu.ca/item/8178>.
8. Entezari, A.; Van De Ville, D.; Moller, T. (2008). "Practical Box Splines for Reconstruction on the Body Centered Cubic Lattice". IEEE Transactions on Visualization and Computer Graphics. 14 (2): 313–328. CiteSeerX 10.1.1.330.3851. doi:10.1109/TVCG.2007.70429. PMID 18192712.
9. Van De Ville, D.; Blu, T.; Unser, M.; Philips, W.; Lemahieu, I.; Van De Walle, R. (2004). "Hex-Splines: A Novel Spline Family for Hexagonal Lattices". IEEE Transactions on Image Processing. 13 (6): 758–772. doi:10.1109/TIP.2004.827231. PMID 15648867.
10. Mirzargar, M.; Entezari, A. (2010). "Voronoi Splines". IEEE Transactions on Signal Processing. 58 (9): 4572. doi:10.1109/TSP.2010.2051808.
11. Ye, W.; Entezari, A. (2012). "A Geometric Construction of Multivariate Sinc Functions". IEEE Transactions on Image Processing. 21 (6): 2969–2979. doi:10.1109/TIP.2011.2162421. PMID 21775264.