Hilbert matrix

In linear algebra, a Hilbert matrix, introduced by Hilbert (1894), is a square matrix with entries being the unit fractions

${\displaystyle H_{ij}={\frac {1}{i+j-1}}.}$

For example, this is the 5 × 5 Hilbert matrix:

${\displaystyle H={\begin{bmatrix}1&{\frac {1}{2}}&{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}\\{\frac {1}{2}}&{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}\\{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}\\{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}&{\frac {1}{8}}\\{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}&{\frac {1}{8}}&{\frac {1}{9}}\end{bmatrix}}.}$

The Hilbert matrix can be regarded as derived from the integral

${\displaystyle H_{ij}=\int _{0}^{1}x^{i+j-2}\,dx,}$

that is, as a Gramian matrix for powers of x. It arises in the least squares approximation of arbitrary functions by polynomials.

The Hilbert matrices are canonical examples of ill-conditioned matrices, being notoriously difficult to use in numerical computation. For example, the 2-norm condition number of the matrix above is about 4.8×10⁵.

Historical note

Hilbert (1894) introduced the Hilbert matrix to study the following question in approximation theory: "Assume that I = [a, b], is a real interval. Is it then possible to find a non-zero polynomial P with integral coefficients, such that the integral

${\displaystyle \int _{a}^{b}P(x)^{2}dx}$

is smaller than any given bound ε > 0, taken arbitrarily small?" To answer this question, Hilbert derives an exact formula for the determinant of the Hilbert matrices and investigates their asymptotics. He concludes that the answer to his question is positive if the length b − a of the interval is smaller than 4.

Properties

The Hilbert matrix is symmetric and positive definite. The Hilbert matrix is also totally positive (meaning that the determinant of every submatrix is positive).

The Hilbert matrix is an example of a Hankel matrix. It is also a specific example of a Cauchy matrix.

The determinant can be expressed in closed form, as a special case of the Cauchy determinant. The determinant of the n × n Hilbert matrix is

${\displaystyle \det(H)={\frac {c_{n}^{4}}{c_{2n}}},}$

where

${\displaystyle c_{n}=\prod _{i=1}^{n-1}i^{n-i}=\prod _{i=1}^{n-1}i!.}$

Hilbert already mentioned the curious fact that the determinant of the Hilbert matrix is the reciprocal of an integer (see sequence OEIS: A005249 in the OEIS), which also follows from the identity

${\displaystyle {\frac {1}{\det(H)}}={\frac {c_{2n}}{c_{n}^{4}}}=n!\cdot \prod _{i=1}^{2n-1}{\binom {i}{[i/2]}}.}$

Using Stirling's approximation of the factorial, one can establish the following asymptotic result:

${\displaystyle \det(H)=a_{n}\,n^{-1/4}(2\pi )^{n}\,4^{-n^{2}},}$

where a_n converges to the constant ${\displaystyle e^{1/4}\,2^{1/12}\,A^{-3}\approx 0.6450}$ as ${\displaystyle n\to \infty }$, where A is the Glaisher–Kinkelin constant.

The inverse of the Hilbert matrix can be expressed in closed form using binomial coefficients; its entries are

${\displaystyle (H^{-1})_{ij}=(-1)^{i+j}(i+j-1){\binom {n+i-1}{n-j}}{\binom {n+j-1}{n-i}}{\binom {i+j-2}{i-1}}^{2},}$

where n is the order of the matrix.[1] It follows that the entries of the inverse matrix are all integers, and that the signs form a checkerboard pattern, being positive on the principal diagonal. For example,

${\displaystyle {\begin{bmatrix}1&{\frac {1}{2}}&{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}\\{\frac {1}{2}}&{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}\\{\frac {1}{3}}&{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}\\{\frac {1}{4}}&{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}&{\frac {1}{8}}\\{\frac {1}{5}}&{\frac {1}{6}}&{\frac {1}{7}}&{\frac {1}{8}}&{\frac {1}{9}}\end{bmatrix}}^{-1}=\left[{\begin{array}{rrrrr}25&-300&1050&-1400&630\\-300&4800&-18900&26880&-12600\\1050&-18900&79380&-117600&56700\\-1400&26880&-117600&179200&-88200\\630&-12600&56700&-88200&44100\end{array}}\right].}$

The condition number of the n × n Hilbert matrix grows as ${\displaystyle O\left(\left(1+{\sqrt {2}}\right)^{4n}/{\sqrt {n}}\right)}$.

Applications

The method of moments applied to polynomial distributions results in a Hankel matrix, which in the special case of approximating a probability distribution on the interval [0,1] results in a Hilbert matrix. This matrix needs to be inverted to obtain the weight parameters of the polynomial distribution approximation[2].

References

1. Choi, Man-Duen (1983). "Tricks or Treats with the Hilbert Matrix". The American Mathematical Monthly. 90 (5): 301–312. doi:10.2307/2975779. JSTOR 2975779.
2. J. Munkhammar, L. Mattsson, J. Rydén (2017) "Polynomial probability distribution estimation using the method of moments". PLoS ONE 12(4): e0174573. https://doi.org/10.1371/journal.pone.0174573

Further reading

• Hilbert, David (1894), "Ein Beitrag zur Theorie des Legendre'schen Polynoms", Acta Mathematica, 18: 155–159, doi:10.1007/BF02418278, ISSN 0001-5962, JFM 25.0817.02. Reprinted in Hilbert, David. "article 21". Collected papers. II.
• Beckermann, Bernhard (2000). "The condition number of real Vandermonde, Krylov and positive definite Hankel matrices". Numerische Mathematik. 85 (4): 553–577. CiteSeerX 10.1.1.23.5979. doi:10.1007/PL00005392.
• Choi, M.-D. (1983). "Tricks or Treats with the Hilbert Matrix". American Mathematical Monthly. 90 (5): 301–312. doi:10.2307/2975779. JSTOR 2975779.
• Todd, John (1954). "The Condition Number of the Finite Segment of the Hilbert Matrix". National Bureau of Standards, Applied Mathematics Series. 39: 109–116.
• Wilf, H. S. (1970). Finite Sections of Some Classical Inequalities. Heidelberg: Springer. ISBN 978-3-540-04809-1.