Kronecker's lemma

In mathematics, Kronecker's lemma (see, e.g., Shiryaev (1996, Lemma IV.3.2)) is a result about the relationship between convergence of infinite sums and convergence of sequences. The lemma is often used in the proofs of theorems concerning sums of independent random variables such as the strong Law of large numbers. The lemma is named after the German mathematician Leopold Kronecker.

The lemma

If ${\displaystyle (x_{n})_{n=1}^{\infty }}$ is an infinite sequence of real numbers such that

${\displaystyle \sum _{m=1}^{\infty }x_{m}=s}$

exists and is finite, then we have for all ${\displaystyle 0<b_{1}\leq b_{2}\leq b_{3}\leq \ldots }$ and ${\displaystyle b_{n}\to \infty }$ that

${\displaystyle \lim _{n\to \infty }{\frac {1}{b_{n}}}\sum _{k=1}^{n}b_{k}x_{k}=0.}$

Proof

Let ${\displaystyle S_{k}}$ denote the partial sums of the x's. Using summation by parts,

${\displaystyle {\frac {1}{b_{n}}}\sum _{k=1}^{n}b_{k}x_{k}=S_{n}-{\frac {1}{b_{n}}}\sum _{k=1}^{n-1}(b_{k+1}-b_{k})S_{k}}$

Pick any ε > 0. Now choose N so that ${\displaystyle S_{k}}$ is ε-close to s for k > N. This can be done as the sequence ${\displaystyle S_{k}}$ converges to s. Then the right hand side is:

${\displaystyle S_{n}-{\frac {1}{b_{n}}}\sum _{k=1}^{N-1}(b_{k+1}-b_{k})S_{k}-{\frac {1}{b_{n}}}\sum _{k=N}^{n-1}(b_{k+1}-b_{k})S_{k}}$

${\displaystyle =S_{n}-{\frac {1}{b_{n}}}\sum _{k=1}^{N-1}(b_{k+1}-b_{k})S_{k}-{\frac {1}{b_{n}}}\sum _{k=N}^{n-1}(b_{k+1}-b_{k})s-{\frac {1}{b_{n}}}\sum _{k=N}^{n-1}(b_{k+1}-b_{k})(S_{k}-s)}$

${\displaystyle =S_{n}-{\frac {1}{b_{n}}}\sum _{k=1}^{N-1}(b_{k+1}-b_{k})S_{k}-{\frac {b_{n}-b_{N}}{b_{n}}}s-{\frac {1}{b_{n}}}\sum _{k=N}^{n-1}(b_{k+1}-b_{k})(S_{k}-s).}$

Now, let n go to infinity. The first term goes to s, which cancels with the third term. The second term goes to zero (as the sum is a fixed value). Since the b sequence is increasing, the last term is bounded by ${\displaystyle \epsilon (b_{n}-b_{N})/b_{n}\leq \epsilon }$.

References

• Shiryaev, Albert N. (1996). Probability (2nd ed.). Springer. ISBN 0-387-94549-0.