Łukaszyk–Karmowski metric

In mathematics, the Łukaszyk–Karmowski metric is a function defining a distance between two random variables or two random vectors.[1][2] This function is not a metric as it does not satisfy the identity of indiscernibles condition of the metric, that is for two identical arguments its value is greater than zero. The concept is named after Szymon Łukaszyk and Wojciech Karmowski.

Continuous random variables

The Łukaszyk–Karmowski metric D between two continuous independent random variables X and Y is defined as:

${\displaystyle D(X,Y)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-y|f(x)g(y)\,dx\,dy}$

where f(x) and g(y) are the probability density functions of X and Y respectively.

One may easily show that such metrics above do not satisfy the identity of indiscernibles condition required to be satisfied by the metric of the metric space. In fact they satisfy this condition if and only if both arguments X, Y are certain events described by Dirac delta density probability distribution functions. In such a case:

${\displaystyle D_{\delta \delta }(X,Y)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-y|\delta (x-\mu _{x})\delta (y-\mu _{y})\,dx\,dy=|\mu _{x}-\mu _{y}|}$

the Łukaszyk–Karmowski metric simply transforms into the metric between expected values ${\displaystyle \mu _{x}}$, ${\displaystyle \mu _{y}}$ of the variables X and Y and obviously:

${\displaystyle D_{\delta \delta }(X,X)=|\mu _{x}-\mu _{x}|=0.}$

For all the other cases however:

${\displaystyle D\left(X,X\right)>0.\,}$

The Łukaszyk–Karmowski metric satisfies the remaining non-negativity and symmetry conditions of metric directly from its definition (symmetry of modulus), as well as subadditivity/triangle inequality condition:

${\displaystyle {\begin{aligned}&{}D(X,Z)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-z|f(x)h(z)\,dx\,dz\ =\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-z|f(x)h(z)\,dx\,dz\int _{-\infty }^{\infty }g(y)dy\ \\&{}=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|(x-y)+(y-z)|f(x)g(y)h(z)\,dx\,dy\,dz\ \\&{}\leq \int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }(|x-y|+|y-z|)f(x)g(y)h(z)\,dx\,dy\,dz\ \\&{}=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-y|f(x)g(y)h(z)\,dx\,dy\,dz\ +\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|y-z|f(x)g(y)h(z)\,dx\,dy\,dz\ \\&{}=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-y|f(x)g(y)\,dx\,dy\ +\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|y-z|g(y)h(z)\,dy\,dz\ \\&{}=D(X,Y)+D(Y,Z)\end{aligned}}}$

Thus

${\displaystyle D(X,Z)\leq D(X,Y)+D(Y,Z).\,}$

L–K metric between two random variables X and Y having normal distributions and the same standard deviation ${\displaystyle \sigma =0,\sigma =0.2,\sigma =0.4,\sigma =0.6,\sigma =0.8,\sigma =1}$ (starting with the bottom curve). ${\displaystyle m_{xy}=|\mu _{x}-\mu _{y}|}$ denotes a distance between means of X and Y.

In the case where X and Y are dependent on each other, having a joint probability density function f(x, y), the L–K metric has the following form:

${\displaystyle \int _{-\infty }^{\infty }\int _{-\infty }^{\infty }|x-y|f(x,y)\,dx\,dy.}$

Example: two continuous random variables with normal distributions (NN)

If both random variables X and Y have normal distributions with the same standard deviation σ, and if moreover X and Y are independent, then D(X, Y) is given by

${\displaystyle D_{NN}(X,Y)=\mu _{xy}+{\frac {2\sigma }{\sqrt {\pi }}}\operatorname {exp} \left(-{\frac {\mu _{xy}^{2}}{4\sigma ^{2}}}\right)-\mu _{xy}\operatorname {erfc} \left({\frac {\mu _{xy}}{2\sigma }}\right),}$

where

${\displaystyle \mu _{xy}=\left|\mu _{x}-\mu _{y}\right|,}$

where erfc(x) is the complementary error function and where the subscripts NN indicate the type of the L–K metric.

In this case, the lowest possible value of the function ${\displaystyle D_{NN}(X,Y)}$ is given by

${\displaystyle \lim _{\mu _{xy}\to 0}D_{NN}(X,Y)=D_{NN}(X,X)={\frac {2\sigma }{\sqrt {\pi }}}.}$

Example: two continuous random variables with uniform distributions (RR)

When both random variables X and Y have uniform distributions (R) of the same standard deviation σ, D(X, Y) is given by

${\displaystyle D_{RR}(X,Y)={\begin{cases}{\frac {24{\sqrt {3}}\sigma ^{3}-\mu _{xy}^{3}+6{\sqrt {3}}\sigma \mu _{xy}^{2}}{36\sigma ^{2}}},&\mu _{xy}<2{\sqrt {3}}\sigma ,\\\mu _{xy},&\mu _{xy}\geq 2{\sqrt {3}}\sigma .\end{cases}}}$

The minimal value of this kind of L–K metric is

${\displaystyle D_{RR}(X,X)={\frac {2\sigma }{\sqrt {3}}}.}$

Discrete random variables

In case the random variables X and Y are characterized by discrete probability distribution the Łukaszyk–Karmowski metric D is defined as:

${\displaystyle D(X,Y)=\sum _{i}\sum _{j}|x_{i}-y_{j}|P(X=x_{i})P(Y=y_{j}).\,}$

For example for two discrete Poisson-distributed random variables X and Y the equation above transforms into:

${\displaystyle D_{PP}(X,Y)=\sum _{x=0}^{n}\sum _{y=0}^{n}|x-y|{\frac {{\lambda _{x}}^{x}{\lambda _{y}}^{y}e^{-(\lambda _{x}+\lambda _{y})}}{x!y!}}.}$

Random vectors

equidistant surface for Euclidean metric ${\displaystyle d^{2}(\mathbf {x} ,\mathbf {0} )={\sqrt {x_{1}^{2}+x_{2}^{2}}}}$

equidistant surface for Euclidean L–K metric ${\displaystyle D_{R\delta }^{2}(\mathbf {X} ,\mathbf {0} )\left(\left(\mathbf {X,0} \right):\Omega \to \mathbb {R} ^{2}\right)}$

The Łukaszyk–Karmowski metric of random variables may be easily extended into metric D(X, Y) of random vectors X, Y by substituting ${\displaystyle |x-y|}$ with any metric operator d(x,y):

${\displaystyle D(\mathbf {X} ,\mathbf {Y} )=\int _{\Omega }\int _{\Omega }d(\mathbf {x} ,\mathbf {y} )F(\mathbf {x} )G(\mathbf {y} )\,d\Omega _{x}\,d\Omega _{y}.}$

For example substituting d(x,y) with an Euclidean metric and assuming two-dimensionality of random vectors X, Y would yield:

${\displaystyle D(\mathbf {X} ,\mathbf {Y} )=\int _{\Omega }\int _{\Omega }{\sqrt {\sum _{i=1}^{2}|x_{i}-y_{i}|^{2}}}F(x_{1},x_{2})G(y_{1},y_{2})\,dx_{1}\,dx_{2}\,dy_{1}\,dy_{2}.}$

This form of L–K metric is also greater than zero for the same vectors being measured (with the exception of two vectors having Dirac delta coefficients) and satisfies non-negativity and symmetry conditions of metric. The proofs are analogous to the ones provided for the L–K metric of random variables discussed above.

In case random vectors X and Y are dependent on each other, sharing common joint probability distribution F(X, Y) the L–K metric has the form:

${\displaystyle D(\mathbf {X} ,\mathbf {Y} )=\int _{\Omega }\int _{\Omega }d(\mathbf {x} ,\mathbf {y} )F(\mathbf {x} ,\mathbf {y} )\,d\Omega _{x}\,d\Omega _{y}.}$

Random vectors – the Euclidean form

If the random vectors X and Y are not also only mutually independent but also all components of each vector are mutually independent, the Łukaszyk–Karmowski metric for random vectors is defined as:

${\displaystyle D_{**}^{(p)}(\mathbf {X} ,\mathbf {Y} )=\left({\sum _{i}{D_{**}(X_{i},Y_{i})}^{p}}\right)^{\frac {1}{p}}}$

where:

${\displaystyle D_{**}(X_{i},Y_{i})\,}$

is a particular form of L–K metric of random variables chosen in dependence of the distributions of particular coefficients ${\displaystyle X_{i}}$ and ${\displaystyle Y_{i}}$ of vectors X, Y .

Such a form of L–K metric also shares the common properties of all L–K metrics.

• It does not satisfy the identity of indiscernibles condition:

${\displaystyle \forall {\mathbf {X} ,\mathbf {Y} }\ D_{**}^{(p)}(\mathbf {X} ,\mathbf {Y} )=0\ \nLeftrightarrow \ \mathbf {X} =\mathbf {Y} \,}$

since:

${\displaystyle D_{**}^{(p)}(\mathbf {X} ,\mathbf {X} )=0\Leftrightarrow \ \forall {i}\ D_{**}(X_{i},X_{i})=0}$

but from the properties of L–K metric for random variables it follows that:

${\displaystyle \exists \ X_{i}\ D_{**}(X_{i},X_{i})>0}$

• It is non-negative and symmetric since the particular coefficients are also non-negative and symmetric:

${\displaystyle \forall \ i\ D_{**}(X_{i},Y_{i})>0\,}$

${\displaystyle \forall \ i\ D_{**}(X_{i},Y_{i})=D_{**}(Y_{i},X_{i})}$

• It satisfies the triangle inequality:

${\displaystyle \forall \ \mathbf {X} ,\mathbf {Y} ,\mathbf {Z} \ D_{**}^{(p)}(\mathbf {X} ,\mathbf {Z} )\leq D_{**}^{(p)}(\mathbf {X} ,\mathbf {Y} )+D_{**}^{(p)}(\mathbf {Y} ,\mathbf {Z} )}$

since (cf. Minkowski inequality):

${\displaystyle {\begin{aligned}&{}\left({\sum _{i}{D_{**}(X_{i},Y_{i})}^{p}}\right)^{\frac {1}{p}}+\left({\sum _{i}{D_{**}(Y_{i},Z_{i})}^{p}}\right)^{\frac {1}{p}}\ \geq \\&{}\geq \left({\sum _{i}{D_{**}(X_{i},Y_{i})+D_{**}(Y_{i},Z_{i})}^{p}}\right)^{\frac {1}{p}}\geq \\&{}\geq \left({\sum _{i}{D_{**}(X_{i},Z_{i})}^{p}}\right)^{\frac {1}{p}}\end{aligned}}}$

Physical interpretation

The Łukaszyk–Karmowski metric may be considered as a distance between quantum mechanics particles described by wavefunctions ψ, where the probability dP that given particle is present in given volume of space dV amounts:

${\displaystyle dP=|\psi (x,y,z)|^{2}dV.\,}$

A quantum particle in a box

L–K metric between a quantum particle in a one-dimensional box of length L and a given point ξ of the box ${\displaystyle (0\leq \xi \leq L)}$.

For example the wavefunction of a quantum particle (X) in a box of length L has the form:

${\displaystyle \psi _{m}(x)={\sqrt {\frac {2}{L}}}\sin {\left({\frac {m\pi x}{L}}\right)},\,}$

In this case the L–K metric between this particle and any point ${\displaystyle \xi \in (0,L)\,}$ of the box amounts:

${\displaystyle {\begin{aligned}&{}D(X,\xi )=\int \limits _{0}^{L}|x-\xi ||\psi _{m}(x)|^{2}dx=\\&{}={\frac {\xi ^{2}}{L}}-\xi +L\left({\frac {1}{2}}-{\frac {\sin ^{2}({\frac {m\pi \xi }{L}})}{m^{2}\pi ^{2}}}\right).\end{aligned}}}$

From the properties of the L–K metric it follows that the sum of distances between the edge of the box (ξ = 0 or ξ= L) and any given point and the L–K metric between this point and the particle X is greater than L–K metric between the edge of the box and the particle. E.g. for a quantum particle X at an energy level m = 2 and point ξ = 0.2:

${\displaystyle d(0,0.2L)+D(0.2L,X)\approx 0.2L+0.3171L=0.517L\neq D(0,X)=0.5L=d(0,0.5L).\,}$

Obviously the L–K metric between the particle and the edge of the box (D(0, X) or D(L, X)) amounts 0.5L and is independent on the particle's energy level.

Two quantum particles in a box

A distance between two particles bouncing in a one-dimensional box of length L having time-independent wavefunctions:

${\displaystyle \psi _{m}(x)={\sqrt {\frac {2}{L}}}\sin {\left({\frac {m\pi x}{L}}\right)},\,}$

${\displaystyle \psi _{n}(y)={\sqrt {\frac {2}{L}}}\sin {\left({\frac {n\pi y}{L}}\right)},\,}$

may be defined in terms of Łukaszyk–Karmowski metric of independent random variables as:

${\displaystyle {\begin{aligned}&{}D(X,Y)=\int \limits _{0}^{L}\int \limits _{0}^{L}|x-y||\psi _{m}(x)|^{2}|\psi _{n}(y)|^{2}\,dx\,dy\\&{}={\begin{cases}L\left({\frac {4\pi ^{2}m^{2}-15}{12\pi ^{2}m^{2}}}\right)&m=n,\\L\left({\frac {2\pi ^{2}m^{2}n^{2}-3m^{2}-3n^{2}}{6\pi ^{2}m^{2}n^{2}}}\right)&m\neq n\end{cases}}\end{aligned}}}$

The distance between particles X and Y is minimal for m = 1 i n = 1, that is for the minimum energy levels of these particles and amounts:

${\displaystyle \min(D(X,Y))=L\left({\frac {4\pi ^{2}-15}{12\pi ^{2}}}\right)\approx 0.2067L.\,}$

According to properties of this function, the minimum distance is nonzero. For greater energy levels m, n it approaches to L/3.

Popular explanation

Normal distributions of two random variables X and Y of the same variance for three locations of their means µ_x, µ_y

Suppose we have to measure the distance between point µ_x and point µ_y, which are collinear with some point 0. Suppose further that we instructed this task to two independent and large groups of surveyors equipped with tape measures, wherein each surveyor of the first group will measure distance between 0 and µ_x and each surveyor of the second group will measure distance between 0 and µ_y.

Under the following assumptions we may consider the two sets of received observations x_i, y_j as random variables X and Y having normal distribution of the same variance σ ² and distributed over "factual locations" of points µ_x, µ_y.

Calculating the arithmetic mean for all pairs |x_i − y_j| we should then obtain the value of L–K metric D_NN(X, Y). Its characteristic curvilinearity arises from the symmetry of modulus and overlapping of distributions f(x), g(y) when their means approach each other.

An interesting experiment the results of which coincide with the properties of L–K metric was performed in 1967 by Robert Moyer and Thomas Landauer who measured the precise time an adult took to decide which of two Arabic digits was the largest. When the two digits were numerically distanced such as 2 and 9. subjects responded quickly and accurately. But their response time slowed by more than 100 milliseconds when they were closer such as 5 and 6, and subjects then erred as often as once in every ten trials. The distance effect was present both among highly intelligent persons, as well as those who were trained to escape it.[3]

Practical applications

A Łukaszyk–Karmowski metric may be used instead of a metric operator (commonly the Euclidean distance) in various numerical methods, and in particular in approximation algorithms such us radial basis function networks,[4] inverse distance weighting or Kohonen self-organizing maps.

This approach is physically based, allowing the real uncertainty in the location of the sample points to be considered. [5][6]

See also

• Probabilistic metric space
• Statistical distance

References

1. Metryka Pomiarowa, przykłady zastosowań aproksymacyjnych w mechanice doświadczalnej (Measurement metric, examples of approximation applications in experimental mechanics), PhD thesis, Szymon Łukaszyk (author), Wojciech Karmowski (supervisor), Tadeusz Kościuszko Cracow University of Technology, submitted December 31, 2001, completed March 31, 2004
2. A new concept of probability metric and its applications in approximation of scattered data sets, Łukaszyk Szymon, Computational Mechanics Volume 33, Number 4, 299–304, Springer-Verlag 2003 doi:10.1007/s00466-003-0532-2
3. The Number Sense: How the Mind Creates Mathematics, Stanislas Dehaene, Oxford University Press US, 1999, ISBN 0-19-513240-8, pp. 73–75
4. Florian Hogewind, Peter Bissolli (2010) Operational maps of monthly mean temperature for WMO-Region VI (Europe and Middle East), IDŐJÁRÁS, Quarterly Journal of the Hungarian Meteorological Service, Vol. 115, No. 1-2, January–June 2011, pp. 31-49, p. 41
5. Gang Meng, Jane Law, Mary E. Thompson (2010) "Small-scale health-related indicator acquisition using secondary data spatial interpolation", International Journal of Health Geographics, 9:50 doi:10.1186/1476-072X-9-50
6. Gang Meng (2010)Social and Spatial Determinants of Adverse Birth Outcome Inequalities in Socially Advanced Societies, Thesis (Doctor of Philosophy in Planning), University of Waterloo, Canada,