Deductive lambda calculus

Deductive lambda calculus considers what happens when lambda terms are regarded as mathematical expressions. One interpretation of the untyped lambda calculus is as a programming language where evaluation proceeds by performing reductions on an expression until it is in normal form. In this interpretation, if the expression never reduces to normal form then the program never terminates, and the value is undefined. Considered as a mathematical deductive system, each reduction would not alter the value of the expression. The expression would equal the reduction of the expression.

History

Alonzo Church invented the lambda calculus in the 1930s, originally to provide a new and simpler basis for mathematics.[1][2] However soon after inventing it major logic problems were identified with the definition of the lambda abstraction: The Kleene–Rosser paradox is an implementation of Richard's paradox in the lambda calculus.[3] Haskell Curry found that the key step in this paradox could be used to implement the simpler Curry's paradox. The existence of these paradoxes meant that the lambda calculus could not be both consistent and complete as a deductive system.[4]

Haskell Curry studied of illative (deductive) combinatory logic in 1941.[5] Combinatory logic is closely related to lambda calculus, and the same paradoxes exist in each.

Later the lambda calculus was resurrected as a definition of a programming language.

Introduction

Lambda calculus is the model and inspiration for the development of functional programming languages. These languages implement the lambda abstraction, and use it in conjunction with application of functions, and types.

The use of lambda abstractions, which are then embedded into other mathematical systems, and used as a deductive system, leads to a number of problems, such as Curry's paradox. The problems are related to the definition of the lambda abstraction and the definition and use of functions as the basic type in lambda calculus. This article describes these problems and how they arise.

This is not a criticism of pure lambda calculus, and lambda calculus as a pure system is not the primary topic here. The problems arise with the interaction of lambda calculus with other mathematical systems. Being aware of the problems allows them to be avoided in some cases.

Terminology

For this discussion, the lambda abstraction is added as an extra operator in mathematics. The usual domains, such as Boolean and real will be available. Mathematical equality will be applied to these domains. The purpose is to see what problems arise from this definition.

Function application will be represented using the lambda calculus syntax. So multiplication will be represented by a dot. Also, for some examples, the let expression will be used.

The following table summarizes;

Name	Notation
Lambda abstraction.	${\displaystyle \lambda v.y}$
Application of the function f to x	${\displaystyle f\ x}$
Multiplication of a by b	${\displaystyle a\cdot b}$
Let x in y	${\displaystyle \operatorname {let} x\operatorname {in} y}$
Mathematical equality	${\displaystyle m=n}$
Beta reducible equality	${\displaystyle m\ {\underset {\beta }{=}}\ n}$

Interpretation of lambda calculus as mathematics

In the mathematical interpretation, lambda terms represent values. Eta and beta reductions are deductive steps that do not alter the values of expressions.

${\displaystyle \operatorname {eta-reduct} [X]=X}$

${\displaystyle \operatorname {beta-reduct} [X]=X}$

Eta reduction as mathematics

An eta-reduct is defined by,

${\displaystyle x\not \in \operatorname {FV} (f)\to \operatorname {eta-reduct} [\lambda x.(f\ x)]=f}$

In the mathematical interpretation,

${\displaystyle \operatorname {eta-reduct} [X]=X}$

Taking f to be a variable then,

${\displaystyle \lambda x.(f\ x)=f}$

or by letting ${\displaystyle f\ x=y}$

${\displaystyle f\ x=y\iff f=\lambda x.y}$

This definition defines ${\displaystyle \lambda x.y}$ to be the solution for f in the equation,

${\displaystyle f\ x=y}$

Beta reduction as mathematics

A beta reduct is,

${\displaystyle \operatorname {beta-reduct} [(\lambda x.b)\ z]=b[x:=z]}$

and as,

${\displaystyle \operatorname {beta-reduct} [X]=X}$

then,

${\displaystyle (\lambda x.b)\ z=b[x:=z]}$

This rule is implied by the instantiation of quantified variables. If,

${\displaystyle \forall x:f\ x=y}$

then ${\displaystyle f\ z}$ is the expression y with the quantified variable x instantiated as z.

${\displaystyle f\ z=y[x:=z]}$

so,

${\displaystyle (\lambda x.y)\ z=y[x:=z]}$

As beta reduction is implied from eta reduction, there is no contradiction between the two definitions.

Inconsistency with the Principle of Bivalence

Let z be a Boolean; then we can form an equation with no solutions,

${\displaystyle z=\neg z}$

To solve this equation by recursion, we introduce a new function f defined by,

${\displaystyle f\ n=\neg (n\ n)}$

where n is an auxiliary variable to hold the recursion value. (We take it that ${\displaystyle \neg }$ still returns a Boolean even if it is given a non-Boolean argument.) By an eta-reduction, we obtain,

${\displaystyle f=\lambda x.\neg (x\ x)}$

And then,

${\displaystyle {\begin{aligned}f\ f&=(\lambda x.\neg (x\ x))(\lambda x.\neg (x\ x))\\&=\neg ((\lambda x.\neg (x\ x))(\lambda x.\neg (x\ x)))\\&=\neg (f\ f)\end{aligned}}}$

Then f f is neither true or false, and as f f is a Boolean value (on any x, f returns the Boolean ${\displaystyle \neg (x\ x)}$) then we see that f f is neither true nor false; it also demonstrates that negation makes less sense when applied to non-logical values.

Intensional versus extensional equality

Another difficulty for the interpretation of lambda calculus as a deductive system is the representation of values as lambda terms, which represent functions. The untyped lambda calculus is implemented by performing reductions on a lambda term, until the term is in normal form. The intensional interpretation[6] [7] of equality is that the reduction of a lambda term to normal form is the value of the lambda term.

This interpretation considers the identity of a lambda expression to be its structure. Two lambda terms are equal if they are alpha convertible.

The extensional definition of function equality is that two functions are equal if they perform the same mapping;

${\displaystyle f=g\iff (\forall xf\ x=g\ x)}$

One way to describe this is that extensional equality describes equality of functions, where as intensional equality describes equality of function implementations.

The extensional definition of equality is not equivalent to the intensional definition. This can be seen in the example below. This inequivalence is created by considering lambda terms as values. In typed lambda calculus this problem is circumvented, because built-in types may be added to carry values that are in a canonical form and have both extensional and intensional equality.

Example

In arithmetic, the distributive law implies that ${\displaystyle 2*(r+s)=2*r+2*s}$. Using the Church encoding of numerals the left and right hand sides may be represented as lambda terms.

So the distributive law says that the two functions,

${\displaystyle \lambda r.\lambda s.2*(r+s)=\lambda r.\lambda s.2*r+2*s}$

are equal, as functions on Church numerals. (Here we encounter a technical weakness of the untyped lambda calculus: there is no way to restrict the domain of a function to the Church numerals. In the following argument we will ignore this difficulty, by pretending that "all" lambda expressions are Church numerals.) The distributive law should apply if the Church numerals provided a satisfactory implementation of numbers.

${\displaystyle {\begin{aligned}\lambda r.\lambda s.\operatorname {mult} \ 2\ (\operatorname {plus} \ r\ s)&=\lambda r.\lambda s.\operatorname {plus} \ (\operatorname {mult} \ 2\ r)\ (\operatorname {mult} \ 2\ s)\\{\scriptstyle \lambda r.\lambda s.(\lambda m.\lambda n.\lambda f.m\ (n\ f))\ (\lambda f.\lambda x.f\ (f\ x))\ ((\lambda m.\lambda n.\lambda f.\lambda x.m\ f\ (n\ f\ x))\ r\ s)}&={\scriptstyle \lambda r.\lambda s.(\lambda m.\lambda n.\lambda f.\lambda x.m\ f\ (n\ f\ x))\ ((\lambda m.\lambda n.\lambda f.m\ (n\ f))\ (\lambda f.\lambda x.f\ (f\ x))\ r)\ ((\lambda m.\lambda n.\lambda f.m\ (n\ f))\ (\lambda f.\lambda x.f\ (f\ x))\ s)}\\\lambda r.\lambda s.\lambda f.\lambda x.r\ f\ (s\ f\ (r\ f\ (s\ f\ x)))&=\lambda r.\lambda s.\lambda f.\lambda x.r\ f\ (r\ f\ (s\ f\ (s\ f\ x)))\end{aligned}}}$

The two terms beta reduce to similar expressions. Still they are not alpha convertible, or even eta convertible (the latter follows because both terms are already in eta-long form). So according to the intensional definition of equality, the expressions are not equal. But if the two functions are applied to the same Church numerals they produce the same result, by the distributive law; thus they are extensionally equal.

This is a significant problem, as it means that the intensional value of a lambda-term may change under extensionally valid transformations. A solution to this problem is to introduce an omega-rule,

• If, for all lambda-expressions t we have ${\displaystyle f\ t\ {\underset {\beta }{=}}\ g\ t}$, then ${\displaystyle f\ {\underset {\beta }{=}}\ g}$.

In our situation, "all lambda-expressions" means "all Church numerals", so this is an omega-rule in the standard sense as well. Note that the omega-rule implies the eta-rule, since ${\displaystyle f\ t\ {\underset {\beta }{=}}\ (\lambda x.f\ x)\ t}$ by a beta-reduction on the right side.

Set theoretic domain

Lambda abstractions are functions of functions. A natural step is to define a domain for the lambda abstraction as a set of all functions.

The set of all functions from a domain D to a range R is given by K in,

${\displaystyle f\in K\iff (\forall x:x\in D\implies f\ x\in R)}$

Then the (imaginary) definition of the set of all functions of functions is given by F in,

${\displaystyle f\in F\iff (\forall x:x\in F\implies f\ x\in F)}$

This definition cannot be formulated in an axiomatic set theory; and this naive equation, even if it could be written in a set theory, has no solutions.

Now lambda calculus is defined by beta reductions and eta reductions. Interpreting reduction as defining equality gives an implicit domain for the lambda calculus. The rules are,

• Every lambda abstraction has one value.
• The beta reduction of a lambda term has the same value.
• The eta reduction of a lambda term has the same value.
• Alpha convertible lambda terms are equal.
• [If the omega-rule is present] "omega-equivalent" lambda terms are equal.
• If two lambda terms can not be shown to be equal by the above rules, they are not equal.

If two lambda terms may be reduced to normal form then the Church–Rosser theorem may be used to show that they are equal if their normal forms are alpha convertible.

If one or both of the terms are not normalizing then the undecidability of equivalence shows that in general there is no algorithm to determine if two lambda terms are equal. In general this makes it impossible to know what the distinct elements of the lambda calculus domain are.

Example: No solutions → one solution

For example the equation ${\displaystyle x=\neg x}$ may be coded with Church encoding and using Curry's Y combinator as,

${\displaystyle \operatorname {not} _{1}=\lambda p.\lambda a.\lambda b.p\ b\ a}$

${\displaystyle (\lambda f.(\lambda x.f\ (x\ x))\ (\lambda x.f\ (x\ x)))(\lambda p.\lambda a.\lambda b.p\ b\ a)}$

And the recursion is,

${\displaystyle (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))\ (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))}$

${\displaystyle (\lambda p.\lambda a.\lambda b.p\ b\ a)\ ((\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))\ (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x)))}$

${\displaystyle \lambda a.\lambda b.((\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))\ (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x)))\ b\ a}$

...

${\displaystyle \lambda a.\lambda b.(\lambda a.\lambda b.((\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))\ (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x)))\ b\ a)\ b\ a}$

... (beta and then eta reduction)

${\displaystyle (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))\ (\lambda x.(\lambda p.\lambda a.\lambda b.p\ b\ a)\ (x\ x))}$

Which is the first line and will recurse indefinitely. The expression never reduces to normal form. However every lambda term in the reduction represents the same value. This value is distinct from the encodings for true or false. It is not part of the Boolean domain but it exists in the lambda calculus domain.

Example: Multiple solutions → one solution

Using division and signed numbers, the Y combinator may be used to define an expression representing a whole number square root. The Church encoding may also be extended further to rational and real numbers, so that a real square root may be defined. The Church-Turing thesis implies that any computable operator (and its operands) can be represented in lambda calculus.

Using such an encoding,

${\displaystyle x^{2}=n\Rightarrow x={\frac {n}{x}}\Rightarrow f\ x={\frac {n}{x}}\land Y\ f=x}$

Using the implementation of divide then,

${\displaystyle Y(\operatorname {divide} n)}$

represents two values in the domain of the signed numbers, if n is not equal to zero. However it is a lambda expression so has only one value in the lambda calculus domain. Beta reduction of this lambda term never reaches normal form. However it represents a value, so a single value in the lambda calculus domain represents two values in the signed number domain.

See also

• Lambda calculus
• Let expression
• Church encoding

References

1. Church, A. (1932). "A set of postulates for the foundation of logic". Annals of Mathematics. Series 2. 33 (2): 346–366. doi:10.2307/1968337. JSTOR 1968337.
2. For a full history, see Cardone and Hindley's "History of Lambda-calculus and Combinatory Logic" (2006).
3. Kleene, S. C. & Rosser, J. B. (1935). "The inconsistency of certain formal logics". Annals of Mathematics. 36 (3): 630–636. doi:10.2307/1968646. JSTOR 1968646.
4. Curry, Haskell B. (1942). "The Inconsistency of Certain Formal Logic". The Journal of Symbolic Logic. 7 (3): 115–117. doi:10.2307/2269292. JSTOR 2269292.
5. Curry, Haskell B. (1941). "The Paradox of Kleene and Rosser". Transactions of the American Mathematical Society. 50: 454–516. doi:10.1090/S0002-9947-1941-0005275-6. JSTOR 1990124. MR 0005275. Retrieved 24 January 2013.
6. Selinger, Peter. "Lecture Notes on Lambda Calculus (PDF)" (PDF). p. 6.
7. "Lambda calculus – intensionality". Stanford. p. 1.2 Intensionality.