Affine arithmetic

Affine arithmetic (AA) is a model for self-validated numerical analysis. In AA, the quantities of interest are represented as affine combinations (affine forms) of certain primitive variables, which stand for sources of uncertainty in the data or approximations made during the computation.

Affine arithmetic is meant to be an improvement on interval arithmetic (IA), and is similar to generalized interval arithmetic, first-order Taylor arithmetic, the center-slope model, and ellipsoid calculus — in the sense that it is an automatic method to derive first-order guaranteed approximations to general formulas.

Affine arithmetic is potentially useful in every numeric problem where one needs guaranteed enclosures to smooth functions, such as solving systems of non-linear equations, analyzing dynamical systems, integrating functions differential equations, etc. Applications include ray tracing, plotting curves, intersecting implicit and parametric surfaces, error analysis (mathematics), process control, worst-case analysis of electric circuits, and more.

Definition

In affine arithmetic, each input or computed quantity x is represented by a formula ${\displaystyle x=x_{0}+x_{1}\epsilon _{1}+x_{2}\epsilon _{2}+{}}$${\displaystyle \cdots }$${\displaystyle {}+x_{n}\epsilon _{n}}$ where ${\displaystyle x_{0},x_{1},x_{2},}$${\displaystyle \dots ,}$${\displaystyle x_{n}}$ are known floating-point numbers, and ${\displaystyle \epsilon _{1},\epsilon _{2},\epsilon _{n}}$ are symbolic variables whose values are only known to lie in the range [-1,+1].

Thus, for example, a quantity X which is known to lie in the range [3,7] can be represented by the affine form ${\displaystyle x=5+2\epsilon _{k}}$, for some k. Conversely, the form ${\displaystyle x=10+2\epsilon _{3}-5\epsilon _{8}}$ implies that the corresponding quantity X lies in the range [3,17].

The sharing of a symbol ${\displaystyle \epsilon _{j}}$ among two affine forms ${\displaystyle x}$, ${\displaystyle y}$ implies that the corresponding quantities X, Y are partially dependent, in the sense that their joint range is smaller than the Cartesian product of their separate ranges. For example, if ${\displaystyle x=10+2\epsilon _{3}-6\epsilon _{8}}$ and ${\displaystyle y=20+3\epsilon _{4}+4\epsilon _{8}}$, then the individual ranges of X and Y are [2,18] and [13,27], but the joint range of the pair (X,Y) is the hexagon with corners (2,27), (6,27), (18,19), (18,13), (14,13), (2,21) — which is a proper subset of the rectangle [2,18]×[13,27].

Affine arithmetic operations

Affine forms can be combined with the standard arithmetic operations or elementary functions, to obtain guaranteed approximations to formulas.

Affine operations

For example, given affine forms ${\displaystyle x,y}$ for X and Y, one can obtain an affine form ${\displaystyle z}$ for Z = X + Y simply by adding the forms — that is, setting ${\displaystyle z_{j}}$ ${\displaystyle \gets }$ ${\displaystyle x_{j}+y_{j}}$ for every j. Similarly, one can compute an affine form ${\displaystyle z}$ for Z = ${\displaystyle \alpha }$X, where ${\displaystyle \alpha }$ is a known constant, by setting ${\displaystyle z_{j}}$ ${\displaystyle \gets }$ ${\displaystyle \alpha x_{j}}$ for every j. This generalizes to arbitrary affine operations like Z = ${\displaystyle \alpha }$X + ${\displaystyle \beta }$Y + ${\displaystyle \gamma }$.

Non-affine operations

A non-affine operation ${\displaystyle Z}$ ${\displaystyle \gets }$ ${\displaystyle F(X,Y,}$${\displaystyle \dots }$${\displaystyle )}$, like multiplication ${\displaystyle Z}$ ${\displaystyle \gets }$ ${\displaystyle XY}$ or ${\displaystyle Z}$ ${\displaystyle \gets }$ ${\displaystyle \sin(X)}$, cannot be performed exactly, since the result would not be an affine form of the ${\displaystyle \epsilon _{i}}$. In that case, one should take a suitable affine function G that approximates F to first order, in the ranges implied by ${\displaystyle x}$ and ${\displaystyle y}$; and compute ${\displaystyle z}$ ${\displaystyle \gets }$ ${\displaystyle G(x,y,}$${\displaystyle \dots }$${\displaystyle )+z_{k}\epsilon _{k}}$, where ${\displaystyle z_{k}}$ is an upper bound for the absolute error ${\displaystyle |F-G|}$ in that range, and ${\displaystyle \epsilon _{k}}$ is a new symbolic variable not occurring in any previous form.

The form ${\displaystyle z}$ then gives a guaranteed enclosure for the quantity Z; moreover, the affine forms ${\displaystyle x,y,}$${\displaystyle \dots }$${\displaystyle ,z}$ jointly provide a guaranteed enclosure for the point (X,Y,...,Z), which is often much smaller than the Cartesian product of the ranges of the individual forms.

Chaining operations

Systematic use of this method allows arbitrary computations on given quantities to be replaced by equivalent computations on their affine forms, while preserving first-order correlations between the input and output and guaranteeing the complete enclosure of the joint range. One simply replaces each arithmetic operation or elementary function call in the formula by a call to the corresponding AA library routine.

For smooth functions, the approximation errors made at each step are proportional to the square h² of the width h of the input intervals. For this reason, affine arithmetic will often yield much tighter bounds than standard interval arithmetic (whose errors are proportional to h).

Roundoff errors

In order to provide guaranteed enclosure, affine arithmetic operations must account for the roundoff errors in the computation of the resulting coefficients ${\displaystyle z_{j}}$. This cannot be done by rounding each ${\displaystyle z_{j}}$ in a specific direction, because any such rounding would falsify the dependencies between affine forms that share the symbol ${\displaystyle \epsilon _{j}}$. Instead, one must compute an upper bound ${\displaystyle \delta _{j}}$ to the roundoff error of each ${\displaystyle z_{j}}$, and add all those ${\displaystyle \delta _{j}}$ to the coefficient ${\displaystyle z_{k}}$ of the new symbol ${\displaystyle \epsilon _{k}}$ (rounding up). Thus, because of roundoff errors, even affine operations like Z = ${\displaystyle \alpha }$X and Z = X + Y will add the extra term ${\displaystyle z_{k}\epsilon _{k}}$.

The handling of roundoff errors increases the code complexity and execution time of AA operations. In applications where those errors are known to be unimportant (because they are dominated by uncertainties in the input data and/or by the linearization errors), one may use a simplified AA library that does not implement roundoff error control.

Affine projection model

Affine arithmetic can be viewed in matrix form as follows. Let ${\displaystyle X_{1},X_{2},}$${\displaystyle \dots ,}$${\displaystyle X_{m}}$ be all input and computed quantities in use at some point during a computation. The affine forms for those quantities can be represented by a single coefficient matrix A and a vector b, where element ${\displaystyle A_{i,j}}$ is the coefficient of symbol ${\displaystyle \epsilon _{j}}$ in the affine form of ${\displaystyle X_{i}}$; and ${\displaystyle b_{i}}$ is the independent term of that form. Then the joint range of the quantities — that is, the range of the point ${\displaystyle (X_{1},X_{2},}$${\displaystyle \dots ,}$${\displaystyle X_{m})}$ — is the image of the hypercube ${\displaystyle U^{n}=[-1,+1]^{n}}$ by the affine map from ${\displaystyle U^{n}}$ to ${\displaystyle R^{m}}$ defined by ${\displaystyle \epsilon }$ ${\displaystyle \to }$ ${\displaystyle A\epsilon +b}$.

The range of this affine map is a zonotope bounding the joint range of the quantities ${\displaystyle X_{1},X_{2},}$${\displaystyle \dots ,}$${\displaystyle X_{m}}$. Thus one could say that AA is a "zonotope arithmetic". Each step of AA usually entails adding one more row and one more column to the matrix A.

Affine form simplification

Since each AA operation generally creates a new symbol ${\displaystyle \epsilon _{k}}$, the number of terms in an affine form may be proportional to the number of operations used to compute it. Thus, it is often necessary to apply "symbol condensation" steps, where two or more symbols ${\displaystyle \epsilon _{k}}$ are replaced by a smaller set of new symbols. Geometrically, this means replacing a complicated zonotope P by a simpler zonotope Q that encloses it. This operation can be done without destroying the first-order approximation property of the final zonotope.

Implementation

Matrix implementation

Affine arithmetic can be implemented by a global array A and a global vector b, as described above. This approach is reasonably adequate when the set of quantities to be computed is small and known in advance. In this approach, the programmer must maintain externally the correspondence between the row indices and the quantities of interest. Global variables hold the number m of affine forms (rows) computed so far, and the number n of symbols (columns) used so far; these are automatically updated at each AA operation.

Vector implementation

Alternatively, each affine form can be implemented as a separate vector of coefficients. This approach is more convenient for programming, especially when there are calls to library procedures that may use AA internally. Each affine form can be given a mnemonic name; it can be allocated when needed, be passed to procedures, and reclaimed when no longer needed. The AA code then looks much closer to the original formula. A global variable holds the number n of symbols used so far.

Sparse vector implementation

On fairly long computations, the set of "live" quantities (that will be used in future computations) is much smaller than the set of all computed quantities; and ditto for the set of "live" symbols ${\displaystyle \epsilon _{j}}$. In this situation, the matrix and vector implementations are too wasteful of time and space.

In such situations, one should use a sparse implementation. Namely, each affine form is stored as a list of pairs (j,${\displaystyle x_{j}}$), containing only the terms with non-zero coefficient ${\displaystyle x_{j}}$. For efficiency, the terms should be sorted in order of j. This representation makes the AA operations somewhat more complicated; however, the cost of each operation becomes proportional to the number of nonzero terms appearing in the operands, instead of the number of total symbols used so far.

This is the representation used by LibAffa.

References

• L. H. de Figueiredo and J. Stolfi (2004) "Affine arithmetic: concepts and applications." Numerical Algorithms 37 (1–4), 147–158.
• J. L. D. Comba and J. Stolfi (1993), "Affine arithmetic and its applications to computer graphics". Proc. SIBGRAPI'93 — VI Simpósio Brasileiro de Computação Gráfica e Processamento de Imagens (Recife, BR), 9–18.
• L. H. de Figueiredo and J. Stolfi (1996), "Adaptive enumeration of implicit surfaces with affine arithmetic". Computer Graphics Forum, 15 5, 287–296.
• W. Heidrich (1997), "A compilation of affine arithmetic versions of common math library functions". Technical Report 1997-3, Universität Erlangen-Nürnberg.
• M. Kashiwagi (1998), "An all solution algorithm using affine arithmetic". NOLTA'98 — 1998 International Symposium on Nonlinear Theory and its Applications (Crans-Montana, Switzerland), 14–17.
• L. Egiziano, N. Femia, and G. Spagnuolo (1998), "New approaches to the true worst-case evaluation in circuit tolerance and sensitivity analysis — Part II: Calculation of the outer solution using affine arithmetic". Proc. COMPEL'98 — 6th Workshop on Computer in Power Electronics (Villa Erba, Italy), 19–22.
• W. Heidrich, Ph. Slusallek, and H.-P. Seidel (1998), "Sampling procedural shaders using affine arithmetic". ACM Transactions on Graphics, 17 3, 158–176.
• F. Messine and A. Mahfoudi (1998), "Use of affine arithmetic in interval optimization algorithms to solve multidimensional scaling problems". Proc. SCAN'98 — IMACS/GAMM International Symposium on Scientific Computing, Computer Arithmetic and Validated Numerics (Budapest, Hungary), 22–25.
• A. de Cusatis Jr., L. H. Figueiredo, and M. Gattass (1999), "Interval methods for ray casting surfaces with affine arithmetic". Proc. SIBGRAPI'99 — 12th Brazilian Symposium on Computer Graphics and Image Processing, 65–71.
• K. Bühler and W. Barth (2000), "A new intersection algorithm for parametric surfaces based on linear interval estimations". Proc. SCAN 2000 / Interval 2000 — 9th GAMM-IMACS International Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics, ???–???.
• I. Voiculescu, J. Berchtold, A. Bowyer, R. R. Martin, and Q. Zhang (2000), "Interval and affine arithmetic for surface location of power- and Bernstein-form polynomials". Proc. Mathematics of Surfaces IX, 410–423. Springer, ISBN 1-85233-358-8.
• Q. Zhang and R. R. Martin (2000), "Polynomial evaluation using affine arithmetic for curve drawing". Proc. of Eurographics UK 2000 Conference, 49–56. ISBN 0-9521097-9-4.
• D. Michelucci (2000), "Reliable computations for dynamic systems". Proc. SCAN 2000 / Interval 2000 — 9th GAMM-IMACS International Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics, ???–???.
• N. Femia and G. Spagnuolo (2000), "True worst-case circuit tolerance analysis using genetic algorithm and affine arithmetic — Part I". IEEE Transactions on Circuits and Systems, 47 9, 1285–1296.
• R. Martin, H. Shou, I. Voiculescu, and G. Wang (2001), "A comparison of Bernstein hull and affine arithmetic methods for algebraic curve drawing". Proc. Uncertainty in Geometric Computations, 143–154. Kluwer Academic Publishers, ISBN 0-7923-7309-X.
• A. Bowyer, R. Martin, H. Shou, and I. Voiculescu (2001), "Affine intervals in a CSG geometric modeller". Proc. Uncertainty in Geometric Computations, 1–14. Kluwer Academic Publishers, ISBN 0-7923-7309-X.
• T. Kikuchi and M. Kashiwagi (2001), "Elimination of non-existence regions of the solution of nonlinear equations using affine arithmetic". Proc. NOLTA'01 — 2001 International Symposium on Nonlinear Theory and its Applications.
• T. Miyata and M. Kashiwagi (2001), "On range evaluation of polynomials of affine arithmetic". Proc. NOLTA'01 - 2001 International Symposium on Nonlinear Theory and its Applications.
• Y. Kanazawa and S. Oishi (2002), "A numerical method of proving the existence of solutions for nonlinear ODEs using affine arithmetic". Proc. SCAN'02 — 10th GAMM-IMACS International Symposium on Scientific Computing, Computer Arithmetic, and Validated Numerics.
• H. Shou, R. R.Martin, I. Voiculescu, A. Bowyer, and G. Wang (2002), "Affine arithmetic in matrix form for polynomial evaluation and algebraic curve drawing". Progress in Natural Science, 12 1, 77–81.
• A. Lemke, L. Hedrich, and E. Barke (2002), "Analog circuit sizing based on formal methods using affine arithmetic". Proc. ICCAD-2002 — International Conference on Computer Aided Design, 486–489.
• F. Messine (2002), "Extensions of affine arithmetic: Application to unconstrained global optimization". Journal of Universal Computer Science, 8 11, 992–1015.
• K. Bühler (2002), "Implicit linear interval estimations". Proc. 18th Spring Conference on Computer Graphics (Budmerice, Slovakia), 123–132. ACM Press, ISBN 1-58113-608-0.
• L. H. de Figueiredo, J. Stolfi, and L. Velho (2003), "Approximating parametric curves with strip trees using affine arithmetic". Computer Graphics Forum, 22 2, 171–179.
• C. F. Fang, T. Chen, and R. Rutenbar (2003), "Floating-point error analysis based on affine arithmetic". Proc. 2003 International Conf. on Acoustic, Speech and Signal Processing.
• A. Paiva, L. H. de Figueiredo, and J. Stolfi (2006), "Robust visualization of strange attractors using affine arithmetic". Computers & Graphics, 30 6, 1020– 1026.

External links

• Stolfi's page on AA.
• LibAffa, an LGPL implementation of affine arithmetic.
  • libaffa on GitHub
• ASOL, a branch-and-prune method to find all solutions to systems of nonlinear equations using affine arithmetic
• YalAA, an object-oriented C++ based template library for affine arithmetic (AA).
• kv on GitHub (C++ library which can use affine arithmetic)