Existential theory of the reals

In mathematical logic, computational complexity theory, and computer science, the existential theory of the reals is the set of all true sentences of the form

${\displaystyle \exists X_{1}\cdots \exists X_{n}\,F(X_{1},\dots ,X_{n}),\,}$

where ${\displaystyle F(X_{1},\dots X_{n})}$ is a quantifier-free formula involving equalities and inequalities of real polynomials.[1]

The decision problem for the existential theory of the reals is the problem of finding an algorithm that decides, for each such formula, whether it is true or false. Equivalently, it is the problem of testing whether a given semialgebraic set is non-empty.[1] This decision problem is NP-hard and lies in PSPACE.[2] Thus it has significantly lower complexity than Alfred Tarski's quantifier elimination procedure for deciding statements in the first-order theory of the reals without the restriction to existential quantifiers.[1] However, in practice, general methods for the first-order theory remain the preferred choice for solving these problems.[3]

Many natural problems in geometric graph theory, especially problems of recognizing geometric intersection graphs and straightening the edges of graph drawings with crossings, may be solved by translating them into instances of the existential theory of the reals, and are complete for this theory. The complexity class ${\displaystyle \exists \mathbb {R} }$, which lies between NP and PSPACE, has been defined to describe this class of problems.[4]

Background

In mathematical logic, a theory is a formal language consisting of a set of sentences written using a fixed set of symbols. The first-order theory of real closed fields has the following symbols:[5]

• the constants 0 and 1,
• a countable collection of variables ${\displaystyle X_{i}}$,
• the addition, subtraction, multiplication, and (optionally) division operations,
• symbols <, ≤, =, ≥, >, and ≠ for comparisons of real values,
• the logical connectives ∧, ∨, ¬, and ⇔,
• parentheses, and
• the universal quantifier ∀ and the existential quantifier ∃

A sequence of these symbols forms a sentence that belongs to the first-order theory of the reals if it is grammatically well formed, all its variables are properly quantified, and (when interpreted as a mathematical statement about the real numbers) it is a true statement. As Tarski showed, this theory can be described by an axiom schema and a decision procedure that is complete and effective: for every fully quantified and grammatical sentence, either the sentence or its negation (but not both) can be derived from the axioms. The same theory describes every real closed field, not just the real numbers.[6] However, there are other number systems that are not accurately described by these axioms; in particular, the theory defined in the same way for integers instead of real numbers is undecidable, even for existential sentences (Diophantine equations) by Matiyasevich's theorem.[5][7]

The existential theory of the reals is the subset of the first-order theory consisting of sentences in which all the quantifiers are existential and they appear before any of the other symbols. That is, it is the set of all true sentences of the form

${\displaystyle \exists X_{1}\cdots \exists X_{n}\,F(X_{1},\dots ,X_{n}),\,}$

where ${\displaystyle F(X_{1},\dots X_{n})}$ is a quantifier-free formula involving equalities and inequalities of real polynomials. The decision problem for the existential theory of the reals is the algorithmic problem of testing whether a given sentence belongs to this theory; equivalently, for strings that pass the basic syntactical checks (they use the correct symbols with the correct syntax, and have no unquantified variables) it is the problem of testing whether the sentence is a true statement about the real numbers. The set of n-tuples of real numbers ${\displaystyle (X_{1},\dots X_{n})}$ for which ${\displaystyle F(X_{1},\dots X_{n})}$ is true is called a semialgebraic set, so the decision problem for the existential theory of the reals can equivalently be rephrased as testing whether a given semialgebraic set is nonempty.[1]

In determining the time complexity of algorithms for the decision problem for the existential theory of the reals, it is important to have a measure of the size of the input. The simplest measure of this type is the length of a sentence: that is, the number of symbols it contains.[5] However, in order to achieve a more precise analysis of the behavior of algorithms for this problem, it is convenient to break down the input size into several variables, separating out the number of variables to be quantified, the number of polynomials within the sentence, and the degree of these polynomials.[8]

Examples

The golden ratio ${\displaystyle \varphi }$ may be defined as the root of the polynomial ${\displaystyle x^{2}-x-1}$. This polynomial has two roots, only one of which (the golden ratio) is greater than one. Thus, the existence of the golden ratio may be expressed by the sentence

${\displaystyle \exists X_{1}(X_{1}>1\wedge X_{1}\times X_{1}-X_{1}-1=0).}$

Because the golden ratio does exist, this is a true sentence, and belongs to the existential theory of the reals. The answer to the decision problem for the existential theory of the reals, given this sentence as input, is the Boolean value true.

The inequality of arithmetic and geometric means states that, for every two non-negative numbers ${\displaystyle x}$ and ${\displaystyle y}$, the following inequality holds:

${\displaystyle {\frac {x+y}{2}}\geq {\sqrt {xy}}.}$

As stated above, it is a first-order sentence about the real numbers, but one with universal rather than existential quantifiers, and one that uses extra symbols for division, square roots, and the number 2 that are not allowed in the first-order theory of the reals. However, by squaring both sides it can be transformed into the following existential statement that can be interpreted as asking whether the inequality has any counterexamples:

${\displaystyle \exists X_{1}\exists X_{2}{\bigl (}X_{1}\geq 0\wedge X_{2}\geq 0\wedge (X_{1}+X_{2})\times (X_{1}+X_{2})<(X_{1}+X_{1})\times (X_{2}+X_{2}){\bigr )}.}$

The answer to the decision problem for the existential theory of the reals, given this sentence as input, is the Boolean value false: there are no counterexamples. Therefore, this sentence does not belong to the existential theory of the reals, despite being of the correct grammatical form.

Algorithms

Alfred Tarski's method of quantifier elimination (1948) showed the existential theory of the reals (and more generally the first order theory of the reals) to be algorithmically solvable, but without an elementary bound on its complexity.[9][6] The method of cylindrical algebraic decomposition, by George E. Collins (1975), improved the time dependence to doubly exponential,[9][10] of the form

${\displaystyle L^{3}(md)^{2^{O(n)}}}$

where ${\displaystyle L}$ is the number of bits needed to represent the coefficients in the sentence whose value is to be determined, ${\displaystyle m}$ is the number of polynomials in the sentence, ${\displaystyle d}$ is their total degree, and ${\displaystyle n}$ is the number of variables.[8] By 1988, Dima Grigoriev and Nicolai Vorobjov had shown the complexity to be exponential in a polynomial of ${\displaystyle n}$,[8][11][12]

${\displaystyle L(md)^{n^{2}}}$

and in a sequence of papers published in 1992 James Renegar improved this to a singly exponential dependence on ${\displaystyle n}$,[8][13][14][15]

${\displaystyle L\log L\log \log L(md)^{O(n)}.}$

In the meantime, in 1988, John Canny described another algorithm that also has exponential time dependence, but only polynomial space complexity; that is, he showed that the problem could be solved in PSPACE.[2][9]

The asymptotic computational complexity of these algorithms may be misleading, because in practice they can only be run on inputs of very small size. In a 1991 comparison, Hoon Hong estimated that Collins' doubly exponential procedure would be able to solve a problem whose size is described by setting all the above parameters to 2, in less than a second, whereas the algorithms of Grigoriev, Vorbjov, and Renegar would instead take more than a million years.[8] In 1993, Joos, Roy, and Solernó suggested that it should be possible to make small modifications to the exponential-time procedures to make them faster in practice than cylindrical algebraic decision, as well as faster in theory.[16] However, as of 2009, it was still the case that general methods for the first-order theory of the reals remained superior in practice to the singly exponential algorithms specialized to the existential theory of the reals.[3]

Complete problems

Several problems in computational complexity and geometric graph theory may be classified as complete for the existential theory of the reals. That is, every problem in the existential theory of the reals has a polynomial-time many-one reduction to an instance of one of these problems, and in turn these problems are reducible to the existential theory of the reals.[4][17]

A number of problems of this type concern the recognition of intersection graphs of a certain type. In these problems, the input is an undirected graph; the goal is to determine whether geometric shapes from a certain class of shapes can be associated with the vertices of the graph in such a way that two vertices are adjacent in the graph if and only if their associated shapes have a non-empty intersection. Problems of this type that are complete for the existential theory of the reals include recognition of intersection graphs of line segments in the plane,[4][18][5] recognition of unit disk graphs,[19] and recognition of intersection graphs of convex sets in the plane.[4]

For graphs drawn in the plane without crossings, Fáry's theorem states that one gets the same class of planar graphs regardless of whether the edges of the graph are drawn as straight line segments or as arbitrary curves. But this equivalence does not hold true for other types of drawing. For instance, although the crossing number of a graph (the minimum number of crossings in a drawing with arbitrarily curved edges) may be determined in NP, it is complete for the existential theory of the reals to determine whether there exists a drawing achieving a given bound on the rectilinear crossing number (the minimum number of pairs of edges that cross in any drawing with edges drawn as straight line segments in the plane).[4][20] It is also complete for the existential theory of the reals to test whether a given graph can be drawn in the plane with straight line edges and with a given set of edge pairs as its crossings, or equivalently, whether a curved drawing with crossings can be straightened in a way that preserves its crossings.[21]

Other complete problems for the existential theory of the reals include:

• the art gallery problem of finding the smallest number of points from which all points of a given polygon are visible.[22]
• the packing problem of deciding whether a given set of polygons can fit in a given square container.[23]
• recognition of unit distance graphs, and testing whether the dimension or Euclidean dimension of a graph is at most a given value.[9]
• stretchability of pseudolines (that is, given a family of curves in the plane, determining whether they are homeomorphic to a line arrangement);[4][24][25]
• both weak and strong satisfiability of geometric quantum logic in any fixed dimension >2;[26]
• Model checking interval Markov chains with respect to unambiguous automata[27]
• the algorithmic Steinitz problem (given a lattice, determine whether it is the face lattice of a convex polytope), even when restricted to 4-dimensional polytopes;[28][29]
• realization spaces of arrangements of certain convex bodies[30]
• various properties of Nash equilibria of multi-player games[31][32][33]
• embedding a given abstract complex of triangles and quadrilaterals into three-dimensional Euclidean space;[17]
• embedding multiple graphs on a shared vertex set into the plane so that all the graphs are drawn without crossings;[17]
• recognizing the visibility graphs of planar point sets;[17]
• (projective or non-trivial affine) satisfiability of an equation between two terms over the cross product;[34]
• determining the minimum slope number of a non-crossing drawing of a planar graph.[35]

Based on this, the complexity class ${\displaystyle \exists \mathbb {R} }$ has been defined as the set of problems having a polynomial-time many-one reduction to the existential theory of the reals.[4]

References

1. Basu, Saugata; Pollack, Richard; Roy, Marie-Françoise (2006), "Existential theory of the reals", Algorithms in Real Algebraic Geometry, Algorithms and Computation in Mathematics, 10 (2nd ed.), Springer-Verlag, pp. 505–532, doi:10.1007/3-540-33099-2_14, ISBN 978-3-540-33098-1.
2. Canny, John (1988), "Some algebraic and geometric computations in PSPACE", Proceedings of the Twentieth Annual ACM Symposium on Theory of Computing (STOC '88, Chicago, Illinois, USA), New York, NY, USA: ACM, pp. 460–467, doi:10.1145/62212.62257, ISBN 0-89791-264-0.
3. Passmore, Grant Olney; Jackson, Paul B. (2009), "Combined decision techniques for the existential theory of the reals", Intelligent Computer Mathematics: 16th Symposium, Calculemus 2009, 8th International Conference, MKM 2009, Held as Part of CICM 2009, Grand Bend, Canada, July 6-12, 2009, Proceedings, Part II, Lecture Notes in Computer Science, 5625, Springer-Verlag, pp. 122–137, doi:10.1007/978-3-642-02614-0_14.
4. Schaefer, Marcus (2010), "Complexity of some geometric and topological problems" (PDF), Graph Drawing, 17th International Symposium, GD 2009, Chicago, IL, USA, September 2009, Revised Papers, Lecture Notes in Computer Science, 5849, Springer-Verlag, pp. 334–344, doi:10.1007/978-3-642-11805-0_32.
5. Matoušek, Jiří (2014), Intersection graphs of segments and ${\displaystyle \exists \mathbb {R} }$, arXiv:1406.2636, Bibcode:2014arXiv1406.2636M
6. Tarski, Alfred (1948), A Decision Method for Elementary Algebra and Geometry, RAND Corporation, Santa Monica, Calif., MR 0028796.
7. Matiyasevich, Yu. V. (2006), "Hilbert's tenth problem: Diophantine equations in the twentieth century", Mathematical events of the twentieth century, Berlin: Springer-Verlag, pp. 185–213, doi:10.1007/3-540-29462-7_10, MR 2182785.
8. Hong, Hoon (September 11, 1991), Comparison of Several Decision Algorithms for the Existential Theory of the Reals, Technical Report, 91-41, RISC Linz.
9. Schaefer, Marcus (2013), "Realizability of graphs and linkages", in Pach, János (ed.), Thirty Essays on Geometric Graph Theory, Springer-Verlag, pp. 461–482, doi:10.1007/978-1-4614-0110-0_24.
10. Collins, George E. (1975), "Quantifier elimination for real closed fields by cylindrical algebraic decomposition", Automata theory and formal languages (Second GI Conf., Kaiserslautern, 1975), Lecture Notes in Computer Science, 33, Berlin: Springer-Verlag, pp. 134–183, MR 0403962.
11. Grigor'ev, D. Yu. (1988), "Complexity of deciding Tarski algebra", Journal of Symbolic Computation, 5 (1–2): 65–108, doi:10.1016/S0747-7171(88)80006-3, MR 0949113.
12. Grigor'ev, D. Yu.; Vorobjov, N. N., Jr. (1988), "Solving systems of polynomial inequalities in subexponential time", Journal of Symbolic Computation, 5 (1–2): 37–64, doi:10.1016/S0747-7171(88)80005-1, MR 0949112.
13. Renegar, James (1992), "On the computational complexity and geometry of the first-order theory of the reals. I. Introduction. Preliminaries. The geometry of semi-algebraic sets. The decision problem for the existential theory of the reals", Journal of Symbolic Computation, 13 (3): 255–299, doi:10.1016/S0747-7171(10)80003-3, MR 1156882.
14. Renegar, James (1992), "On the computational complexity and geometry of the first-order theory of the reals. II. The general decision problem. Preliminaries for quantifier elimination", Journal of Symbolic Computation, 13 (3): 301–327, doi:10.1016/S0747-7171(10)80004-5, MR 1156883.
15. Renegar, James (1992), "On the computational complexity and geometry of the first-order theory of the reals. III. Quantifier elimination", Journal of Symbolic Computation, 13 (3): 329–352, doi:10.1016/S0747-7171(10)80005-7, MR 1156884.
16. Heintz, Joos; Roy, Marie-Françoise; Solernó, Pablo (1993), "On the theoretical and practical complexity of the existential theory of reals", The Computer Journal, 36 (5): 427–431, doi:10.1093/comjnl/36.5.427, MR 1234114.
17. Cardinal, Jean (December 2015), "Computational geometry column 62", SIGACT News, 46 (4): 69–78, arXiv:cs/0010039, doi:10.1145/2852040.2852053.
18. Kratochvíl, Jan; Matoušek, Jiří (1994), "Intersection graphs of segments", Journal of Combinatorial Theory, Series B, 62 (2): 289–315, doi:10.1006/jctb.1994.1071, MR 1305055.
19. Kang, Ross J.; Müller, Tobias (2011), "Sphere and dot product representations of graphs", Proceedings of the Twenty-Seventh Annual Symposium on Computational Geometry (SCG'11), June 13–15, 2011, Paris, France, pp. 308–314.
20. Bienstock, Daniel (1991), "Some provably hard crossing number problems", Discrete and Computational Geometry, 6 (5): 443–459, doi:10.1007/BF02574701, MR 1115102.
21. Kynčl, Jan (2011), "Simple realizability of complete abstract topological graphs in P", Discrete and Computational Geometry, 45 (3): 383–399, doi:10.1007/s00454-010-9320-x, MR 2770542.
22. Abrahamsen, Mikkel; Adamaszek, Anna; Miltzow, Tillmann (2017), The Art Gallery Problem is ${\displaystyle \exists \mathbb {R} }$-complete, arXiv:1704.06969, Bibcode:2017arXiv170406969A.
23. Abrahamsen, Mikkel; Miltzow, Tillmann; Nadja, Seiferth (2020), Framework for ${\displaystyle \exists \mathbb {R} }$-Completeness of Two-Dimensional Packing Problems, arXiv:2004.07558.
24. Mnëv, N. E. (1988), "The universality theorems on the classification problem of configuration varieties and convex polytopes varieties", Topology and geometry—Rohlin Seminar, Lecture Notes in Mathematics, 1346, Berlin: Springer-Verlag, pp. 527–543, doi:10.1007/BFb0082792, MR 0970093.
25. Shor, Peter W. (1991), "Stretchability of pseudolines is NP-hard", Applied Geometry and Discrete Mathematics, DIMACS Series in Discrete Mathematics and Theoretical Computer Science, 4, Providence, RI: American Mathematical Society, pp. 531–554, MR 1116375.
26. Herrmann, Christian; Ziegler, Martin (2016), "Computational Complexity of Quantum Satisfiability", Journal of the ACM, 63, doi:10.1145/2869073.
27. Benedikt, Michael; Lenhardt, Rastislav; Worrell, James (2013), "LTL Model Checking of Interval Markov Chains", Tools and Algorithms for the Construction and Analysis of Systems. TACAS 2013, Lecture Notes in Computer Science, 7795, pp. 32–46, doi:10.1007/978-3-642-36742-7_3
28. Björner, Anders; Las Vergnas, Michel; Sturmfels, Bernd; White, Neil; Ziegler, Günter M. (1993), Oriented Matroids, Encyclopedia of Mathematics and its Applications, 46, Cambridge: Cambridge University Press, Corollary 9.5.10, p. 407, ISBN 0-521-41836-4, MR 1226888.
29. Richter-Gebert, Jürgen; Ziegler, Günter M. (1995), "Realization spaces of 4-polytopes are universal", Bulletin of the American Mathematical Society, New Series, 32 (4): 403–412, arXiv:math/9510217, doi:10.1090/S0273-0979-1995-00604-X, MR 1316500.
30. Dobbins, Michael Gene; Holmsen, Andreas; Hubard, Alfredo (2014). "Realization spaces of arrangements of convex bodies". arXiv:1412.0371..
31. Garg, Jugal; Mehta, Ruta; Vazirani, Vijay V.; Yazdanbod, Sadra (2015), "ETR-Completeness for Decision Versions of Multi-player (Symmetric) Nash Equilibria", Proc. 42nd International Colloquium on Automata, Languages, and Programming (ICALP), Lecture Notes in Computer Science, 9134, Springer, pp. 554–566, doi:10.1007/978-3-662-47672-7_45.
32. Bilo, Vittorio; Mavronicolas, Marios (2016), "A Catalog of ETR-Complete Decision Problems about Nash Equilibria in Multi-Player Games", Proceedings of 33rd International Symposium on Theoretical Aspects of Computer Science, LIPIcs, Schloss Dagstuhl--Leibnitz Zentrum fuer Informatik, pp. 17:1–17:13, doi:10.4230/LIPIcs.STACS.2016.17.
33. Bilo, Vittorio; Mavronicolas, Marios (2017), "ETR-Complete Decision Problems about Symmetric Nash Equilibria in Symmetric Multi-Player Games", Proceedings of 34th International Symposium on Theoretical Aspects of Computer Science, LIPIcs, Schloss Dagstuhl--Leibnitz Zentrum fuer Informatik, pp. 13:1–13:14.
34. Herrmann, Christian; Sokoli, Johanna; Ziegler, Martin (2013), "Satisfiability of cross product terms is complete for real nondeterministic polytime Blum-Shub-Smale machines", Proceedings of the 6th Conference on Machines, Computations and Universality (MCU'13), doi:10.4204/EPTCS.128.
35. Hoffmann, Udo (2016), "The planar slope number", Proceedings of the 28th Canadian Conference on Computational Geometry (CCCG 2016).