State complexity

State complexity is an area of theoretical computer science dealing with the size of abstract automata, such as different kinds of finite automata. The classical result in the area is that simulating an ${\displaystyle n}$-state nondeterministic finite automaton by a deterministic finite automaton requires exactly ${\displaystyle 2^{n}}$ states in the worst case.

Transformation between variants of finite automata

Finite automata can be deterministic and nondeterministic, one-way (DFA, NFA) and two-way (2DFA, 2NFA). Other related classes are unambiguous (UFA), self-verifying (SVFA) and alternating (AFA) finite automata. These automata can also be two-way (2UFA, 2SVFA, 2AFA).

All these machines can accept exactly the regular languages. However, the size of different types of automata necessary to accept the same language (measured in the number of their states) may be different. For any two types of finite automata, the state complexity tradeoff between them is an integer function ${\displaystyle f}$ where ${\displaystyle f(n)}$ is the least number of states in automata of the second type sufficient to recognize every language recognized by an ${\displaystyle n}$-state automaton of the first type. The following results are known.

• NFA to DFA: ${\displaystyle 2^{n}}$ states. This is the subset construction by Rabin and Scott,[1] proved optimal by Lupanov.[2]

• UFA to DFA: ${\displaystyle 2^{n}}$ states, see Leung,[3] An earlier lower bound by Schmidt[4] was smaller.
• NFA to UFA: ${\displaystyle 2^{n}-1}$ states, see Leung.[3] There was an earlier smaller lower bound by Schmidt.[4]
• SVFA to DFA: ${\displaystyle \Theta (3^{n/3})}$ states, see Jirásková and Pighizzini[5]
• 2DFA to DFA: ${\displaystyle n(n^{n}-(n-1)^{n})}$ states, see Kapoutsis.[6] Earlier construction by Shepherdson[7] used more states, and an earlier lower bound by Moore[8] was smaller.
• 2DFA to NFA: ${\displaystyle {\binom {2n}{n+1}}=O({\frac {4^{n}}{\sqrt {n}}})}$, see Kapoutsis.[6] Earlier construction by Birget [9] used more states.
• 2NFA to NFA: ${\displaystyle {\binom {2n}{n+1}}}$, see Kapoutsis.[6]
  • 2NFA to NFA accepting the complement: ${\displaystyle O(4^{n})}$ states, see Vardi.[10]
• AFA to DFA: ${\displaystyle 2^{2^{n}}}$ states, see Chandra, Kozen and Stockmeyer.[11]
• AFA to NFA: ${\displaystyle 2^{n}}$ states, see Fellah, Jürgensen and Yu.[12]
• 2AFA to DFA: ${\displaystyle 2^{n2^{n}}}$, see Ladner, Lipton and Stockmeyer.[13]
• 2AFA to NFA: ${\displaystyle 2^{\Theta (n\log n)}}$, see Geffert and Okhotin.[14]

The 2DFA vs. 2NFA problem and logarithmic space

Unsolved problem in computer science: Does every ${\displaystyle n}$-state 2NFA have an equivalent ${\displaystyle \operatorname {poly} (n)}$-state 2DFA? (more unsolved problems in computer science)

It is an open problem whether all 2NFAs can be converted to 2DFAs with polynomially many states, i.e. whether there is a polynomial ${\displaystyle p(n)}$ such that for every ${\displaystyle n}$-state 2NFA there exists a ${\displaystyle p(n)}$-state 2DFA. The problem was raised by Sakoda and Sipser,[15] who compared it to the P vs. NP problem in the computational complexity theory. Berman and Lingas[16] discovered a formal relation between this problem and the L vs. NL open problem. This relation was further elaborated by Kapoutsis.[17]

State complexity of operations for finite automata

Given a binary regularity-preserving operation on languages ${\displaystyle \circ }$ and a family of automata X (DFA, NFA, etc.), the state complexity of ${\displaystyle \circ }$ is an integer function ${\displaystyle f(m,n)}$ such that

• for each m-state X-automaton A and n-state X-automaton B there is an ${\displaystyle f(m,n)}$-state X-automaton for ${\displaystyle L(A)\circ L(B)}$, and
• for all integers m, n there is an m-state X-automaton A and an n-state X-automaton B such that every X-automaton for ${\displaystyle L(A)\circ L(B)}$ must have at least ${\displaystyle f(m,n)}$ states.

Analogous definition applies for operations with any number of arguments.

The first results on state complexity of operations for DFAs were published by Maslov [18] and by Yu, Zhuang and Salomaa. [19] Holzer and Kutrib [20] pioneered the state complexity of operations on NFA. The known results for basic operations are listed below.

Union

If language ${\displaystyle L_{1}}$ requires m states and language ${\displaystyle L_{2}}$ requires n states, how many states ${\displaystyle L_{1}\cup L_{2}}$ requires?

• DFA: ${\displaystyle mn}$ states, see Maslov[18] and Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle m+n+1}$ states, see Holzer and Kutrib.[20]
• UFA: between ${\displaystyle mn+m+n}$ and ${\displaystyle O(n2^{0.79m})}$ states, see Jirásek, Jirásková and Šebej.[21]
• SVFA: ${\displaystyle mn}$ states, see Jirásek, Jirásková and Szabari.[22]
• 2DFA: between ${\displaystyle m+n}$ and ${\displaystyle 4m+n+4}$ states, see Kunc and Okhotin.[23]
• 2NFA: ${\displaystyle m+n}$ states, see Kunc and Okhotin.[24]

Intersection

How many states ${\displaystyle L_{1}\cap L_{2}}$ requires?

• DFA: ${\displaystyle mn}$ states, see Maslov[18] and Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle mn}$ states, see Holzer and Kutrib.[20]
• UFA: ${\displaystyle mn}$ states, see Jirásek, Jirásková and Šebej.[21]
• SVFA: ${\displaystyle mn}$ states, see Jirásek, Jirásková and Szabari.[22]
• 2DFA: between ${\displaystyle m+n}$ and ${\displaystyle m+n+1}$ states, see Kunc and Okhotin.[23]
• 2NFA: between ${\displaystyle m+n}$ and ${\displaystyle m+n+1}$ states, see Kunc and Okhotin.[24]

Complementation

If language L requires n states then how many states its complement requires?

• DFA: ${\displaystyle n}$ states, by exchanging accepting and rejecting states.
• NFA: ${\displaystyle 2^{n}}$ states, see Birget.[25]
• UFA: at least ${\displaystyle n^{2-o(1)}}$ and at most ${\displaystyle O(2^{0.79n})}$ states, see Okhotin[26] for the lower bound and Jirásek, Jirásková and Šebej[21] for the upper bound. Raskin[27] recently proved a superpolynomial lower bound.
• SVFA: ${\displaystyle n}$ states, by exchanging accepting and rejecting states.
• 2DFA: at least ${\displaystyle n}$ and at most ${\displaystyle 4n}$ states, see Geffert, Mereghetti and Pighizzini.[28]

Concatenation

How many states ${\displaystyle L_{1}L_{2}=\{w_{1}w_{2}\mid w_{1}\in L_{1},w_{2}\in L_{2}\}}$ requires?

• DFA: ${\displaystyle m\cdot 2^{n}-2^{n-1}}$ states, see Maslov [18] and Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle m+n}$ states, see Holzer and Kutrib.[20]
• UFA: ${\displaystyle {\frac {3}{4}}2^{m+n}-1}$ states, see Jirásek, Jirásková and Šebej.[21]
• SVFA: ${\displaystyle \Theta (3^{n/3}2^{m})}$ states, see Jirásek, Jirásková and Szabari.[22]
• 2DFA: at least ${\displaystyle {\frac {2^{\Omega (n)}}{\log m}}}$ and at most ${\displaystyle 2m^{m+1}\cdot 2^{n^{n+1}}}$ states, see Jirásková and Okhotin.[29]

Kleene star

• DFA: ${\displaystyle {\frac {3}{4}}2^{n}}$ states, see Maslov[18] and Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle n+1}$ states, see Holzer and Kutrib.[20]
• UFA: ${\displaystyle {\frac {3}{4}}2^{n}}$ states, see Jirásek, Jirásková and Šebej.[21]
• SVFA: ${\displaystyle {\frac {3}{4}}2^{n}}$ states, see Jirásek, Jirásková and Szabari.[22]
• 2DFA: at least ${\displaystyle {\frac {1}{n}}2^{{\frac {n}{2}}-1}}$ and at most ${\displaystyle 2^{O(n^{n+1})}}$ states, see Jirásková and Okhotin.[29]

Reversal

• DFA: ${\displaystyle 2^{n}}$ states, see Mirkin,[30] Leiss,[31] and Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle n+1}$ states, see Holzer and Kutrib.[20]
• UFA: ${\displaystyle n}$ states.
• SVFA: ${\displaystyle 2n+1}$ states, see Jirásek, Jirásková and Szabari.[22]
• 2DFA: between ${\displaystyle n+1}$ and ${\displaystyle n+2}$ states, see Jirásková and Okhotin.[29]

Finite automata over a unary alphabet

State complexity of finite automata with a one-letter (unary) alphabet, pioneered by Chrobak,[32] is different from the multi-letter case.

Let ${\displaystyle g(n)=e^{\Theta ({\sqrt {n\ln n}})}}$ be Landau's function.

Transformation between models

For a one-letter alphabet, transformations between different types of finite automata are sometimes more efficient than in the general case.

• NFA to DFA: ${\displaystyle g(n)+O(n^{2})}$ states, see Chrobak.[32]
• 2DFA to DFA: ${\displaystyle g(n)+O(n)}$ states, see Chrobak[32] and Kunc and Okhotin.[33]
• 2NFA to DFA: ${\displaystyle O(g(n))}$ states, see Mereghetti and Pighizzini.[34] and Geffert, Mereghetti and Pighizzini.[35]
• NFA to 2DFA: at most ${\displaystyle O(n^{2})}$ states, see Chrobak.[32]
• 2NFA to 2DFA: at most ${\displaystyle n^{O(\log n)}}$ states, proved by implementing the method of Savitch's theorem, see Geffert, Mereghetti and Pighizzini.[35]
• UFA to DFA: ${\displaystyle e^{\Theta ({\sqrt[{3}]{n(\ln n)^{2}}})}}$, see Okhotin.[26]
• NFA to UFA: ${\displaystyle g(n)+O(n^{2})}$, see Okhotin.[26]

Union

• DFA: ${\displaystyle mn}$ states, see Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle m+n+1}$ states, see Holzer and Kutrib.[20]
• 2DFA: between ${\displaystyle m+n}$ and ${\displaystyle 2m+n+4}$ states, see Kunc and Okhotin.[23]
• 2NFA: ${\displaystyle m+n}$ states, see Kunc and Okhotin.[24]

Intersection

• DFA: ${\displaystyle mn}$ states, see Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle mn}$ states, see Holzer and Kutrib.[20]
• 2DFA: between ${\displaystyle m+n}$ and ${\displaystyle m+n+1}$ states, see Kunc and Okhotin.[23]
• 2NFA: between ${\displaystyle m+n}$ and ${\displaystyle m+n+1}$ states, see Kunc and Okhotin.[24]

Complementation

• DFA: ${\displaystyle n}$ states.
• NFA: ${\displaystyle g(n)+O(n^{2})}$ states, Holzer and Kutrib.[20]
• UFA: at least ${\displaystyle n^{2-o(1)}}$ and at most ${\displaystyle e^{\Theta ({\sqrt[{3}]{n(\ln n)^{2}}})}}$ states, see Okhotin.[26]
• 2DFA: at least ${\displaystyle n}$ and at most ${\displaystyle 2n+3}$ states, see Kunc and Okhotin.[23]
• 2NFA: at least ${\displaystyle n}$ and at most ${\displaystyle O(n^{8})}$ states. The upper bound is by implementing the method of the Immerman–Szelepcsényi theorem, see Geffert, Mereghetti and Pighizzini.[28]

Concatenation

• DFA: ${\displaystyle mn}$ states, see Yu, Zhuang and Salomaa.[19]
• NFA: between ${\displaystyle m+n-1}$ and ${\displaystyle m+n}$ states, see Holzer and Kutrib.[20]
• 2DFA: ${\displaystyle e^{\Theta ({\sqrt {(m+n)\log(m+n)}})}}$ states, see Kunc and Okhotin.[23]
• 2NFA: ${\displaystyle e^{\Theta ({\sqrt {(m+n)\log(m+n)}})}}$ states, see Kunc and Okhotin.[23]

Kleene star

• DFA: ${\displaystyle (n-1)^{2}+1}$ states, see Yu, Zhuang and Salomaa.[19]
• NFA: ${\displaystyle n+1}$ states, see Holzer and Kutrib.[20]
• UFA: ${\displaystyle (n-1)^{2}+1}$ states, see Okhotin.[26]
• 2DFA: ${\displaystyle \Theta ((g(n))^{2})}$ states, see Kunc and Okhotin.[23]
• 2NFA: ${\displaystyle \Theta (g(n))}$ states, see Kunc and Okhotin.[23]

Further reading

Surveys of state complexity were written by Holzer and Kutrib[36][37] and by Gao et al.[38]

New research on state complexity is commonly presented at the annual workshops on Descriptional Complexity of Formal Systems (DCFS), at the Conference on Implementation and Application of Automata (CIAA), and at various conferences on theoretical computer science in general.

References

1. Rabin, M. O.; Scott, D. (1959). "Finite Automata and Their Decision Problems". IBM Journal of Research and Development. 3 (2): 114–125. doi:10.1147/rd.32.0114. ISSN 0018-8646.
2. Lupanov, Oleg B. (1963). "A comparison of two types of finite sources". Problemy Kibernetiki. 9: 321–326.
3. Leung, Hing (2005). "Descriptional complexity of NFA of different ambiguity". International Journal of Foundations of Computer Science. 16 (5): 975–984. doi:10.1142/S0129054105003418. ISSN 0129-0541.
4. Schmidt, Erik M. (1978). Succinctness of Description of Context-Free, Regular and Unambiguous Languages (Ph.D.). Cornell University.
5. Jirásková, Galina; Pighizzini, Giovanni (2011). "Optimal simulation of self-verifying automata by deterministic automata". Information and Computation. 209 (3): 528–535. doi:10.1016/j.ic.2010.11.017. ISSN 0890-5401.
6. Kapoutsis, Christos (2005). "Removing Bidirectionality from Nondeterministic Finite Automata". Mathematical Foundations of Computer Science 2005. Lecture Notes in Computer Science. 3618. pp. 544–555. doi:10.1007/11549345_47. ISBN 978-3-540-28702-5. ISSN 0302-9743.
7. Shepherdson, J. C. (1959). "The Reduction of Two-Way Automata to One-Way Automata". IBM Journal of Research and Development. 3 (2): 198–200. doi:10.1147/rd.32.0198. ISSN 0018-8646.
8. Moore, F.R. (1971). "On the Bounds for State-Set Size in the Proofs of Equivalence Between Deterministic, Nondeterministic, and Two-Way Finite Automata". IEEE Transactions on Computers. C-20 (10): 1211–1214. doi:10.1109/T-C.1971.223108. ISSN 0018-9340.
9. Birget, Jean-Camille (1993). "State-complexity of finite-state devices, state compressibility and incompressibility". Mathematical Systems Theory. 26 (3): 237–269. doi:10.1007/BF01371727. ISSN 0025-5661.
10. Vardi, Moshe Y. (1989). "A note on the reduction of two-way automata to one-way automata". Information Processing Letters. 30 (5): 261–264. CiteSeerX 10.1.1.60.464. doi:10.1016/0020-0190(89)90205-6. ISSN 0020-0190.
11. Chandra, Ashok K.; Kozen, Dexter C.; Stockmeyer, Larry J. (1981). "Alternation". Journal of the ACM. 28 (1): 114–133. doi:10.1145/322234.322243. ISSN 0004-5411.
12. Fellah, A.; Jürgensen, H.; Yu, S. (1990). "Constructions for alternating finite automata∗". International Journal of Computer Mathematics. 35 (1–4): 117–132. doi:10.1080/00207169008803893. ISSN 0020-7160.
13. Ladner, Richard E.; Lipton, Richard J.; Stockmeyer, Larry J. (1984). "Alternating Pushdown and Stack Automata". SIAM Journal on Computing. 13 (1): 135–155. doi:10.1137/0213010. ISSN 0097-5397.
14. Geffert, Viliam; Okhotin, Alexander (2014). Transforming Two-Way Alternating Finite Automata to One-Way Nondeterministic Automata. Lecture Notes in Computer Science. 8634. pp. 291–302. doi:10.1007/978-3-662-44522-8_25. ISBN 978-3-662-44521-1. ISSN 0302-9743.
15. Sakoda, William J.; Sipser, Michael (1978). Nondeterminism and the Size of Two Way Finite Automata. STOC 1978. ACM. pp. 275–286. doi:10.1145/800133.804357.
16. Berman, Piotr; Lingas, Andrzej (1977). On the complexity of regular languages in terms of finite automata. Report 304. Polish Academy of Sciences.
17. Kapoutsis, Christos A. (2014). "Two-Way Automata Versus Logarithmic Space". Theory of Computing Systems. 55 (2): 421–447. doi:10.1007/s00224-013-9465-0.
18. Maslov, A. N. (1970). "Estimates of the number of states of finite automata". Soviet Mathematics - Doklady. 11: 1373–1375.
19. Yu, Sheng; Zhuang, Qingyu; Salomaa, Kai (1994). "The state complexities of some basic operations on regular languages". Theoretical Computer Science. 125 (2): 315–328. doi:10.1016/0304-3975(92)00011-F. ISSN 0304-3975.
20. Holzer, Markus; Kutrib, Martin (2003). "Nondeterministic descriptional complexity of regular languages". International Journal of Foundations of Computer Science (Submitted manuscript). 14 (6): 1087–1102. doi:10.1142/S0129054103002199. ISSN 0129-0541.
21. Jirásek, Jozef; Jirásková, Galina; Šebej, Juraj (2016). Operations on Unambiguous Finite Automata. Lecture Notes in Computer Science. 9840. pp. 243–255. doi:10.1007/978-3-662-53132-7_20. ISBN 978-3-662-53131-0. ISSN 0302-9743.
22. Jirásek, Jozef Štefan; Jirásková, Galina; Szabari, Alexander (2015). Computer Science -- Theory and Applications. Lecture Notes in Computer Science. 9139. pp. 231–261. doi:10.1007/978-3-319-20297-6_16. ISBN 978-3-319-20296-9. ISSN 0302-9743.
23. Kunc, Michal; Okhotin, Alexander (2012). "State complexity of operations on two-way finite automata over a unary alphabet". Theoretical Computer Science. 449: 106–118. doi:10.1016/j.tcs.2012.04.010. ISSN 0304-3975.
24. Kunc, Michal; Okhotin, Alexander (2011). "State Complexity of Union and Intersection for Two-way Nondeterministic Finite Automata". Fundamenta Informaticae. 110 (1–4): 231–239. doi:10.3233/FI-2011-540.
25. Birget, Jean-Camille (1993). "Partial orders on words, minimal elements of regular languages, and state complexity". Theoretical Computer Science. 119 (2): 267–291. doi:10.1016/0304-3975(93)90160-U. ISSN 0304-3975.
26. Okhotin, Alexander (2012). "Unambiguous finite automata over a unary alphabet". Information and Computation. 212: 15–36. doi:10.1016/j.ic.2012.01.003. ISSN 0890-5401.
27. Raskin, Michael (2018). "A superpolynomial lower bound for the size of non-deterministic complement of an unambiguous automaton". Proc. ICALP 2018. pp. 138:1–138:11. doi:10.4230/LIPIcs.ICALP.2018.138.
28. Geffert, Viliam; Mereghetti, Carlo; Pighizzini, Giovanni (2007). "Complementing two-way finite automata". Information and Computation. 205 (8): 1173–1187. doi:10.1016/j.ic.2007.01.008. ISSN 0890-5401.
29. Jirásková, Galina; Okhotin, Alexander (2008). On the State Complexity of Operations on Two-Way Finite Automata. Lecture Notes in Computer Science. 5257. pp. 443–454. doi:10.1007/978-3-540-85780-8_35. ISBN 978-3-540-85779-2. ISSN 0302-9743.
30. Mirkin, Boris G. (1966). "On dual automata". Cybernetics. 2: 6–9. doi:10.1007/bf01072247.
31. Leiss, Ernst (1985). "Succinct representation of regular languages by boolean automata II". Theoretical Computer Science. 38: 133–136. doi:10.1016/0304-3975(85)90215-4. ISSN 0304-3975.
32. Chrobak, Marek (1986). "Finite automata and unary languages". Theoretical Computer Science. 47: 149–158. doi:10.1016/0304-3975(86)90142-8. ISSN 0304-3975.
33. Kunc, Michal; Okhotin, Alexander (2011). Developments in Language Theory. Lecture Notes in Computer Science. 6795. pp. 324–336. CiteSeerX 10.1.1.616.8835. doi:10.1007/978-3-642-22321-1_28. ISBN 978-3-642-22320-4. ISSN 0302-9743.
34. Mereghetti, Carlo; Pighizzini, Giovanni (2001). "Optimal Simulations between Unary Automata". SIAM Journal on Computing. 30 (6): 1976–1992. doi:10.1137/S009753979935431X. ISSN 0097-5397.
35. Geffert, Viliam; Mereghetti, Carlo; Pighizzini, Giovanni (2003). "Converting two-way nondeterministic unary automata into simpler automata". Theoretical Computer Science. 295 (1–3): 189–203. doi:10.1016/S0304-3975(02)00403-6. ISSN 0304-3975.
36. Holzer, Markus; Kutrib, Martin (2009). "Nondeterministic finite automata — recent results on the descriptional and computational complexity". International Journal of Foundations of Computer Science. 20 (4): 563–580. doi:10.1142/S0129054109006747. ISSN 0129-0541.
37. Holzer, Markus; Kutrib, Martin (2011). "Descriptional and computational complexity of finite automata—A survey". Information and Computation. 209 (3): 456–470. doi:10.1016/j.ic.2010.11.013. ISSN 0890-5401.
38. Gao, Yuan; Moreira, Nelma; Reis, Rogério; Yu, Sheng (2015). "A Survey on Operational State Complexity". arXiv:1509.03254v1 [cs.FL].