Exact cover
In mathematics, given a collection S of subsets of a set X, an exact cover is a subcollection S* of S such that each element in X is contained in exactly one subset in S*. One says that each element in X is covered by exactly one subset in S*. An exact cover is a kind of cover.
In computer science, the exact cover problem is a decision problem to determine if an exact cover exists. The exact cover problem is NP-complete[1] and is one of Karp's 21 NP-complete problems.[2] The exact cover problem is a kind of constraint satisfaction problem.
An exact cover problem can be represented by an incidence matrix or a bipartite graph.
Knuth's Algorithm X is an algorithm that finds all solutions to an exact cover problem. DLX is the name given to Algorithm X when it is implemented efficiently using Donald Knuth's Dancing Links technique on a computer.[3]
The standard exact cover problem can be generalized slightly to involve not only "exactly one" constraints but also "at-most-one" constraints.
Finding Pentomino tilings and solving Sudoku are noteworthy examples of exact cover problems. The n queens problem is a slightly generalized exact cover problem.
Formal definition
Given a collection S of subsets of a set X, an exact cover of X is a subcollection S* of S that satisfies two conditions:
- The intersection of any two distinct subsets in S* is empty, i.e., the subsets in S* are pairwise disjoint. In other words, each element in X is contained in at most one subset in S*.
- The union of the subsets in S* is X, i.e., the subsets in S* cover X. In other words, each element in X is contained in at least one subset in S*.
In short, an exact cover is "exact" in the sense that each element in X is contained in exactly one subset in S*.
Equivalently, an exact cover of X is a subcollection S* of S that partitions X.
For an exact cover of X to exist, it is necessary that:
- The union of the subsets in S is X. In other words, each element in X is contained in at least one subset in S.
If the empty set ∅ is contained in S, then it makes no difference whether or not it is in any exact cover. Thus it is typical to assume that:
- The empty set is not in S*. In other words, each subset in S* contains at least one element.
Basic examples
Let S = {N, O, P, E} be a collection of subsets of a set X = {1, 2, 3, 4} such that:
- N = { },
- O = {1, 3},
- P = {2, 3}, and
- E = {2, 4}.
The subcollection {O, E} is an exact cover of X, since the subsets O = {1, 3} and E = {2, 4} are disjoint and their union is X = {1, 2, 3, 4}.
The subcollection {N, O, E} is also an exact cover of X. Including the empty set N = { } makes no difference, as it is disjoint with all subsets and does not change the union.
The subcollection {E, P} is not an exact cover of X. The intersection of the subsets E and P, {2}, is not empty: The subsets E and P are not disjoint. Moreover, the union of the subsets E and P, {2, 3, 4}, is not X = {1, 2, 3, 4}: Neither E nor P covers the element 1.
On the other hand, there is no exact cover—indeed, not even a cover—of Y = {1, 2, 3, 4, 5} because is a proper subset of Y: None of the subsets in S contains the element 5.
Detailed example
Let S = {A, B, C, D, E, F} be a collection of subsets of a set X = {1, 2, 3, 4, 5, 6, 7} such that:
- A = {1, 4, 7};
- B = {1, 4};
- C = {4, 5, 7};
- D = {3, 5, 6};
- E = {2, 3, 6, 7}; and
- F = {2, 7}.
Then the subcollection S* = {B, D, F} is an exact cover, since each element in X is contained in exactly one of the subsets:
- B = {1, 4};
- D = {3, 5, 6}; or
- F = {2, 7}.
Moreover, {B, D, F} is the only exact cover, as the following argument demonstrates: Because A and B are the only subsets containing 1, an exact cover must contain A or B, but not both. If an exact cover contains A, then it doesn't contain B, C, E, or F, as each of these subsets has an element in common with A. Then D is the only remaining subset, but the collection {A, D} doesn't cover the element 2. In conclusion, there is no exact cover containing A. On the other hand, if an exact cover contains B, then it doesn't contain A or C, as each of these subsets has an element in common with B. Because D is the only remaining subset containing 5, D must be part of the exact cover. If an exact cover contains D, then it doesn't contain E, as E has an element in common with D. Then F is the only remaining subset, and the collection {B, D, F} is indeed an exact cover. See the example in the article on Knuth's Algorithm X for a matrix-based version of this argument.
Representations
An exact cover problem is defined by the binary relation "contains" between subsets in S and elements in X. There are different equivalent ways to represent this relation.
Standard representation
The standard way to represent the relation "contains" is to list the elements in each subset.
For example, the detailed example above uses this standard representation:
- A = {1, 4, 7};
- B = {1, 4};
- C = {4, 5, 7};
- D = {3, 5, 6};
- E = {2, 3, 6, 7}; and
- F = {2, 7}.
Again, the subcollection S* = {B, D, F} is an exact cover, since each element is contained in exactly one selected subset, as the highlighting makes clear.
Inverse representation
The relation "contains" between subsets and elements can be converted, listing the subsets in which each element is contained.
For example, the relation "contains" in the detailed example above can be represented by listing the subsets each element is contained in:
- 1 is an element of A, B;
- 2 is an element of E, F;
- 3 is an element of D, E;
- 4 is an element of A, B, C;
- 5 is an element of C, D;
- 6 is an element of D, E; and
- 7 is an element of A, C, E, F.
Again, the subcollection S* = {B, D, F} is an exact cover, since each element is contained in exactly one selected subset, as the highlighting makes clear.
When solving an exact cover problem, it is often useful to switch between the standard and inverse representations.
Matrix and hypergraph representations
The relation "contains" can be represented by an incidence matrix.
The matrix includes one row for each subset in S and one column for each element in X. The entry in a particular row and column is 1 if the corresponding subset contains the corresponding element, and is 0 otherwise. As each row represents the elements contained in the corresponding subset and each column represents the subsets containing the corresponding element, an incidence matrix effectively provides both the standard and inverse representations.
In the matrix representation, an exact cover is a selection of rows such that each column contains a 1 in exactly one selected row.
For example, the relation "contains" in the detailed example above can be represented by a 6×7 incidence matrix:[4]
1 2 3 4 5 6 7 A 1 0 0 1 0 0 1 B 1 0 0 1 0 0 0 C 0 0 0 1 1 0 1 D 0 0 1 0 1 1 0 E 0 1 1 0 0 1 1 F 0 1 0 0 0 0 1
Again, the subcollection S* = {B, D, F} is an exact cover, since each element is contained in exactly one selected subset, i.e., each column contains a 1 in exactly one selected row, as the highlighting makes clear.
See the example in the article on Knuth's Algorithm X for a matrix-based solution to the detailed example above.
In turn, the incidence matrix can be seen also as describing a hypergraph. The hypergraph includes one node for each element in X and one edge for each subset in S; each node is included in exactly one of the edges forming the cover.
Graph representation
The relation "contains" can be represented by a bipartite graph.
The vertices of the graph are divided into two disjoint sets, one representing the subsets in S and another representing the elements in X. If a subset contains an element, an edge connects the corresponding vertices in the graph.
In the graph representation, an exact cover is a selection of vertices corresponding to subsets such that each vertex corresponding to an element is connected to exactly one selected vertex.
For example, the relation "contains" in the detailed example above can be represented by a bipartite graph with 6+7 = 13 vertices:
Again, the subcollection S* = {B, D, F} is an exact cover, since each element is contained in exactly one selected subset, i.e., the vertex corresponding to each element in X is connected to exactly one selected vertex, as the highlighting makes clear.
Equivalent problems
Although the canonical exact cover problem involves a collection S of subsets of a set X, the logic does not depend on the presence of subsets containing elements. An "abstract exact cover problem" arises whenever there is a heterogeneous relation between two sets P and Q and the goal is to select a subset P* of P such that each element in Q is related to exactly one element in P*. In general, the elements of P represent choices and the elements of Q represent "exactly one" constraints on those choices.
More formally, given a binary relation R ⊆ P × Q between sets P and Q, one can call a subset P* of P an "abstract exact cover" of Q if each element in Q is RT-related to exactly one element in P*. Here RT is the converse of R.
In general, RT restricted to Q × P* is a function from Q to P*, which maps each element in Q to the unique element in P* that is R-related to that element in Q. This function is onto, unless P* contains the "empty set," i.e., an element which isn't R-related to any element in Q.
In the canonical exact cover problem, P is a collection S of subsets of X, Q is the set X, R is the binary relation "contains" between subsets and elements, and RT restricted to Q × P* is the function "is contained in" from elements to selected subsets.
Exact hitting set
In mathematics, given a collection S of subsets of a set X, an exact hitting set X* is a subset of X such that each subset in S contains exactly one element in X*. One says that each subset in S is hit by exactly one element in X*.
In computer science, the exact hitting set problem is a decision problem to find an exact hitting set or else determine none exists.
The exact hitting set problem is an abstract exact cover problem. In the notation above, P is the set X, Q is a collection S of subsets of X, R is the binary relation "is contained in" between elements and subsets, and R−1 restricted to Q × P* is the function "contains" from subsets to selected elements.
Whereas an exact cover problem involves selecting subsets and the relation "contains" from subsets to elements, an exact hitting set problem involves selecting elements and the relation "is contained in" from elements to subsets. In a sense, an exact hitting set problem is the inverse of the exact cover problem involving the same set and collection of subsets.
Exact hitting set example
As in the detailed exact cover example above, let S = {A, B, C, D, E, F} be a collection of subsets of a set X = {1, 2, 3, 4, 5, 6, 7} such that:
- A = {1, 4, 7};
- B = {1, 4};
- C = {4, 5, 7};
- D = {3, 5, 6};
- E = {2, 3, 6, 7}; and
- F = {2, 7}.
Then X* = {1, 2, 5} is an exact hitting set, since each subset in S contains exactly one element in X*, as the highlighting makes clear.
Moreover, {1, 2, 5} is the only exact hitting set, as the following argument demonstrates: Because 2 and 7 are the only elements that hit F, an exact hitting set must contain 2 or 7, but not both. If an exact hitting set contains 7, then it doesn't contain 1, 2, 3, 4, 5, or 6, as each of these elements are contained in some subset also containing 7. Then there are no more remaining elements, but {7} is not an exactly hitting set, as it doesn't hit B or D. In conclusion, there is no exact hitting set containing 7. On the other hand, if an exact hitting set contains 2, then it doesn't contain 3, 6, or 7, as each of these elements are contained in some subset also containing 2. Because 5 is the only remaining element that hits D, the exact hitting set must contain 5. If an exact hitting set contains 5, then it doesn't contain 4, as both hit C. Because 1 is the only remaining element that hits A, the exact hitting set must contain 1. Then there are no more remaining elements, and {1, 2, 5} is indeed an exact hitting set.
Although this example involves the same collection of subsets as the detailed exact cover example above, it is essentially a different problem. In a sense, the exact hitting set problem is the inverse (or transpose or converse) of the corresponding exact cover problem above, as the matrix representation makes clear:
A B C D E F 1 1 1 0 0 0 0 2 0 0 0 0 1 1 3 0 0 0 1 1 0 4 1 1 1 0 0 0 5 0 0 1 1 0 0 6 0 0 0 1 1 0 7 1 0 1 0 1 1
Dual example
But there is another exact hitting set problem that is essentially the same as the detailed exact cover example above, in which numbered elements become subsets and lettered subsets become elements, effectively inverting the relation between subsets and element.
For example, as the subset B contains the elements 1 and 4 in the exact cover problem, the subsets I and IV contain the element b in the dual exact hitting set problem.
In particular, let S = {I, II, III, IV, V, VI, VII} be a collection of subsets of a set X = {a, b, c, d, e, f} such that:
- I = {a, b}
- II = {e, f}
- III = {d, e}
- IV = {a, b, c}
- V = {c, d}
- VI = {d, e}
- VII = {a, c, e, f}
Then X* = {b, d, f} is an exact hitting set, since each subset in S contains (is hit by) exactly one element in X*, as the highlighting makes clear.
The exact hitting set X* = {b, d, f} here is essentially the same as the exact cover S* = {B, D, F} above, as the matrix representation makes clear:
I II III IV V VI VII a 1 0 0 1 0 0 1 b 1 0 0 1 0 0 0 c 0 0 0 1 1 0 1 d 0 0 1 0 1 1 0 e 0 1 1 0 0 1 1 f 0 1 0 0 0 0 1
Finding solutions
Algorithm X is the name Donald Knuth gave for "the most obvious trial-and-error approach" for finding all solutions to the exact cover problem.[3] Technically, Algorithm X is a recursive, nondeterministic, depth-first, backtracking algorithm.
When Algorithm X is implemented efficiently using Donald Knuth's Dancing Links technique on a computer, Knuth calls it DLX. DLX uses the matrix representation of the problem, implemented as a series of doubly linked lists of the 1s of the matrix: each 1 element has a link to the next 1 above, below, to the left, and to the right of itself. (Technically, because the lists are circular, this forms a torus). Because exact cover problems tend to be sparse, this representation is usually much more efficient in both size and processing time required. DLX then uses the Dancing Links technique to quickly select permutations of rows as possible solutions and to efficiently backtrack (undo) mistaken guesses.[3]
Generalizations
In a standard exact cover problem, each constraint must be satisfied exactly once. It is a simple generalization to relax this requirement slightly and allow for the possibility that some "primary" constraints must be satisfied by exactly one selection but other "secondary" constraints can be satisfied by at most one selection.
As Knuth explains, a generalized exact cover problem can be converted to an equivalent exact cover problem by simply appending one row for each secondary column, containing a single 1 in that column.[5] If in a particular candidate solution a particular secondary column is satisfied, then the added row isn't needed. But if the secondary column isn't satisfied, as is allowed in the generalized problem but not the standard problem, then the added row can be selected to ensure the column is satisfied.
But Knuth goes on to explain that it is better working with the generalized problem directly, because the generalized algorithm is simpler and faster: A simple change to his Algorithm X allows secondary columns to be handled directly.
The N queens problem is an example of a generalized exact cover problem, as the constraints corresponding to the diagonals of the chessboard have a maximum rather than an exact queen count.
Noteworthy examples
Due to its NP-completeness, any problem in NP can be reduced to exact cover problems, which then can be solved with techniques such as Dancing Links. However, for some well known problems, the reduction is particularly direct. For instance, the problem of tiling a board with pentominoes, and solving Sudoku can both be viewed as exact cover problems.
Pentomino tiling
The problem of tiling a 60-square board with the 12 different free pentominoes is an example of an exact cover problem, as Donald Knuth explains in his paper "Dancing links."[3]
For example, consider the problem of tiling with pentominoes an 8×8 chessboard with the 4 central squares removed:
11 12 13 14 15 16 17 18 21 22 23 24 25 26 27 28 31 32 33 34 35 36 37 38 41 42 43 46 47 48 51 52 53 56 57 58 61 62 63 64 65 66 67 68 71 72 73 74 75 76 77 78 81 82 83 84 85 86 87 88
The problem involves two kinds of constraints:
- Pentomino: For each of the 12 pentominoes, there is the constraint that it must be placed exactly once. Name these constraints after the corresponding pentominoes: F I L P N T U V W X Y Z.[6]
- Square: For each of the 60 squares, there is the constraint that it must be covered by a pentomino exactly once. Name these constraints after the corresponding squares in the board: ij, where i is the rank and j is the file.
Thus there are 12+60 = 72 constraints in all.
As both kinds of constraints are "exactly one" constraints, the problem is an exact cover problem.
The problem involves many choices, one for each way to place a pentomino on the board. It is convenient to consider each choice as satisfying a set of 6 constraints: 1 constraint for the pentomino being placed and 5 constraints for the five squares where it is placed.
In the case of an 8×8 chessboard with the 4 central squares removed, there are 1568 such choices, for example:
- {F, 12, 13, 21, 22, 32}
- {F, 13, 14, 22, 23, 33}
- …
- {I, 11, 12, 13, 14, 15}
- {I, 12, 13, 14, 15, 16}
- …
- {L, 11, 21, 31, 41, 42}
- {L, 12, 22, 32, 42, 43}
- …
One of many solutions of this exact cover problem is the following set of 12 choices:
- {I, 11, 12, 13, 14, 15}
- {N, 16, 26, 27, 37, 47}
- {L, 17, 18, 28, 38, 48}
- {U, 21, 22, 31, 41, 42}
- {X, 23, 32, 33, 34, 43}
- {W, 24, 25, 35, 36, 46}
- {P, 51, 52, 53, 62, 63}
- {F, 56, 64, 65, 66, 75}
- {Z, 57, 58, 67, 76, 77}
- {T, 61, 71, 72, 73, 81}
- {V, 68, 78, 86, 87, 88}
- {Y, 74, 82, 83, 84, 85}
This set of choices corresponds to the following solution to the pentomino tiling problem:
A pentomino tiling problem is more naturally viewed as an exact cover problem than an exact hitting set problem, because it is more natural to view each choice as a set of constraints than each constraint as a set of choices.
Each choice relates to just 6 constraints, which are easy to enumerate. On the other hand, each constraint relates to many choices, which are harder to enumerate.
Whether viewed as an exact cover problem or an exact hitting set problem, the matrix representation is the same, having 1568 rows corresponding to choices and 72 columns corresponding to constraints. Each row contains a single 1 in the column identifying the pentomino and five 1s in the columns identifying the squares covered by the pentomino.
Using the matrix, a computer can find all solutions relatively quickly, for example, using Dancing Links.
Sudoku
Main articles: Sudoku, Sudoku solving algorithms
The problem in Sudoku is to assign numbers (or digits, values, symbols) to cells (or squares) in a grid so as to satisfy certain constraints.
In the standard 9×9 Sudoku variant, there are four kinds of constraints:
- Row-Column: Each intersection of a row and column, i.e, each cell, must contain exactly one number.
- Row-Number: Each row must contain each number exactly once
- Column-Number: Each column must contain each number exactly once.
- Box-Number: Each box must contain each number exactly once.
While the first constraint might seem trivial, it is nevertheless needed to ensure there is only one number per cell. Intuitively, placing a number into a cell prohibits placing that number in any other cell sharing the same column, row, or box and also prohibits placing any other number into the now occupied cell.
Solving Sudoku is an exact cover problem.
More precisely, solving Sudoku is an exact hitting set problem, which is equivalent to an exact cover problem, when viewed as a problem to select possibilities such that each constraint set contains (i.e., is hit by) exactly one selected possibility. In the notation above for the (generalized) exact cover problem, X is the set of possibilities, Y is a set of constraint sets, and R is the binary relation "is contained in."
Each possible assignment of a particular number to a particular cell is a possibility (or candidate). When Sudoku is played with pencil and paper, possibilities are often called pencil marks.
In the standard 9×9 Sudoku variant, in which each of 9×9 cells is assigned one of 9 numbers, there are 9×9×9=729 possibilities. Using obvious notation for rows, columns and numbers, the possibilities can be labeled
- R1C1#1, R1C1#2, …, R9C9#9.
The fact that each kind of constraint involves exactly one of something is what makes Sudoku an exact hitting set problem. The constraints can be represented by constraint sets. The problem is to select possibilities such that each constraint set contains (i.e., is hit by) exactly one selected possibility.
In the standard 9×9 Sudoku variant, there are four kinds of constraints sets corresponding to the four kinds of constraints:
- Row-Column: A row-column constraint set contains all the possibilities for the intersection of a particular row and column, i.e., for a cell. For example, the constraint set for row 1 and column 1, which can be labeled R1C1, contains the 9 possibilities for row 1 and column 1 but different numbers:
- R1C1 = { R1C1#1, R1C1#2, R1C1#3, R1C1#4, R1C1#5, R1C1#6, R1C1#7, R1C1#8, R1C1#9 }.
- Row-Number: A row-number constraint set contains all the possibilities for a particular row and number. For example, the constraint set for row 1 and number 1, which can be labeled R1#1, contains the 9 possibilities for row 1 and number 1 but different columns:
- R1#1 = { R1C1#1, R1C2#1, R1C3#1, R1C4#1, R1C5#1, R1C6#1, R1C7#1, R1C8#1, R1C9#1 }.
- Column-Number: A column-number constraint set contains all the possibilities for a particular column and number. For example, the constraint set for column 1 and number 1, which can be labeled C1#1, contains the 9 possibilities for column 1 and number 1 but different rows:
- C1#1 = { R1C1#1, R2C1#1, R3C1#1, R4C1#1, R5C1#1, R6C1#1, R7C1#1, R8C1#1, R9C1#1 }.
- Box-Number: A box-number constraint set contains all the possibilities for a particular box and number. For example, the constraint set for box 1 (in the upper lefthand corner) and number 1, which can be labeled B1#1, contains the 9 possibilities for the cells in box 1 and number 1:
- B1#1 = { R1C1#1, R1C2#1, R1C3#1, R2C1#1, R2C2#1, R2C3#1, R3C1#1, R3C2#1, R3C3#1 }.
Since there are 9 rows, 9 columns, 9 boxes and 9 numbers, there are 9×9=81 row-column constraint sets, 9×9=81 row-number constraint sets, 9×9=81 column-number constraint sets, and 9×9=81 box-number constraint sets: 81+81+81+81=324 constraint sets in all.
In brief, the standard 9×9 Sudoku variant is an exact hitting set problem with 729 possibilities and 324 constraint sets. Thus the problem can be represented by a 729×324 matrix.
Although it is difficult to present the entire 729×324 matrix, the general nature of the matrix can be seen from several snapshots:
|
|
|
|
The complete 729×324 matrix is available from Bob Hanson.
Note that the set of possibilities RxCy#z can be arranged as a 9×9×9 cube in a 3-dimensional space with coordinates x, y, and z. Then each row Rx, column Cy, or number #z is a 9×9×1 "slice" of possibilities; each box Bw is a 9x3×3 "tube" of possibilities; each row-column constraint set RxCy, row-number constraint set Rx#z, or column-number constraint set Cy#z is a 9x1×1 "strip" of possibilities; each box-number constraint set Bw#z is a 3x3×1 "square" of possibilities; and each possibility RxCy#z is a 1x1×1 "cubie" consisting of a single possibility. Moreover, each constraint set or possibility is the intersection of the component sets. For example, R1C2#3 = R1 ∩ C2 ∩ #3, where ∩ denotes set intersection.
Although other Sudoku variations have different numbers of rows, columns, numbers and/or different kinds of constraints, they all involve possibilities and constraint sets, and thus can be seen as exact hitting set problems.
N queens problem
The N queens problem is an example of a generalized exact cover problem.[3] The problem involves four kinds of constraints:
- Rank: For each of the N ranks, there must be exactly one queen.
- File: For each of the N files, there must be exactly one queen.
- Diagonals: For each of the 2N − 1 diagonals, there must be at most one queen.
- Reverse diagonals: For each of the 2N − 1 reverse diagonals, there must be at most one queen.
Note that the 2N rank and file constraints form the primary constraints, while the 4N − 2 diagonal and reverse diagonals form the secondary constraints. Further, because each of first and last diagonal and reverse diagonals involves only one square on the chessboard, these can be omitted and thus one can reduce the number of secondary constraints to 4N − 6. The matrix for the N queens problem then has N2 rows and 6N − 6 columns, each row for a possible queen placement on each square on the chessboard, and each column for each constraint.
See also
- Constraint satisfaction problem
- Dancing Links
- Difference map algorithm
- Hitting set
- Karp's 21 NP-complete problems
- Knuth's Algorithm X
- List of NP-complete problems
- Perfect matching and 3-dimensional matching are special cases of the exact cover problem
References
- M.R. Garey; D.S. Johnson (1979). Computers and Intractability: A Guide to the Theory of NP-Completeness. New York: W.H. Freeman. ISBN 0-7167-1045-5. This book is a classic, developing the theory, then cataloguing many NP-Complete problems.
- Richard M. Karp (1972). "Reducibility among combinatorial problems". In R.E. Miller; J.W. Thatcher (eds.). Complexity of Computer Computations. Proc. of a Symp. on the Complexity of Computer Computations. New York: Plenum. pp. 85–103. ISBN 0-3063-0707-3.
- Knuth, Donald (2000). "Dancing links". arXiv:cs/0011047.
- Donald Knuth in his paper "Dancing Links" gives this example, as equation (3), only with the rows reordered.
- Donald Knuth explains this simple generalization in his paper "Dancing Links," in particular, in explaining the tetrastick and N queens problems.
- Golomb, Solomon W. (1994). Polyominoes: Puzzles, Patterns, Problems, and Packings (2nd ed.). Princeton, New Jersey: Princeton University Press. p. 7. ISBN 0-691-02444-8.
- Dahlke, K. "Exact cover". Math Reference Project. Retrieved 2008-06-21.
External links
- Free Software implementation of an Exact Cover solver in C - uses Algorithm X and Dancing Links. Includes examples for sudoku and logic grid puzzles.
- Exact Cover solver in Golang - uses Algorithm X and Dancing Links. Includes examples for sudoku and n-queens.