constraint models for the covering test problems authors: brahim hnich, steven d. prestwich, evgeny...
Post on 19-Dec-2015
215 views
TRANSCRIPT
1
Constraint Models for the Covering Test ProblemsAuthors: Brahim Hnich, Steven D. Prestwich, Evgeny
Selensky, Barbara M. Smith
Speaker: Pingyu Zhang CSE 990 Advanced Constraint Processing, Fall 2009
2
Outline
• Introduction & background• CSP model
– Naïve model, Alternative model, Integrated model
• Symmetry breaking• Solving the CSP
– Setting up the Ilog Solver, Experiment results
• SAT Model– Model, Experiment results
3
• A combinatorial problem– A machine with 10 switches,
each with two positions– 210 possible combinations to
be tested before shipping!
The Combinatorial Testing Problem
• Real world problems– Software interaction testing– Hardware testing– Testing of advanced materials– Interactions regulating gene expressions
4
Optimization Problem: CA(t,k,g)
• Given– A set of k software ‘components’ to be
tested– Each component can take g different
values (alphabet) – A covering strength t
• Find – the minimum number of tests, b– Such that every combination of t
components appears in some test
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
k=5
b=?
t=3
b=2
5
• Given: CA(t, k, g) of size b: b×k array– k: # of parameters– g: size of the alphabet– t: covering strength: for every subset of t parameters, each value combination appear at least once– Example CA(3, 5, 2), 25=32? b=10 does it!
• Goal: Minimize b – Unfortunately, NP hard
Mathematical Object: Covering Array
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
6
• Challenges– How to model the problem into a CSP?– How to setup a solver?
• The general framework– Step 1: guess a CA size b– Step 2: encode the problem as a CSP and try to solve it– Step 3:
• if the CSP is solvable, reduce b by some value and repeat Steps 1—3 . • If CSP is not solvable, enlarge b by some value and repeat Steps 1—3.
– The smallest solvable b is the optimum size.
How about solving it with CSP
7
Outline
• Introduction & Background• CSP model
– Naïve model, Alternative model, Integrated model
• Symmetry breaking• Solving the CSP
– Setting up the Ilog Solver, Experiment results
• SAT Model– Model, Experiment results
8
• Rows Each variable represents the value of one parameter in one vector: b×k matrix
– Example: k=5 (xi1..5), g=2 (0/1), t=3 (every combination of three parameters), b=5 (a total of 5 combinations/rows)
• How to express constraints?– Every subset of t parameters must be combined in all possible ways
A Naïve Matrix Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
9
• Each variable represent the value of one parameter in one vector: b×k matrix
• How to express constraints?– Every subset of t parameters must be combined in all possible ways– Introduce additional boolean variables
A Naïve Matrix Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 ...
Describes the situation where x1, x2, x3 are assigned 0 at vector 1
10
• Each variable represent the value of one parameter in one vector: b×k matrix
• How to express constraints?– Every subset of t parameters must be combined in all possible ways
A Naïve Matrix Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 ...
x2,123,000 ...
x3,123,000 ...
x4,123,000 ...
x5,123,000 ...
1
11
• Each variable represent the value of one parameter in one vector: b×k matrix
• How to express constraints?– Every subset of t parameters must be combined in all possible ways– Question: How many columns are there for this example?
A Naïve Matrix Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 x1,123,001 ... x1,123,111 x1,124,000 ... x1,345,111x2,123,000 x2,123,001 ... x2,123,111 x2,124,000 ... x2,345,111x3,123,000 x3,123,001 ... x3,123,111 x3,124,000 ... x3,345,111x4,123,000 x4,123,001 ... x4,123,111 x4,124,000 ... x4,345,111x5,123,000 x5,123,001 ... x5,123,111 x5,124,000 ... x5,345,111
12
• Each variable represent the value of one parameter in one vector: b×k matrix
• How to express constraints?– Every subset of t parameters must be combined in all possible ways.– Express coverage constraints over columns (in general, columns)
– Clearly, this is not very efficient…
A Naïve Matrix Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 x1,123,001 ... x1,123,111 x1,124,000 ... x1,345,111x2,123,000 x2,123,001 ... x2,123,111 x2,124,000 ... x2,345,111x3,123,000 x3,123,001 ... x3,123,111 x3,124,000 ... x3,345,111x4,123,000 x4,123,001 ... x4,123,111 x4,124,000 ... x4,345,111x5,123,000 x5,123,001 ... x5,123,111 x5,124,000 ... x5,345,111
1
1
1
1
1
k
t
2t
13
• What did we learn from last model?– Setting up variables is simple and straightforward.– Expressing constraints is cumbersome and introduces numerous
assistant variables.
• Each variable represents a t-tuple in a vector (compound variable), domain is all possible values for the tuple.
Alternative Matrix Model
1,2,3 c1,1c2,1c3,1c4,1c5,1...
1,2,4 c1,2c2,2c3,2c4,2c5,2...
1,2,5 c1,3c2,3c3,3c4,3c5,3...
1,3,4 c1,4c2,4c3,4c4,4c5,4...
1,3,5 c1,5c2,5c3,5c4,5c5,5...
1,4,5 c1,6c2,6c3,6c4,6c5,6...
2,3,4 c1,7c2,7c3,7c4,7c5,7...
2,3,5 c1,8c2,8c3,8c4,8c5,8...
2,4,5 c1,9c2,9c3,9c4,9c5,9...
3,4,5 c1,10c2,10c3,10c4,10c5,10...
Domain of C1,1
Assignments for x1, x2, x3
0 0, 0, 0
1 0, 0, 1
2 0, 1, 0
3 0, 1, 1
4 1, 0, 0
5 1, 0, 1
6 1, 1, 0
7 1, 1, 1
14
1,2,3 0
0
1
2
3
4
5
6
7
7
1,2,4 0
1
0
2
3
4
5
7
6
7
1,2,5 0
1
1
3
2
5
4
6
6
7
1,3,4 0
1
2
0
3
4
7
5
6
7
1,3,5 0
1
3
1
2
5
6
4
6
7
1,4,5 0
3
1
1
2
5
6
6
4
7
2,3,4 0
1
2
4
7
0
3
5
6
7
2,3,5 0
1
3
5
6
1
2
4
6
7
2,4,5 0
3
1
5
6
1
2
6
4
7
3,4,5 0
3
5
1
6
1
6
2
4
7
• How to express constraints?– Now, each column represents all assignments for one specific tuple.– In each column, every number in the range 0 to 2t -1 should appear at
least once, and at most…– Question: How many times each number appears at most in a column?
– Enforcing such a global constraint on each column. ( constraints in total)
Alternative Matrix Model
k
t
15
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 x1,123,001 ... x1,123,111 x1,124,000 ... x1,345,111x2,123,000 x2,123,001 ... x2,123,111 x2,124,000 ... x2,345,111x3,123,000 x3,123,001 ... x3,123,111 x3,124,000 ... x3,345,111x4,123,000 x4,123,001 ... x4,123,111 x4,124,000 ... x4,345,111x5,123,000 x5,123,001 ... x5,123,111 x5,124,000 ... x5,345,111
• Improvement over the last model?
• Are we done?
Alternative Matrix Model
1,2,3 c1,1c2,1c3,1c4,1c5,1...
1,2,4 c1,2c2,2c3,2c4,2c5,2...
1,2,5 c1,3c2,3c3,3c4,3c5,3...
1,3,4 c1,4c2,4c3,4c4,4c5,4...
1,3,5 c1,5c2,5c3,5c4,5c5,5...
1,4,5 c1,6c2,6c3,6c4,6c5,6...
2,3,4 c1,7c2,7c3,7c4,7c5,7...
2,3,5 c1,8c2,8c3,8c4,8c5,8...
2,4,5 c1,9c2,9c3,9c4,9c5,9...
3,4,5 c1,10c2,10c3,10c4,10c5,10...
16
• Intersection Constraints– Values assigned to compound variables in the same vector should be
consistent.– In every row, if two variables share some positions, we impose a
binary constraint stating the allowed pairs of values.
Alternative Matrix Model
1,2,3 c1,1c2,1c3,1c4,1c5,1...
1,2,4 c1,2c2,2c3,2c4,2c5,2...
1,2,5 c1,3c2,3c3,3c4,3c5,3...
1,3,4 c1,4c2,4c3,4c4,4c5,4...
1,3,5 c1,5c2,5c3,5c4,5c5,5...
1,4,5 c1,6c2,6c3,6c4,6c5,6...
2,3,4 c1,7c2,7c3,7c4,7c5,7...
2,3,5 c1,8c2,8c3,8c4,8c5,8...
2,4,5 c1,9c2,9c3,9c4,9c5,9...
3,4,5 c1,10c2,10c3,10c4,10c5,10...
Allowed tuples
(0,0), (0,1), (1,0), (1,1), (2,2), (2,3), (3,2), (3,3), (4,4), (4,5), (5,4), (5,5), (6,6), (6,7), (7,6), (7,7)
17
• How many Intersection Constraints for each row?– For each compound variable, # of variables sharing ONE position is – # of variables sharing TWO positions– Continues until the case of sharing (t-1) positions
• For the CA(3, 5, 2) example– # of variables sharing ONE position is 3 – # of variables sharing TWO positions is 6– 10 variables in each row, (3+6)×10/2 = 45 constraints.
Alternative Matrix Model
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
t k t
t 1
t
2
k t
t 2
18
• How many Intersection Constraints for each row?– Reduction 1: the red constraint is redundant with the conjunction of
the two blue constraints and it can be removed.
– In general, constraints between variables that share fewer than t-1 positions in common, can be removed.
Alternative Matrix Model
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
1,2 1,41
19
• How many Intersection Constraints for each row?– Reduction 2: a clique can be reduced to a path.
– The savings are more obvious if k gets bigger.
Alternative Matrix Model
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
(1, 2, 3)
(1, 2, 7) (1, 2, 4)
(1, 2, 6) (1, 2, 5)
(1, 2, 3)
(1, 2, 7) (1, 2, 4)
(1, 2, 6) (1, 2, 5)
1,21,2
1,2
20
• How many Intersection Constraints for each row?– Apply reduction 1: 45 30
Alternative Matrix Model
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
21
• How many Intersection Constraints for each row?– Apply reduction 1: 45 30
– Apply reduction 2: 30 20
Alternative Matrix Model
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
1,2,3 1,2,4 1,2,5 1,3,4 1,3,5 1,4,5 2,3,4 2,3,5 2,4,5 3,4,5
22
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
x1,123,000 x1,123,001 ... x1,123,111 x1,124,000 ... x1,345,111x2,123,000 x2,123,001 ... x2,123,111 x2,124,000 ... x2,345,111x3,123,000 x3,123,001 ... x3,123,111 x3,124,000 ... x3,345,111x4,123,000 x4,123,001 ... x4,123,111 x4,124,000 ... x4,345,111x5,123,000 x5,123,001 ... x5,123,111 x5,124,000 ... x5,345,111
• Still, the # of intersection constraints is a problem – Why not apply the intersection constraints on the naïve model?
• To summarize so far– Naïve model suffers from # of additional variables.– The alternative model suffers from # of intersection constraints.– Can we combine the strengths together?
Alternative Matrix Model
Implicit connections
23
• Channeling constraint– explicitly express connections between compound variable and its
corresponding t variables in the naïve model.
– There are totally channeling constraints, each with arity t+1.– Enforcing GAC on them leads to assignment of x or domain reduce of c– Eliminate all intersection constraints.
Combining them together: an Integrated Model
x11 x12 x13 x14 x15x21 x22 x23 x24 x25x31 x32 x33 x34 x35x41 x42 x43 x44 x45x51 x52 x53 x54 x55
1,2,3 c1,1c2,1c3,1c4,1c5,1...
1,2,4 c1,2c2,2c3,2c4,2c5,2...
1,2,5 c1,3c2,3c3,3c4,3c5,3...
1,3,4 c1,4c2,4c3,4c4,4c5,4...
1,3,5 c1,5c2,5c3,5c4,5c5,5...
1,4,5 c1,6c2,6c3,6c4,6c5,6...
2,3,4 c1,7c2,7c3,7c4,7c5,7...
2,3,5 c1,8c2,8c3,8c4,8c5,8...
2,4,5 c1,9c2,9c3,9c4,9c5,9...
3,4,5 c1,10c2,10c3,10c4,10c5,10...
Extensionally (0,0,0,0), (1,0,0,1),(2,0,1,0),(3,0,1,1),(4,1,0,0),(5,1,0,1),(6,1,1,0),(7,1,1,1)
Intensionally C1,1=4x11+2x12+x13
k
t
b
24
Outline
• Introduction & Background• CSP model
– Naïve model, Alternative model, Integrated model
• Symmetry breaking• Solving the CSP
– Setting up the Ilog Solver, Experiment results
• SAT Model– Model, Experiment results
25
• CA has both row and column symmetries: any two cols/rows
• Another less obvious symmetry: value symmetry
• Size of the symmetry group: – So we must deal with them!
Symmetry
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
1 1 0 1 0
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
0 0 0 1 1
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
0 0 0 0 0
0 1 0 0 1
0 0 1 0 1
0 0 0 1 1
0 1 1 1 0
1 0 0 0 1
1 1 1 0 0
1 1 0 1 0
1 0 1 1 0
1 1 1 1 1
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
1 1 1 1 1
1 1 1 0 0
1 1 0 1 0
1 0 1 1 0
1 0 0 0 1
0 1 1 1 0
0 1 0 0 1
0 0 1 0 1
0 0 0 1 1
0 0 0 0 0
k!b! g! k
26
• For row and column symmetries– [Flener02] Theorem1: For a matrix model with row and column
symmetry in some 2-d matrix, each symmetry class of assignments has an element where both the rows and the columns of that matrix are lexicographically ordered.
– Naïve model: Impose lexicographical ordering constraints on both rows and columns of the matrix
– Alternative model: rows are the same, columns are not as powerful, but can be help
– Integrated model: can apply lexicographical ordering on either original or alternative matrix, but not both.
Symmetry Breaking
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
27
• For value symmetries– Very simple: force the first row to be all 0s (no matter which model)
– It does not conflict with row/column symmetry-breaking constraints (the first row is lexicographically smallest anyway)
– Triggers better propagation.
Symmetry Breaking
0 0 0 0 0
0 0 0 1 1
0 0 1 0 1
0 1 0 0 1
0 1 1 1 0
1 0 0 0 1
1 0 1 1 0
1 1 0 1 0
1 1 1 0 0
1 1 1 1 1
28
Outline
• Introduction & Background• CSP model
– Naïve model, Alternative model, Integrated model
• Symmetry breaking• Solving the CSP
– Setting up the Ilog Solver, Experiment results
• SAT Model– Model, Experiment results
29
• Use ILOG Solver 6.0• Use compound variables as search variables
– Coverage constraints expressed over compound variables
• Variable and value ordering– Values assigned in ascending order– Labeling variables by column (coverage constraints are on columns)– Lexicographical ordering within each column
• Symmetry-breaking constraints (as shown before)• Channeling constraints
– Extensional: GAC– Intensional: bounds consistency– Same for domain of binary alphabet: each value is a bound. However,
solver may run faster on bounds consistency
Setting up the solver
30
• Results for CA(3, k, 2)
– For alternative model, both with all/minimal intersection constraints– For integrated model, channeling constraints expressed both
extensionally (GAC) and intensionally (bounds consistency).– * indicates finding optimal size of b.
Experiment results
31
• Results for CA(3, k, 2)
– For integrated model, enforcing intensional constraints is cheaper than enforcing extensional constraints.
Experiment results
32
• Results for CA(3, k, 2)
– Integrated model is better than alternative model– For k=12, integrated model has 220 channeling constraints, while
alternative model has 594 non-redundant intersection constraints.
Experiment results
33
• Results for CA(4, k, 2)
– Runtime limit is 1 hour (CA(4, 7, 2) for b=24 can’t finish in 1 hour).
Experiment results
34
Outline
• Introduction & Background• CSP model
– Naïve model, Alternative model, Integrated model
• Symmetry breaking• Solving the CSP
– Setting up the Ilog Solver, Experiment results
• SAT Model– Model, Experiment results
35
• Encoding the problem into CNF SAT (Example CA(2, 3, 2))
– Still have two matrices: original and alternative– Create a Boolean variable for EACH value of EACH variable.
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
(1,2), (2,3), (1,3)
36
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
x
mijx
(2)
m ijx m ijx'
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
m11,0 m11,1
m 11,0 m 11,1
37
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
(2)
m ijx m ijx'
(3)
y
aij 'y
(4)
a ij 'y a ij 'y'
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
m11,0 m11,1
m 11,0 m 11,1
a11,0 a11,1 a11,2 a11,3
(a 11,0 a 11,1) (a 11,0 a 11,2) (a 11,0 a 11,3) (a 11,1 a 11,2) (a 11,1 a 11,3) (a 11,2 a 11,3)
x
mijx
38
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
x
mijx
(2)
m ijx m ijx'
(3)
y
aij 'y
(4)
a ij 'y a ij 'y'
(5)
iaij 'y
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
a11,0 a11,1 a11,2 a11,3
(a 11,0 a 11,1) (a 11,0 a 11,2) (a 11,0 a 11,3) (a 11,1 a 11,2) (a 11,1 a 11,3) (a 11,2 a 11,3)
m11,0 m11,1
m 11,0 m 11,1
a11,0 a21,0 a31,0
39
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
x
mijx
(2)
m ijx m ijx'
(3)
y
aij 'y
(4)
a ij 'y a ij 'y'
(5)
iaij 'y
(6)
a ij 'y mijx
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
a11,0 a11,1 a11,2 a11,3
(a 11,0 a 11,1) (a 11,0 a 11,2) (a 11,0 a 11,3) (a 11,1 a 11,2) (a 11,1 a 11,3) (a 11,2 a 11,3)
m11,0 m11,1
m 11,0 m 11,1
a11,0 a21,0 a31,0
(a 11,0 m11,0) (a 11,0 m12,0)
40
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
x
mijx
(2)
m ijx m ijx'
(3)
y
aij 'y
(4)
a ij 'y a ij 'y'
(5)
iaij 'y
(6)
a ij 'y mijx
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
a11,0 a11,1 a11,2 a11,3
(a 11,0 a 11,1) (a 11,0 a 11,2) (a 11,0 a 11,3) (a 11,1 a 11,2) (a 11,1 a 11,3) (a 11,2 a 11,3)
m11,0 m11,1
m 11,0 m 11,1
a11,0 a21,0 a31,0
(a 11,0 m11,0) (a 11,0 m12,0)
41
• Encoding the problem into CNF SAT
Local search model with SAT
x11 x12 x13x21 x22 x23x31 x32 x33... ... ...
m11,0 m11,1 m12,0 m12,1 m13,0 m13,1
m21,0 m21,1 m22,0 m22,1 m23,0 m23,1
m31,0 m31,1 m32,0 m32,1 m33,0 m33,1
... ... ... ... ... ...
(1)
x
mijx
(2)
m ijx m ijx'
(3)
y
aij 'y
(4)
a ij 'y a ij 'y'
(5)
iaij 'y
(6)
a ij 'y mijx
(1,2), (2,3), (1,3)
c11 c12 c13c21 c22 c23c31 c32 c33... ... ...
a11,0 a11,1 a11,2 a11,3 a12,0 a12,1 a12,2 a12,3 a13,0 a13,1 a13,2 a13,3a21,0 a21,1 a21,2 a21,3 a22,0 a22,1 a22,2 a22,3 a23,0 a23,1 a23,2 a23,3a31,0 a31,1 a31,2 a31,3 a32,0 a32,1 a32,2 a32,3 a33,0 a33,1 a33,2 a33,3... ... ... ... ... ... ... ... ... ... ... ...
a11,0 a11,1 a11,2 a11,3
(a 11,0 a 11,1) (a 11,0 a 11,2) (a 11,0 a 11,3) (a 11,1 a 11,2) (a 11,1 a 11,3) (a 11,2 a 11,3)
m11,0 m11,1
m 11,0 m 11,1
a11,0 a21,0 a31,0
(a 11,0 m11,0) (a 11,0 m12,0)
42
• SAT local search algorithm– First, randomly assign all boolean variables.– Select a violated clause, flip the value of one variable in it (satisfy the
clause, but may cause others to violate).– Repeat until timeout or satisfied.
• Variable selection heuristic– With probability p, randomly select a variable. (noise, set to .2, .3, .4)– With 1-p, pick variable with min score
– Break ties by selecting the variable that was least recently flipped.– Freebie move: if there are multiple variables such that flipping them
would not create new unsat clauses (score=0), break ties randomly.
Setting up the solver
# of unsatisfied clauses results from flipping v
total # of flips in the past on all variables other than vScore =
Smallest negative
effect Prefer variables that have
fewest flips
43
Results for local search model: CA(2, k, g)
*bold denotes best results.
HW: HWFSAT (2006)HR: Hartmann & Raskin 2004CK: Chateaunef & Kreher 2002MS: Meagher & Stevens 2005NU: Nurmela 2004
44
• CA(3, k, g)
• CA(4, k, g)
Results for local search model
Better than the other 2
In fact, they are optimal, but do we
know they are optimal?
45
• Modeling CA problem into CSP– Naïve model– Alternative model– Integrated model
• Local search with SAT– Handles larger problems– Trade scalability with completeness– Combining results with CSP results may be valuable
Summary
46
• Page 203, first formula:• Page 203, fifth line from bottom: variables • Page 212, 20th line from top:
Small Typos in Paper
xrl p
(xri,xrj ,xrl )
iaij 'y
47
• References– Hnich et al. ‘06: Constraints models for the covering test problems– Flener et al. ‘02: Breaking row and column symmetry in matrix models– Frisch et al. ‘02: Global constraints for lexicographical orderings– Gent et al. ‘95: Unsatisfied variables in local search– Hartman et al. ‘04:Problems and algorithms for covering arrays– Chateauneuf et al. ‘02: On the state of strength-three covering arrays– Meagher et al. ‘05: Group construction of covering arrays– Nurmela et al. ‘04: Upper bounds for covering arrays by Tabu search
• The switches and light bulbs shown on first slide is a real game– http://www.devicedaily.com/gadgets/awesome-wooden-switch-and-b
ulb-game-resurrects-1960s-idea.html
Literature