From

1
From Monotonic Transition Systems to Monotonic
Games
Parosh Aziz Abdulla Uppsala University
2
Outline

• Model Checking
• Infinite-State Systems
• Methodology
• Monotonicity
• Well Quasi-Orderings
• Models
• Petri Nets
• Lossy Channel Systems
• Timed Petri Nets
• Extension to Games

3
Model Checking
T sat f ?
transition system
specification
4
Model Checking
T sat f ?
transition system
specification
5
(No Transcript)
6
(No Transcript)
7
Forward Reachability Analysis
8
Forward Reachability Analysis
Post
9
Forward Reachability Analysis
Post
Forward Reachability Analysis computing Post
Fin
Init
10
Backward Reachability Analysis
11
Backward Reachability Analysis
Pre
12
Backward Reachability Analysis
Pre
Backward Reachability Analysis computing Pre
Init
Fin
13
Forward Reachability Analysis
Fin
Init
Backward Reachability Analysis
Init
Fin
14
Infinite-State Systems
1. Unbounded Data Structures

• stacks
• queues
• clocks
• counters, etc.

2. Unbounded Control Structures

• Parameterized Systems
• Dynamic Systems

15
Backward Reachability Analysis
Init
Fin
infinite
16
Backward Reachability Analysis
Init
Fin
infinite
effective symbolic representation
17
Petri Nets
18
States Markings
19
Transitions
20
Transitions
t
Firing t
21
Transitions
t
t is disabled
22
Monotonicity
23
Monotonicity
24
Monotonicity
25
Petri Nets infinite state
26
Petri Nets infinite state
27
Petri Nets infinite state
28
Petri Nets infinite state
29
Petri Nets infinite state
30
Mutual Exclusion
W
R1?
R1
R0
C
31
Mutual Exclusion
W
R1?
R1
R0
C
R1?
R1?
R1?
R1
R1
R1
R0
R0
R0
32
Mutual Exclusion
R1?
R1?
R1?
R1
R1
R1
R0
R0
R0
33
Mutual Exclusion
R1?
R1?
R1?
R1
R1
R1
R0
R0
R0

• Initial states
• R1
• All processes in

Infinitely many
34
Mutual Exclusion
R1?
R1?
R1?
R1
R1
R1
R0
R0
R0

• Initial states
• R1
• All processes in

Infinitely many
Bad states Two or more processes in
35
Mutual Exclusion
R1?
R1?
R1?
R1
R1
R1
R0
R0
R0
R1
W
C
36
Mutual Exclusion
Set of initial states
infinite
37
Mutual Exclusion
38
Mutual Exclusion
R1
W
C
39
Mutual Exclusion
R1
W
C
40
Mutual Exclusion
R1
W
C
41
Safety Properties

• mutual exclusion
• tokens in critical section gt 1

critical section
42
Safety Properties

• mutual exclusion
• tokens in critical section gt 1

Ideal Upward closed set of markings
critical section
43
Safety Properties

• mutual exclusion
• tokens in critical section gt 1

Ideal Upward closed set of markings
critical section
safety reachability of ideals
44
Petri Nets

• Concurrent systems
• Infinite-state symbolic representation
• Monotonic behaviour
• Safety properties reachability of ideals

45
Petri Nets

• Concurrent systems
• Infinite-state symbolic representation
• Monotonic behaviour
• Safety properties reachability of ideals

46
Monotonicity ideals closed under computing
Pre
47
Monotonicity ideals closed under computing
Pre
I
48
Monotonicity ideals closed under computing
Pre
I
49
Monotonicity ideals closed under computing
Pre
I
50
Monotonicity ideals closed under computing
Pre
I
Pre(I)
51
Backward Reachability Analysis
Fin
Ideals
52
Ideals Symbolic Representation
i index (generator)
i generator of ideal i denotes all markings
larger than i
53
Ideals Symbolic Representation
index (generator)
54
Ideals Symbolic Representation
index (generator)
55
Ideals Symbolic Representation
index (generator)
56
Ideals Symbolic Representation
index (generator)
57
Ideals Symbolic Representation
C
Index for bad states
58
Ideals Symbolic Representation
C
Index for bad states
59
Each ideal can be characterized by a finte set of
generators
60
Index is minimal element of its ideal
j
If i j then
i
61
Monotonicity ideals closed under computing
Pre
C
Index for bad states
Indices of Pre
62
Monotonicity ideals closed under computing
Pre
C
Index for bad states
i index Pre(i) computable
Indices of Pre
63
Backward Reachability Analysis
C
Step 0
64
Backward Reachability Analysis
C
Step 0
Step 1
65
Backward Reachability Analysis
C
Step 0
Step 1
66
Backward Reachability Analysis
C
Step 0
Step 1
Step 2
67
Backward Reachability Analysis
C
Step 0
Step 1
Step 2
68
Backward Reachability Analysis
C
Step 0
Step 1
Step 2
Step 3
69
Backward Reachability Analysis
C
Step 0
Step 1
Step 2
Step 3
70
What did we need?

• Computable ordering
• Monotonicity, Computability of Pre
• Termination -- Ordering is WQO

71
What did we need?

• Computable ordering
• Monotonicity, Computability of Pre
• Termination -- Ordering is WQO

nice properties
72
Well Quasi-Ordering (WQO)
( A , ) is WQO if
a0 a1 a2 a3 .......
i,j iltj and ai aj
WQO Simple Example
( Nat , ) is WQO
x0 x1 x2 x3 ....... natural numbers
i,j iltj and xi xj
73
Properties of WQO
Finite Sets
( A , ) is WQO if A is finite
a0 a1 a2 b a3 a4 a5 b a6 ..............
74
Properties of WQO
Words
if ( A , ) is WQO
w1 a0 a1
a2

w2 b0 b1 b2 b3 b4 b5
b6


then ( A , ) is WQO
75
Properties of WQO
Multisets
if ( A , ) is WQO
then ( AM , M ) is WQO
M1 M M2
M2
M1
76
Methodology

• Start from a finite domain
• Build more complicated data structures
• words, multisets, lists, sets, etc.

77
Examples -- WQO
( A , )
A finite alphabet
w1 w2 w1 subword of w2
e.g. ab xaybz
78
Examples -- WQO
Words of natural numbers
5 2 7
w1
w2
3 7 1 4 2 8
w1
w2
79
Multisets over a finite alphabet
80
Words of multisets over a finite alphabet
81
Lossy Channel Systems
!m

• finite state process
• unbounded lossy channel
• send and receive operations

?n
m n n m

• Infinite state space
• Perfect channel Turing machine
• Motivation Link protocols

82
State
!m
mpnm npn
?n
83
Transitions
Send
!m
m
84
Transitions
Send
!m
m
Receive
?m
m
85
Transitions
Send
!m
m
Receive
?m
m
Messages may nondeterministically be lost
86
Example
!m
?n
p n m p n
n m p m
m p m
87
Ordering

• same colour
• subword

m n p m p n p
m n p m p n p
m n p m p
m n p m p n p
88
Ordering

• same colour
• subword

m n p m p n p
Computable and WQO
m n p m p n p
m n p m p
m n p m p n p
89
Monotonicity
w1
w3
w2
90
Monotonicity
w1
w3
w2
Downward closed
91
Ideal Index
m n p
denotes all larger states
m n m p m m n m p
m n p
m n m p m m n m p
m n p
92
Each ideal can be characterized by a finite set
of generators
By WQO of
93
Computing Pre
Pre ( ) contains the following
w
94
Computing Pre
Pre ( ) contains the following
w
!m
and w w m
if
w
then
95
Computing Pre
Pre ( ) contains the following
w
!m
and w w m
if
w
then
!m
and last(w) m
if
w
then
96
Computing Pre
Pre ( ) contains the following
w
!m
and w w m
if
w
then
!m
and last(w) m
if
w
then
?m
m w
then

if
97
Example
Pre ( )
a d b
!b
a d
if
!d
if
a d b
?d

d a d b
if
98
Methodology (applied to LCS)

• Computable ordering
• Monotonicity, Computability of Pre
• Ordering is WQO

99
LCS -- Forward vs Backward Analysis
Pre(w) is regular and computable Post(w) is
regular but not computable
100
Timed Petri Nets
2.1
0.5
8.5
6.2
4,7
1,5
3,6
0,3
4, )
1,2
4.6
101
States Markings
2.1
0.5
3.5
6.2
3,6
1,5
4,7
0,3
1,2
4.6
2.1 3.5 0.5 6.2 4.6
102
Timed Transitions
2.1
0.5
3.5
6.2
3,6
1,5
4,7
2.1 3.5 0.5 6.2 4.6
0,3
1,2
4.6
103
Timed Transitions
2.1
0.5
3.5
6.2
3,6
1,5
4,7
2.1 3.5 0.5 6.2 4.6
0,3
increase age by 1.3
1,2
4.6
3.4
1.8
4.8
7.5
1,5
4,7
3.4 4.8 1.8 7.5 5.9
0,3
1,2
5.9
104
Discrete Transitions
3.1
1.5
4.5
7.2
3,6
1,5
4,7
t
3.1 4.5 1.5 7.2 5.6
0,3
1,2
5.6
105
Discrete Transitions
3.1
1.5
4.5
7.2
3,6
1,5
4,7
t
3.1 4.5 1.5 7.2 5.6
0,3
1,2
5.6
Firing t
3.1
7.2
1,5
4,7
3.1 7.2 0.8 5.6
t
0,3
1,2
0.8
5.6
106
Timed Petri Nets

• Concurrent timed systems
• Infinite-state symbolic representation
• Monotonic behaviour
• Safety properties reachability of ideals

107
Equivalence on Markings
3.1
7.2
3,6
1,5
4,7
t
0,3
1,2
0.8
5.6

• max 7
• ages gt max behave identically

108
Equivalence on Markings
Markings equivalent if they agree on

• colours
• integral parts of clock values
• ordering on fractional parts

3.1 4.8 1.5 6.2 5.6
3.2 4.8 1.6 6.4 5.7
109
Equivalence on Markings
Markings equivalent if they agree on

• colours
• integral parts of clock values
• ordering on fractional parts

3.1 4.8 1.5 6.2 5.6
3.1 1.5 4.8
3.2 4.8 1.6 6.4 5.7
110
Equivalence on Markings
Markings equivalent if they agree on

• colours
• integral parts of clock values
• ordering on fractional parts

3.1 4.8 1.5 6.2 5.6
3.1 1.5 4.8
3.2 4.8 1.6 6.4 5.7
3.2 1.6 4.7
111
Equivalence on Markings
Markings equivalent if they agree on

• colours
• integral parts of clock values
• ordering on fractional parts

3.1 4.8 1.5 6.2 5.6
3 6 1 5 4
3.2 4.8 1.6 6.4 5.7
112
Equivalence on Markings
Markings equivalent if they agree on

• colours
• integral parts of clock values
• ordering on fractional parts

3.1 4.8 4.8 1.1 5.4
3 1
4 4
5
3.2 4.7 4.7 1.2 5.5
words over multisets over a finite alphabet
113
Ordering on Markings
M1 M2 iff M3

• M1 M3
• M3 M2

4.8 6.4 5.7
3.1 4.8 1.5 6.2 5.6
114
Ordering on Markings
M1 M2 iff M3

• M1 M3
• M3 M2

4.8 6.4 5.7
4.8 6.2 5.6
3.1 4.8 1.5 6.2 5.6
115
4.8 6.4 5.7
4.8 6.2 5.6
3.1 4.8 1.5 6.2 5.6
116
4.8 6.4 5.7
4.8 6.2 5.6
3.1 4.8 1.5 6.2 5.6
6 5 4

subword
6 5 4
subword
3 6 1 5 4
117
Ordering on Markings
M1 M2 iff M3

• M1 M3
• M3 M2

3.2 1.2 4.7
3.1 4.8 4.8 1.1 5.4
118
Ordering on Markings
M1 M2 iff M3

• M1 M3
• M3 M2

3.2 1.2 4.7
3.1 4.8 1.1
3.1 4.8 4.8 1.1 5.4
119
3.2 1.2 4.7
3.1 4.8 1.1
3.1 4.8 4.8 1.1 5.4
3 1
4

subword
3 1
4
subword
3 1
4 4
5
120
Properties of
subword ordering on multisets over a
finite alphabet
is a well quasi-ordering

121
Properties of -- Monotonicity
M3
M1
M2
122
Properties of -- Monotonicity
M3
M1
M4
M2
123
Properties of -- Monotonicity
M3
M1
M5
M4
M2
124
Properties of -- Monotonicity
M3
M1
M5
M4
M2
M6
125
Properties of -- Monotonicity
M3
M1
M5
M4
M2
M6
126
Methodology (applied to TPN)

• Computable ordering
• Monotonicity, Computability of Pre
• Ordering is WQO

127
Infinite-State Games
Player A
Player B
Can B take game to ?
128
Backward Reachability Analysis
Characterize losing states for A
A-states
B-states
Pre( )
129
Backward Reachability Analysis
Characterize losing states for A
B-states
A-states
Pre( )
130
Backward Reachability Analysis
Characterize losing states for A
Pre
Pre
Pre
Pre
131
Vector Addition Systems with States (VASS)
x
y --
x--

• Finite-state automaton operating on variables
• Variables range over natural numbers
• Operations increment or decrement variable

132
VASS Petri nets
y--
x
x--
VASS
y
Petri net
x
133
x
VASS Games
x
x--
x--
x
Player A
Player B
Can B take game to ?
134
x
0
x
0
x--
1
x--
2
x
3
4
135
x
0
x
0
x--
1
x--
2
x
3
A cannot avoid
4
136
x
1
x
1
0
x--
2
x--
3
x
4
5
137
x
1
x
1
0
x--
2
x--
3
x
4
A can avoid
5
138
x
2
x
2
1
x--
3
0
x--
4
1
x
5
2
6
3
139
x
2
x
2
1
x--
3
0
x--
4
1
x
5
2
A cannot avoid
6
3
140
Player A 0 -- lose 1 -- win
gt1 -- lose
Monotonicity does not imply upward closedness
141
Backward Reachability Analysis
Characterize losing states for A
Pre
Pre
Pre
Pre
Why scheme does not work for VASS?
Monotonicity does not imply that ideals are
closed under
Pre
142
2-Counter Machines
x
y--
x--
x0?
Is reachable?
Problem undecidable
143
Simulation of 2-Counter Machines by VASS Games
x
Counter machine
x
VASS game
144
Simulation of 2-Counter Machines by VASS Games
x--
Counter machine
x--
VASS game
145
Simulation of 2-Counter Machines by VASS Games
x0?
Counter machine
x--
VASS game
146
Safety undecidable for Monotonic Games
Safety undecidable for VASS Games
147
B-Downward Closed Games
s1
s3
s2
148
B-Downward Closed Games
s1
s3
s2
Pre
any set
ideal
149
Backward Reachability Analysis
B-Downward closed games
Pre
Pre
Pre
Pre
ideal
150
Backward Reachability Analysis
B-Downward closed games
Pre
Pre
Pre
Pre
ideal
nice ordering
characterization of A-losing states
decidability of safety
151
Backward Reachability Analysis
B-LCS Games
!m
Player B can lose messages
!n
?m
?n
!m
B-LCS characterization of A-losing states
Safety decidable for B-LCS games
152
A-Downward Closed Games
153
A-Downward Closed Games
Post
154
A-Downward Closed Games
Post
155
A-Downward Closed Games
156
A-Downward Closed Games
157
A-Downward Closed Games
F
158
A-Downward Closed Games
F
159
A-Downward Closed Games
F
T
160
A-Downward Closed Games
F
T
F
T

• Termination
• all leaves closed
• Evaluate tree OR
• AND

161
A-Downward Closed Games
F
T
F
T
Termination guaranteed if is WQO
162
A-Downward Closed Games
F
T
F
T
Safety decidable for A-LCS Games
Can we characterize winning states ?
163
!m
A Problem for LCS
?n
characterize
sf
w w
sf

• Set regular
• But Not computable

164
A-LCS Games

• Winning set regular
• But not computable

!m
LCS
!m
A-LCS game
165
A-LCS Games

• Winning set regular
• But not computable

?m
LCS
?m
A-LCS game
166
A-LCS Games

• Winning set regular
• But not computable

For each
A-LCS game
167
Conclusions and Planned Work

• Define a WQO on state space
• Safety properties reachability of ideals
• Examples
• Timed Petri nets
• Parameterized systems
• Broadcast protocols
• Cache coherence protocols
• Lossy channel systems, etc.

168

• Extension to Games
• Regular Model Checking
• Stochastic behaviours