parameter synthesis in dynamical systems by model checking

73
Parameter synthesis in dynamical systems by model checking David ˇ Safr´ anek with Nikola Beneˇ s, Luboˇ s Brim, Martin Demko, Samuel Pastva keynote talk SynCoP + PV 2017 Masaryk University Czech Republic SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 1/52

Upload: others

Post on 08-Apr-2022

4 views

Category:

Documents


0 download

TRANSCRIPT

Parameter synthesis in dynamical systems bymodel checking

David Safranek

with Nikola Benes, Lubos Brim, Martin Demko, Samuel Pastva

keynote talkSynCoP + PV 2017

Masaryk UniversityCzech Republic

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 1/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 2/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 3/52

Motivation: Systems View of Processes Driving the CellTo Mechanistically Understand Natural/Physical Systems

nutrients enzymes

metabolic products

signals

proteins

regulatory elements

METABOLISM PROTEOSYNTHESIS

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 4/52

Motivation: Models of Complex Dynamical SystemsUnderstanding Role of Parameters

deterministic models of dynamical systems:

x = f (x(t), p)

f ... phase space (vector field), f : Rn × Rm → Rn

x ... state vector (Rn)

p ... parameter vector (Rm)

0 0,8 1,6 2,4 3,2 4 4,8 5,6 6,4 7,2 8 8,8 9,6 10,4 11,2 12 12,8 13,6 14,4 15,2 16 16,8 17,6 18,4 19,2

0,8

1,6

2,4

3,2

4

4,8

5,6

6,4

7,2

8

8,8

9,6

10,4

11,2

12

12,8

Insert text here

pRB

E2F1

0 0,8 1,6 2,4 3,2 4 4,8 5,6 6,4 7,2 8 8,8 9,6 10,4 11,2 12 12,8 13,6 14,4 15,2 16 16,8 17,6 18,4 19,2

0,8

1,6

2,4

3,2

4

4,8

5,6

6,4

7,2

8

8,8

9,6

10,4

11,2

12

12,8

Insert text here

pRB

E2F1

p = 0.006 p = 0.012

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 5/52

Motivation: Dynamical Systems with Parameters

parameters

real-worldsystem

mathematicalmodel

observedproperties

specifiedproperties

requiredproperties

admissibleparameters

influencing reality

observation

reconstruction

formalisation

parameter tuning

parametersynthesis

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 6/52

Motivation: Dynamical Systems with Parameters

parameters

real-worldsystem

mathematicalmodel

observedproperties

specifiedproperties

requiredproperties

admissibleparameters

influencing reality

observation

reconstruction

formalisation

parameter tuning

parametersynthesis

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 6/52

Model-Based Dynamical Systems AnalysisEmploying Constraints on Systems Dynamics

(bio)physics: often use parameterised non-linear ODEs,supplied with local methods (e.g., simulation)

biology: observations in the form of time-series data

literature provides further constraints on systems dynamics

computer science: turn all known facts into formalspecification and find admissible model parameters

a suitable formal language is provided by temporal logics

if the model is given as a state-transition system we canemploy model checking⇒ exhaustive – global view wrt parameters and initialconditions, different than simulation

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 7/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 8/52

Problem FormulationParameter Synthesis for Dynamical Systems

parameter constraints

behavior constraints

p |=ΦI ∧M

(p) |=ϕ

parametrised modelM(p)

restrictp

restrictM

ϕ

ΦI

Parameter Synthesis Problem

Assume P is the admissible parameter space. Given a behaviourconstraint ϕ, parameter constraint ΦI , and a parameterisedmodel M, find the maximal set P ⊆ P of parameterisationssuch that p |= ΦI and M(p) |= ϕ for all p ∈ P.

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 9/52

Considered Parameterised Models of Dynamical Systems

a b

c

dynamical systems as regulatory networks

discrete models (e.g., Boolean networks)

parameters determine the logic of interactionsdeterministic (synchronous) vs. non-deterministic(asynchronous)finite-state, finite parameters, parameter explosion dominatesTCCB 2010, CMSB 2012, SASB 2016Henzinger et al. TACAS 2015; Ballarini et al. 2016

non-linear ODE models

continuous parameters determine the vector fieldundecidablesemi-decidable by employing approximations/abstractions

piece-wise affine and piece-wise multi-affineoverapproximation by (parametrised) finite automatastate explosion and parameter explosion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 10/52

Considered Parameterised Models of Dynamical Systems

a b

c

dynamical systems as regulatory networks

discrete models (e.g., Boolean networks)

parameters determine the logic of interactionsdeterministic (synchronous) vs. non-deterministic(asynchronous)finite-state, finite parameters, parameter explosion dominatesTCCB 2010, CMSB 2012, SASB 2016Henzinger et al. TACAS 2015; Ballarini et al. 2016

non-linear ODE models

continuous parameters determine the vector fieldundecidablesemi-decidable by employing approximations/abstractions

piece-wise affine and piece-wise multi-affineoverapproximation by (parametrised) finite automatastate explosion and parameter explosion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 10/52

Work Chronology

Related Work

Batt et al. 2007: RoverGene, BDD/Polytopes-based approach

de Jong et al. 2010: GNA, symbolic approach, piecewise affine

Grosu et al. 2011: RoverGene revisited, approximation improved

Bogomolov et al. 2015, SpaceEx, multi-affine hybrid automata

Our Contribution

HIBI 2010, TCCB 2012: coloured LTL model checking, piecewisemulti-affine, parallel algorithm

CMSB 2015: coloured CTL model checking, piecewise multi-affine,parallel algorithm, independent parameters

HSB 2015, FM 2016: discrete bifurcation analysis by colouredHUCTL model checking

ATVA 2016, CMSB 2016, CAV 2017: SMT employed,interdependent parameters, Pithya tool

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 11/52

Workflow

behaviourconstraints

parameterconstraints

ODE model

PWMA model

parameterisedKripke structure

temporal formulae

valid parametervaluations

ColouredModel

Checking

formalisation approximation

abstraction

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 12/52

Step 1: ApproximationDiscretisable Continuous (ODE) Models

(bio)physical mechanisms modeled by sigmoidal kinetics (e.g.,signalling pathways, gene regulatory circuits, ...)optimal approximation of sigmoid functions by piece-wiseaffine functions (ramps) [Grosu et al. CAV 2011]

model abstraction kinetics

piece-wise multi-affinetransient over-approximatedsteady state over-approximated

sigmoidal kineticsmass action

piece-wise affinetransient over-approximatedsteady state exact

first-order sigmoidalkineticsSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 13/52

Step 2: Rectangular Abstraction

approach originates in [Batt, Belta, Habets, van Schuppen 2006]

continuous phase-space is partitioned into (hypher)rectangles

no diagonal transitions, overapproximation

self-transitions, in PWMA only necessary condition for exiting abox in finite time =⇒ overapproximation

A

B

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 14/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = 0.6

B

A0 2.5 5

2.5

5

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = 0.6

B

A0 2.5 5

2.5

5

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = 0.6

B

A0 2.5 5

2.5

5

1

2

3

45

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = 0.6

B

A0 2.5 5

2.5

5

1

2

3

45

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = ?

B

A0 2.5 5

2.5

5

1

2

3

45

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = ?

B

A0 2.5 5

2.5

5

1

2

3

45

(0,0.4) (0.4,0.8) (0.8,1.6) (1.6,max)1

2

3

4

5

−2.5 · k1 > 0

−2.5·k1+2.5·k2 > 0

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaPhase Space Discretisation Leads to Parameter Space Discretisation

dA

dt= −k1 · A + k2 · B

dB

dt= k1 · A− k2 · B

k2 = 0.8

k1 = ?

B

A0 2.5 5

2.5

5

1

2

3

45

Φstate00→state10 := −2.5 · k1 > 0 ∨ −2.5 · k1 + 2.5 · k2 > 0

The transition exists if and only if the formula is satisfiable.Local parameter constraints are predicates over reals.

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 15/52

Step 3: Parameter Synthesis – Main IdeaLiveness

necessary condition for escaping a state (rectangle) s in finitetime is

0 /∈ hull{f (v , p) | v ∈ vertices(s)}for all p ∈ P not satisfying the necessary condition above aself-transition is added to s:

Φs,s := ∃c1, . . . , ck :

(k∧

i=1

ci ≥ 0

)∧(

k∑i=1

ci = 1

)∧(

k∑i=1

ci · f (vi , p) = 0

)

quantifier-free formulae giving coarser overapproximation ofself-transitions can be used alternatively

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 16/52

WorkflowParameterised Kripke Structures and Model Checking

behaviourconstraints

parameterconstraints

parameterisedKripke structure

temporal formulae

valid parametervaluations

ColouredModel

Checking

formalisation

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 17/52

Parameterised Kripke StructuresState Transition Systems with Parameters

Transitions with Parameters (coloured transitions)

••

••••

••

••

•••• ••

••

•••

•••

••

••

••••

each parameter valuation represents one Kripke structure

shared state space, different transition space

symbolic representation of parameters

symbolic PKS: every transition is associated with a formula

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 18/52

Parameterised Kripke StructuresState Transition Systems with Parameters

Transitions with Parameters (coloured transitions)

••

••••

••

••

•••• ••••

•••

•••

••

••

••••

each parameter valuation represents one Kripke structure

shared state space, different transition space

symbolic representation of parameters

symbolic PKS: every transition is associated with a formula

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 18/52

Parameter Synthesis by Coloured Model Checking

LT

L o

r (A

)CT

L s

pe

cif

ica

tio

n

the specification is guaranteed(some might be missing)

the specification might be violated

parameter intervals where

[A]

[B]

5

0 2.5 5

2.5

[A][A]

parameterized Kripke structure of the model

CMC

YES NO

parameter intervals where

identify states and colors for which the property does/doesn’t hold

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 19/52

Parameter Synthesis by Coloured Model CheckingSome Observations

exloiting experiences with enumerative MC

many parameter values typically shared on a transition

coloured MC is an effective heuristics wrt naıve approach

parallel automata-based LTL MC [BioDiVinE – TCBB 2010]

LTL nicely preserved by the abstractionsabstractions are non-deterministicneed to analyse decision states (neighbourhood aroundunstable equillibria)we went more to monitoring/robustness analysis STL, STL*(extending work of Donze et al.)

towards coloured CTL model checking [Pithya – CAV 2017]

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 20/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

••••

•••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

••••

•••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••

••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

••••

••

••••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••

••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

••••

••

••••

•••

•••

•••

•••

••

••

••

••••

•••••••

••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Coloured CTL Model CheckingBasic Idea

enumerative approach

CTL model checking: dynamic programming, back propagation

coloured CTL model checking: back propagation of colours

p

••

••••

••

••

•••• ••

••

••

•••

•••

•••

•••

••

••

••

••••

•••••••

•••••

CTL formula: EF p

intersection of colour sets: state + transition

union of colour sets: inside stateSynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 21/52

Parameter Synthesis by Coloured CTL Model CheckingFormal Definition

Parameter Synthesis wrt CTL Specification

Let K = (P, S , I ,→, L) be a parameterised Kripke structureover AP. Let ΦI be an initial parameter constraint. Let furtherϕ be a behaviour constraint defined as a CTL formula over AP.The parameter synthesis problem is to find the functionF : S → 2P :

F(s) = {p ∈ P | p |= ΦI , s |=Kp ϕ}

where Kp is a concrete (un-parametrised) Kripke structure for aparameter value p ∈ P.

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 22/52

Symbolic Representation of ParametersUsing SMT to Deal With Parameter Sets

Encoding

every set of parameters (on transitions, inside states)represented by a formula with free variables:satisfying assignments are set elements

union is disjunction, intersection is conjunction

call SMT solver to check whether a formula is satisifiable(i.e. whether the set is nonempty)

call SMT solver to check whether two formulae are equivalent(i.e. whether the set has changed)

optimisation: delay SMT solver calls, cache SMT results

simplification: if parameters are independent we can workdirectly with intervals (symbolic sets) instead of SMT

Expressiveness: anything an SMT solver can handle (we employlinear arithmetics over reals)

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 23/52

Parallelisation of Coloured CTL MCCluster or Multi-Core Based Computing

Kripke Fragments

each worker owns a part of the whole state space

extended with border states

assumption-based approach, three-valued(true/false/unknown)

after everything is computed locally, exchange border stateassumptions

Idea based on:Brim, Yorav, Zıdkova 2005: parallel CTL model checking

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 24/52

Performance and ScalabilityEnzymatic Chain ODE as a Benchmark

S + E ES1 · · · ESk P + ES = 0.1 · ES1 − p1 · E · S

E = 0.1 · ES1 − p2 · E · S + 0.1 · ESk − p2 · E · P˙ES1 = 0.01 · E · S − p3 · ES1 + 0.05 · ES2

...˙ESk = 0.1 · ESk−1 − pk · ESk + 0.01 · E · PP = 0.1 · ESk − pk+1 · E · P − 0.1 · PList1

Stránka 1

2 3 4 5 6 7 8 9 10 11 12

0

1000

2000

3000

4000

5000

6000

7000

Scalabilityall for 6 dimensions per 13 thresholds

1 param2 param3 param4 param5 param6 param

Nodes

time

(s

)

quad-core 2GHz Intel Xeon CPUs, 1 core used per node, without SMT

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 25/52

Performance and ScalabilityRepressilator ODE

d [x1]dt

= k1K5

1

K51 +[x2]5

− φx1 [x1]

d [x2]dt

= k2K5

2

K52 +[xn ]5

− φx2 [x2]

d [xn ]dt

= knK5n

K5n +[x1]5

− φxn [xn]

ki = 1, Ki = 5 for all i ∈ {1, ..., n}, n = 6φxj , φx1 ∈ (0, 1) considered unknown

1923

1487

1073

968

792

643

572

3227

2109

1750

1486

1203

1008

922

5023

4597

3291

3070

2693

2155

1932

7630

5186

3922

3371

2896

2704

2328

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

4 6 8 10 12 14 16

Tim

e (

s)

# of computational nodes

90k_1P

160k_1P

90k_2P

160k_2P

quad-core 2GHz Intel Xeon CPUs, 1 core used per node, with SMT

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 26/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 27/52

Motivation: How Parameters Influence Systems Dynamics?

Example: decision making in living cells— to divide or not to divide?

E2F1pRB

[Swat et al. 2004]

decisions implemented by circuits of positive and negative interactionsmodelling of cell cycle since 1970 [Goldbetter et al.]

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 28/52

Motivation: How Parameters Influence Systems Dynamics?Bifurcation Analysis of Dynamical Systems

typical phase portraits around equilibria:

bifurcation is defined as a topological change in phase space

small change in parameter =⇒ qualitative change in dynamicsthe goal of bifurcation analysis is to identify bifurcation points

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 29/52

Motivation: How Parameters Influence Systems Dynamics?Bifurcation Analysis in Systems Theory

cannot divide can decide for division must divide

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 30/52

Motivation: How Parameters Influence Systems Dynamics?Bifurcation Analysis in Systems Theory

cannot divide can decide for division must divide

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 30/52

Motivation: Models of Complex Dynamical SystemsUnderstanding Role of Parameters

in the vector field the equilbria have certain patterns

the patterns change with parameters (appear, disappear,change shape)

0 0,8 1,6 2,4 3,2 4 4,8 5,6 6,4 7,2 8 8,8 9,6 10,4 11,2 12 12,8 13,6 14,4 15,2 16 16,8 17,6 18,4 19,2

0,8

1,6

2,4

3,2

4

4,8

5,6

6,4

7,2

8

8,8

9,6

10,4

11,2

12

12,8

Insert text here

pRB

E2F1

0 0,8 1,6 2,4 3,2 4 4,8 5,6 6,4 7,2 8 8,8 9,6 10,4 11,2 12 12,8 13,6 14,4 15,2 16 16,8 17,6 18,4 19,2

0,8

1,6

2,4

3,2

4

4,8

5,6

6,4

7,2

8

8,8

9,6

10,4

11,2

12

12,8

Insert text here

pRB

E2F1

p = 0.006 p = 0.012

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 31/52

Phase Portrait SpecificationElementary Patterns

Single-state patterns

*

saddle

*

sink source flow

Multi-state patterns

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 32/52

Phase Portrait Specification

elementary patterns describe temporal behaviour in states

(in)stability, stabilisation, flow direction, ...in non-deterministic system: possibility or inevitability

employ temporal logics to formalise the patterns

need to express branching over labeled transitions, future andpast, state variables

stability (sink)there is a state with no outgoing transition (only a self-loop)instability (source)there is a state with no incoming transition (only a self-loop)increasing flowonly transitions in particular direction

some work done – UCTL [ter Beek et al.], hybrid logics[Arellano et al. 2011], ...

to combine all of these we introduce HUCTLP

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 33/52

Phase Portrait Specification: HUCTLP

HUCTLP — hybrid UCTL with past

in addition to AP there are direction formulae:

χ ::= true | d | ¬χ | χ ∧ χ where d ∈ Dir

state formulae

ϕ ::= true | p | ¬ϕ | ϕ ∧ ϕ | Eψ | Aψ |Eψ | Aψ | x | ↓ x .ϕ | @x .ϕ | ∃x .ϕ

path formulae

ψ ::= Xχ ϕ | ϕ χUϕ | ϕ χUχ ϕ | ϕ χWϕ | ϕ χWχ ϕ

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 34/52

Phase Portrait Specification: HUCTLP

Single-state patterns

sink (stable steady state): ↓ s.AX s

source (only self-loops, no other incoming): ↓ s. AX s

2d-saddle (nort-south outgoing, west-east incoming):AXN∨S true ∧ EXN true ∧ EXS true∧AXE∨W true ∧ EXE true ∧ EXW true

Multi-state patterns

state in a nontrivial SCC: ↓ s.EX EF s

state in a final SCC (generalised sink): ↓ s.AG EF s

Relations among patterns

at least two sinks in the whole system:∃s.∃t.(@s.¬t ∧ AX s) ∧ (@t.AX t)

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 35/52

Phase Portrait SpecificationFrom Phase Portrait Specification to Parametric Phase Portrait

phase portrait specification φ = {ϕ1, ϕ2}phase portrait pattern Xφ = {ϕ1 ∧ ϕ2, ϕ1 ∧ ¬ϕ2,¬ϕ1 ∧ ϕ2,¬ϕ1 ∧ ¬ϕ2}

subpatterns, e.g., X ′ = {¬ϕ1 ∧ ϕ2,¬ϕ1 ∧ ¬ϕ2} ⊂ Xφ

ϕ1 ∧ ¬ϕ2

ϕ1 ∧ ϕ2

¬ϕ1 ∧ ϕ2

¬ϕ1 ∧ ¬ϕ2

ϕ2

¬ϕ2

Parametric Phase Portrait

parameter space PP(ϕ) ⊆ P all parameters for which there is a state satisfying ϕ

stratum: ΓXφ =⋂ϕ∈Xφ P(ϕ), ΓX ′ =

⋂ϕ∈X ′ P(ϕ), . . .

p ∈ P is a bifurcation point if it is a boundary point of some stratum

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 36/52

Phase Portrait SpecificationFrom Phase Portrait Specification to Parametric Phase Portrait

phase portrait specification φ = {ϕ1, ϕ2}phase portrait pattern Xφ = {ϕ1 ∧ ϕ2, ϕ1 ∧ ¬ϕ2,¬ϕ1 ∧ ϕ2,¬ϕ1 ∧ ¬ϕ2}

subpatterns, e.g., X ′ = {¬ϕ1 ∧ ϕ2,¬ϕ1 ∧ ¬ϕ2} ⊂ Xφ

ϕ1 ∧ ¬ϕ2

ϕ1 ∧ ϕ2

¬ϕ1 ∧ ϕ2

¬ϕ1 ∧ ¬ϕ2

ϕ2

¬ϕ2

Parametric Phase Portrait

parameter space PP(ϕ) ⊆ P all parameters for which there is a state satisfying ϕ

stratum: ΓXφ =⋂ϕ∈Xφ P(ϕ), ΓX ′ =

⋂ϕ∈X ′ P(ϕ), . . .

p ∈ P is a bifurcation point if it is a boundary point of some stratum

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 36/52

Discrete Bifurcation Analysis Problem

Problem Definition

Assume P is a finite partially ordered domain representing them-dimensional parameter space. Given a parameterised modelM and a phase portrait specification φ, compute the parametricportrait of M wrt φ and identify all bifurcation points in P wrtM and φ.

Parametrised Model M

Phase Portrait Specification φ

ColouredModel

Checking

Parametric Portrait Bifurcation Points

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 37/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 38/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 39/52

Case study: Biodegradation of Trichloropropane in E. coli

TCP DCP ECH CPD GDL GLYDhaA HheC EchA HheC EchA

d [TCP]dt

=− k1·DhaA·[TCP]Km,1+[TCP]

d [DCP]dt

= k1·DhaA··[TCP]Km,1+[TCP]

− k2·HheC ·[DCP]Km,2+[DCP]

d [ECH]dt

= k2·HheC ·[DCP]Km,2+[DCP]

− k3·EchA·[ECH]Km,3+[ECH]

d [CPD]dt

= k3·EchA·[ECH]Km,3+[ECH]

− k4·HheC ·[CPD]Km,4+[CPD]

d [GDL]dt

= k4·HheC ·[CPD]Km,4+[CPD]

− k5·HheC ·[GDL]Km,5+[GDL]

d [GLY ]dt

= k5·HheC ·[GDL]Km,5+[GDL]

biodegradation of toxic substrate and intermediates

synthetic pathway utilising enzymes from two other bacteriaRhodococcus rhodochrous NCIMB 13064; Agrobacterium radiobacter AD1

find optimal enzymes concentration balancing metabolicburden and toxicity

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 40/52

Case study: Biodegradation of Trichloropropane in E. coli

Desired behaviour:

“TCP is finally completely degraded and the concentration of intermediates does notexceed given bounds”

Formally:

ϕ1 = (A([TCP] > x)U(AF(AG [TCP] < y))),

ϕ2 = (A([GLY ] < y)U(AF(AG [GLY ] > x))),

ϕ3 = (AG [DCP] < v) ∧ (AG [GDL] < w),

ϕ = (ϕ1 ∧ ϕ2 ∧ ϕ3),

where x , y , v and w are estimated values making an instance of this property:

x = 1.9 (according to authors1 using the value 2 mM),

y = 0.01 (obviously, cannot be zero),

v ∈ {0.5, 0.3, 0.1} (variations based on experimental data observation)

w ∈ {0.5, 0.25, 0.1} (variations based on experimental data observation)

1Kurumbang et al., ACS Synthetic Biology, 2013SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 41/52

Case study: Biodegradation of Trichloropropane in E. coli

DhaA

HheC

EchA

DhaA

Hh

eC

DhaA

Ech

A

HheC

Ech

A

A sample of the resulting parameter space for a particular initial state:TCP ∈ [1.9, 1.9586], DCP ∈ [0.448898, 0.5], GDL ∈ [0.0, 0.0669138], GLY ∈ [0.0, 0.01]

Dotted area corresponds to ϕ (v = 0.5, w = 0.25).SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 42/52

Case study: Biodegradation of Trichloropropane in E. coliPreliminary Biological Validation

DhaA HheC

EchA

Time (s)

Co

nce

ntr

ati

on

(mM

)

2.0

1.5

1.0

0.5

0.0

02000

40006000

800010000

1200014000

1600018000

TCP GLY

DCP

GDL

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 43/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 44/52

Case Study: Regulation of G1/S Cell Cycle Transition

E2F1pRB

[Swat et al. 2004]

d [pRB]dt

= k1[E2F1]

Km1+[E2F1]J11

J11+[pRB]− φpRB [pRB]

d [E2F1]dt

= kp + k2a2+[E2F1]2

K2m2+[E2F1]2

J12J12+[pRB]

− φE2F1[E2F1]

bifurcation analysis wrt φpRB

Analysed phase portrait pattern:

• ϕ1 := ∃s.∃t.(@s.AG EF s)∧ (@t.¬EF s ∧AG EF t)∧E¬NF s ∧E¬SF t

• ϕ2 := ¬ϕ1 ∧ ↓ s.AG EF s ∧ E2F1 < 4

• ϕ3 := ¬ϕ1 ∧ ↓ s.AG EF s ∧ E2F1 > 4SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 45/52

Case Study: ResultsE

2F

1

pRB

ϕ2 ϕ1 ϕ3

φpRB = 0.0075 φpRB = 0.0115 φpRB = 0.014[0.002, 0.011] [0.011, 0.0136] [0.0136, 0.5]

bifurcation points: {0.011, 0.0136}

results agree with numerical methods up-to precision ofapproximation/discretisation

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 46/52

Outline

1 Motivation

2 Parameter Synthesis by Coloured Model Checking

3 Discrete Bifurcation Analysis

4 Case StudiesCase Study using Parameter SynthesisCase Study using Discrete Bifurcation Analysis

5 Discussion

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 47/52

Summary and Conclusions

exploiting dynamical systems under parameter uncertainty byenumerative model checking with symbolic representation ofparameters

good scalability achieved for interval-based representation ofparameters

scalability of SMT-based version depends on model structure

remaining challenges:

approximation: explore errors, what can be guaranteed?abstraction: narrow the extent of overapproximation – canDarboux polynomials or barrier certificates help?improve scalabilityis it possible to combine model checking with simulation?[TCSB XIV, 2012]

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 48/52

Discussion

relations to parametric model checking

action synthesis [Knapik et al. 2014]entirely symbolic approachesin our case action parameters depend on states

bifurcation of programs/protocols

a form of robustness analysis

abstract interpretation wrt parameters

parameter space compaction

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 49/52

Check Out Pithya

https://github.com/sybila/pithya-gui

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 50/52

Digital Systems Biology Laboratory

http://sybila.fi.muni.cz

since 2009

originated in model checking communityinvolved in systems biology since 2007 (EC-MOAN FP6)

parallel model checking algorithms development

adapting formal methods to applications in systems biologyformal specification and modelling of biological systemsparameter synthesis and bifurcation analysis

contributions to systems biology and bioinformaticsintegration of formal methods with bionformatics andexperimental biologycase studies with biological groups

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 51/52

Credits

Computer Science

Lubos Brim, Marta Kwiatkowska, Thomas Henzinger,Loıc Pauleve, Ezio Bartocci, Luca Bortolussi, Jerome Feret,Andrzej Mizera, Alessandro Abate, Jan Van Schuppen, MilanCeska, Nikola Benes, Stefan Haar, Heike Siebert, Hidde de Jong

Biology

Ralf Steuer, Louis Mahadevan, Jan Cerveny, Dusan Lazar, PavelKrejcı, Stefanie Hertel, Christoff Flamm

Funding

Grant Agency of Czech Republic

C4SYS – National Infrastructure for Systems Biology

SynCoP + PV 2017, ETAPS, Uppsala, 22.4.2017 52/52