cyber-physical systems: opportunities, problems and (some

124
- 1 - technische universität dortmund fakultät für informatik P. Marwedel, Informatik 12, 2015 SFB 876 technische universität dortmund fakultät für informatik informatik 12 Cyber-physical systems: opportunities, problems and (some) solutions Peter Marwedel* TU Dortmund (Germany), Informatik 12 Photos/Graphics: P. Marwedel + Microsoft 20151109* + contributions by PhD students

Upload: others

Post on 15-Oct-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cyber-physical systems: opportunities, problems and (some

- 1 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

technische universität dortmund

fakultät für informatik

informatik 12

Cyber-physical systems:

opportunities, problems and

(some) solutions

Peter Marwedel* TU Dortmund (Germany), Informatik 12

Photos/Graphics: P. Marwedel + Microsoft 2015年11月09日 * + contributions by PhD students

Page 2: Cyber-physical systems: opportunities, problems and (some

- 2 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

What is a Cyber-Physical System?

Emperor’s New Cloths?

Physical Cyber

Digital Controls Systems, ca. 1980

Cyber-Physical Systems, 2010+ !

© P. Marwedel,

Marco Di Natale

Just wearing the inside out?

Page 3: Cyber-physical systems: opportunities, problems and (some

- 3 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Cyber-physical systems and embedded systems

CPS = ES + physical environment

Embedded systems

("small computers")

Embedded systems (ES): information processing

embedded into a larger product [Peter Marwedel, 2003]

Cyber-physical systems (CPS): integrations of computation

with physical processes [Edward Lee, 2006].

Physics

Information processing

© Graphics:

Microsoft

Page 4: Cyber-physical systems: opportunities, problems and (some

- 4 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Definitions

Cyber-physical systems (CPS) are engineered

systems that are built from and depend upon the

synergy of computational and physical

components.

Emerging CPS will be coordinated, distributed,

and connected, and must be robust and

responsive. [National Science Foundation (US)]

cps-vo.org

… represent networked, software-intensive

embedded systems in a control loop, provide

networked and distributed services [akatech]

Akatech: Cyber-Physical Systems. Driving force for innovation in mobility, health, energy and production, http://www.acatech.de/de/publikationen/

stellungnahmen/kooperationen/detail/artikel/cyber-physical-systems-innovationsmotor-fuer-mobilitaet-gesundheit-energie-und-produktion.html

Page 5: Cyber-physical systems: opportunities, problems and (some

- 5 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Description according to H-2020-ICT-2014-1

Cyber-Physical Systems (CPS) refer to next generation

embedded ICT systems that are interconnected and

collaborating including through the Internet of things, and

providing citizens and businesses with a wide range of

innovative applications and services.

These are the ICT systems increasingly embedded in all types of artefacts

making "smarter", more intelligent, more energy-efficient and more

comfortable our transport systems, cars, factories, hospitals, offices,

homes, cities and personal devices.

Often endowed with control, monitoring and data gathering functions,

CPS need to comply with essential requirements like safety, privacy,

security and near-zero power consumption as well as size, usability

and adaptability constraints.

http://ec.europa.eu/research/participants/portal/desktop/en/opportunities/h2020/topics/78-ict-01-2014.html

http://bit.ly/13I7985

Page 6: Cyber-physical systems: opportunities, problems and (some

- 6 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 6 -

Standard

techniques

Own

results

Outline

Page 7: Cyber-physical systems: opportunities, problems and (some

- 7 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Increased connectivity of systems

© Design: P. Marwedel

Components: Microsoft

Page 8: Cyber-physical systems: opportunities, problems and (some

- 8 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Transportation

Automotive

Avionics

Rail

Ships

©Photos:

P. Marwedel

Comprise many embedded systems, increasingly connected

Page 9: Cyber-physical systems: opportunities, problems and (some

- 9 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

More flexible production planning

(“Industrie 4.0”)

http://www.autonomik40.de/en/SMART%20FACE.php

E.g. flexible islands in automotive production

© Graphics: SMART

FACE project

Page 10: Cyber-physical systems: opportunities, problems and (some

- 10 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Health

©: Microsoft Cliparts,

dobelle

Diagnosis

• Sensors

• Patient information

• Data analysis

• Risk analysis

Support of therapies

• Personalized medication

• Medical devices

• Support for handicapped patients

Result monitoring

One of the areas covered in the acatech report

© www.dobelle.com,

~2000

Insup Lee

Page 11: Cyber-physical systems: opportunities, problems and (some

- 11 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Smart Home

Generates as much energy as it is consuming

Provides maximum comfort

Offers safety without constraining users

Supports users, ambient assisted living

©: Microsoft Cliparts

+ P. Marwedel, 2011

Page 12: Cyber-physical systems: opportunities, problems and (some

- 12 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

More Opportunities

Smart Grid

Disaster recovery

Public safety

Structural health monitoring

Scientific experiments ©

CE

RN

© airlinetrends.com

© w

ww

.sp

ieg

el.d

e

Social spaces Tarek F. Abdelzaher

Microsystems

Jan Madsen

© u

mw

eltbundesam

t.de

© P

. M

arw

edel

Page 13: Cyber-physical systems: opportunities, problems and (some

- 13 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

More Opportunities (2)

©: Microsoft Cliparts

+ P. Marwedel, 2011

Robotics

Military systems

Telecommunication

Consumer electronics

© w

ww

.sp

ieg

el.d

e

Wide scope!

Page 14: Cyber-physical systems: opportunities, problems and (some

- 14 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

NSF-CPS Sample topics

Listed at cps-vo.org:

Networked Sensor Swarm of Underwater

Drifters

Towards a Programmable and

Reconfigurable Lab-on-Chip

Context-dependent control of smart

artificial hands

Cloud Environmental Analysis and Relief

Timing-Centric Software

Wide range of opportunities!

Micro-

systems

Jan

Madsen

© Graphics:

Microsoft

Page 15: Cyber-physical systems: opportunities, problems and (some

- 15 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Smart Beer Mug

processor Capacitive sensor

for fluid level

Inductive coil for

RF ID activation &

power

CPU and reading coil in the table.

Reports the level of fluid in the mug,

alerts servers when close to empty

Contact less

transmission

of power and

readings

© Design: Jakob

Engblom, Marwedel

http://www.oktoberfest-munchen.com/festhalle-oktoberfest/

Page 16: Cyber-physical systems: opportunities, problems and (some

- 16 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 16 -

Standard

techniques

Own

results

Outline

Page 17: Cyber-physical systems: opportunities, problems and (some

- 17 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Security & Safety

Increased connectedness increases risk of attacks

• complete systems can be affected

Defending against

• Cyber crime

• Cyber attacks ( Stuxnet)

• Cyber terrorism

• Cyber war

Local islands provide some protection,

but are in contradiction to the idea of global connectedness

www.nytimes.com

Social spaces Tarek F. Abdelzaher

© Graphics:

Microsoft

Page 18: Cyber-physical systems: opportunities, problems and (some

- 18 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Timing predictability

The system must react within a time interval dictated by the

environment [Adopted from Bergé]

t

execute

Consequences underestimated

© Graphics: Microsoft,

Marwedel © 2011

Example: Problems with new ICE trains: slow

propagation of signals from one end to the other.

The lack of timing in the core abstraction (of computer science)

is a flaw [Edward Lee]

Page 19: Cyber-physical systems: opportunities, problems and (some

- 19 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Worst case execution time

Definition of worst case execution time:

WC

ET

ES

T

© Graphics: adopted from

R. Wilhelm + Microsoft Cliparts

WCETEST must be

1. safe (i.e. ≥ WCET) and

2. tight (WCETEST-WCET≪WCETEST)

Time

constraint

dis

rtribution

of

tim

es

possible execution times

worst-case performance

worst-case guarantee

WC

ET

BC

ET

BC

ET

ES

T

timing predictability time

Compute average and worst case execution times!

Page 20: Cyber-physical systems: opportunities, problems and (some

- 20 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Why care about energy efficiency ?

Relevant during use?

Execution platform Plugged Uncharged

periods

Unplug-

ged

E.g. Factory Car Sensor

Global warming

Cost of energy

Increasing performance

Problems with cooling, avoiding hot spots

Avoiding high currents & metal migration

Reliability

Energy a very scarce resource

Power

© Graphics: P.

Marwedel, 2011

𝐸 = 𝑃𝑒𝑙 𝑡 𝑑𝑡, 𝑡𝑚𝑎𝑥≤ WCET𝑡𝑚𝑎𝑥

0

Page 21: Cyber-physical systems: opportunities, problems and (some

- 21 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Portable systems must be energy efficient

Carrying energy or energy harvesting

Many

opportunities!

Electrical energy

converted into

thermal energy

© Photos: Marwedel,

Fraunhofer IML

Energy Harvesting with 400lx solar cell

Energy storage

Discharge < 2% p.a.

7.000 telegrams

without re-charging

© Fraunhofer IML, Dortmund

Page 22: Cyber-physical systems: opportunities, problems and (some

- 22 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 22 -

Standard

techniques

Own

results

Outline

Page 23: Cyber-physical systems: opportunities, problems and (some

- 23 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Thermal requirements

Pel(t) T; Increasingly important

since temperatures become

more relevant due to increased

performance,

and since temperatures affect

usability

and dependability:

MTTF =𝐴

𝑗𝑒𝑛 𝑒

𝐸𝑎𝑘𝑻 (see slide 68 for details)

© Graphics:

Microsoft

Page 24: Cyber-physical systems: opportunities, problems and (some

- 24 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Reliability/dependability/resilience

The system must be reliable

© Microsoft + Triquint

Inc (with permission)

Consequences frequently

underestimated

Order of magnitude of

probabilities: 10-9/hr = 1 FIT

Failure rates for GaAs at 150°C [www.triquint.com/company/quality/

faqs/faq_11.cfm]

Different devices

Reduced reliability due to smaller patterns

within semiconductor chips [ITRS, 2009]

Transient & permanent faults ww

w.jrw

hip

ple

.

co

m/c

om

pu

ter_

han

gs.h

tml

Page 25: Cyber-physical systems: opportunities, problems and (some

- 25 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Terms

“A service failure, often abbreviated here to failure, is an

event that occurs when the delivered service of a system

deviates from the correct service.”

“The definition of an error is the part of the total state of

the system that may lead to its subsequent service failure”

“The adjudged or hypothesized cause of an error is called

a fault. Faults can be internal or external of a system.”

Example:

Transient fault flipping a bit in memory.

After this bit flip, the memory cell will be in error.

Failure: if the system service is affected by this error.

[La

prie

et

al., 1

99

2, 2

00

4]

Page 26: Cyber-physical systems: opportunities, problems and (some

- 26 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 26 -

Standard

techniques

Own

results

Outline

Page 27: Cyber-physical systems: opportunities, problems and (some

- 27 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

A new look at control loops

Many CPS comprise control loops

• Voltage control in dynamic voltage scaling

• Overheating control

• Bandwidth control

• CPU resource management

Feedback from classical analog feedback:

• Discrete instead of continuous feedback

• Quantization effects

• Larger delays (e.g. with complex algorithms)

• Feedback broken at times (e.g. wireless)

Don‘t forget stability issues!

Karl-Erik Årzén

© Graphics: Microsoft,

P. Marwedel, 2015

Page 28: Cyber-physical systems: opportunities, problems and (some

- 28 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Control loop problems

Paulo Tabuada: Is it about time for control?, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5997

period

Page 29: Cyber-physical systems: opportunities, problems and (some

- 29 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Paulo Tabuada: Is it about time for control?, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5997

Page 30: Cyber-physical systems: opportunities, problems and (some

- 30 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Paulo Tabuada: Is it about time for control?, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5997

Period 0.2s Period 2.2s

Page 31: Cyber-physical systems: opportunities, problems and (some

- 31 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Period 0.2|0.7|0.2|0.7s

Paulo Tabuada: Is it about time for control?, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5997

Period 0.2s Period 0.7s

Good performance

Page 32: Cyber-physical systems: opportunities, problems and (some

- 32 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

A new look at control loops

Periodic sampling worked well

CPS: more flexible control: when to sample?

A case for machine learning:

• Longer sampling periods required by

machine learning become acceptable

• Time for the next sampling may itself be

predicted with machine learning

Paulo Tabuada: Is it about time for control?, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5997

Page 33: Cyber-physical systems: opportunities, problems and (some

- 33 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Human/social & legal issues

Human/social issues

What is the impact of CPS on human society?

How to ensure benefit of humans?

How to ensure acceptance of technology?

Legal issues

How to ensure necessary cooperation

(e.g. in the smart grid)?

How to solve intellectual property issues?

Who owns the data?

Who is liable?

© Graphics: Microsoft

Page 34: Cyber-physical systems: opportunities, problems and (some

- 34 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Dynamism & heterogeneity

Environment is frequently changing

Various network standards

Networks are less reliable

and not permanently available

Data rates and costs vary

Dynamic handover

Components are very heterogeneous

Analog and digital

Different standards

© Graphics: Microsoft,

P. Marwedel, 2011

Page 35: Cyber-physical systems: opportunities, problems and (some

- 35 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Verification problem

Real time model checking

Statistical model checking

..

“Fuzzy” Verification

• Implementation will not correspond to specification

exactly

Boolean decision “specification is met/not met” has to

be replaced by a level of confidence l, 0 ≤ l ≤ 1

New verification techniques required

George Pappas: Science of Cyber-Physical Systems Bridging CS and

Control, 2012 NSF CPS PI meeting, http://cps-vo.org/node/5876

Axel Legay

Kim G. Larsen

Page 36: Cyber-physical systems: opportunities, problems and (some

- 36 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Real vs. floating point numbers

Physics:

Many physical quantities described as (real number, unit)

Infinitely many real numbers

Cyber:

Floating point numbers as an approximation

Finite number of floating point values

Absolute resolution depends on size of value

Mismatch!

W. Taha, R. Cartwright: Some Challenges for Model-Based Simulation, The 4th Analytic

Virtual Integration of Cyber-Physical Systems Workshop, Dec. 2013, Vancouver

© Graphics: Microsoft,

P. Marwedel, 2015

Page 37: Cyber-physical systems: opportunities, problems and (some

- 37 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Big Data

Examples:

LHC/Geneva: 25 Petabytes/year

Sloan Digital Sky Survey: 200 GB/night

Data from navigation systems

Data from social networks

Getting to the limits of classical data bases

©Photo: CERN

Page 38: Cyber-physical systems: opportunities, problems and (some

- 38 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Zeno behavior

Due to damping, each cycle

is shorter than the previous

one.

Let be a time interval

Is there an upper bound on

the number of bounces in ?

Example: Ideal collision & damping

assuming point mass

0

y>0, t<0: ÿ(t)=-g

y=0: ẏ(0)=- maxt<0(ẏ(t))

Ideal model for one collision

at t=0:

Assume repeated collisions

A system shows Zeno

behavior if there can be an

unlimited number of jumps in

a finite time.

Requires hybrid simulation

NO y

t

….

Page 39: Cyber-physical systems: opportunities, problems and (some

- 39 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

More objectives/constraints

In addition to challenges already mentioned:

quality of the results (QoS, ..)

cost, size

weight

EMC characteristics

radiation hardness

environmental friendliness, ..

© Graphics: Microsoft,

P. Marwedel, 2011

Page 40: Cyber-physical systems: opportunities, problems and (some

- 40 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

CPS design is multidisciplinary

CS

Physics

Knowledge from many areas must be available,

Walls between disciplines must be torn down

EE

medicine,

statistics,

ME, biology

© Graphics: Microsoft

Page 41: Cyber-physical systems: opportunities, problems and (some

- 41 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Problems with classical CS theory and

von Neumann (thread) computing

Even the core … notion of “computable” is at

odds with the requirements of embedded software.

In this notion, useful computation terminates, but termination

is undecidable.

In embedded software, termination is failure, and yet to get

predictable timing, subcomputations must decidably

terminate.

What is needed is nearly a reinvention of computer science.

Edward A. Lee: Absolutely Positively

on Time, IEEE Computer, July, 2005

Search for non-thread-based, non-von-Neumann MoCs.

Page 42: Cyber-physical systems: opportunities, problems and (some

- 42 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Models

Definition: A model is a simplification of another entity,

which can be a physical thing or another model. The model

contains exactly those characteristics and properties of the

modeled entity that are relevant for a given task. A model

is minimal with respect to a task if it does not contain any

other characteristics than those relevant for the task. [Jantsch, 2004]:

Page 43: Cyber-physical systems: opportunities, problems and (some

- 43 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Wishlist for specification & modeling techniques

Hierarchy

• Humans cannot understand systems

containing > ~5 objects.

Most actual systems require more objects

Hierarchy (+ abstraction)

Component-based design

• Systems must be designed from components

Support for designing reactive systems

• State-oriented behavior

• Event-handling

• Exception-oriented behavior

Page 44: Cyber-physical systems: opportunities, problems and (some

- 44 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Wishlist for specification & modeling techniques

(2)

Presence of programming elements

Executability (no algebraic specification)

Support for the design of large systems ( Object Orientation)

Domain-specific support

Readability

Portability and flexibility

Termination

Support for non-standard I/O devices

Non-functional properties

Support for the design of dependable systems

No obstacles for efficient implementation

Adequate model of computation

© Graphics: Microsoft

Page 45: Cyber-physical systems: opportunities, problems and (some

- 45 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Models

Models of computation should define:

Components and an execution model for

computations for each component

Communication model for exchange of information

between components.

C-1

C-2

Page 46: Cyber-physical systems: opportunities, problems and (some

- 46 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 46 -

Standard

techniques

Own

results

Outline

Page 47: Cyber-physical systems: opportunities, problems and (some

- 47 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Some models of computation

* Classification based on implementation with centralized data structures

Communication/

local computations

Shared

memory

Message passing

Synchronous | Asynchronous

Undefined

components

Plain text, use cases

| (Message) sequence charts

Different. equations Modelica, Matlab, ….

CFSM StateCharts SDL

Data flow Scoreboarding +

Tomasulo Algor. ->

Comp.Architecture

Kahn networks,

SDF

Petri nets C/E nets, P/T nets, …

Discrete event (DE)

model

VHDL,Verilog,

SystemC*, … Only experimental systems, e.g.

distributed DE in Ptolemy

V.Neumann threads C, C++,Java C, C++, Java with libraries

CSP, ADA |

Radu

Gro

su

Kim G. Larsen

More details in my

textbook & on youtube

(cyphysystems)

Page 48: Cyber-physical systems: opportunities, problems and (some

- 48 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Integrated simulation: Modelica

Component/device

Each Icon represents a physical component.

(electrical resistance, mechanical device, pump, ...)

A connection line represents the actual physical

coupling (wire, fluid flow, heat flow, ...)

A component consists of connected sub-components

(= hierarchical structure) and/or is described by

equations.

By symbolic algorithms, the high level Modelica

description is transformed into a set of explicit

differential equations:

Connection Connector

( ) ( ( ), )

( ) ( ( ), )

t t t

t t t

x f x

y f x

0 ( ( ), ( ), ( ), )t t t t f x x y

Schematics

https://www.modelica.org/education/educational-material/ lecture-material/english/ ModelicaOverview.ppt

Page 49: Cyber-physical systems: opportunities, problems and (some

- 49 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Break

Page 50: Cyber-physical systems: opportunities, problems and (some

- 50 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 50 -

Standard

techniques

Own

results

Outline

Page 51: Cyber-physical systems: opportunities, problems and (some

- 51 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Worst case execution times (WCETs)

Complexity:

in the general case: undecidable if a bound exists.

for restricted programs: simple for “old“ architectures,

complex for new architectures with pipelines, caches,

interrupts, virtual memory, etc.

Approaches:

for hardware: requires detailed timing behavior

for software: requires machine programs; complex analysis

© Graphics: Microsoft

Page 52: Cyber-physical systems: opportunities, problems and (some

- 52 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

WCET estimation: AiT (AbsInt)

Implicit path enumeration technique

• Objective function: execution time as a

function of the execution time of blocks.

To be maximized.

• Constraints: dependencies between

blocks.

• No explicit consideration of all paths

Page 53: Cyber-physical systems: opportunities, problems and (some

- 53 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Implicit path enumeration technique (IPET):

Example

/* Objective function = WCET to be maximized*/

21 x2 + 27 x7 + 2 x11 + 2 x14 + 20 x16 + 13 x18 + 20 x19;

/* CFG Start Constraint */ x0 - x4 = 0;

/* CFG Exit Constraint */ x1 - x5 = 0;

/* Constraint for flow entering function main */

x2 - x4 = 0;

/* Constraint for flow leaving exit node of main */

x3 - x5 = 0;

/* Constraint for flow entering exit node of main */

x3 - x20 = 0;

/* Constraint for flow entering main = flow leaving main */

x2 - x3 = 0;

/* Constraint for flow leaving CFG node _main */

x2 - x6 = 0;

/* Constraint for flow entering CFG node _L1 */

x7 - x8 - x6 = 0;

/* Constraint for flow leaving CFG node _L1 */

x7 - x9 - x10 = 0;

/* Constraint for lower loop bound of _L1 */

x7 - 101 x9 >= 0;

/* Constraint for upper loop bound of _L1 */

x7 - 101 x9 <= 0; ….

Equations per node

Sum of incoming edge

variables = #exec. of node

Sum of outgoing edge

variables = #exec. of node

ILP _main: 21 cycles

_L1: 27

_L3: 2

_L4: 2

_L5: 20

_L6: 13

_L2: 20

x7

x6

x8

x9

x10

x2

x18

Page 54: Cyber-physical systems: opportunities, problems and (some

- 54 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Real-time calculus (RTC)/

Modular performance analysis (MPA)

1

2

3

p 2p 3p

u

l

1

2

3

p 2p 3p

u

l

p-J p+J

Thiele et al. (ETHZ): Extended network calculus:

Arrival curves describe the maximum and minimum number of events

arriving in some time interval .

periodic event stream periodic event stream with jitter

p p p-J P+J

Streams of events important: Examples

Page 55: Cyber-physical systems: opportunities, problems and (some

- 55 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

RTC/MPA: Service curves

Service curves u resp. ℓ describe the maximum and

minimum service capacity available in some time interval

s

p

bandwidth b

TDMA bus

p s p-s p+s

b s

2p

ul

Example:

t

Volume

Page 56: Cyber-physical systems: opportunities, problems and (some

- 56 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

RTC/MPA: Workload characterization

u resp. ℓ describe the maximum and minimum service

capacity required as a function of the number e of events.

Example:

1 2 3

4

8

12

16

e

WCETEST=4

BCETEST=3

u

l (Defined

only for

an integer

number of

events)

Page 57: Cyber-physical systems: opportunities, problems and (some

- 57 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

RTC/MPA: Workload required for incoming

stream

uuu

Incoming workload

lll

Upper and lower bounds on the number of events

ulu

1

)( lul

1

)(

Page 58: Cyber-physical systems: opportunities, problems and (some

- 58 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

RTC/MPA: System of real time components

ul

,

RTC

RTC’

','

u

RTC”

','ul

ul

,

Incoming event streams and available capacity

are transformed by real-time components:

Page 59: Cyber-physical systems: opportunities, problems and (some

- 59 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 59 -

Standard

techniques

Own

results

Outline

Page 60: Cyber-physical systems: opportunities, problems and (some

- 60 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Evaluation of energy consumption E: Challenges

E hardly predictable from source code

Small code variations possibly large variations in E

E must be predicted from executable code

(like the WCET)

E might depend on instance of HW

© Graphics: Microsoft

ESTWCET max

0

,)(max

tdttPE

t

el

Pel(t)

Page 61: Cyber-physical systems: opportunities, problems and (some

- 61 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

How to obtain Pel(t)?

Measurements (potentially precise, fixed architecture):

• Currents difficult to measure precisely

• Tiwari (1994), Russell, Jacome (1998), ..

• Odroid (see later slide)

Models (flexible architecture, less precise):

• (H)SPICE, CACTI [Jouppi, 1996], Wattch [Brooks, 2000]:

• Commercial offerings

Combined models

• Steinke et al., TU Dortmund (2001), …

© Photo, P.

Marwedel, 2015

Page 62: Cyber-physical systems: opportunities, problems and (some

- 62 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Battery models

(Chemical) & physical models

e.g. concentrated solution theory, partial differential eq.s

Empirical models

Simple equations, inaccurate

• Peukert’s law: lifetime= C/I, with empirical

• Weibull fit

Abstract models

• Electrical circuit models

• Discrete time model (e.g. in VHDL)

• Stochastic models (e.g. Markov processes)

Mixed models

e.g. electrical models with physical explanation

So

urc

es inclu

de: R

. R

ao

, S

. V

rud

hu

la, D

.N.

Rakh

ma

tov: B

att

ery

Mod

elin

g

for

En

erg

y-A

wa

re S

yste

m D

esig

n, IE

EE

Co

mp

ute

r, 2

00

3, p

p. 7

7

fre

quently w

ith f

itting

Page 63: Cyber-physical systems: opportunities, problems and (some

- 63 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Model proposed by Chen and Rincón-Mora

Full charge capacitor: CCapacity = 3600 Capacity f1(cycle) f2(Temp)

Self-discharge resistor: RSelf-Discharge (might depend on parameters)

Current dependency of VBatt: modeled by Rseries+RTransient_S+RTransient_L

IBatt charges and discharges CCapacity

Voltage controlled voltage source V0C captures nonlinear dependency

between the state of charge and V0C (measurement can take days)

RSeries: models immediate voltage drop at load change

Source: M. Chen, G. A.

Rincón-Mora: Accurate

Electrical Battery Model

Capable of Predicting

Runtime and I-V

Performance, IEEE

Trans. on Energy

Conversion, 2006, pp.

504

RSel

f-D

isch

arg

e

CC

apaci

ty

I Batt

VSOC

IBatt

+ -

RSeries RTransient_S RTransient_L

CTransient_L CTransient_S VBatt

V0C(V

SO

C)

Page 64: Cyber-physical systems: opportunities, problems and (some

- 64 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Evaluation of thermal behavior

A

l

(1) l

ATPth

Where

Pth : thermal power transferred

: thermal conductivity

T : temperature difference

A : area

l : length

(2) A

l

P

TR

th

th

Thermal resistance

Thermal conductivity

Page 65: Cyber-physical systems: opportunities, problems and (some

- 66 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Dynamic thermal behavior

Thermal capacity:

Cth = m c, Cth: thermal capacity, m: mass, c: specific heat

Tfan: transient with time constant

t

Tfan

Rth,die

Rth,fan

Ground Reference temperature

Tfan

Pth Cth,fan

+ -

Page 66: Cyber-physical systems: opportunities, problems and (some

- 67 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Equivalences

Electrical model Thermal model

Current I Thermal flow,

flow of “power”

Pth=

Total charge Q = I dt Thermal energy Eth = Pth dt

Resistance R Thermal resistance Rth

Potential Temperature T

Voltage = potential

difference

U= Temperature difference T

Capacitance C Thermal capacitance Cth

Ohm’s law U = R I Temperature at Rth T = Rth Pth

Page 67: Cyber-physical systems: opportunities, problems and (some

- 68 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Impact of temperature on reliability

Approximation: Black’s Equation:

MTTF =𝐴

𝑗𝑒𝑛 𝑒

𝐸𝑎𝑘𝑻

where

A : constant

je : current density

n : constant (1..7, controversial, 2 according to Black)

Ea : activation energy (e.g. ~ 0.6 eV)

k : Boltzmann constant (~ 8.617 10-5 eV/K)

T : Temperature • J. Bernstein et al.: Electronic circuit reliability modeling,

Microelectronic Reliability 46 (2006) 1957-1979

• J.R. Black.: Electromigration Failure Modes in Aluminium

Metallization for Semiconductor Devices. Proceedings of

the IEEE, Vol. 57, p. 1587-1594, 1969

Page 68: Cyber-physical systems: opportunities, problems and (some

- 69 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Let V: time until first failure (random variable) *

Let f(v) be the density function of V *

Reliability: f(v), F(v)

f(v)

v

F(v) = probability of the system being faulty at time v:

F(v) = Pr(V≤v)

Example: Exponential distribution

vvx

v

x eedxevF 1][)( 0

0

F(v) 1

v

Example: Exponential distribution

f(v)=e-v

v

dxxfvF0

)()(

* Replacing commonly used T by V and t by v to avoid confusion with temperatures.

Appropriate for

constant failure rate

Page 69: Cyber-physical systems: opportunities, problems and (some

- 72 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

MTTF = E{V }, the statistical mean value of V

0

)(}{ dvvfvVE MTTF

dveevdvev vvvλ

0

0

0

exp

MTTF

wuwuwu ''

Example: Exponential distribution

110

110exp teMTTF

According to the definition of

the statistical mean value

MTTF is the reciprocal value of failure rate.

Page 70: Cyber-physical systems: opportunities, problems and (some

- 76 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Which design should we select?

Let X: m-dimensional solution space for the design problem.

Example: dimensions correspond to # of processors, size of

memories, type and width of busses etc.

Let F: n-dimensional objective space for the design problem.

Example: dimensions correspond to average and worst case

delay, power/energy consumption, size, weight, reliability, …

Let f(x)=(f1(x),…,fn(x)) where xX be an objective function.

We assume that we are using f(x) for evaluating designs.

solution space objective space

f(x)

x x

Page 71: Cyber-physical systems: opportunities, problems and (some

- 77 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Pareto points

ii

ii

wuni

wuni

:},...,1{

:},...,1{

We assume that, for each objective, an order < and the

corresponding order are defined.

Definition:

Vector u=(u1,…,un) F dominates vector w=(w1,…,wn) F

u is “better” than w with respect to one objective and not

worse than w with respect to all other objectives:

A solution xX is called Pareto-optimal with respect to X

there is no solution yX such that u=f(x) is dominated by

w=f(y). x is a Pareto point.

Page 72: Cyber-physical systems: opportunities, problems and (some

- 78 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Graphically

Pareto point Pareto front

Page 73: Cyber-physical systems: opportunities, problems and (some

- 79 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 79 -

Standard

techniques

Own

results

Outline

Page 74: Cyber-physical systems: opportunities, problems and (some

- 80 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Detection of nano objects using plasmon effect

(Optical effect of objects ≪ wavelength of light)

Energy efficient (bio-) virus detection

Truly a cyber-physical system

© SFB 876

Page 75: Cyber-physical systems: opportunities, problems and (some

- 81 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Reflectivity changed if virus attaches to surface

55,0 55,2 55,4 55,6 55,8 56,0 56,2

-0,04

-0,02

0,00

0,02

0,04

0,06

Sig

na

l (

I/I)

incidence angle, grad

Reflectivity

t

Page 76: Cyber-physical systems: opportunities, problems and (some

- 82 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Mapping to Embedded Odroid (1)

O. Neugebauer, P. Libuschewski, M. Engel, H. Müller, P. Marwedel: Plasmon-

based Virus Detection on Heterogeneous Embedded Systems, SCOPES, 2015

Allows power measurements!

Page 77: Cyber-physical systems: opportunities, problems and (some

- 83 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Mapping to Embedded Odroid (2)

O. Neugebauer, P. Libuschewski, M. Engel, H. Müller, P. Marwedel: Plasmon-

based Virus Detection on Heterogeneous Embedded Systems, SCOPES, 2015

Real energy

measurements!

Page 78: Cyber-physical systems: opportunities, problems and (some

- 84 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Results (1)

O. Neugebauer, P.

Libuschwewski, M.

Engel, H. Müller, P.

Marwedel: Plasmon-

based Virus Detection

on Heterogeneous

Embedded Systems,

SCOPES, 2015

Tradeoff

between

detection

quality and

energy

consumption!

Page 79: Cyber-physical systems: opportunities, problems and (some

- 85 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Results (2)

O. Neugebauer, P.

Libuschwewski, M.

Engel, H. Müller, P.

Marwedel: Plasmon-

based Virus Detection

on Heterogeneous

Embedded Systems,

SCOPES, 2015

Optimization

of both

hardware

and software

Page 80: Cyber-physical systems: opportunities, problems and (some

- 86 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 86 -

Standard

techniques

Own

results

Outline

Page 81: Cyber-physical systems: opportunities, problems and (some

- 87 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

How to take timing constraints into account?

1. Specification of CPS/ES system

2. Generation of Code (ANSI-C or similar)

3. Compilation of Code

4. Execution and/or simulation of code,

using a (e.g. random) set of input data

5. Measurement-based computation of “estimated worst

case execution time” (WCETmeas)

6. Adding safety margin m on top of WCETmeas: WCEThypo := (1 + m)* WCETmeas

7. If “WCEThypo” > deadline: change some detail, go back to

1 or 2.

Trial-and-error approach!

Page 82: Cyber-physical systems: opportunities, problems and (some

- 88 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Problems with this Approach

Dependability

Computed “WCEThypo” not a safe approximation

Time constraint may be violated

Design time

How to find necessary changes?

How many iterations until successful?

“Make the common case fast” a wrong approach for RT-

systems

Computer architecture and compiler techniques focus on average

speed

Circuit designers know it’s wrong

Compiler designers (typically) don’t

“Optimizing” compilers unaware of cost

functions other than code size

Common case fast

© Graphics:

Microsoft

Page 83: Cyber-physical systems: opportunities, problems and (some

- 89 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Integration of formal WCETEST estimation

First step: formal analysis of

WCETEST, using, for example, aiT of

AbsInt

• Remaining problem:

Lack of cost function in compiler,

code not optimized for WCETEST

Second step: integration of WCET

bound computation (e.g. aiT) into

compiler, generation of WCETEST-

optimized code

Compiler

WCET-

analysis

Source code

Compiler WCET-

analysis

Source code

Page 84: Cyber-physical systems: opportunities, problems and (some

- 90 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Integration of WCETEST estimation and

compilation

Why not

consider

WCETEST as

an objective

function

already in the

compiler?

Integration

of WCETEST

analysis tool

aiT into

compiler

Standard-Compiler

structure

Page 85: Cyber-physical systems: opportunities, problems and (some

- 91 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

WCET-oriented optimizations

Extended loop analysis (CGO 09)

Instruction cache locking (CODES/ISSS 07, CGO 12)

Cache partitioning (WCET-Workshop 09)

Procedure cloning (WCET-WS 07, CODES 07, SCOPES 08)

Procedure/code positioning (ECRTS 08, CASES 11 (2x))

Function inlining (SMART 09, SMART 10)

Loop unswitching/invariant paths (SCOPES 09)

Loop unrolling (ECRTS 09)

Register allocation (DAC 09, ECRTS 11))

Scratchpad optimization (DAC 09)

Extension towards multi-objective optimization (RTSS 08)

Superblock-based optimizations (ICESS 10)

Surveys (Springer 10, Springer 12)

© Graphics:

Microsoft

Page 86: Cyber-physical systems: opportunities, problems and (some

- 92 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Relative WCETEST with I-Cache Locking 5 Bench-

marks/ARM920T/Postpass-Opt

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

110%

64 128 256 512 1024 2048 4096 8192 16384

Cache Size [bytes]

Re

l. W

CE

T_

ES

T [

%]

ADPCM G723 Statemate Compress MPEG2

(ARM920T)

[S. Plazar et al.]

Page 87: Cyber-physical systems: opportunities, problems and (some

- 93 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Register Allocation

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

110%

adpcm

_ver

ify

cjpeg

_tra

nsupp

com

pres

s crc

dijkst

raduff

edge_

detect ed

nep

ic

expin

tfd

ct

fft_1

024

fft_2

56 fir

fir2d

imgsm

gsm_e

ncode h26

3

h264d

ec_b

lock

h264d

ec_m

acro

iir_4_

64

iir_bi

quad_N

jfdct

int

latn

rm_3

2_64

lmsf

ir_8_

1

lmsf

ir_32

_64

lpc

ludcm

p

mat

mult

mat

rix2_

fixed

mat

rix2_

float

md5

min

ver

mult_

10_10

mult_

4_4

ndes

prime

qmf_

rece

ive

qmf_

tran

smit

qurt

rijndae

l_en

c

sele

ctsh

a

spec

tral

star

tup

v32_

benc

Ave

rage

Re

lati

ve

WC

ET

ES

T [

%]

(Op

tim

iza

tio

n L

ev

el -O

3)

100% = WCETEST using Standard Graph Coloring (highest degree)

[H. Falk]

Page 88: Cyber-physical systems: opportunities, problems and (some

- 94 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scratch pad memories (SPM):

Fast, energy-efficient, timing-predictable

Address space

ARM7TDMI

cores, well-

known for low

power

consumption

scratch pad memory

0

FFF..

Example

Small; no

tag memory

SPMs are small,

physically

separate

memories

mapped into the

address space;

Selection is by

an appropriate

address decoder

(simple!)

SPM

select

Page 89: Cyber-physical systems: opportunities, problems and (some

- 95 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Property of the

PREDATOR consortium;

© Photo: P. Marwedel

WCETEST-aware SPM allocation

Setup

Bosch Democar: Runnable: IgnitionSWCSync

Part of task actuator, activated every 90° of crankshaft

angle time-critical

WCETEST-aware scratch pad memory (SPM) allocation

of program code by WCC, including fully automated

WCETEST analyses using aiT and solution of the ILP for

SPM allocation

WCETEST reduced to about 50%, compared to gcc.

PREDATOR project partners Bosch & Airbus interested in

WCC

Page 90: Cyber-physical systems: opportunities, problems and (some

- 99 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 99 -

Standard

techniques

Own

results

Outline

Page 91: Cyber-physical systems: opportunities, problems and (some

- 100 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Tradeoff between reliability and timeliness

Traditional error correction requires resources,

including time, may violate time constraint of CPS

Conflicting with timing requirements of real-time

systems

➁ ➀

©

Page 92: Cyber-physical systems: opportunities, problems and (some

- 101 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Flexible Error Correction

In some cases, errors have no effect

In some cases, timing requirements are dominating & error

correction may be compromised

In other cases, error correction requirements are

dominating & timing requirements may be compromised

Imprecise output No effect System crash

unused

variable i

unused

variable j

Register 0

Register 1

Register 2

Register 3

Classification requires application knowledge

Page 93: Cyber-physical systems: opportunities, problems and (some

- 102 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Reliability Annotations

Annotate impact of faults in the source code using type

qualifiers

− Errors cannot be tolerated

reliable int r;

unreliable int u;

r = u; // invalid

u = r; // okay

Inhibit propagation of faults to reliable data

− Unreliable data must not have any effect on reliable data

Use of type qualifiers can be checked by static analysis

− Errors will have non-fatal consequences

Page 94: Cyber-physical systems: opportunities, problems and (some

- 103 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Compile-time actions

Classifi-

cation

Executable

Compiler

Source code with

annotations providing

application knowledge

• Encoding of

classification

Application Knowledge:

• Impact of errors

• Feasible correction methods

unreliable int j;

reliable int control;

reliable int y = control;

Propagation of

annotations and

inference of error

classes 0110110101110111

0001010111011001

1101110101101100

1101010100100101

• Source code analysis

variables: x, y, control

address: 0xe01fd08c

size: 12 bytes

class: reliable

correction: recovery_2

Page 95: Cyber-physical systems: opportunities, problems and (some

- 104 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Run-time actions

Classifi-

cation

Operating System

Executable

• Error-Resilient

• Implements

error handling

Runtime

Conditions

Hardware includes

reliable as well as

unreliable components

RCB

Page 96: Cyber-physical systems: opportunities, problems and (some

- 105 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Results

Added type qualifiers to C source code of JPEG decoder

and constrained baseline H.264 decoder (> 3000 LOC)

Fault injection experiment

• No faults are injected into reliable data

• 240 faults per second are injected into the memory

ranges storing unreliable data

No unintended terminations (crashes) if faults are

injected only into the unreliable data objects

Average PSNR of frames with errors: 40.89dB

(still recognizable)

Page 97: Cyber-physical systems: opportunities, problems and (some

- 106 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Results (cont.)

Results for H.264 decoder

Video

resolution

Memory size of reliable data Memory size of unreliable data

176 x 144 91 kB ( 55% ) 74 kB ( 45% )

352 x 288 223 kB ( 43% ) 297 kB ( 57% )

1280 x 720 1,585 kB ( 37% ) 2,700 kB ( 63% )

Impact of uncorrected errors on the quality of service:

Injection into unreliable memory 240 faults / sec 80 faults / sec

Average PSNR of frames with errors 40.89 dB 50.57 dB

Deteriorated reliability/QoS, timeliness maintained!

Page 98: Cyber-physical systems: opportunities, problems and (some

- 107 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Reduction of jitter

Flexible

error

handling

allows

significant

jitter

reduction

even at high

fault

injection

rates

Schmoll et al.: Improving the Fault Resilience of an H.264 Decoder using Static Analysis Methods. ACM TECS, 2013

Heinig et al.: Classification-based Improvement of App. Robustness and QoS in Probabilistic Computer Systems, ARCS’12

Heinig et al.: Using Application Knowledge to Improve Embedded Systems Dependability, HotDep 2011

10-5 10-6

Page 99: Cyber-physical systems: opportunities, problems and (some

- 108 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 108 -

Standard

techniques

Own

results

Outline

Page 100: Cyber-physical systems: opportunities, problems and (some

- 109 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Two metrics for the behavior of memories

Potential

improvement is

determined by the

ratio S between

objectives for large

and small memories.

Can even be larger

for larger memories

Memory

hierarchies

energy

time

ratio

S

Page 101: Cyber-physical systems: opportunities, problems and (some

- 110 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Introduction of memory hierarchies

“Ideally one would desire an indefinitely large

memory capacity such that any particular ...

word ... would be immediately available - i.e. in a

time which is ... shorter than the operation time

of a fast electronic multiplier. ...

It does not seem possible physically to achieve

such a capacity.

We are therefore forced to recognize the

possibility of constructing a hierarchy of

memories, each of which has greater capacity

than the preceding but which is less quickly

accessible.”

Registers (SRAM)

Caches/scratch pad

Main or primary memory (DRAM)

Disk cache (DRAM)

Secondary memory (Disks, Flash)

Tertiary memory (Optical, cloud)

A.W. Burks, H.H. Goldstine, and J. von Neumann: Preliminary

Discussion of the Logical Design of an Electronic Computing

Element, 1946

Page 102: Cyber-physical systems: opportunities, problems and (some

- 111 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Performance impact of caches

Access time for elements of size NPAD*8 Byte in a linked

list, stored in an array

U. Drepper: What every programmer should know about memory*, 2007, http://www.akkadia.org/drepper/

cpumemory.pdf; thanks to J. Teubner for pointing to this source. * stimulated by David Goldberg, What

every programmer should know about floating point arithmetic, ACM Computing Surveys, 1991

Configuration

Pentium P4

16 kB L1 data cache, 4 cycles/access

1 MB L2 cache, 14 cycles/access

main memory, 200 cycles/access

© Graphics: U.

Drepper, 2007

Page 103: Cyber-physical systems: opportunities, problems and (some

- 112 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Cycles/access as a function of the size of the list

L1d L2 hit L2 miss*

* prefetching succeeds

L1d L2 hit L2 miss§

§ prefetching fails © Graphics: U.

Drepper, 2007

Page 104: Cyber-physical systems: opportunities, problems and (some

- 113 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Migration of data & instructions,

global optimization model (TU Dortmund)

Which memory object (array,

loop, etc.) to be stored in SPM?

Non-overlaying (“Static”)

allocation:

Gain gk and size sk for each object

k. Maximize gain G = gk,

respecting size of SPM SSP sk.

Solution: Knapsack algorithm.

Overlaying (“dynamic”)

allocation:

Moving objects back and forth Processor

Scratch pad

memory,

capacity SSP

main

memory

?

For i .{ }

for j ..{ }

while ...

Repeat

call ...

Array ...

Int ...

Array

Example:

Page 105: Cyber-physical systems: opportunities, problems and (some

- 114 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

How much better can we get?

where

: fraction of memory references

replaced by faster/more energy efficient memory

and

S: speed/energy improvement

Important not to have many “untouchable” references (1- ),

otherwise even S does not help

S

timprovemen

)1(

1(Amdahl’s law) *

S

1

1/(1- )

* Replacing commonly used P by to avoid confusion with power

Page 106: Cyber-physical systems: opportunities, problems and (some

- 115 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Results for parts of GSM coder/decoder

“Working set“

Page 107: Cyber-physical systems: opportunities, problems and (some

- 116 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Non-overlaying allocation problematic for

multiple hot spots Overlaying allocation

Effectively results in a kind

of compiler-controlled

overlays for SPM

Address assignment within

SPM required

CPU

Memory

Memory

SPM

Page 108: Cyber-physical systems: opportunities, problems and (some

- 117 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Overlaying allocation by Verma et al. (1)

C

DEF A

USE A

USE A

MOD A USE C

USE C

B1

B2

B3

B4

B5

B6

B7

B8

Based on control flow graph.

M.Verma, P.Marwedel: Dynamic Overlay of Scratchpad

Memory for Energy Minimization, ISSS, 2004

Page 109: Cyber-physical systems: opportunities, problems and (some

- 118 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Overlaying allocation by Verma et al. (2)

SPILL_STORE(A);

SPILL_LOAD(C);

SPILL_LOAD(A);

C

DEF A

USE A

USE A

MOD A USE C

USE C

B1

B2

B3

B4

B5

B6

B7

B8

B9

B10

Global set of ILP equations

reflects cost/benefit relations

of potential copy points

Code handled like data

Page 110: Cyber-physical systems: opportunities, problems and (some

- 119 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Runtime/energy reduction with respect to

non-overlaying (“static”) allocation

Page 111: Cyber-physical systems: opportunities, problems and (some

- 120 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Less seriously …

Some people got already completely rid of

cache

© I

EE

E, 2

01

2

Content not shown in public version of the slides

Page 112: Cyber-physical systems: opportunities, problems and (some

- 121 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Resource aware data analysis

Helena Kotthaus, Ingo Korb, Peter Marwedel:

Performance Analysis for Parallel R Programs:

Towards Efficient Resource Utilization, Technical

Report 1/2015, TU Dortmund, CS Department

Finding impact of treatment

for class of patients

Finding the best model to

predict survival rates of

cancer patients

Requires a huge amount of

model evaluations

Can be mapped to multi-

cores

However: how many

threads should be used?

© Graphics:

SFB 876

Page 113: Cyber-physical systems: opportunities, problems and (some

- 122 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

4 cores, no load balancing

Helena Kotthaus, Ingo

Korb, Peter Marwedel:

Performance Analysis

for Parallel R

Programs: Towards

Efficient Resource

Utilization, Technical

Report 1/2015, TU

Dortmund, CS

Department

Memory

congestion

low CPU

utilizations

Page 114: Cyber-physical systems: opportunities, problems and (some

- 123 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

4 cores, with load balancing

Helena Kotthaus, Ingo

Korb, Peter Marwedel:

Performance Analysis for

Parallel R Programs:

Towards Efficient

Resource Utilization,

Technical Report 1/2015,

TU Dortmund, CS

Department

No memory

congestion

high CPU

utilizations

Page 115: Cyber-physical systems: opportunities, problems and (some

- 124 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 124 -

Standard

techniques

Own

results

Outline

Page 116: Cyber-physical systems: opportunities, problems and (some

- 125 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

CS, EE or physics concentration

vs. separate CPS/ES program

Specialization Separate

program

Well-known degrees + -

Enough headroom for teaching

integrated CPS/ES material

- +

Headroom for more depth in physics,

mechanical engineering, ..

- +

Effort for introduction small large

No. of faculty members required moderate larger

Building community? difficult easier

Is it feasible? For ES ok, for

CPS

questionable

Yes, but there

are also

constraints

Page 117: Cyber-physical systems: opportunities, problems and (some

- 126 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

ES fundamentals of

CPS selected

Books on fundamentals:

1st edition

• English

• Original hardcover version

• Reprint, soft cover, 2006

• German, 2007

• Chinese, 2006

• Macedonian, 2010

2nd edition, with CPS

• English, Dec. 2010/Jan. 2011

• Translated Chinese edition,

2013

• Contract for German edition

Peter

Marwedel Peter

Marwedel

Peter

Marwedel

© Graphics: Springer, Science

Publishers, Ad Verbum

Peter

Marwedel

Peter

Marwedel Peter

Marwedel

Page 118: Cyber-physical systems: opportunities, problems and (some

- 127 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Mature course

“Cyber-physical system fundamentals”

1. Introduction (applications, challenges, design flows)

2. Specification and modeling (models of computation, …)

3. Embedded system hardware (HW loop, converters, proc.s)

4. System software (real-time OS, priority inversion)

5. Evaluation & validation (>1 objective & Pareto optimality)

6. Application mapping (scheduling)

7. Optimizations

8. Test

Page 119: Cyber-physical systems: opportunities, problems and (some

- 128 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Slides and videos available

2nd generation videos are available at

http://www.youtube.com/user/cyphysystems

Page 120: Cyber-physical systems: opportunities, problems and (some

- 129 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Value of lectures?

Lectures: value compared to

videos if no interaction?

Lectures communicate facts,

they are not training skills.

“Lectures aren‘t just boring,

They‘re Ineffective, Too, Study

Finds” http://news.sciencemag.org/education/2014/05/lectures-arent-

just-boring-theyre-ineffective-too-study-finds

Use presence of students to

their advantage! ( MOOCs)

© Photo:

P. Marwedel

Page 121: Cyber-physical systems: opportunities, problems and (some

- 130 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Teaching style @ CPSF: flipped classroom

Serious procrastination due to video availability

Home work and work in the classroom are flipped:

• Students watch videos at home

• Physical presence is used to work on work sheets

Interactive learning

Training for teamwork & communication skills

Taking advantage of student’s presence

Lab sessions focusing on practical training

Re-discovery of the usefulness of books

Early feedback for educator

Higher quality of recorded videos

© Photo:

P. Marwedel

Page 122: Cyber-physical systems: opportunities, problems and (some

- 131 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

© S

imp

so

ns

Related work S

imp

so

n‘s

experi

ence

with

flip

ped c

lassro

om

(not so serious)

Content not shown in public version of the slides

Page 123: Cyber-physical systems: opportunities, problems and (some

- 132 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Designed Integrated CPS program

Undergraduate level Graduate level

Informatik

34%

Elektrotechnik

22%

CPS

19%

Mathe

19%

Logistik

6%Informatik

27%

Elektrotechnik

19%

Logistik

9%

CPS

45%

Logistics

CS

EE

Math

CPS

CPS

CS

EE

Logistics

Page 124: Cyber-physical systems: opportunities, problems and (some

- 133 - technische universität

dortmund

fakultät für

informatik

P. Marwedel,

Informatik 12, 2015

SFB

876

Scope & definitions

Opportunities & examples

Challenges

Security, timing, energy, heat, reliability, control, .., specs

(Some) solutions

Modeling techniques (Intro)

Evaluation techniques (WCETRTCETMTTF)

Energy efficient virus detection with GPUs

Worst-case execution time aware compilation

Flexible error handling to maintain timeliness

Efficient memory accesses (SPM, thrashing)

Education in ES/CPS

Summary

- 133 -

Standard

techniques

Own

results

Summary Q&A?