steve parkes, albert ferrer university of dundee stuart...

43
SpaceWire-D Steve Parkes, Albert Ferrer University of Dundee Stuart Mills, Chris McClements, Alex Mason, Paul McKechnie, Pete Scott, Bruce Yu, STAR-Dundee Ltd 1 1

Upload: others

Post on 17-Aug-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

SpaceWire-D

Steve Parkes, Albert FerrerUniversity of Dundee

Stuart Mills, Chris McClements, Alex Mason, Paul McKechnie, Pete Scott, Bruce Yu,

STAR-Dundee Ltd

11

Presenter
Presentation Notes
Supporting – we care about our customers and supporting them is top priority SpaceWire – the technology we love Applications – we want to get our technology used
Page 2: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

New SpaceWire Protocols

SpaceWire Protocol ID–

ECSS-E-ST-50-51C

Identifies packets as belonging to a particular protocol

Remote Memory Access Protocol (RMAP)–

ECSS-E-ST-50-52C

Read from and write to memory in a remote node over a SpaceWire network

Ideal for configuration, control, housekeeping and data collection

Already being used on several missions

CCSDS Packet Transfer Protocol–

ECSS-E-ST-50-53C

Transfers CCSDS Space Packets over SpaceWire22

Page 3: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Deterministic SpaceWire (SpW-D)

SpaceWire for control applications

Determinism is essential–

Determinism means

Predictable

Delivery within time constraints

Constrained Architecture–

Time-slicing

Single SpaceWire link is deterministic

33

SpW MassMemoryInstrument

Page 4: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Determinism with Constrained Architecture

44

Inst. 1 Inst. 2 Inst. 3 SpaceWire Router

Inst. 4 Inst. 5

MassMemory

Data-HandlingProcessor

SpaceWire Router

ControllingNode

Read CommandRead Reply Read CommandRead Reply

Page 5: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Problem with Multiple Masters

55

Inst. 1 Inst. 2 Inst. 3 SpaceWire Router

Inst. 4 Inst. 5

MassMemory

Data-HandlingProcessor

SpaceWire Router

Read Command

Read Command

Page 6: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Determinism with Time-Slots

Time-codes used to define time-slots

Time-slot has same number as time-code that starts the time-slot

64 time-slots

66

Time-Slot 6

Time-Code 6

Time-Slot 7

Time-Code 7 Time-Code 8

Page 7: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Determinism with Time-Slots

77

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

0 1 2 3 4 ...

Y N N Y N ...

0 1 2 3 4 ...

N Y Y N N ...

Each initiator has a schedule table

Specifies in which time-slots an initiator isallowed to initiate an RMAP command

Page 8: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Time-Slot 0

88

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Write ReplyWrite Command

1

N

2

N

3

Y

4

N

...

...

1

Y

2

Y

3

N

4

N

...

...

Page 9: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Time-Slot 1

99

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Read ReplyRead Command

0

Y

2

N

3

Y

4

N

...

...

0

N

2

Y

3

N

4

N

...

...

Page 10: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Time-Slot 2

1010

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Read ReplyRead Command

0

Y

3

Y

4

N

...

...

0

N

3

N

4

N

...

...

Page 11: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Time-Slot 3

1111

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Read ReplyRead Command

1

N

2

N

4

N

...

...

1

Y

2

Y

4

N

...

...

Page 12: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

SpW-D Performance

1212

Time-code Time-code

HDR DATA

a

b

HDR

c

d

DATAe

DATAe

f

REPL

Y

g

h

REPL

Y

i

Page 13: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Initiator Constraints

Max data in RMAP read or write is limited

Must respond to time-code quickly–

Time-code to send RMAP command < 5 μs (a)

Must handle reply in a timely fashion

1313

Page 14: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Target Constraints

No modifications to RMAP target

Must respond to RMAP command quickly–

End of header to authorisation: < 5 μs (d)

Read or Write at least as fast as SpaceWire link can handle data 20 Mbytes/s

Read or Write latency: < 5 μs (f) –

Create reply: < 5 μs (g)

Can simply state that–

Target must respond to an RMAP command within

15 μs + time to transfer the data (at full SpW link speed)

1414

Page 15: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

SpW-D Performance

1515

Assumes average packet size is (4+L)/2 bytes where L = max length

Page 16: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Concurrent Data Transfer

1616

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Write ReplyWrite Command

1

N

2

N

3

Y

4

N

...

...

1

Y

2

Y

3

N

4

N

...

...

Read ReplyRead Command

Time and Space Partitioning of networkTime: using time-slotsSpace: using different links

Doubles the effective network bandwidth

Page 17: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Multi-Slot Data Transfer

For large data transfers

Allow RMAP transaction to run over many slots

1717

87 4845

89

89

63

45

48

96

87

87

96

Processor

Mass Memory

Time Slot 1 2 3 4 5 6 7

Page 18: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Multi-Slot Data Transfer:Time-Slot 0

1818

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Write ReplyWrite Command

1

Y

2

Y

3

Y

4

N

...

...

1

M

2

M

3

N

4

N

...

...

Read ReplyRead Command

Page 19: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Multi-Slot Data Transfer: Time-Slot 1

1919

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Read Reply

0

Y

2

Y

3

Y

4

N

...

...

0

M

2

M

3

N

4

N

...

...

Write ReplyWrite Command

Page 20: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Multi-Slot Data Transfer: Time-Slot 2

2020

Inst. 1 Inst. 2 Inst. 3 MassMemory

Data-HandlingProcessor

SpaceWire Router

Read Reply

0

Y

3

Y

4

N

...

...

0

M

3

N

4

N

...

...

Write ReplyWrite Command

Page 21: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Multi-Slot Performance

2121

Page 22: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

SpaceWire-D

Built on SpaceWire

and RMAP standards

Uses time-codes to produce time-slots

Schedules communication in time-slots

Uses RMAP transactions

Can support FDIR

Simple constraints:–

RMAP target

Speed of response to RMAP command

RMAP initiator

Speed of response to time-code

Limit to size of RMAP data field

Very simple to implement2222

Page 23: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

2323

Page 24: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

It is easy to make things complicated and difficult to keep them simple

The simpler something is the easier it is to check that it works properly

2424

Page 25: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Key Principles–

Simplicity

RMAP target unchanged

Provided it meets some (reasonable) performance criteria

FDIR more important than throughput

2525

Page 26: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Is everyone happy with–

Simple, concurrent and multi-slot scheduling?

Multiple transactions in a single time-slot?

Who specifies time-slot duration, data size, etc–

The standard or the system engineer?

Segmentation–

Responsibility of application or standard?

Only modify the initiator?

Retry and redundancy–

Should this be included in the protocol stack?

FDIR–

How important is this?

2626

Page 27: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

SpW-D Protocol Stack

2727

SpaceWire-D (Scheduling)

RMAP

SpaceWire-R (Retry/Redundancy)

PnP

User Application

SpaceWire

PTP

Page 28: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Is everyone happy with–

Simple, concurrent and multi-slot scheduling?

2828

Page 29: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Multiple transactions in a single time-slot?

2929

Page 30: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Who specifies time-slot duration, data size, etc–

The standard or the system engineer?

3030

Page 31: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Segmentation–

Responsibility of application or standard?

Only modify the initiator?

3131

Page 32: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

Retry and redundancy–

Should this be included in the protocol stack?

3232

Page 33: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Discussion

FDIR–

How important is FDIR?

3333

Page 34: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

3434

Page 35: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Amount of data in RMAP transaction?–

Currently 512 bytes

3535

Page 36: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Duration of time-slot?–

Currently 50 usec

Request for epoch of 1/64 second

Makes a time-slot 15.6 ms

Not very timely but may be adequated

3636

Page 37: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Allow various specific time-slot durations?

Allow system engineer to determine time-slot duration?

3737

Page 38: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Data rates on links–

Normally should all be the same

Do we allow links of slower data rate to be supported–

May be reducing the size of packet that can be transferred?

Or using multiple time-slots?

3838

Page 39: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Key thing is what do we specify/constrain in the standard?

We could leave it open and have devices specify key parameters e.g.–

Speed of response of target device

Data rate supported

3939

Page 40: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Multiple transactions in one time-slot?–

Would add flexibility to SpW-D

But make FDIR much more difficult–

Trade-off between flexibility/complexity vs

FDIR

4040

Page 41: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Segmentation–

Do we include segmentation of large RMAP transactions in the SpW-D protocol?

i.e. SpW-D able to perform any required RMAP transaction.

4141

Page 42: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

Retry and Redundancy–

Do we include this in the protocol stack?

Along with FDIR mechanisms?

4242

Page 43: Steve Parkes, Albert Ferrer University of Dundee Stuart ...spacewire.esa.int/WG/SpaceWire/SpW-WG-Mtg15... · Steve Parkes, Albert Ferrer University of Dundee. Stuart Mills, Chris

Things to be considered

4343