epics 2011 spring collaboration meeting, hsinchu, june 13-17, 2011 tps timing system & plan of...

EPICS 2011 Spring Collaboration Meeting, Hsinchu, June 13-17, 2011

TPS Timing SystemTPS Timing System&&

Plan of Machine Protection SystemPlan of Machine Protection System

Chun-Yi WuTPS Control Team

NSRRC, Hsinchu, Taiwan

June 16, 2011

2EPICS 2011 Spring Collaboration Meeting, Hsinchu, June 13-17, 2011

• TPS Timing System– Hardware– Timing network– Timestamp for TPS timing system – Operation status of TPS linac timing

• Plan of Machine Protection System– Hardware – MPS network structure– Response time of fast protection system– Health check

• Summary

Outline


GunLinac LTB

BTS

Booster RingStorage Ring

333.333 msec

TRF = 2.00139 nsecTBR = TRF x 828 = 1.657 μsTSR = TRF x 864 = 1.729 μsTcoinc = TBR x 24 = 39.768 μs

BR-CLK

SR-CLK

COINC-CLK Sync every 39 μs(24 turns of BR and 23 turns of SR)

0

0

24

23

TPS Machine Clocks

Transfer to SR3 GeV – BR Ext

Energy Ramping

150 MeV – BR Inj t


Timing System Selection

• Event system is the most advanced timing system.• It adopt by many synchrotron light sources.• Performance and functionality are pretty well for synchrotron light source

applications.• Select event system are very nature!

• Form factor selectionTPS accelerator controls will adopt cPCI as standard EPICS

platform.Only 6U form factor will support for Phase I.Negotiate with MRF to redesign the EVG/EVR.

Delivery of the first lot of event system module in late 2010.First operation in Spring 2011 – delivery service for the TPS linac operation.

• Distribution system– Long distance (~300 m): single mode fiber is most cost effective (> 100

m).– Short distance (< 50 m): OM3 multi mode fiber will be used.


cPCI-EVRTG-300(e-Gun Trigger)

Fan-Out Concentrator

Timing System Hardware

Universal I/O TTL Interlock Input ModuleUniversal I/O TTL Input UNIV-TTLIN Universal I/O TTL Output UNIV-TTLUniversal I/O TTL Output Module w/ Delay TuningUniversal I/O NIM Output UNIV-NIMUniversal I/O LVPECL Output ModuleUniversal I/O LVPECL Output Module with Delay Tuning Universal I/O HFBR-1414 Output UNIV-HFBR-1414 Universal I/O HFBR-1528 Output UNIV-HFBR-1528

Universal I/O modules

cPCI-EVG-300

cPCI-EVR-300

GUN-RC-203/300

Fibre+

Transceiver


cPCI-EVG-300

cPCI-EVR-300

cPCI-EVRTG-300

GUN-RC-203 Gun Trigger Receiver

Event Generator

Event Receiver

Event Receiver withGun Trigger andFine Delay

Fanout Concentrator

cPCI-FOUT-CT-8

TPS Phase I Timing modules


Structure of TPS Timing System

Serializer & Transmitter

Registers

Dividers

Sync

SequenceRAM

0x2A……..0x28

……..0x26

……..0x24……0x22……0x20

Opt

ical

Fan

out

con

cent

rato

r

EventReceiver(EVR) 8

IRQ

Clocks

Tri

gger

s


IRQ

Clocks

Tri

gger

s


IRQ

Clocks

Tri

gger

s

Event Generator (EVG)

8 bitExt Bus

8 ExtTriggers(1PPS,1 MHz,

Beam Loss,Beam Abort

…)

RF499.654 MHz

Mains 60 Hz

RF/4


Multiplexed counter 1SR revolution clock generation ( 216)

Multiplexed counter 0Booster revolution clock generation ( 207)

Multiplexed counter 7Coincidence clock generation ( 4968)

EventPriorityEncoder

Sequence RAM 1

Sequence RAM 2

0

1

2

3

4

5

6

7

EventCode

EventFrame

Distribution

Bits

FiberOpticLink

Divide by4

Divide by1 to 256

Synchronize toCoincidence

clock

Phase shift(delay)

0 to 25.5 msec

Trigger Event 0~7

RFMaster

Oscillator

AC mainsvoltage

Transformer60 Hz)

cPCI-EVG-300

Sequence RAMs alternate. One event RAM may be modified while the other one is active sending events to control injection.

20 (3 Hz)24 (2.5 Hz)30 (2 Hz)40 (1.5 Hz)60 (1 Hz)

124.9135 MHz

Rep. rate

499.654 MHz

578.303 kHz

603.445 kHz

25.14 kHz(39.772 s)

Orbit Feedback Time Tick

125MEvents/sec

Beam Trip Command

UnivInput 1~12External Interrupt

OpticalTransceiver

SR: 864 = 25 x 33

= 22 x 32 x 24 = 4 x 216 578.303 KHz (1729.197 nsec)

BR: 828 = 22 x 32 x 23

= 4 x 207 603.445 KHz

(1657.147 nsec)Coincident Freq 4 x 4968 25.14 KHz (39.772 s)

SR: 518.4 mBR: 496.8 m

Trigger

Universal Input xMapping Registers

Distributed Bus 0~7EVR

(Uplink Event)

Trigger IN


De-Serializer

2 KData

Buffer

cPCI Interface

Delay

WidthF/F

S

C

S

C

Pol

Set

Event CLK

Trigger

Reset

ClockRecovery

RecoveredEventClock

EventMapping(RAM)

UnivOutput

0, 1

UnivOutput

2, 3

UnivOutput

8, 9

UnivOutput

4, 5

UnivOutput

6, 7

UnivOutput10, 11

Delay

WidthF/F

S

C

S

C

Pol

Set

Event CLK

Trigger

Reset

cPCI-EVR-300

Distribution BusData8 bit

Events8 bit

UnivOutMapxRegisters

Optical Fiber

from EVG

Uplink Logic

Trigger IN

Trigger OUT

Front Panel Input Mapping Registers


De-Serializer

2 KData

Buffer

cPCI Interface

Delay

WidthF/F

S

C

S

C

Pol

Set

Event CLK

Trigger

Reset

EventMapping(RAM)

UnivOutput

0, 1

UnivOutput

2, 3

GTX4Pulse Mode

Frequency ModePattern Mode

Delay

WidthF/F

S

C

S

C

Pol

Set

Event CLK

Trigger

Reset

cPCI-EVRTG-300

Distribution BusData8 bit

Events8 bit

UnivOutMapxRegisters

Optical Fiber

from EVG

Trigger OUT

GTX5Pulse Mode


GTX6Pulse Mode


GUN-TX-203 Mode

SFP

GTX7Pulse Mode


GUN-TX-203 Mode

SFP

Diff OUT

Diff OUT

FiberOUT

FiberOUT

ClockRecovery

RecoveredEventClock


EVG

EVRTG-300 Gun Trigger

EVR-Linac

EVR-Booster PS

EVR- Injection/Extraction #1

EVR-CIA01CIA 01Fanout

Concentrator

EVR-CIA02CIA 02Fanout

Concentrator

CIA 24Fanout

Concentrator

EVR-RF 1

EVR-CSCR

EVR-RF 3

EVR-RF 2

EVR-Booster RF

DriftCompensator

350 Meter Signal Mode Fiber

60 Meter OM3 Fiber

EVR-300 Linac Trigger

EVR-BBFCIA 23Fanout

Concentrator

EVR-LTB/BTS Diag

400 Meter environmental temperature sensing

OM3 FiberEVR-CIA

EVR- Injection/Extraction #2

EVR-CIA24

Master RF FrequencyStandard

TimingMaster

Fanout

Concentrator

Fanout

Concentrator

Fanout

Concentrator

Fanout

Concentrator

Fanout

Concentrator

EVR-300 Uplink

Timing System DistributionFanout Concentrator1st level x 12nd level x 43 rd level x 24Total 29 units

• The propagation delay time due to fiber is ~5 ns/m.• In order to achieve almost simultaneous receipt of

event codes at EVRs. All fiber lengths are equal.


GPS Antenna

EVG

1 MHz

1 PPS

TPS Control Network

TriggerEvents

TPSTiming

Network

Mains 60 Hz

cPCI EPICS IOC

CPU

EVR

Triggers/Clocks Output

Triggers,Interlock

Input

Triggers/Clocks Output

499.654 MHz

Rubidium Frequency Standard NTP server

“Second” EventGenerator

0x70

0x71

RF

RF Distribution

DB

US5

0x44

0x45Beam lossMPS

10 MHz

1 PPS

EPICSIOC

UTC “Second”

Fanout

CPU

EVR

Time reference for TPS control system


Tx

Rx

External 1PPS

“Second” Register

“Second” Counter

Load

“Second” Shift Register

Count Up Clock

cPCI or VME64x Bus

Load

τ

ClockGenerator

τ

Set by the host CPU on-demand(system boot, cold start)

Bit0

Existed EVG core

Possibility to use cPCI-EVG-300 generate “SECOND” events

Host CPU can acquire UTC second from NTP server at system boot time or anytime when need.

0x70

0x71


Planned Beamline Timing Interface

EPICS IOC

cPCI-EVRTG-300

Control Network

Fiber Patch Panel

to nearby CIA(4 Pairs OM3 Fiber)

UNIV I/O 0(TTL or NIM)

Short Gate


Long Gate


SR Clock


Spare

UNIV I/O 5(PECL)

RF Clock

UNIV I/O 5(PECL)

RF Clock5 ~ 20 ps Trigger or Clock (dependent on modules used)

~ 30 psec drift (worst case) for a few degree of ambient temperature variation(without drift compensation)

JitterCleaner(Option)

~ 300 m Fiber Link(with/without

drift compensation)

DedicatedFiberLink

(Option)

Control Network+

Timing NetworkFiber Link

fRF

orfRF/N, N = 4,5,6 ?

Low Jitter Clock ( < 100 fsec ?)

Synchrolock-AP, FEMTOLOCK, etc.(< 500 fs)

Standard Supports

Commercial fs Locker


Transceiver Demodulator

PulseOut

GUN-RC-203 (one channel)

Delay WidthTrigger

EncodedClock

RF CLK

EncodedClock

Pulse Out

cPCI-EVRTG-300 (SFP port, GTX6 or GTX7 )

EncodedClock

Tx

Rx

Fiber Link

RecoveredEvent Clock

MicrelSY100EP196Delay Line1024 step

~ 9 psec/step

Pulse GeneratorOutput

TransceiverModulator

Tx

Rx

ToGUN-RC-203

Event Clock

Delay ≡ 8 nsec step (Pulse Generator)+

2 ns (Phase Shifter)+

10 ps step (Delay Line)Width ≡ multiple of event clock period 8 ns (Pulse Generator)UNIV-TTLIN-IL@UNIV0/1 for inhibit

GUN-TX-203 Mode - Operation Scheme

External inhibit Iuput

Phase Shifter0, 2, 4, 6 nsec


TPS E-Gun Trigger Options

Single Bunch

Current< 1 nsec

Multi Bunch with 500 MHz Modulation

Current

2 nsec

50 ~ 1000 nsec

Current

2 nsec

50 ~ 1000 nsec

Arbitrary bunch pattern ?

MRF GUN-RC-203

MRF GUN-RC-300

We still consider e-gun trigger need to support arbitrary bunch pattern or not?


Prototype Operation GUI

TPS Main GUI

E-Gun Trigger module

Timing Master Prototype

TPS Timing Summary page


EVG/EVR/EVRTG Configuration pages


FCT #1 vs. RF < 10 ps

cPCI-EVR-300 TTL output Module vs. RF < 20 ps

Preliminary Jitter Measurement of Timing System

LTB FCT #1 (Linac test site )

Single Bunch Beam


Machine Protection System – Purpose

• Latch input event• Transmit the input event to somewhere • Apply interlock rules and activate actuator• Reset the latch after the input event removed


Global Machine Protection System (MPS) PLC Network

EPICS CA access(read status, interlock reset,~ 100 msec response time)

Trip beam command,post-mortem trigger,

…etc.(to event system)

Strategic to achieve high reliability- High reliable PLC

- Heart beat- Redundancy

- Failsafe

TPS SR

TPSBooster

Cell # ..Interlock PLC

Sub Unit

Cell #1,2Interlock PLC

Main UnitBeam position interlockBeam trip interlockRF statusInterface to the safety/interlock which are responsible various groups…

Intra-PLC Communication LinkFiber-optic FA Bus Type 2( ~ 2 msec response time~ 2 msec response time)

PLCwith Embedded

EPICS IOC


Sub Unit


Sub Unit


Sub Unit


Sub Unit


Sub Unit

Cell # 21, 22Interlock PLC

Sub Unit

Cell # 23, 24Interlock PLC

Sub Unit

Redundancy dual loop can be installed later or necessary Economic design by heavily used remote I/O Heartbeat ensure system is alive

Cost Saving Design


CIA 1

CIA 2

CIA 3

CIA 4

CIA 5

CIA 6

CIA 7

CIA 7

CIA 8

CIA 11

CIA 10

CIA 12CIA 13

CIA 14

CIA 15

CIA 18

CIA 17

CIA 16 CIA 21

CIA 24

CIA 23

CIA 22

CIA 19

CIA 20

50 m Fiber

300 m Fiber300 m Fiber

Configuration of MPS PLC Communication link

Main Unit PLC

10 m Fiber

Sub Unit(Remote I/O)

F3LR02-ONLink module


TPS Fast Protection System

Timing systemEVR

MPS systemPLC

Fast event(Trip RF signal)

Actuator(RF station)

Timing systemEVR

MPS systemPLC

Fast Protection system

Slow Protection system

• TPS timing system can be used to transmit fast event to actuator.– EVR modules have uplink event generation capability.

– Fan out concentrator modules can concentrate signals form eight EVRs/downstream and forward the signals upstream.

– EVG module has external input to enable 8 event triggers.


• It’s necessary to measure the time delay of fast protection system .

• Time delay come from Fiber optic propagation time and timing system processing time– Optical fiber propagation time is around 5 ns/m.

– Processing time depends on EVG/EVR/Fan-out concentrator modules.

Response Time of TPS Fast Protection System


Measure Response Time of TPS Fast Protection System

MPS-Trip In

MPS-Trip Out

5 m(fiber)

Delay(EVR1)：2.45 μs (Uplink)

Delay(EVR2)：4.42 μs (Downlink)

10 m(fiber)

310 m(fiber)

MPS-Trip (decode Uplink Event)

Uplink

< 5 μs response time

EVG

FOUT-CT

EVR1

FOUT-CT

FOUT-CT

EVR2

10 m(fiber)

MPS-Trip Out

MPS-Trip In

MPS-Trip Out (EVR2)

1

2

3

1

3

2


Machine Protection System – Event Input Board

• Input from– Magnet Thermostat

– Beam Line dump beam

– Front End dump beam

– Vacuum dump beam

– Orbit interlock

– DCCT failed

– Heartbeat

– ……

• Output to– MPS PLC

– Fast protection system(Timing system)

– cPCI EPICS IOC

• Latch/Reset event function


Machine Protection System – Actuator Output Board

• Input from– MPS PLC

– Fast protection system (Timing System, TTL)

– cPCI EPICS IOC (Contact, TTL or 24 V)

• Contact output to (~ a few ms response time)– e-gun inhibit

– RF inhibit ?

– ….

• Open collector output to(~ μs response time)– RF inhibit ?

– Heartbeat

– Power supply of magnets inhibit

– …..


Heartbeat

Machine Protection System Actuator Output Board

Actuator output will be normal when heartbeat is normal!Actuator output will be failed when heartbeat stop!

Role of the Heartbeat check on Actuator Output Board

MPSPLC DO

EPICS IOCDO

TimingEVR Output

To Actuator


• TPS timing system– The first lot of EVG/EVR/Fan-out concentrator modules was received in

December 2010– Setup test system has been started from February 2011– Linac timing is ready for commissioning of the TPS linac in April 2011– cPCI-EVR-300 jitter w.r.t. RF clock < 20ps– cPCI-EVRTG-300 jitter w.r.t. RF clock < 10ps– Other issues are being planned

• Beam Injection/Top up mode Injection• Timestamp • ….

• Machine protection system– Provide MPS PLC system(~few ms) and fast protection system(<5us)– Need to

– Define and implement MPS interlock logic– Low level Interface definition and specification– Prototype manufacture

Summary


32

epics 2011 spring collaboration meeting, hsinchu, june 13-17, 2011 tps timing system & plan of...

Documents