fpga-based hardware instrumentation development...

19
1 Billy Huang 1,2 , Graham Naylor 1 , Nizar Ben-Ayed 1 , Geoffrey Cunningham 1 , Anthony Field 1 , Sunita Khilar 1 , Richard Myers 2 , Ray Sharples 2 , Roddy Vann 3 1 EURATOM/UKAEA Fusion Association, Culham Science Centre, Abingdon OX14 3DB, UK. 2 Department of Physics, University of Durham, South Road, Durham DH1 3LE, UK. 3 Department of Physics, University of York, Heslington, York YO10 5DD, UK. [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]. Funded by EPSRC and EURATOM. FPGA-based hardware instrumentation development on MAST ICALEPCS October 2011 Hardware

Upload: others

Post on 31-May-2020

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

1

Billy Huang1,2, Graham Naylor1, Nizar Ben-Ayed1, Geoffrey Cunningham1, Anthony Field1, Sunita Khilar1, Richard Myers2, Ray Sharples2, Roddy Vann3

1EURATOM/UKAEA Fusion Association, Culham Science Centre, Abingdon OX14 3DB, UK.2Department of Physics, University of Durham, South Road, Durham DH1 3LE, UK.3Department of Physics, University of York, Heslington, York YO10 5DD, UK.

[email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected].

Funded by EPSRC and EURATOM.

FPGA-based hardware instrumentation development on MAST

ICALEPCS October 2011Hardware

Page 2: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

2 of 19

Introduction• A very brief introduction to the Mega Amp

Spherical Tokamak (MAST) machine and general development context for an FPGA system on MAST.

• Details on the hardware used for 7 different FPGA systems on the Mega Amp Spherical Tokamak (MAST).

• Description of the hardware methodology used to create these systems.

Page 3: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

3 of 19

Vertical Stabilisation

MAST Tokamak Plasma

-60

-40

-20

0

20

40

60zap 12886 XCM_FA1 VOLTS VOLTS

zap 12886 XCM_FA2 VOLTS VOLTS

-2000

-1000

0

1000

2000

3000zap 12886 XCM_FA1 CURR AMPS

zap 12886 XCM_FA2 CURR AMPS

0.25 0.30 0.35Time(s)

0.0

0.5

1.0

1.5

2.0zap 12886 XIM_DA/HM10/T VOLTS

Plasma lost due to amplifiertrip induced by plasmaeruption (ELM)

Plasma vertical(P6) stabilisation coils

Hydrogen fuel (deuterium) heated to ~ 30 million degrees.

Page 4: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

4 of 19

Vertical Stabilisation

Viewing a vertically unstable plasma(Shot 12886)

Page 5: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

Texas ADS167224-bit 625 ksps

Power distribution and reboot board ATX Power Supply

Spartan 6 FPGA

(SP601)

DAC with OP602 amplifiers

FMC Digital I/O

Custom Optical Fibre boards

Page 6: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

6 of 19

Laser Triggering System

Controls 8 Nd:Yag 1.6J Lasers at 30 Hz (megawatts of Peak power)

BNC 50 Ohm driving signals to each of the 8 lasers

Custom Power supply

The old way of doing things using the Spartan 3E and serial UART for communication

Spartan3E FPGA

Optical amplitude digitisation for laser energy.

Page 7: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

7 of 19

PLC Pulse Generator - Fast Timer

Spartan 6 FPGA

(SP601)

Power distribution and remote reboot

ATX Power supply

FMC Digital I/O

Optical TX/RX for Trigger and Pulse

Generator

37 ns precision pulse generator

with variable delay and width

Page 8: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

8 of 19

Real-time fast acquisition

This was a joint project led by Dr. Roddy Vann of York University.

5U Chassis. 16 Channels, 250MHz at 14-bit digitising 125 MHz bandwidth signals.

Streaming in real-time at 8GB/s (for 0.5s)

Microwave Imaging System Ultra high performance FPGA system for acquiring and analysing 6-40 GHz microwave radiation emitted by the plasma.

Page 9: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

FPGA FirmwareCompactFlash

Gigabit Ethernet

DDR3 RAM 2GB6.4 GB/s Theoretical

5+ GB/s Achieved

FMC 108 4DSP8 Channel ADC 14-bit 250 Msps

SSMC Connectors

(High density but fragile, always wire internally)

Standard ATX Power Supply

Read more

USB JTAG/UART

Opto Clock, Trigger, Reboot

FMC I/O

SMA Front Panel

Virtex 6 FPGA Board (ML605)

Dual Layer system: 2 FPGA

boards with 2 FMC108 ADCs

Page 10: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

10 of 19

Resonance Monitoring/Driving - TAE System

Spartan 3EFPGA Board

ADC and op-amp inverters

5V DC Power Supply

Single pole lemo

Optical TX/RX boards

Toroidal Alven Eigenmode (TAE) are global plasma modes. They can be driven by the FPGA system below at different frequencies. Similar to a Tune Monitor.

Page 11: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

11 of 19

Monitoring - NBI Arc Current

NBI arc current: Measuring in greater detail helps diagnosis system failures.

Neutral Beam Injection (NBI) on MAST provides over 3.2MW of power.

In development: Atlys Spartan6 FPGA Board, 1U Rack, ATX Power supply, 1 MHz 12-bit 4 Channel DAC.

Page 12: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

12 of 19

Synchronous detection – Bolometer Upgrade

The MAST 32 channel bolometer array is used to image plasma irradiation energy.

In development: Simplified conceptual system below.

Vertically on the centre column

Tangentially through the tokamak

Page 13: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

13 of 19

Standardisation of an FPGA system

FPGA Firmware Communication Interface

Memory

I/O

FPGA

Page 14: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

14 of 19

Standardisation of an FPGA system

BPI/Compact/SD Flash

Gigabit Ethernet

DDR3

FMC

FPGA

Page 15: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

15 of 19

AXI Bus

• The AXI Bus is supported on Xilinx FPGAs and becoming supported on Altera FPGAs. The AXI bus can be 256+ bits wide at 200MHz. Translates to 51.2+ Gbps bus lines, such as to a memory DIMM or other peripherals.

• AXI is easy to develop for and could be integrated in future with the ARM processor, such as anticipated for the ZYNQ FPGA using a dual core 1GHz ARM processor.

AXI bus viewed in Xilinx Platform studio

Page 16: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

16 of 19

Open Hardware• For FPGA dev: www.opencores.com

– Many open cores. Some of these are supported in the mainline Linux kernel.

• For Hardware: www.ohwr.org – We have moved our design

for the LPC FMC12PEXP (I/O FMC Expansion board) to the OHWR, a first step into sharing hardware design. FMC Digital I/O board

A small first contribution towards open hardware.

Page 17: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

17 of 19

Summary• A generic methodology for developing

FPGA systems on MAST has been used successfully to develop a variety of FPGA systems – both simple and complex.

• Developing hardware systems that can perform complex functionality relies not just on assembling the right hardware, good investment in the development using open-source software where possible allows the integration of these systems.

Page 18: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

18 of 19

FPGA Workshop 2012• Building on last year, we will be running another hands-

on FPGA Workshop at CCFE, Oxfordshire, UK in early February 2012. It will include embedded Linux and FPGA development. Please email [email protected] if you are interested in joining.

Page 19: FPGA-based hardware instrumentation development …epaper.kek.jp/icalepcs2011/talks/tubaust01_talk.pdfFPGA Firmware CompactFlash Gigabit Ethernet DDR3 RAM 2GB 6.4 GB/s Theoretical

19 of 19

Thanks

• Thanks to all the authors with whom I have worked with on a variety FPGA systems and who have given huge amounts of work and effort only briefly glanced at in this presentation.

• Thanks to you for listening!

• Extra info at http://www.ccfe.ac.uk/fpga