speech recognition powered by xilinx fpga for virtual

12
Minwook Ahn Module Leading Developer 2018.10.02 Speech Recognition powered by Xilinx FPGA for Virtual Personal Assistant, NUGU Presented By

Upload: others

Post on 04-Dec-2021

14 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Speech Recognition Powered by Xilinx FPGA for Virtual

Minwook Ahn

Module Leading Developer

2018.10.02

Speech Recognition powered by Xilinx FPGA

for Virtual Personal Assistant, NUGUPresented By

Page 2: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

Contents

˃ Introduction: SK Group & SK Telecom

˃ NUGU: Virtual Personal Assistant

˃ SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA

˃ Technical Roadmap

Page 3: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

Introduction: SK Group & SK Telecom

NUGU AI Speaker

Navigation withNUGU HD Map Self-driving Car

Surveillance CloudMedia ServicesSK Telecom

SK Hynix

SK C&C

SK planet

No.1 Mobile Comm. in Korean

No.2 Memory Semiconductor Manufacturer in Global Market

Total IT Service Provider

Platform Provider

Page 4: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

NUGU: Virtual Personal Assistant

Page 5: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

NUGU: Virtual Personal Assistant

Page 6: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA

Page 7: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

FPGA Resource Utilization for SKT AIX

LUT as logicLUT as

memoryFlipFlop BRAM DSP

Available 663360 293760 1326720 2160 5520

Used 292781 24910 491916 1002 5212

Utilization 44.14% 8.48% 37.08% 46.39% 94.42%

Page 8: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

SW stack for NUGU

Page 9: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

SDK for SKT AIX

Neural Network designed by Caffe, Tensorflow, or MxNet

Compression (Quantization/Factorization)

Acceleration Op Creator

Neural Network Execution Engine

Accelerator opsCPU opsGPU ops

SKTAIX

DL Framework

SK AI Inference

SDK

SK AI Inference

Accelerator

Page 10: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

SKT AIX performance

5x Performance16x Performance-Per-Watt

compared to GPU

0

5,000

10,000

15,000

20,000

25,000

0 20 40 100 120 140

fram

es/s

ec

60 80

# of channels

CPU-28Core GPU-TitanX AIX-FPGA

0.00

100.00

200.00

300.00

400.00

500.00

0 20 40 100 120 140

ms/

bat

ch

60 80

# of channels

CPU-28Core GPU-TitanX AIX-FPGA

Throughput according tonumber of concurrent channels

Latency according tonumber of concurrent channels

Environment: 28-Core CPU, 8-Batch

Power Consumption

CPU-28Core

GPU-TitanX

AIX-FPGA

150W

250 W

75 W 100 200

Page 11: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL

Technical Roadmap

3

Page 12: Speech Recognition Powered by Xilinx FPGA for Virtual

XILINX CONFIDENTIAL