building a deep learning (dream) machine

46
Building a Deep Learning (Dream) Machine DIY hardware hacking for the uninitiated Roelof Pieters @graphific http://www.graph-technologies.com 27 June 2016

Upload: roelof-pieters

Post on 08-Jan-2017

1.621 views

Category:

Education


1 download

TRANSCRIPT

Page 1: Building a Deep Learning (Dream) Machine

Building a Deep Learning (Dream)

MachineDIY hardware hacking for the uninitiated

Roelof Pieters@graphific http://www.graph-technologies.com

27 June 2016

Page 2: Building a Deep Learning (Dream) Machine
Page 3: Building a Deep Learning (Dream) Machine
Page 4: Building a Deep Learning (Dream) Machine
Page 5: Building a Deep Learning (Dream) Machine
Page 6: Building a Deep Learning (Dream) Machine

http://graphific.github.io/

Page 7: Building a Deep Learning (Dream) Machine

How: Machine Thank you gamers!

Page 8: Building a Deep Learning (Dream) Machine

Why- Cheaper *- Can do things you can’t do in the cloud- Desktop = faster experiment iteration - Remote still possible- Customize to your own needs- Fun!

* in my own particular case

Page 9: Building a Deep Learning (Dream) Machine

Points to think about- How many GPUs now and later- Motherboard (40 lanes / 16x8x8x8 configuration for 4 GPUs)- Chassis with enough space + air flow- 4 GPUs: 7 PCIe slots (last GPU can be mounted at the bottom using only one

slot)- CPU: good enough, as much cores as GPUs, make sure CPU supports 40

PCIe lanes, some new Haswell CPUs only support 32;- RAM: 2x of total GPU memory- SSD = nice if data doesn’t fit into GPU+RAM (or hdfs reads from disk): get

larger SSD than your largest dataset- Mechanical disks: plenty of storage- PSU: don’t save on efficiency (titanium/platinum)- Cooling: Water (hard diy) or Fan (easy/cheap but noisy)

Page 10: Building a Deep Learning (Dream) Machine
Page 11: Building a Deep Learning (Dream) Machine

I: HARDWARE

Page 12: Building a Deep Learning (Dream) Machine

How: Machine

Page 13: Building a Deep Learning (Dream) Machine

How: Machine

Page 14: Building a Deep Learning (Dream) Machine

How: Machine (2)

Page 15: Building a Deep Learning (Dream) Machine
Page 16: Building a Deep Learning (Dream) Machine
Page 17: Building a Deep Learning (Dream) Machine
Page 18: Building a Deep Learning (Dream) Machine
Page 19: Building a Deep Learning (Dream) Machine
Page 20: Building a Deep Learning (Dream) Machine
Page 21: Building a Deep Learning (Dream) Machine

II: SOFTWARE

Page 22: Building a Deep Learning (Dream) Machine
Page 23: Building a Deep Learning (Dream) Machine
Page 24: Building a Deep Learning (Dream) Machine
Page 25: Building a Deep Learning (Dream) Machine
Page 26: Building a Deep Learning (Dream) Machine
Page 27: Building a Deep Learning (Dream) Machine
Page 29: Building a Deep Learning (Dream) Machine

And so on...

Page 30: Building a Deep Learning (Dream) Machine
Page 31: Building a Deep Learning (Dream) Machine

http://gitxiv.com/

Page 32: Building a Deep Learning (Dream) Machine

http://www.creativeai.net/

Page 33: Building a Deep Learning (Dream) Machine
Page 34: Building a Deep Learning (Dream) Machine
Page 35: Building a Deep Learning (Dream) Machine

GTX 1080

Page 36: Building a Deep Learning (Dream) Machine

Drive PX 2

P100

Page 37: Building a Deep Learning (Dream) Machine
Page 38: Building a Deep Learning (Dream) Machine
Page 39: Building a Deep Learning (Dream) Machine

EPGU

Page 40: Building a Deep Learning (Dream) Machine

PGU

Page 41: Building a Deep Learning (Dream) Machine
Page 42: Building a Deep Learning (Dream) Machine

READ MORE

Page 43: Building a Deep Learning (Dream) Machine

http://graphific.github.io/