boris mattijssen follow nerdalize - deltares
TRANSCRIPT
Building the cloud, one house at a time
Boris Mattijssen
+316 57889845
Follow Nerdalize
Outline
● Who is Nerdalize?
● How to benefit from the cloud
● Hands-on: Using Docker and Nerdalize
A short introduction of Nerdalize
Cloud is the steam engine of the 21st century
Cloud is the steam engine of the 21st century
The Nerdalize benefits
The World
saves on energy
3t CO2/yr per household
Home Owner
saves on heating
€300/yr
Cloud User
reduces cloud costs
30% - 50%
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at great price / performance;
3. without vendor lock-in;
4. and being easy to use.
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
50 CloudBoxes
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
Delft3D 1000 vCPU
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
How can the cloud benefit you?
1. Providing you with much compute capacity;
2. at a good price / performance;
3. without being locked in;
4. and being easy to use
> nerd upload dataset ~/my-dataset
> nerd workload start quay.io/nerdalize/delft3d --input-dataset 308c7bf29
> nerd task create 07bb2204534256f48a66
> nerd dataset download 81b8365bd1a6b3d36e7b ~/simulation-output
Workshop
Interactive workshop
1. Getting to know each other
2. Setup
3. Running Delft3D in Docker
4. Running Delft3D (in Docker) on Nerdalize
Getting to know each other
● Who is running Windows / macOS / linux?
● Who works with Delft3D?
● Who has ever worked with Docker?
Setup
1. Install Docker
2. Download Delft3D example dataset
Running Delft3D in Docker
What is Docker?
“Docker containers wrap up a piece of software in
a complete filesystem that contains everything it
needs to run: code, runtime, system tools, system
libraries – anything you can install on a server. This
guarantees that it will always run the same,
regardless of the environment it is running in.”
What is Docker?
File
System Runtime
System
Tools
System
Libs
What is Docker?
What is Docker?
Why use Docker?
1. Deterministic software configuration
2. Portable (Across computers and to the Cloud)
3. Easy to share and collaborate on
4. Quick to start and extend
Simple as that
docker run \
-v ~/my-dataset:/input \
-v ~/simulation-output:/output \
quay.io/nerdalize/delft3d
Running Delft3D on Nerdalize
Running Delft3D on Nerdalize
1. Upload your input dataset
2. Run the Docker container on Nerdalize
○ Scale up to 8 vCPU for demo
○ Could scale up to hundreds of vCPUs in real-world cases
3. Download your output dataset
Running Delft3D on Nerdalize
nerdalize.com/beta
promo code dsd17
What did we do?
Workload - Image
- Dataset
Worker Task
(Delft3D)
Input
Dataset
Output
Dataset
Upload
Start
Workload
Create Execute Upload
Create
Task
View logs Download
Results
Worker
Worker
Evaluation
Building the cloud, one house at a time
Boris Mattijssen
+316 57889845
Follow Nerdalize
nerdalize.com/dsd17
Docker pointers (also see speaker notes)
1. Nerdalize documentation: www.nerdalize.com/docs
2. Nerdalize Delft3D application page: www.nerdalize.com/applications/delft3d
3. Docker short intro video (12 min): https://www.youtube.com/watch?v=YFl2mCHdv24
4. Docker long intro (45 min): https://www.youtube.com/watch?v=Vyp5_F42NGs&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX
a. Also his video on Dockerfiles is intersting (45 min):
https://www.youtube.com/watch?v=6Er8MAvTWlI&index=4&list=PLX0Ak4vUBQfC6S8egys9kx6uy6tpw5yDX
5. Short videos about a lot of Docker concepts:
https://www.youtube.com/watch?v=kWkIMMYn6d4&index=1&list=PL7hgvWUGJtUtm-ZudXLKrqAnhkiRi0TtH
6. Docker official documentation (has some nice examples): docs.docker.com