options for running kubernetes at scale across multiple cloud providers

16 – 17 November, SofiaISTACON.ORG

Running Kubernetes at Scale Across Multiple Cloud Providers

by Iliyan Nenov, Krasimir SemerdzhievSAP


Kubernetes 101


Technology Continues to Evolve. Where Does Your Company Stand Today?

ContainersCloud

Native

Open

Source

IaaSPaaS

Open

Source

PaaS

Virtualiza-

tion

2000 2001 2006 2009 2010 2011

Non-

Virtualized

Hardware

2013 2015

IaaS


Run anywhere

Highly efficient

Lightweight

Standardized

delivery

Cloud ready

Easy to

assemble

Dynamically

managed

Kubernetes 101: The Container Promise


At the same runtime performance1: containers are deployed faster2 than regular VMs

1 Identical ScoreMark performance measured for Native + Docker + KVM2 Start time: 50ms vs 30-45 sec; Stop time: 50ms vs 5-10 sec

Source: https://www.slideshare.net/Flux7Labs/performance-of-docker-vs-vms

900x


https://www.slideshare.net/Flux7Labs/performance-of-docker-vs-vms



Running container workloads on a container management platformleads to increase1 in annual CPU utilization

1 McKinsey & Co: Transforming global IT infrastructure to

capture immediate savings; 5-15% vs 70-85%

6x



All containers on a host share the same IP address

Container management platforms resolve that challenge: IP per container

Host (10.10.10.5)

Proxy

WebApp

#1

WebApp

#2

:80

:80

:8080

:8081


Kubernetes 101: Overall Kubernetes Setup


The Public Cloud Dilemma


The Public Cloud Dilemma To Leverage or Not to Leverage

You can use the cloud or spend your career catching up…


The Public Cloud Dilemma To Leverage or Not to Leverage

Microsoft, Google and AWS: Each is spending more than $10bn a year in infrastructure1 and is releasing features daily.

1 Datacenter Knowledge (Apr, 2017): Equinix spend analysis

Fact:

Half of the countries in the world have smaller GDP than these companies combined spend on cloud infrastructure


The Public Cloud Dilemma Cloud Services Become a Commodity

Source: ilyas-it83.github.io/CloudComparer/

AWS annual new features

rundown

https://ilyas-it83.github.io/CloudComparer/


The Public Cloud Dilemma Managed Service: Running VMs

Experience: Running VM in AWS/Azure

Underlying XEN/Hyper-V is:• Installed by AWS/Azure• Managed by AWS/Azure• Updated/Patched by AWS/Azure

You really do not want to mess with your hypervisor!


The Public Cloud Dilemma Managed Service: Running VMs

Call API to get a VM of the desired size and use it.


The Public Cloud Dilemma Managed Service: AWS EC2

System requirement?

> curl https://ec2.amazonaws.com/?Action=RunInstances

&ImageId=ami-2ey653421sample

&MaxCount=5

&MinCount=2

&Placement.AvailabilityZone=us-east-1a

&Monitoring.Enabled=true

&AUTHPARAMS


System requirement?

> curl

The Public Cloud Dilemma Managed Service: MS Azure VMs

"storageProfile": {

"imageReference": {

"id":

"/SID/resourceGroups/providers/Microsoft.Compute/images/sample"

},

"osDisk": {

"name": "osdisk",

"osType": "<Windows or Linux>",

"createOption": "fromImage"

}

}


The Public Cloud Dilemma Next level: Containers & Functions

The next frontier of commoditization:


The Public Cloud Dilemma Major Issue: Lock-in (1/4)

The 3 stages of Cloud lock-in:

1

3

2

Choosing a platform and adding data

Programmatically connecting to the platform

Using advanced, proprietary features of the platform

Question: Is AWS/Azure/GCP lock-in a bad thing?



Question: Is AWS/Azure/GCP lock-in a bad thing?



Simple answer: It depends…



Protect the assets that are really critical for the company

Look at IaaS, PaaS as powerful value-add enablers. It is extremely

hard to compete with hyper-scaled vendors. Leverage them!

The crown jewels of an enterprise are its data and code base

(apps, algorithms, methodology) which drive differentiation from

competitors.


Options for Cloud Delivery at Scalewith Kubernetes


Kubernetes Options: Many Choices

It’s all about portability – that’s the next “VM”.

Source: blog.kubernetes.io/2017/10

http://blog.kubernetes.io/2017/10/software-conformance-certification.html


Kubernetes Options: #1 Do it Yourself

100% open source – low entry barrier!

Source: github.com/kelseyhightower/kubernetes-the-hard-way

https://github.com/kelseyhightower/kubernetes-the-hard-way


Kubernetes Options: #2 Use a Kubernetes distribution

Few questions to consider: • Open Source vs Proprietary• Software vs Managed service• Installed on your resources vs all-in-one• Wide range of pricing models

Many options - try to choose among the certifiedones!

https://docs.google.com/spreadsheets/d/1LxSqBzjOxfGx3cmtZ4EbB_BGCxT_wlxW_xgHVVa23es/edit#gid=0


Kubernetes Options: #3 Managed Kubernetes Service (1/2)

Provided by Azure/Google vs 3rd party company

Pricing considerations:• Control plane infrastructure

• Workers infrastructure

• Updates/Upgrades

• 24x7 Operations and Support

• Price (per month/cluster)

3rd party vendor

managed service

included

included

included

included

(may be) included?

included

Cost of VMs Cost of VMs Cost of VMs

Cost of min 3 VMs

Cost of VMs+

$ 0

$ 0 $ 0

Cost of VMs

+

$ 0 / $ 109.50(1-6 nodes is free)

Cost of VMs+

$ varies(models include

cores, memory, etc.)


Kubernetes Options: #3 Managed Kubernetes Service (2/2)

System requirements:curl or the corresponding cloud CLI

$ az aks create –g aks –n mycluster

$ az aks get-credentials –g aks –n mycluster

Use kubectl to work with the cluster

$ gcloud container clusters create mycluster

$ gcloud container clusters get-credentials mycluster

$ kubectl get nodes

NAME STATUS AGE VERSION

aks-agentpool1-125550043-0 Ready 10m v1.8.1




Kubernetes Options: Key Point: Focus on Portability

Kubernetes does not address every challenge: • Deliver your software in containers• Consider the end-to-end system setup• On-premise connectivity• Complex network setups

Kubernetes is the “new VM” w.r.t. cloud portability


Further Materials


Additional resources:

Introduction to Kubernetes (Free course)www.cncf.io/announcement/2017/07/10/

linux-foundation-cncf-edx-org-announce-new-free-intro-kubernetes-course/

Kubernetes Fundamentals (LFS258)https://training.linuxfoundation.org/

linux-courses/system-administration-training/kubernetes-fundamentals

Certified Kubernetes Administrator (CKA)https://www.cncf.io/certification/expert/ Source: monster.com

http://www.cncf.io/announcement/2017/07/10/linux-foundation-cncf-edx-org-announce-new-free-intro-kubernetes-course/

https://training.linuxfoundation.org/linux-courses/system-administration-training/kubernetes-fundamentals

https://www.cncf.io/certification/expert/

https://monster.com/


Questions?

Iliyan Nenov

SAP Cloud Platform

@iliyan_nenov

Krasimir Semerdzhiev

SAP Hybris Cloud Services

@evilyeti