scaleconf 2013 - scaling on windows azure
DESCRIPTION
The Windows Azure architecture is based on scale-out and offers different scale-units to build large systems. In this session, we will discuss the capabilities for compute, distributed caching, storage and big data.TRANSCRIPT
“Scaling on Windows Azure”
Beat Schwegler - Director, Platform Strategy Group - Microsoft corp.
[email protected] - http://cloudbeatsch.com - @cloudbeatsch
democratized access to scale & reach
spectrum of IT services
global footprint
99.95% monthly SLA
application
platforms
operating
systems
Windows
Azure
store
open platform
scaling on Windows Azure
Cloud Services
servicepackage
servicepackage
servicepackage
servicepackage
Network load-balancer configured for traffic
fault and upgrade domains
storage options
Windows Azure Cache
Windows Azure CDN
Windows Azure Traffic Manager
direct users to the service in the closest region
data becomes the new currency
store – store – store – store – store
move compute to data
the hadoop ecosystem
MapReduce
Map f(k1,v1) list(k2,v2)
Reduce f(k2, list(v2)) (k2, v3)
functionallyin practice, WordCount
the quick brown fox jumps over the lazy dog
Map
(the,1) (quick,1), (brown,1), (fox,1), (jumps,1) (over,1), (the,1),(lazy,1),(dog,1)
Shuffle
(the,(1,1)) (quick,1), (brown,1), (fox,1),(jumps,1) (over,1),(lazy,1),(dog,1)
Reduce
(the,2) (quick,1), (brown,1), (fox,1), (jumps,1),(over,1), (lazy,1),(dog,1)
in code
Then, scale to TB/PB of data over 10’s, 100’s or 1000’s of nodes
scaling on Windows Azure
start nowhttp://WindowsAzure.com