cloud computing and dynamic network provisioning for ...cloud computing and dynamic network...
TRANSCRIPT
Cloud Computing and Dynamic Network Provisioning for Weather
Warning and Forecast
Michael Zink
Sustainable Urban Water Workshop, University of Texas Arlington
June 5th, 2015
The CASA System
query
streaming storage
resource allocation
MC&C: Meteorological command and control
1 2 3 4 5 6 7 8 9 A G3 G3 G3 G3 G3 G3 G3 G3 G3 B G3 G3 G3 G3 G3 G3 G3 G3 G3 C G3 G3 G3 G3 G3 G3 G3 G3 G3 D G3 G3 G3 G3 G3 G3 G3 G3 G3 E G3 G3 G3 G3 G3 G3 G3 G3 G3 F G3 G3 G3 G3 G3 G3 G3 G3 G3 G G3 G3 G3 G3 G3 G3 G3 G3 G3 H R1 R1 R2 R2 R1 G3 C2 G3 G3 I R1 F 1 F 2, R1 F 2,H2 R1 G3 C2 G3 G3 J R1 H1 , F1 H1 , F1 T 2,R1 R1 G3 C2 G3 G3 K R1 H1 T 2,H1 T 2,R1 R1 G3 G3 G3 G3
Feature Repository
detection algorithms
query
streaming storage
optimization
meteorological task
generation
user preferences,
Policy
End users: NWS, emergency response
Detect Weather
Forecast
Detection
Initiate Nowcast in the cloud
Allocate network and
cloud resources
Shut down Nowcast
Release network and cloud resources
Run during weather event
Dynamically Allocated Compute & Network Resources
Results Instance Type
Memory (GB)
Disk (GB)
CPU Cost/hr ($)
Total Cost ($)
Exec. Time (sec)
Total Time (sec)
Amazon EC2
7.5 850 4 0.34 1.13 74.34 95.08
Rackspace 8.0 320 4 0.48 1.63 96.53 120.33
GENICloud 8.0 20 4 - - 67.45 78.60
ExoGENI 8.0 20 4 - - 56.83 72.07
75 days of IOP in spring 2011 90 hours of convective precipitation Dedicated resources to process data in a timely
manner: $4000 IaaS cloud model:
$40 per product $70/moth for storage
Dilip Kumar Krishnappa, Eric Lyons, David Irwin, and Michael Zink, CloudCast: Cloud Computing for Short-term Weather Forecasts. IEEE Computing Science in Science & Engineering Magazine. 15(4), 30-37, September 2013.
Cost
Detect Weather
Forecast
Detection
Initiate SWIM in the cloud
Allocate network and
cloud resources
Shut down SWIM
Release network and cloud resources
Run during weather event
Dynamic Resources for Flood Forecasts
Current State
• Needed a Linux version • Running a 1-D model • Created image and can run it in cloud
SDN Controller
Command & Control Forecast Detection
Weather Impact
GENI: Infrastructure
10 ECE Department
iSPUW & GENI
GENI Rack
LEARN
GENI Racks
CloudLab
I2 – AL2S Sensors
CASA
Crowd
Utah Wisconsin Clemson GENI
Slice B
Stock OpenStack
CC-NIE, Internet2 AL2S, Regionals
Slice A
Geo-Distributed Storage Research
Slice D
Allocation and Scheduling Research for Cyber-Physical Systems
Slice C
Virtualization and Isolation Research
• Supports transformative cloud research
• Built on Emulab and GENI • Control to the bare metal • Diverse, distributed
resources • Repeatable and scientific
CloudLab