cloud computing and dynamic network provisioning for ...cloud computing and dynamic network...

Cloud Computing and Dynamic Network Provisioning for Weather

Warning and Forecast

Michael Zink

Sustainable Urban Water Workshop, University of Texas Arlington

June 5th, 2015

The CASA System

query

streaming storage

resource allocation

MC&C: Meteorological command and control

1 2 3 4 5 6 7 8 9 A G3 G3 G3 G3 G3 G3 G3 G3 G3 B G3 G3 G3 G3 G3 G3 G3 G3 G3 C G3 G3 G3 G3 G3 G3 G3 G3 G3 D G3 G3 G3 G3 G3 G3 G3 G3 G3 E G3 G3 G3 G3 G3 G3 G3 G3 G3 F G3 G3 G3 G3 G3 G3 G3 G3 G3 G G3 G3 G3 G3 G3 G3 G3 G3 G3 H R1 R1 R2 R2 R1 G3 C2 G3 G3 I R1 F 1 F 2, R1 F 2,H2 R1 G3 C2 G3 G3 J R1 H1 , F1 H1 , F1 T 2,R1 R1 G3 C2 G3 G3 K R1 H1 T 2,H1 T 2,R1 R1 G3 G3 G3 G3

Feature Repository

detection algorithms

query

streaming storage

optimization

meteorological task

generation

user preferences,

Policy

End users: NWS, emergency response

Detect Weather

Forecast

Detection

Initiate Nowcast in the cloud

Allocate network and

cloud resources

Shut down Nowcast

Release network and cloud resources

Run during weather event

Dynamically Allocated Compute & Network Resources

Results Instance Type

Memory (GB)

Disk (GB)

CPU Cost/hr ($)

Total Cost ($)

Exec. Time (sec)

Total Time (sec)

Amazon EC2

7.5 850 4 0.34 1.13 74.34 95.08

Rackspace 8.0 320 4 0.48 1.63 96.53 120.33

GENICloud 8.0 20 4 - - 67.45 78.60

ExoGENI 8.0 20 4 - - 56.83 72.07

75 days of IOP in spring 2011 90 hours of convective precipitation Dedicated resources to process data in a timely

manner: $4000 IaaS cloud model:

$40 per product $70/moth for storage

Dilip Kumar Krishnappa, Eric Lyons, David Irwin, and Michael Zink, CloudCast: Cloud Computing for Short-term Weather Forecasts. IEEE Computing Science in Science & Engineering Magazine. 15(4), 30-37, September 2013.

Cost

Detect Weather

Forecast

Detection

Initiate SWIM in the cloud

Allocate network and

cloud resources

Shut down SWIM

Release network and cloud resources

Run during weather event

Dynamic Resources for Flood Forecasts

Current State

• Needed a Linux version • Running a 1-D model • Created image and can run it in cloud

SDN Controller

Command & Control Forecast Detection

Weather Impact

GENI: Infrastructure

10 ECE Department

iSPUW & GENI

GENI Rack

LEARN

GENI Racks

CloudLab

I2 – AL2S Sensors

CASA

Crowd

Utah Wisconsin Clemson GENI

Slice B

Stock OpenStack

CC-NIE, Internet2 AL2S, Regionals

Slice A

Geo-Distributed Storage Research

Slice D

Allocation and Scheduling Research for Cyber-Physical Systems

Slice C

Virtualization and Isolation Research

• Supports transformative cloud research

• Built on Emulab and GENI • Control to the bare metal • Diverse, distributed

resources • Repeatable and scientific

CloudLab