loud computing for dynamically …swat.tamu.edu/media/114809/j1-1-saraswat.pdfupdate cooperative...

19
Presented at: CLOUD COMPUTING FOR DYNAMICALLY UPDATING LAND USE FILE IN SWAT Cooperative Extension Service Presenter: Dharmendra Saraswat, Ph.D. [email protected] Team: Mouli Koppolu, Ben Hancock, Eeshan Kumar, Gurdeep Singh and Naresh Pai (former member)

Upload: haduong

Post on 26-Mar-2018

217 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

Presented at:

CLOUD COMPUTING FOR DYNAMICALLY

UPDATING LAND USE FILE IN SWAT

Cooperative Extension Service

Presenter: Dharmendra Saraswat, Ph.D.

[email protected]

Team: Mouli Koppolu, Ben Hancock, Eeshan Kumar,

Gurdeep Singh and Naresh Pai (former member)

Page 2: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

BACKGROUND…

Cooperative Extension Service

• SWAT 2009: released January 2010

• New module inclusion: land use change (LUU)*

• Input files required: lup.dat, file1.dat,

file2.dat,….

*Arnold et al. (2010)

Page 3: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

LUC MODULE WORKING…..RECAP

Cooperative Extension Service

subbasin

HRU

SWAT2009 onwards

Model run 1998 - 2008

HRU_FR in *.hru

HRU_FR= 0.1 means 10% of subbasin

HRU_FR= summation (1)

Page 4: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

UPDATE

Cooperative Extension Service

• SWAT2009_LUC was developed to create input

files for activating LUU module*

• More than 7000 user visits** to SWAT2009_LUC

tool have been made since mid 2011.

• Changing either the data path, renaming of folders,

land use data format, not checking box against hru

feature class etc. have invited lots of questions from

users

• Tutorial example is recommended for guidance*Pai and Saraswat(2011) ** Google Analytics

Page 5: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

OBJECTIVES

Cooperative Extension Service

Develop a Cloud-based tool using open

source software to create lup.dat file for use

in SWAT model

Demonstrate and Performance Results

Page 6: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

Cloud Architecture

Page 7: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

ALLFOLDERS CONF LOGS SITE_MEDIA

STATIC SWAT SWATLUC

ALLFOLDERS

Django Apache configuration (WSGI) files

CONF

Access log

LOGS

Error log

Images

SITE_MEDIA & STATIC

CSS

JavaScript

Manuals

USER UPLOADED DATASWAT Model

Landuse Layers

Landuse Lookup

Settings

SWAT

Urls

Templates (HTML)

Python modules

SWATLUC

Views

Models

Dja

ngo

Pro

ject

SWAT_LUC FILE STRUCTURE

Page 8: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

Provide site’s styleUAEX header and footer

CSS

AJAX requests and responsesEvent triggersInteract with DOM objects

JQuery

Client

HTML

SWAT LUC ContentDjango templatesForms

Server

User Table

DjangoData

Models

DjangoData

FormsDjangoView

Functions

DjangoTemplates

SWAT_LUC TECHNOLOGY STACK

Page 9: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

• Manage user objects

• Assign permission and authorize requests

• Manage administrator accounts

• Built-in views for handling login authentication, password encryption, and password resets

• Automated password reset through email validation

Database Schema

DJANGO USER AUTHENTICATION

Page 10: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

Demonstration and Results

Page 11: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

3 Seconds

STEP 1. SWAT Project folder input

Cache River Watershed (5000 sq km, 12321 HRU)

Goose Creek Illinois River Watershed (114 Sq km, 1050 HRU )

11 Seconds

DEMONSTRATION AND PERFORMANCE

Cooperative Extension Service

Page 12: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

2 Seconds

STEP 2. Land use layers folder input

4 Seconds

Cooperative Extension Service

DEMONSTRATION AND PERFORMANCE

Cache River Watershed (5000 sq km, 12321 HRU)

Goose Creek Illinois River Watershed (114 Sq km, 1050 HRU )

Page 13: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

20 Seconds

90 Seconds

Cooperative Extension Service

STEP 3. Individual land use layers input

DEMONSTRATION AND PERFORMANCE

Cache River Watershed (5000 sq km, 12321 HRU)

Goose Creek Illinois River Watershed (114 Sq km, 1050 HRU )

Page 14: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

2 Seconds 2 Seconds

Cooperative Extension Service

STEP 4. Land use look up file input

DEMONSTRATION AND PERFORMANCE

Cache River Watershed (5000 sq km, 12321 HRU)

Goose Creek Illinois River Watershed (114 Sq km, 1050 HRU )

Page 15: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

2 minutes 29 Seconds2 Seconds

Steps 1 to 4 may depend on the internet speed of the user, but step 5 runs on the server.

Cooperative Extension Service

STEP 5. Tool run/process time/output download

DEMONSTRATION AND PERFORMANCE

Cache River Watershed (5000 sq km, 12321 HRU)

Goose Creek Illinois River Watershed (114 Sq km, 1050 HRU )

Page 16: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

0

5

10

15

20

25

30

Nothrottle

3 G 256 kbps 128 kbps 64 kbps

Tim

e

Internet Speed

Goose Creek Illinois River WatershedSWAT Project Size 11 mb & #HRUs 1050

Step 1 in mins

Step 2 in secs

Step 3 in secs

Step 4 in secs

Step 5 in secs

0

10

20

30

40

50

60

70

80

No throttle 3 G 256 kbpsTi

me

in m

inu

tes

Internet Speed

Cache River WatershedSWAT Project Size 128 mb & #HRUs 12321

Step 1

Step 2

Step 3

Step 4

Step 5

Cooperative Extension Service

DEMONSTRATION AND PERFORMANCE

Overall Performance

Page 17: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

CONCLUSIONS

Cooperative Extension Service

Objective 1: SWAT_LUC, a cloud-based tool using

open source software was developed

Objective 2: Data upload time varied with size of data

and internet speed at the user’s end

Output from the tool was independent of the user’s

internet speed

Additional tools are undergoing testing and will be

released at 2015 SWAT Conference organized by

Purdue University during 12-16 October, 2015

Page 18: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

ACKNOWLEDGEMENTS

Cooperative Extension Service

Financial support: Arkansas Natural Resources Commission (ANRC)

Page 19: LOUD COMPUTING FOR DYNAMICALLY …swat.tamu.edu/media/114809/j1-1-saraswat.pdfUPDATE Cooperative Extension Service •SWAT2009_LUC was developed to create input files for activating

QUESTIONS

Cooperative Extension Service

Dr. Dharmendra SaraswatAssociate Professor - Geospatial

Department of Biological & Agricultural Engineering

University of Arkansas

Email: [email protected]