understanding arcgis in virtualization and cloud environments · understanding arcgis in...

Understanding ArcGIS in Virtualization and

Cloud Environments Marwa Mabrouk

Esri Middle East and Africa User Conference December 10–12 | Abu Dhabi, UAE

Powerful GIS capabilities

Delivered as Web services

To help solve real problems by real people

ArcGIS Server

Native 64-Bit

Code optimizations

Clip &Ship

Imagery

Map Caching

Editing

&Ship

Analysis A

Find Addresses

Mapping

5x

10x

2x

50x

Queries

Ima

p

ng

pDrive-time Polygons

ries

Search

g

MGeoprocessing

Identify

Web Services

Easy to install, configure, and manage

Server Administration API

IT Friendly

GIS Server

Pure Web Services GIS Server New Architecture New user experience

REST SOAP OGC

Printing

Dynamic Layers

Feature Services

Caching Server Object Extensions

Automatic Clear REST

WMTS and WPS

Editor Tracking Ownership-based data access

Cache Status

Edit Zs and Ms

Edit any GDB version

Image Mensuration

Traffic aware routing Estimate Cache on disk

Batch Geocoding in REST

Schematics OOTB

Geometric Network Tracing

Cloud Builder

•  VMWare - Certified on vSphere 4.x, 5.x

•  Amazon Web Services

- Easier to launch and administer ArcGIS sites -  Linux support

•  Microsoft Azure

•  Private Cloud Support -  IBM - VCE

Virtualization & Cloud

Agenda

•  Virtualization Basics •  What are people doing with Virtualization? •  New Architecture •  New Virtualization Features

•  Understanding the Clouds •  ArcGIS in the Cloud

Virtualization Basics

Hardware

Virtualization Platform (VMWare, Microsoft, others)

Operating System (Windows, Linux)

ArcGIS New

IP

Dynamic Resource Allocation

Organizational Resources

Dynamic Resource Allocation

Organizational Resources

Persistence

GIS

Development & QA

Staging Production

Persistence

Development & QA

Staging Production

GIS

Copy and Run

GIS

Data Management

Data Visualization

Old Architecture

SOM

SOC SOC

New Architecture

Machine 1 My ArcGIS Server Site

Machine 2 My ArcGIS Server Site

New Architecture

Machine 1 My ArcGIS Server Site

Machine 2 My ArcGIS Server Site

Web Tier (Web Adaptor)

Firewall

Cluster 2

Cluster 1

New Architecture

Machine 1 My ArcGIS Server Site

Machine 2 My ArcGIS Server Site

Web Tier (Web Adaptor)

Firewall

Machine 3 My ArcGIS Server Site

Machine 4 My ArcGIS Server Site

Simplified Setup, Configuration and Management

•  Pure web services server - Easier install and configuration - Self contained GIS server - No DCOM access, no external dependencies

•  Built for resilience •  More robust

- Easier management of clusters

•  More Linux friendly

A

Server 10.1 Architecture

ArcGIS account (OS level)

GIS site

GIS Server

Service directories

Manager

Server Administrator API

http://6080

Primary Site Administrator (PSA)

A

Data Server directories

Configuration store

Single machine deployment with Web Adaptor

•  Easily block admin end points •  Forward compatibility

- Connect via port 80 - GIS site name

•  Leverage Web tier features - Security - Logging

Web Server W b

http://80

Web Adaptor

GIS site GIS Server GIS

http://6080

Data Server directories

Configuration store

Firewall

•  OOTB reverse proxy

A

New Web Manager

Demo

Key New features for Server Virtualization

• Support for new ip assignment

• ArcGIS for Server Admin REST API

Creating a Base Image

Hardware

Virtualization Platform (VMWare vSphere)

Operating System (Windows, Linux)

ArcGIS

Virtualization Management

Machine Image (Files)

Launching a new VM from Image

Hardware

Virtualization Platform (VMWare)

Operating System (Windows, Linux)

ArcGIS Machine Image (Files)

Machhiiiine

Virtualization Management

The value of Imaging

Procurement

Hardware Setup

IT Setup

Software Setup

Data & Application

Loading

Launch VM from Image

Data & Application

Loading

Launch VM from your

Image

The Value of automation Create Custom Images for distributed sites

• New ArcGIS for Server 10.1 Admin REST API

• Site Management functions - Remove site - Join site - Cluster Management

• Service publishing functions - Create Service - Update Service - Delete Service

Demo Admin REST

API

Desktop Virtualization

Hardware

Windows

Citrix XenApp

ArcGIS for Desktop

Hardware

Windows

Citrix XenApp

ArcGIS for Desktop

Internet

Desktop Virtualization

• Citrix XenApp is Certified

• Launch ArcGIS for Desktop from the browser

• Access ArcGIS for Desktop from any machine with web access

• ArcGIS for Desktop access to data is over the network where it’s running

Understanding ArcGIS in the Cloud

Cloud Categories & ArcGIS

Infrastructure As A Service

(IaaS)

Platform As A Service (PaaS)

Software As A Service (SaaS)

ArcGIS on Amazon EC2, ArcGIS on Private Cloud

ArcGIS Online

ArcGIS Online web services, ArcGIS Server Web APIs

ArcGIS on Amazon EC2, ArcGIS on Private Cloud

ArcGIS Online web services, ArcGIS Server Web APIs

Leveraging the Cloud

Private Cloud

Public Cloud

LESS MORE

Security & Control

Public CloudCloud

Leveraging the Cloud

Private Cloud

Public Cloud

LESS MORE Security & Control

Hybrid Public CloudCloud Private Clouddd

Cloud Flavors

Appliance s/w stack

Off-Premise On-Premise

Public Cloud

Private Cloud Hybrid

Security in the Cloud

•  Shared responsibility in Public Cloud

•  General Concepts: - Network overlays - Private Cloud isolation

•  Government Certifications

Dynamic Resource Allocation

•  A DOT

- Road conditions for storms

•  Unpredictable loads, critical application

Resources Replacement

•  NASA

•  One machine, took 15 days to process Satellite imagery.

•  Using AWS analysis takes 2 hours.

Resource outbursts

•  Organization X - Have their own hosted

environment, and they like it

•  Need extra resources every now and then, they use the cloud

Resource backup

•  Organization XX - Have their own hosted

environment, but are concerned about a Disaster recovery situation

•  Chose the cloud for off-site backup

ArcGIS Server

Rapid Resource Allocation

•  Disaster recovery - BP

•  Rapid response - Haiti

•  Time to market / Opportunity cost

- Australian Yacht racing

Resource Redundancy & best practices

•  Production is paired with Staging, in addition to QA

•  Organizations shy away from the investment to setup and maintain extra environments

•  Start staging and QA only when needed, terminate otherwise.

•  Server Persistence to run a system that is ready to use

Production Staging

Resource Migration

•  Turning staging into production

•  Testing new versions, switch systems rather than setup again

•  Replacing a system with issues instantly

•  Result: More productivity

ArcGIS compatibility with Cloud Stack

Hardware

Virtualization Platform (VMWare, Microsoft, Citrix, other)

Operating System (Windows, Linux)

ArcGIS

Management Tools

ArcGIS on Private Cloud

ArcGIS on Public Cloud

ArcGIS on Public Cloud

•  Amazon Web Services, Pioneers IaaS

•  IT Consumerization - Buy resources based on an hourly rate and per GB - Monthly bill - Get started in 5 mins using your credit card

•  Geographically controlled cloud

Amazon Instance types

•  Sizes - Standard - High CPU

High CPU Extra Large

High Memory Quadruple Extra Large

Standard Large

7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each)

7 GB of memory, 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each)

68.4 GB of memory, 26 EC2 Compute Units (8 virtual cores with 3.25 EC2 Compute Units each)

- High Memory - HPC / Clusters

Amazon Machine Images (AMIs)

•  A virtual image that works in the Amazon Cloud

•  A cookie-cutter approach for configuring servers

•  OS + Software + Data

•  ESRI provided AMIs 10.0

ArcGIS Server 10 AMI

Enterprise Geodatabase AMI

Windows 2008 64 bit ArcGIS Server GIS Services Microsoft SQL Server Express (ArcSDE enabled) ArcGIS Desktop 100Gb of storage (optional)

Windows 2008 64 bit PostgreSQL 8.3.0 (ArcSDE enabled) 100Gb of storage (optional)

ArcGIS for Server on AWS AMIs 10.1

ArcGIS Server 10.1 AMI

Enterprise Geodatabase AMI (Created Automatically)

Ubuntu 64 bit ArcGIS Server GIS Services 100Gb of storage (optional) Postgres SQL - ArcSDE enabled (Optional)

Windows 2008 R2 64 bit Microsoft SQL Server Standard (ArcSDE enabled) 100Gb of storage (optional)

ArcGIS Server 10.1 AMI Windows 2008 R2 64 bit ArcGIS Server GIS Services Microsoft SQL Server Express or Microsoft SQL Server Standard - ArcSDE enabled (Optional) ArcGIS Desktop 100Gb of storage (optional)

Enterprise Geodatabase AMI Ubuntu 64 bit PostgreSQL (ArcSDE enabled) 100Gb of storage (optional)

ArcGIS Cloud Builder for Amazon Web Services

Custom AMIs

ArcGIS cloud product spectrum

ArcGIS Server On

Private Cloud

ArcGIS Server On

Amazon Web Services

ArcGIS Online

Manage it Yourself High Low

ArcGIS in the Cloud

ArcGIS Online

Groups

Users

Catalogue

ArcGIS Online Services cGIS Online Servi

ArcGIS for Server in Cloud

Patterns and Alignment

Data Management

A Complete Integrated System

Planning & Analysis

Field Mobility

Visualization Engagement

Transform Data Into Actionable

Information

Collect, Organize, & Exchange Data

Get Information Into and Out of

the Field

Disseminate Information Where

and When it is Needed

Get Feedback and Make Informed

Decisions

ArcGIS Aligns Value with Business

Visualization Case Study

•  User Special Access control

•  Data updates - Static - Dynamic

Case Analysis

•  Architecture

•  Geo Services - Map Services - GP Services for data visualization

•  Data/ application Security requirements

•  Cost Analysis - Budget - Time lines - Cost estimates

High Availability Deployment with Redundancy

ArcGIS Server 1

ArcGIS Server n

ArcGIS Server 2

ArcGIS Server 3

Database Mirroring

ArcGIS Server

High Availability Deployment Staging & Production

ArcGIS Server 1

ArcGIS Server n

ArcGIS Server 2

ArcGIS Server 3

editing

ArcGIS Server

ArcGIS Desktop

2-way replication

active active

ArcGIS Server

Test/ Staging

ArcGIS Server

Visualization on a Hybrid Cloud

ArcGIS Server 1

ArcGIS Server 2

ArcGIS Server

Private Cloud

ArcGIS Server 1

ArcGIS Server 2

Public Cloud

Database Mirroring

GIS Se

IS Ser

Replication Over HTTPS

Summary

• Virtualization new features - Server - Desktop

• Cloud environments - Private vs Public

• Get started with ArcGIS 10.1

Resources

• White papers - http://www.vce.com/asset/documents/vce-esri-arcgis-white-

paper.pdf- http://www.ibm.com/developerworks/cloud/library/cl-

geospatialanalytics/ - http://media.amazonwebservices.com/

AWS_ESRI_Mapping_GeoSpatial_Analysis_Using_ArcGIS.pdf

• Resources.esri.com

• My email: mmabrouk@esri.com

Q&A