understanding arcgis in virtualization and cloud environments · understanding arcgis in...
TRANSCRIPT
Understanding ArcGIS in Virtualization and
Cloud Environments Marwa Mabrouk
Esri Middle East and Africa User Conference December 10–12 | Abu Dhabi, UAE
Powerful GIS capabilities
Delivered as Web services
To help solve real problems by real people
ArcGIS Server
Native 64-Bit
Code optimizations
Clip &Ship
Imagery
Map Caching
Editing
&Ship
Analysis A
Find Addresses
Mapping
5x
10x
2x
50x
Queries
Ima
p
ng
pDrive-time Polygons
ries
Search
g
MGeoprocessing
Identify
Web Services
Easy to install, configure, and manage
Server Administration API
IT Friendly
GIS Server
Pure Web Services GIS Server New Architecture New user experience
REST SOAP OGC
Printing
Dynamic Layers
Feature Services
Caching Server Object Extensions
Automatic Clear REST
WMTS and WPS
Editor Tracking Ownership-based data access
Cache Status
Edit Zs and Ms
Edit any GDB version
Image Mensuration
Traffic aware routing Estimate Cache on disk
Batch Geocoding in REST
Schematics OOTB
Geometric Network Tracing
Cloud Builder
• VMWare - Certified on vSphere 4.x, 5.x
• Amazon Web Services
- Easier to launch and administer ArcGIS sites - Linux support
• Microsoft Azure
• Private Cloud Support - IBM - VCE
Virtualization & Cloud
Agenda
• Virtualization Basics • What are people doing with Virtualization? • New Architecture • New Virtualization Features
• Understanding the Clouds • ArcGIS in the Cloud
Virtualization Basics
Hardware
Virtualization Platform (VMWare, Microsoft, others)
Operating System (Windows, Linux)
ArcGIS New
IP
Dynamic Resource Allocation
Organizational Resources
Dynamic Resource Allocation
Organizational Resources
Persistence
GIS
Development & QA
Staging Production
Persistence
Development & QA
Staging Production
GIS
Copy and Run
GIS
Data Management
Data Visualization
Old Architecture
SOM
SOC SOC
New Architecture
Machine 1 My ArcGIS Server Site
Machine 2 My ArcGIS Server Site
New Architecture
Machine 1 My ArcGIS Server Site
Machine 2 My ArcGIS Server Site
Web Tier (Web Adaptor)
Firewall
Cluster 2
Cluster 1
New Architecture
Machine 1 My ArcGIS Server Site
Machine 2 My ArcGIS Server Site
Web Tier (Web Adaptor)
Firewall
Machine 3 My ArcGIS Server Site
Machine 4 My ArcGIS Server Site
Simplified Setup, Configuration and Management
• Pure web services server - Easier install and configuration - Self contained GIS server - No DCOM access, no external dependencies
• Built for resilience • More robust
- Easier management of clusters
• More Linux friendly
A
Server 10.1 Architecture
ArcGIS account (OS level)
GIS site
GIS Server
Service directories
Manager
Server Administrator API
http://6080
Primary Site Administrator (PSA)
A
Data Server directories
Configuration store
Single machine deployment with Web Adaptor
• Easily block admin end points • Forward compatibility
- Connect via port 80 - GIS site name
• Leverage Web tier features - Security - Logging
Web Server W b
http://80
Web Adaptor
GIS site GIS Server GIS
http://6080
Data Server directories
Configuration store
Firewall
• OOTB reverse proxy
A
New Web Manager
Demo
Key New features for Server Virtualization
• Support for new ip assignment
• ArcGIS for Server Admin REST API
Creating a Base Image
Hardware
Virtualization Platform (VMWare vSphere)
Operating System (Windows, Linux)
ArcGIS
Virtualization Management
Machine Image (Files)
Launching a new VM from Image
Hardware
Virtualization Platform (VMWare)
Operating System (Windows, Linux)
ArcGIS Machine Image (Files)
Machhiiiine
Virtualization Management
The value of Imaging
Procurement
Hardware Setup
IT Setup
Software Setup
Data & Application
Loading
Launch VM from Image
Data & Application
Loading
Launch VM from your
Image
The Value of automation Create Custom Images for distributed sites
• New ArcGIS for Server 10.1 Admin REST API
• Site Management functions - Remove site - Join site - Cluster Management
• Service publishing functions - Create Service - Update Service - Delete Service
Demo Admin REST
API
Desktop Virtualization
Hardware
Windows
Citrix XenApp
ArcGIS for Desktop
Hardware
Windows
Citrix XenApp
ArcGIS for Desktop
Internet
Desktop Virtualization
• Citrix XenApp is Certified
• Launch ArcGIS for Desktop from the browser
• Access ArcGIS for Desktop from any machine with web access
• ArcGIS for Desktop access to data is over the network where it’s running
Understanding ArcGIS in the Cloud
Cloud Categories & ArcGIS
Infrastructure As A Service
(IaaS)
Platform As A Service (PaaS)
Software As A Service (SaaS)
ArcGIS on Amazon EC2, ArcGIS on Private Cloud
ArcGIS Online
ArcGIS Online web services, ArcGIS Server Web APIs
ArcGIS on Amazon EC2, ArcGIS on Private Cloud
ArcGIS Online web services, ArcGIS Server Web APIs
Leveraging the Cloud
Private Cloud
Public Cloud
LESS MORE
Security & Control
Public CloudCloud
Leveraging the Cloud
Private Cloud
Public Cloud
LESS MORE Security & Control
Hybrid Public CloudCloud Private Clouddd
Cloud Flavors
Appliance s/w stack
Off-Premise On-Premise
Public Cloud
Private Cloud Hybrid
Security in the Cloud
• Shared responsibility in Public Cloud
• General Concepts: - Network overlays - Private Cloud isolation
• Government Certifications
Dynamic Resource Allocation
• A DOT
- Road conditions for storms
• Unpredictable loads, critical application
Resources Replacement
• NASA
• One machine, took 15 days to process Satellite imagery.
• Using AWS analysis takes 2 hours.
Resource outbursts
• Organization X - Have their own hosted
environment, and they like it
• Need extra resources every now and then, they use the cloud
Resource backup
• Organization XX - Have their own hosted
environment, but are concerned about a Disaster recovery situation
• Chose the cloud for off-site backup
ArcGIS Server
Rapid Resource Allocation
• Disaster recovery - BP
• Rapid response - Haiti
• Time to market / Opportunity cost
- Australian Yacht racing
Resource Redundancy & best practices
• Production is paired with Staging, in addition to QA
• Organizations shy away from the investment to setup and maintain extra environments
• Start staging and QA only when needed, terminate otherwise.
• Server Persistence to run a system that is ready to use
Production Staging
Resource Migration
• Turning staging into production
• Testing new versions, switch systems rather than setup again
• Replacing a system with issues instantly
• Result: More productivity
ArcGIS compatibility with Cloud Stack
Hardware
Virtualization Platform (VMWare, Microsoft, Citrix, other)
Operating System (Windows, Linux)
ArcGIS
Management Tools
ArcGIS on Private Cloud
ArcGIS on Public Cloud
ArcGIS on Public Cloud
• Amazon Web Services, Pioneers IaaS
• IT Consumerization - Buy resources based on an hourly rate and per GB - Monthly bill - Get started in 5 mins using your credit card
• Geographically controlled cloud
Amazon Instance types
• Sizes - Standard - High CPU
High CPU Extra Large
High Memory Quadruple Extra Large
Standard Large
7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each)
7 GB of memory, 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each)
68.4 GB of memory, 26 EC2 Compute Units (8 virtual cores with 3.25 EC2 Compute Units each)
- High Memory - HPC / Clusters
Amazon Machine Images (AMIs)
• A virtual image that works in the Amazon Cloud
• A cookie-cutter approach for configuring servers
• OS + Software + Data
• ESRI provided AMIs 10.0
ArcGIS Server 10 AMI
Enterprise Geodatabase AMI
Windows 2008 64 bit ArcGIS Server GIS Services Microsoft SQL Server Express (ArcSDE enabled) ArcGIS Desktop 100Gb of storage (optional)
Windows 2008 64 bit PostgreSQL 8.3.0 (ArcSDE enabled) 100Gb of storage (optional)
ArcGIS for Server on AWS AMIs 10.1
ArcGIS Server 10.1 AMI
Enterprise Geodatabase AMI (Created Automatically)
Ubuntu 64 bit ArcGIS Server GIS Services 100Gb of storage (optional) Postgres SQL - ArcSDE enabled (Optional)
Windows 2008 R2 64 bit Microsoft SQL Server Standard (ArcSDE enabled) 100Gb of storage (optional)
ArcGIS Server 10.1 AMI Windows 2008 R2 64 bit ArcGIS Server GIS Services Microsoft SQL Server Express or Microsoft SQL Server Standard - ArcSDE enabled (Optional) ArcGIS Desktop 100Gb of storage (optional)
Enterprise Geodatabase AMI Ubuntu 64 bit PostgreSQL (ArcSDE enabled) 100Gb of storage (optional)
ArcGIS Cloud Builder for Amazon Web Services
Custom AMIs
ArcGIS cloud product spectrum
ArcGIS Server On
Private Cloud
ArcGIS Server On
Amazon Web Services
ArcGIS Online
Manage it Yourself High Low
ArcGIS in the Cloud
ArcGIS Online
Groups
Users
Catalogue
ArcGIS Online Services cGIS Online Servi
ArcGIS for Server in Cloud
Patterns and Alignment
Data Management
A Complete Integrated System
Planning & Analysis
Field Mobility
Visualization Engagement
Transform Data Into Actionable
Information
Collect, Organize, & Exchange Data
Get Information Into and Out of
the Field
Disseminate Information Where
and When it is Needed
Get Feedback and Make Informed
Decisions
ArcGIS Aligns Value with Business
Visualization Case Study
• User Special Access control
• Data updates - Static - Dynamic
Case Analysis
• Architecture
• Geo Services - Map Services - GP Services for data visualization
• Data/ application Security requirements
• Cost Analysis - Budget - Time lines - Cost estimates
High Availability Deployment with Redundancy
ArcGIS Server 1
ArcGIS Server n
ArcGIS Server 2
ArcGIS Server 3
Database Mirroring
ArcGIS Server
High Availability Deployment Staging & Production
ArcGIS Server 1
ArcGIS Server n
ArcGIS Server 2
ArcGIS Server 3
editing
ArcGIS Server
ArcGIS Desktop
2-way replication
active active
ArcGIS Server
Test/ Staging
ArcGIS Server
Visualization on a Hybrid Cloud
ArcGIS Server 1
ArcGIS Server 2
ArcGIS Server
Private Cloud
ArcGIS Server 1
ArcGIS Server 2
Public Cloud
Database Mirroring
GIS Se
IS Ser
Replication Over HTTPS
Summary
• Virtualization new features - Server - Desktop
• Cloud environments - Private vs Public
• Get started with ArcGIS 10.1
Resources
• White papers - http://www.vce.com/asset/documents/vce-esri-arcgis-white-
paper.pdf- http://www.ibm.com/developerworks/cloud/library/cl-
geospatialanalytics/ - http://media.amazonwebservices.com/
AWS_ESRI_Mapping_GeoSpatial_Analysis_Using_ArcGIS.pdf
• Resources.esri.com
• My email: [email protected]
Q&A