© 2002 ibm corporation grid computing: technology team update mark cathcart, ibm distinguished...
TRANSCRIPT
© 2002 IBM Corporation
Grid Computing:
Technology Team Update
Mark Cathcart, IBM Distinguished EngineerOn Demand Architecture and Design
http://ibm.com/servers/corner
IBM's Vision for theNext Generation Data Center
Enabled by Commercial Grids
May 2003
Responsive Variable Focused Resilient
Open Integrated Virtualized Autonomic
Flexible Variable Managed Optimized
ComputingEnvironment
Bus
ines
sD
esig
n Financial &
Delivery M
odels
What Do You Need To Become an On Demand Business?
Improve working capital and asset utilization
Create business flexibilityby integrating disparate,
unconnected businessand IT processes
Business Transformation
On Demand Business
Reduce costs and increase business responsiveness through IT and business linkage
Requires an On Demand Operating Environment
On Demand Operating Environment
IBM On Demand Operating Environment Delivers Unique Value
Assets used efficiently based
on business requirements
Business policies drive IT resource allocation
Flexible, dynamic business processes
Resources allocatedand managed
dynamically without intervention
On Demand Operating Environment
Business Objectives
and Policies
Op
en S
tan
dar
ds-
bas
ed
Transactional Processes
Application Development, Deployment & Maintenance
CollaborationInformation
Management
Integration of People – Business Process – Information Anywhere, any time, from any device
Availability Provisioning Optimization
Systems and Policy Management
Security
Pools of Virtual Resources
StorageServers Distributed Systems
Transactional Processes
Application Development, Deployment & Maintenance
CollaborationInformation
Management
Integration of People – Process – Information Anywhere, any time, from any device
On Demand Operating Environment
Transactional Processes
Application Development, Deployment & Maintenance
CollaborationInformation
Management
Integration of People – Process – Information Anywhere, any time, from any device
Security Optimization Provisioning
Policy-based Orchestration
Availability
On Demand Operating Environment
Transactional Processes
Application Development, Deployment & Maintenance
CollaborationInformation
Management
Integration of People – Process – Information Anywhere, any time, from any device
Virtualization Engine
StorageServers Distributed Systems
Network
Security Optimization Provisioning
Policy-based Orchestration
Availability
On Demand Operating Environment
Delivering the Operating EnvironmentBased on an evolving set of components that simplify development, deployment and maintenance
Shared components Integrated system
console Security and identity Choreography Transaction coordination Data persistence Workload management Collaboration Application connectivity Configuration tool
Based on open standards XML Web services J2EE Open Grid Services
Architecture Common Information
Model
e-business on demand OfferingsSimple and easy approach to acquiring capabilities
Based on experience from customer engagements
Built around simple, incremental, modular roadmaps
Exploits capabilities from across IBM
Enables the IBM and Business Partner channels to capitalize on opportunities
Virtualization based on Grid Computing capabilities incorporating Policy-Based Dynamic Provisioning
Incorporating key technology initiatives…
Autonomic Capabilities
Self-protecting
Self-healing
Self-optimizing
Self-configuring
Open Standards
Linux
OGSA SOAP
WSDLXML
e-business on demand Operating Environment
Application Environment
An integrated platform, based on open standards, to enable rapid deployment and integration of business applications and processes
Systems Environment
An environment that allows true virtualization and automation of the infrastructure and enables delivery of IT capability and service level on demand
“…with a sophisticated on demand Operating Environment that is…”
…approachable, adaptive, integrated and reliable
infrastructure delivering on demand services for on demand
business operations …
Virtualized Autonomic
IntegratedOpen
CRMERP Finance
PeopleSoftSAP SiebelSoftware:Monolithic
SunHP DellIBM
Processors:Single purpose
InternetWANLANNetwork:Fragmented
The Problem: IT in Vertical FragmentsThe Problem: IT in Vertical Fragments
Storage:Isolated
EMCHitachiHitachi NetAppNetApp
Virtualized
StorageStorage
ApplicationsApplicationsProcessingProcessing
Operating SystemOperating System
DataData
I/OI/O
“Distributed Computing Over a Network,Using Heterogeneous Resources and
Enabled by Open Standards”
MiddlewareMiddleware
A full range of delivery models to bring e-business on demand utility offerings to clients…
‘Internal’ Utility
A client operated IT utility using dedicated, client owned assets
Private Utility
A client specific utility using dedicated assets, but construction and management of these services is provided by an external provider
Hybrid Utility
A mixture of client specific utility services using dedicated resources, and shared use of some public utility services with other subscribers
Public Utility
A set of IT utility services shared across multiple subscribers
Client Benefits• Control• Dedicated resources
Client Benefits• Control• Dedicated resources• Assisted management
Client Benefits• Control for key functions• Dedicated resources for some
assets• Progressively enter public
arena as services mature
Client Benefits• Full provisioning of IT in a
utility mode, giving a comprehensive usage and cost profile
• Cost efficiencies• Shared risk
Operating Environment Pain Points
Insufficient PerformanceHardware and systems are quickly outdated
Difficult to manage systems to an end-to-end QOS
Unable to adapt to change in demandNot able to dynamically adjust to fluctuations in load
Can’t share capacity across applications
Unable to adapt to changes in applications and infrastructure
Each new component causes significant integration challenges
Interfaces are not based on open standards
FragileSingle points of failure are prevalent
Failover and business continuity requires expensive, custom solutions
Applications
Middleware
Systems Management and Automation
Workload / Performance Management
Security
Availability / Service Management
Logical Resource Management
Clustering Services
Connectivity Management
Physical Resource Management
OSOSOS + + +
Open Services Architecture
Exploiting Grid standards in Enterprise Computing
Virtualise Data CenterConsolidate logically
Business Rules managed provisioning,
performance, workloads
Heterogeneous ClusteringX-Platform Automation, backup,
disaster recovery, workload management
Integrated InfrastructureAutonomic discovery and provisioning
Common Services Bus Interface
Coherent, consistent infrastructureBased on open standards (OGSA, OGSI, Web Services, XML, SOAP, HTTP etc.)
Accessed via Web Services interface
Grid Services Structure
Pro
fessio
nal S
erv
ices
Network
OGSA Enabled
Storage
OGSA Enabled
Servers
OGSA Enabled
Messaging
OGSA Enabled
Directory
OGSA EnabledFile
Systems
OGSA Enabled
Database
OGSA EnabledWorkflo
w
OGSA Enabled
Security
OGSA Enabled
Web Services
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Sevices
Open Grid Services Architecture (OGSA)
Applications
Au
ton
om
ic C
ap
ab
ilit
ies
Meta-OS Services
OGSA: policy repository, data replication, security, problem determination, resources instrumentation, logging, basic provisioning
Grid Service Infrastructure
OGSI: discovery, lifecycle, registry, manageability factory, handlemapper, notification, install
Management Functions
Utility Enablement
Billing, Metering, Subscription, Identification, Disaster Recovery
Autonomic I/T Resources
Grid Computing Architecture
Workload Management, Clustering, Job & Service Scheduling, Automated Server Recovery, Distributed e-business Workflow, Provisioning, Data Federation, File System Federation
Solaris & HP/UX
Linux
zSeries pSeries iSeries z,p,i,xSeries xSeries Sun & HP
DellCompaq
...
New classes of applications enabled
Windows
Common GUI
IBM Platforms QoS Enablers/Optimizers
S&TC eCommerce xSP etc...
Storagez/OS WindowsLinuxAIX OS/400
WebServices Run-time
Open Grid Services Architecture
Autonomic Functions & Management Middleware
eLiza eServer Foundation
DellCompaq
...
Architecture Framework
Architecture Framework
OGSA Enabled
OGSA Enabled
OGSA Enabled
Messaging
OGSA Enabled
Directory
OGSA EnabledFile
Systems
OGSA Enabled
Database
OGSA EnabledWorkflo
w
OGSA Enabled
Security
OGSA Enabled
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Sevices
Au
ton
om
ic C
ap
ab
ilit
ies
OGSA
IBM
Glo
bal
Se
rvic
es
software
IBM TotalStorage
www.globus.org
On Demand BusinessGoal
On Demand Operating Environment
Cri
tical
Att
rib
ute
PC’s & Mobile
Lightly Managed
Distributed Systems
Traditional Data Centers and
Managed, Distributed Systems
Infr
astr
uctu
reEle
men
tsFou
nd
ati
on
Tech
nolo
gie
s
Web Services
Grid
Autonomic
eUtility, Provisioning, Utility Management Infrastructure
Schematic for On Demand
OGSA Service Model
Provides capabilities essential to distributed / Grid computing Builds on Web Services technology...current and planned A component model extension for Web Services All OGSA services adhere to specified service interfaces and
behaviours (some required and some optional) Factory, registry, discovery, lifecycle, query service data,
notification, reliable invocation Provides reliable / secure preservation of distributed state Supports dynamic late-binding and creation of distributed resource
groups Supports the creation of virtual resources as stateful OGSA service
instances Location transparent deployment
OGSA Mapping
Message delivery across multiple messaging modelsEndpoint abstractionQuality of service managementMessage BrokingTransformation and Routing
JetStream Messaging
Grid service lifecycle mgt:Instance Creation
Addressing
Component Model:Grid ServiceNotificationService DataRegistrationResource Instrumentation
Web Services
OGSA Services
WSDLUnit of Work Coordination Business Process FlowSecurityContext PropagationQuality of service managementPlug-in architecture
OGSI
ClusteringPolicy ManagementRegistryAutomationProvisioning Problem DeterminationVO Definition and RegistrationService Desk etc
Resources expressed as OGSA Services: The next level of virtualization
Hardw
areH
ardware
OS
OS
Middlew
areM
iddleware
Application
Application
Netw
orkN
etwork
Service interface separate from access and implementation
Service interaction with underlying resource can be local or remote
Abstract representation of “logical” IT resource (node, process, disk, file system, IP address, XML database, Security service, Commerce Server) described as a web services interface (WSDL)
Common operations to configure and monitor resource details.
Provide common behavior for lifecycle, discovery, events.
Abstract representation of “logical” IT resource (node, process, disk, file system, IP address, XML database, Security service, Commerce Server) described as a web services interface (WSDL)
Common operations to configure and monitor resource details.
Provide common behavior for lifecycle, discovery, events.
Adapter/Connector can push down onto multiple underlying resource instrumentations such as CIM or SNMP or RMC
Adapter/Connector can push down onto multiple underlying resource instrumentations such as CIM or SNMP or RMC
OGSA Common Resource Model ArchitectureOGSA Common Resource Model Architecture
OGSA and non-OGSA Resource ManagersOGSA and non-
OGSA Resource Managers
New and existing Java/J2EE Apps
New and existing Non-Java Apps
How will this get deployed ?
OGSA OGSA
Full OGSA NGCM App
OGSA and non-OGSA Resource Managers Full
OGSA NGCM App
Location Independent
Could be
•Centralised
•Decentralised
•Both
Applies to both enabled and existing applications
Exploits Pegasus CIM arechitecture
•Exposed via OGSI web svc
Utility Services BusService
Ser
vice
Service
Service
Service
Monitoring
AppApp
App
Directory
Coordin'n
SelectionMetering
Separates business logic from infrastructure services
•Infrastructure services run within the Service Bus
Not invoked by business logic
•Services required to do business with web services
•Metering, billing (related to contracts)
•Monitoring, load balancing (related to QoS mgmt, SLAs)
•Directory, reputation identification, logging, non-repudiation
Bus provides plug-in points for infrastructure services
•Does not expect to provide all the services
•On-ramp, just after application invokes service
•Off-ramp, just before bus passes control to service
Configurable Infrastructure
•Tooling to connect services and applications to bus
Wider than an enterprise
GatewayGateway
Gateway
Business Continuity and Automated Operations
E n d - t o - E n d A u t o m a t i o n M g r
& x D R
A d a p t e r
A d a p t e r
A d a p t e r
A d a p t e r
A d a p t e rA d a p t e r
A d a p t e r
A d a p t e r
zSeries cluster
pSeries cluster
xSeries cluster
Sun or HP Cluster
ISV Cluster
IBM Server Appliances
Linux cluster
iSeries cluster
On Demand Systems EnvironmentBigger, More Value-rich than just Utility Services
Pools of Virtual ResourcesBladesPartitioning
Storage Virtualization
Business Processes & Applications
Virtualize
Systems IntegrationClustering, Policy Repository, Security, Problem Determination, Logging,
Integrated Systems Mgmt, WLM, Provisioning, Scalability, Security,
Network Mgmt, Storage Mgmt, CUOD
AutomateWorkload Mgmt. Provisioning Billing/Metering …
HP
Physical ResourcesIslands of Heterogeneous
Resources
Phase 1(enable)
Phase 2(exploit)
IT Optimization Scorpion Assess Applications
Exploit OGSA via Webservices/Websphere
Exploit On Demand TechnologieseWLM eAutomation eDisaster Recovery Tivoli Storage Tank
Next Steps for Customers Next Steps for Customers
dynamic business process integration billing metering distributed scaling distributed resource management
V
V
V
V Consolidate & Virtualize Software Enable Storage/Servers/DensityLPAR/IRD/VMWareIBM Director/Blade Center
Appropriate OS levelsSystems Mgmt (Tivoli)Grid (Globus Toolkit)
Leve
l of i
nteg
ratio
n
Full
Silos
Level of automationLabor-intensive Autonomic
Lev
erag
e o
pen
sta
nd
ard
sA
pp
lica
tio
n E
nvi
ron
men
t
Leverage virtualizationSystems Environment
Toward an On Demand Operating Environment
e-business on demand: The New Agenda
Variable
Responsive
Resilient
Focused
Integrated
Open
Virtual
Autonomic
on demand business
on demand operating environment
new financial models
If you are open, integrated, autonomic and virtualised, you are On Demand!
e-Business on Demand: Operating Environment
Systems Environmen
t
UtilityServices
ApplicationEnvironment
BusinessTransformation
OperatingEnvironmen
t