data center virtualization @ cisco
TRANSCRIPT
Cisco Confidential 1 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Jim Robshaw IT Director – Cisco Systems
April 2009
Data Center Virtualization Facility Business Risk Business Agility
Cisco Confidential 2 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco - VMware Logistics
The Need for Virtualization
Cisco’s Stats & “Things to Consider”
Break (15 min)
Our Hope for the Future of UCS and VMware
Cisco Confidential 3 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco at A Glance
Cisco Confidential 4 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
WW Headcount 66,000 employees*
35% Engineering 27% Sales 38% all others
WW Portfolio: 18. 9 million sf (60% owned, 40% leased)
283 metros 90 countries 444 buildings
51 data centers & server rooms 1500+ labs (500+ in San Jose)
20,000 Channel Partners 110+ ASPs 210+ Business & Support Development Partners
End of Q2 FY08 * Persons Housed (excluding SA, Webex, & Ironport)
Over 180,000 people around the world in the extended Cisco family
128+ Acquisitions
Cisco Confidential 5 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
The Data Center Reality Why Virtualization
3 Major Issues Power Space Cooling
Production Data Center
Business Agility
3 Phases of virtualization Where We Were
Where We Are
Where Are We Going
Cisco Confidential 6 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Constraints
Time Factors
• 65 Data Centers • 230,000 sq ft of Raised DC floor globally • 150 Megawatts of Power • 45%+ of Cisco Data Centers Required Action
• DC Construction requires 2 - 3 years • Application provisioning and data migration may add 1
- 2 years, or 3 – 5 years total
• Services responsible for Cisco revenue • Business Continuance • Green technologies not built into older DC designs
Cisco’s Data Center Journey – Wake Up Call!
Cisco Confidential 7 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Data Center / Business Agility Challenges “IT runs the business – downtime is not an option” “I want to see more business value out of IT”
“Our applications are the ‘face’ of our business” “It’s all about keeping the application available”
“As long as my servers are up I’m OK” “We have too many underutilized servers”
“Our information is our business. We need to protect our data everywhere – in transit and at rest”
“I can’t keep up with the amount of storage that needs to be backed up, replicated and archived ”
CxO
Apps
Server
SecOps
Storage
Network “I need to provide lots of bandwidth between data centers, and make sure users can get to the apps”
© 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 7
Cisco Confidential 8 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Technology Leadership Business Strategy Cisco Green Initiative
Minimize energy consumption
Consider power from renewable sources
Technical innovation Environmental compliance Enable new Green
business models Demonstrate corporate
citizenship
Drive for growth
Enable market transitions
New business models
Globalization
Technology and business architecture
Enable every move we make with IT
Early Adoption
Flexibility through modularity
Product quality improvement
BU/IT/AS Joint discovery
Early value realization
Acquisition opportunities
Acceleration
Automation
Virtualization
Next-Gen DC Networking
Adoption Curve
Management
New Opportunities
Accelerated Adoption
So – Now What? What’s The Plan?
Cisco Confidential 9 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
A Concept! Service Oriented Data Center (SODC)
SODC Target State: Pooled Virtual Resources, Automated, Standard Services Based, Secure, Intelligent Unified Data Center Network
Service Oriented
Data Center
Vision
Vision Enablers
Software Technology
Business Processes People Hardware
Technology
Cisco Confidential 10 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco’s Data Center Evolution – Roadmap for “virtual machine deployment”
2005 2004 2006 - 2009 2010 - 2013
• Standardization • Virtual Machines
• 4 Tier Silos • Heterogeneous OS • Storage Silos • Low Utilization
• IP Connectivity
• Perimeter Security
• Application Silos • Distributed
• Server Orchestration • VM Mobility • Storage
Virtualization • Unified Network
Services FCoE
• Policy Based Security
• WAAS ACE
• Infrastructure Aligned to Application Services
• Policy Based Management
• Unified I/O • Tiered Recovery • Usage and SLA-
based Funding Model
• Cloud Based Apps & Services
Legacy Data Center
Virtual Data Center
Service Oriented Data Center
Consolidated Data Center
Consolidation Phase Virtualization Phase
Automation Phase
Compute
Storage
Network
Security
Application
• SANs, VSANs • Tiered Storage
• Consolidate, Centralize
• Consolidated Network Services
• Secure Each Application Tier
Cisco Confidential 11 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Service Oriented Data Center –SODC 2 Tracks - Tech Track & Business Track
IT Architecture
IT Operations
Data Center Architecture WAN Optimization Data Center Provisioning
Critical Systems Resiliency Tracks Application Enterprise Architecture Application Dependency Mapping Common Management Database
Agility and Resiliency
Cisco Confidential 12 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
SODC Design Phases
Consolidate Optimize Data Center Resources
Increase Resource Utilization
Virtualize Virtual Resource Pools
Increase Availability and Agility
Automate Adaptive Orchestration
Rapid Delivery of Services
Cisco Confidential 13 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
SODC Server Virtualization Architecture
Data Center Aggregation
Block
Network Services
Block
Catalyst 4948
Catalyst 6509
Catalyst 6509
SAN B SAN A
Ethernet Fiber Channel
Cisco Confidential 14 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco Data Centers (65)
SJ-12 SJ-K Linksys
RTP 5
Amsterdam
Business Data Center Data Centers Engineering R&D Data Center
Total of 245,000 square feet of
raised Data Center space at Cisco
Scientific Atlanta
Cisco Confidential 15 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Why A New Data Center? (Business Risk)
PDC infrastructure does not support increasing technical requirements, and does not scale cost effectively
“…a significant percentage of new business requests are delayed due to current limitations…”
PDC architecture presents significant business continuity risks
“70% of US computing resources lie within a major earthquake and flood zone”
PDCs are not geared to showcasing the Cisco message
“Cisco technologies such as “Business Ready Data Center” cannot be showcased as designed in our existing data centers”
• US PDCs have been running at capacity for 12 to 18 months; incremental expansion strategies are costly and introduce risk of construction-related disruptions
• Lack of infrastructure redundancy requires complete data center shutdown to perform thorough testing & maintenance
• Cooling and load bearing constraints limit efficient use of floor space and increase deployment time
• Current applications and technical architecture does not support full business resiliency
• Location based risks are not currently mitigated and present exposure to potential disruptions
• Cisco cannot fully support Advanced Technologies in our own production environment
• Current PDC environment is a generation behind and does not represent a best-in-class showcase
Cisco Confidential 16 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
PDC Site Selection Strategy From 420 Metro Areas Down to 8, Then 1
Must-haves: U.S. or Canada Negligible environmental
risk (e.g. earthquake, hurricane, tornadoes, etc.)
Fiber service At least 2 long
distance providers
Additional Criteria: Electrical power cost; long-term price stability Other costs: real estate, labor, taxes, govt incentives Proximity to existing Cisco IT operations
Close to customers Availability of technical labor
Regulatory environment
Earthquakes Hurricanes
Tornado Fiber
Cisco Confidential 17 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Where we are (Storage – Compute – Data Center)
Cisco Confidential 18 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco today! Standards based approach
2005 2004 2006 - 2009 2010 - 2013
• Standardization • Virtual Machines
• 4 Tier Silos • Heterogeneous OS • Storage Silos • Low Utilization
• IP Connectivity
• Perimeter Security
• Application Silos • Distributed
• Server Orchestration • VM Mobility • Storage
Virtualization
• Unified Network Services FCoE
• Policy Based Security
• WAAS ACE
• Infrastructure Aligned to Application Services
• Policy Based Management
• Unified I/O • Tiered Recovery • Usage and SLA-
based Funding Model
• Cloud Based Apps & Services
Legacy Data Center
Virtual Data Center
Service Oriented Data Center
Consolidated Data Center
Consolidation Phase Virtualization Phase
Automation Phase
Compute
Storage
Network
Security
Application
• SANs, VSANs • Tiered Storage
• Consolidate, Centralize
• Consolidated Network Services
• Secure Each Application Tier
Cisco Confidential 19 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Consolidation of Network Fabrics Today in Mountain View
Data Center Aggregation
Block
Network Services
Block
10 GbE Server Access
Nexus 5000
Nexus 7000
Catalyst 6509
SAN B SAN A
Ethernet Fiber Channel
Consolidated transports
SAN Aggregation
Cisco Confidential 20 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Over 13 PB of “raw” storage
Overall Growth Rate: FY’02=69%, FY’03=32%, FY’04=50%, FY’05=58%, FY’06=29%, FY’07=52%, FY’08=48%
Cisco Data Center Storage Landscape
Cisco Confidential 21 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
SODC Storage Results to date
Overall utilization increased from 20% to 68% over past 6years
Managed storage per FTE increased from 25 TB to 750 Terabytes over past 6 years
Total Cost of Ownership reduced from .21/MB to .01/MB over past 6 years
$71 Million in cost avoidance over past 4 fiscal years ($9M in FY04, $14M in FY05, $27M in FY06, $21M in FY07)
Cisco Confidential 22 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Data Center Server Consolidation Improve Operational Agility Lower Data Center Operating Expense
Increase Utilization of Physical Servers Optimize TCO Improve Data Center Capacity Management
Reduce Service Provisioning Times Rapid deployment of Operational Services
Increase Operational Efficiencies Support of Environments Zero down time Operations
SODC Server Virtualization
Cisco Confidential 23 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco Data Center Server Landscape (Standards)
14,230 virtual/physical servers
3,802 Applications 1263 DBs (279 prod)
Source: Cisco IT, July 2008
Solaris 20.5% 2,911
Linux 50% 7,101
HPUX 1.5% 217
Windows 28% 4,001
Cisco Confidential 24 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Farms online
Farm Pending go-live
Syd and HK Under Discussion
~3,160 VMs Deployed to Date
~2,609 Active VMs ~43% of IT Business Servers ~203 TB of Storage
204 VMware Servers Across 25 Clusters in 8 Data Centers
~300 New VMs/Qtr (Greenfield)
Target 80% of All New Servers deployed as a Virtual Machine
(currently at 60%)
Service Oriented Data Center – VMware Landscape & Growth
Cisco Confidential 25 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Over $20.4M in Total Cost Avoidance To Date!
Improved Server utilization from 8% to 65%
Service Oriented Data Center – Vmware Financial Results
Cisco Confidential 26 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Server Virtualization Considerations
Support Model Support Model must drive operational objectives Managed by core SODC Team
Risk vs. Virtualization Targets ISV’s Support? Reduced Risk = Reduced Potential Savings
Keep Clients In Mind Minimize Impact of Migrating to Virtual Servers Platespin, VM Converter Software is Crucial
Communicate VMware Strategy and Direction Success Depends on Leadership Support
Cisco Confidential 27 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Production Data Center (On-Line June 08)
1.0 General & Operations
1.1 Collection & storage recyclables 1.2 Consolidation of equipment 1.3 Construction waste re-cycling 1.4 Energy star appliances 1.5 Building commissioning 1.6 Indoor air quality
2.0 Site
2.1 Erosion control 2.2 Wildlife habitat 2.3 Relocation of trees 2.4 Reduction in automobile use
3.0 Building Shell
3.1 Fly ash 3.2 Glazed screening 3.3 Re-use of existing facility
4.0 Interior Construction
4.1 Recycled content finishes 4.2 Low VOC materials 4.3 Non-CFC fire extinguishers 4.4 No gas suppression system 4.5 Carbon monoxide monitoring 4.6 Lighting controls 4.7 Re-use of building systems 4.8 Salvage & stock materials
5.0 Electrical
5.1 Generator emission controls 5.2 Distributed battery pack 5.3 Lighting controls 5.4 Generator test under build load 5.5 Transformer efficiency 5.6 Electronic ballasts 5.7 T8 flourescent lamps
6.0 Mechanical
6.1 Waterside economizer 6.2 Pump curves 6.3 Chiller efficiencies 6.4 Cooling tower water treatment 6.5 Non CFC refrigerant 6.6 VFD’s 6.7 UPS heat tempering 6.8 Heat recovery for office space 6.9 Chilled water operating temps 6.10 Motion activated fixtures 6.11 Vapour barrier 6.12 N+2 chiller configuration
Cisco Confidential 28 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Data Center Operational Choices
Active-Standby
Same as today Doesn’t work well today Only critical apps Idle hardware Different configuration in both DCs
Min infra complexity Med apps complexity
Active-Active
Used by financial institutions (E.g. metro clusters, multi-master data)
Majority of apps Vendor specific
High infra complexity High apps complexity
Cisco Confidential 29 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco Data Centers (51)
SJ-12 SJ-K Linksys
RTP 5
Amsterdam
Business Data Center Data Centers Engineering R&D Data Center
Total of 230,000 square feet of
raised Data Center space at Cisco
Scientific Atlanta
Cisco Confidential 30 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Break - 15 Minutes
Cisco Confidential 31 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco’s Future with Virtualization! Unified Computing System & VMware
Cisco Confidential 32 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
The Vmware VMMark benchmark – 164% increase over prior top-scoring two-socket systems based on previous-generation Intel processors.
Vmware Benchmark - UCS 164% Increase
UCS and Vmware will exploit all of the next generation features & functionality!
Cisco Confidential 33 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Cisco’s Data Center Future – Roadmap for “virtual machine deployment”
2005 2004 2006 - 2009 2010 - 2013
• Standardization • Virtual Machines
• 4 Tier Silos • Heterogeneous OS • Storage Silos • Low Utilization
• IP Connectivity
• Perimeter Security
• Application Silos • Distributed
• Server Orchestration • VM Mobility • Storage
Virtualization • Unified Network
Services FCoE
• Policy Based Security
• WAAS ACE
• Infrastructure Aligned to Application Services
• Policy Based Management
• Unified I/O • Tiered Recovery • Usage and SLA-
based Funding Model
• Cloud Based Apps & Services
Legacy Data Center
Virtual Data Center
Service Oriented Data Center
Consolidated Data Center
Consolidation Phase Virtualization Phase
Automation Phase
Compute
Storage
Network
Security
Application
• SANs, VSANs • Tiered Storage
• Consolidate, Centralize
• Consolidated Network Services
• Secure Each Application Tier
Cisco Confidential 34 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Virtualization Architecture Unified Computing System
Network Services
Block
Nexus 7000
Catalyst 6500
SAN A
An even simpler arrangement
SAN B
Cisco Confidential 35 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
From cabling to your Data Center organization – UCS simplifies
From ad hoc and inconsistent…
…to structured, but siloed, complicated
and costly… …to simple, optimized
and automated
What does your Data Center organization look like?
Cisco Confidential 36 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Plant / Business Risk / Agility The differences (Airflow/cables, etc.)
What UCS provides: Less Cabling Increased Air flow Less Power Less Components Greater Memory Greater Density
We will be able to: Defer Data Center build 3yrs Better asset utilization Automate Services Reduce Opex Reduce Capex Offer Cloud based services
IaaS PaaS SaaS
Drive VMs per Kwatt Tighter Partnership with Vmware and Intel
Cisco Confidential 37 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
… Evolution: You have been building the foundation since 1993
Legacy Virtualization + consolidated infrastructure
+ Unified Data Center
Compute
Storage
Network
Management
Dedicated Physical Multi-OS Servers
Dedicated Storage Infrastructure
Dedicated Network Infrastructure
Single Element Management per Technology
Multiple virtuals in physical server.
Multiple Storage Fabrics on single Physical Infrastructure Services virtualized and migrated into Network
Element Managers deployed for virtual and physical infrastructure
Higher performance virtual servers
Improved performance with fewer nodes
Migration to single Data Center Infrastructure
Servers optimized across I/O, memory and cpu
Storage integration into compute plane
Data Center integrated and holistically managed
Network fully integrated into data center platform
Integration of Storage and networks into single Management platform
Cisco Confidential 38 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Global DC Presence – Target End State 51 – 20 by FY13
Netherlands – Metro-based DC Pair (Tier-III)
Single-Instance Order Management (OM/AR) -
AsiaPAC TBD – Single DC (Tier-III) + land Continental hub for SaaS, Unified
Communications and software development
1 A 1 x Type - A ( Tier - III ) 2 A sc 2 x Type - A at Synchronous Capable Distance
1 A 2 A sc
2 A sc
1 A
Mountain View (CA) –
Early Adopter DC
E
E Early Adopter DC
(~Uptime Tier-II) (~Uptime Tier-III)
B
B Type - B ( Tier - II ) 1 x Type - A ( Tier - III ) B
2 x Type - A at Synchronous Capable Distance
B
40 ms rtt
B B
B
B
B B
B B
Distributed standalone DCs (Tier-II)
Latency-sensitive software development at lower availability
Richardson (TX) – Metro-based DC Pair (Tier-III)
Global hub for business applications Continental hub for SaaS and communications
Global Disaster Recovery Strategy
Short to Mid-Term: Leverage Current Assets
Long-Term: Part of Decision Process (Make/Buy)
1 x Type - A ( Tier - III ) 2 x Type - A at Synchronous Capable Distance
BC / DR Plan Type - B ( Tier - II ) 1 x Type - A ( Tier - III ) 2 x Type - A at Synchronous Capable Distance
BC / DR Plan
1 A
Cisco Confidential 39 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Data Center 3.0 Evolution Path
Unified Computing
Consolidation Virtualization Automation Utility Cloud
Data Center Networking
Unified Fabric
Unified Computing
Enterprise Class Clouds
Inter - Cloud
Location Freedom
HW Freedom
Provisioning Freedom
Virtualization has created a market transition . “Servers” are becoming fluid objects in the network. The data center must evolve to continue to scale. Cisco is offering a fresh alternative to traditional ad-hoc add-on approaches for virtualized data centers.
…
Cisco Confidential 40 Copyright © 2008 Cisco Systems, Inc. All rights reserved.
Thank You!
Jim Robshaw [email protected]