data center cabling amp - bicsi center cabling solutions ... • stratex networks • tellabs /...

Data Center Cabling Solutions

Hans-Jürgen NiethammerHead of Program Management EMEAMember of ISO JTC1/SC25/WG3

Content

• Data Center Cabling Standards

• Data Center Cabling Trends

• Data Center Applications today & tomorrow

• Premium Data Center Cabling Solutions

Data Center Cabling Standards

Data Center Standards

• TIA 942: Telecommunications Infrastructure Standard, April 2005

– Substantial, Available, American

• EN 50173-5: Information technology – Data Centers

– Smaller scope, European perspective

• ISO/IEC Draft 24764: Information technology

– Global Generic Cabling for Data Centers

Hierarchical Structure of Data Centers

Tiers• The Uptime institute defined 4 levels of reliability for Data

Centers

Not much time

for re-cabling

Data Center Cable Types

• Fiber media types:

– Singlemode fiber– Multimode fiber – TIA: recommendation OM3 (XG) | ISO min. OM3 (XG)

• Copper media types:

– TIA: min. Cat. 6 | ISO: minimum Class E A !!!!!!!

Structured Cabling Trends for SAN’s and Data Centers

Data Center Dynamics Survey

Data Center Dynamics Survey

IDC Research about TOP DC Concerns

Premium Passive Solutions for Data Center

• DC cabling requirements aredifferent from the ones in Office Networks

• Static vs. Dynamic

– Easy deployment (weekend work/testing)– High performance– Structured scalability– Fast & easy MAC‘s (operational cost)– Functional Security (less human errors)– High density (cost of space)– Effective cable management– Availability (less planning, less downtime)– Cooling/airflow support

Data Center Applications & Technologies

Today & Tomorrow

GBE/10GBE

• GigaBit Ethernet

– OM1/OM2/OM3 for fiber (1000Base-SX/LX)– Cat.5e for copper (1000Base-T)

• 10GigaBit Ethernet

– OM3 recommended for fiber (10GBase-SR)– Cat.6A/Cat.7/Cat.7A for copper (10GBase-T)

Fibre Channel

InfiniBand Bandwidth

2004 2005 2006 2007

Spe

ed

40G

20G

10G8G4G2G

Infiniband10G EthernetFibre Channel1G Ethernet

120G QDR

DDR

SDR

Parallel lanesmeans parallel optics

InfiniBand: High Speed Cabling Types

QSFP

Shielded

InfiniBand: QSFP

InfiniBand: Multi Fiber QSFP

InfiniBand: Cable-Media-Converter QSFP

IEEE HSSG: 40/100 GBE (IEEE 802.3ba)

• 850nm 12x10G CWDM devices may support 100-300m (100 m proven)

• Utilisation of 12 ribbon fiber & MPO connectors an important factor for economic feasibility of 100G MMF

• Pre-terminated OM3 ribbon fiber will be cost-effective

Premium Data Center Cabling

Solutions

The Premium

• Modern Data Center Cabling Systems have to meet or exceed:

– all Data Center Cabling Standard Definitions

– all Data Center specific Cabling Requirements

– all Technology & Application Requirements (today & tomorrow)

Recall: DC Premium Cabling Requirements

– Easy deployment (weekend work/testing)

– High performance– Structured scalability– Fast & easy MAC‘s– Functional Security (less human

errors)– High density– Effective cable management– Availability (less planning,

less downtime)– Cooling support

Pre-terminated Plug & Play

Modular Cabling Solutionfor Copper & Fiber

MRJ21 MPO 1€

High Density Pre-terminated Solutions

• Pre-terminated MRJ21 Copper System

• High Density with 6 GBE Channels per cable

• Pre-terminated MPO Fiber System

• High Density with 12 or 72 fibers per cable

ISO/IEC 24764 Data Center Standard

Backbone

Horizontal

• Combines high density and ease of maintenance with energy saving:

• Doubles GBE switch capacity compared to RJ45 interface

• Utilize existing chassis

• Flexibility

• Rapid installation / change-out• Fewer cables to manage on the switch

MRJ21: The End-to-End System approach

Network Vendors with MRJ21 Equipment

• Alcatel TiMetra• Barco Xenia• EIT• EntriSphere • Foundry Networks• Force10 Networks • Fujitsu • IBM • Lucent • Motorola • NMS Communications

• Proworks

• Shanghai Electronics• Stratex Networks• Tellabs / Vivace

Force10 E1200

Up to 1260 GBE ports / chassis

Foundry RX-8

48 GbE ports/blade

Note: The vendors listed and shown have publicly launched MRJ21 equipment into the marketplace. Those not listed should be contacted directly for program status updates.

IBM eServer

BladeCenter Copper Pass-thru module

High-density Pre-terminated Solutions

• Common Systems features:

– High-density and/or modular connectivity– The simplicity of a “Plug&Go” installation– Factory tested– Less Installation time in avg. 5x faster

than traditional termination/panel– Space saving in average 30%

(pathways & spaces)– Support of cooling concepts– Easy Scalability

Recall: DC Premium Cabling Requirements

– Easy deployment(weekend work/testing)

– High performance– Structured scalability– Fast & easy MAC‘s– Functional Security

(less human errors)– High density– Effective cable management– Availability

(less planning, less downtime)– Cooling support

Zero U Cable Management

Why Cable Management ?

• Does this look familiar?

– Unmanaged and unstructured connections

– No documentation– 30-40% abandoned patch cords

after 1 year of operation– Dead ports in switches and cable

runs 30-40% unused capacity– MAC time > 1h per port– Adds up to 150% of operational

cost– Adds up to 200% of floorspace

needed – Heat sinks creation (blocking of

air flow)

Zero U Cable Management Technology

• Zero U Corner Brackets combined with AngledPatch Panels

– Eliminates the need for horizontal cable managers– Uses unused valuable cabinet space– Effectively increase of cabinet density– Available for Copper & Fiber

Source: RGD handboek universele bekabeling

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

31

41

40

39

38

37

36

35

34

33

32

31

29

30

28

27

26

25

24

23

22

21

20

19

18

17

16

15

14

13

12

11

10

9

8

7

6

5

4

3

2

1

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 2 413 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

1 9 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

19 20 21 22 23 241 3 14 15 16 17 187 8 9 10 11 12

Category 6System

1 2 3 4 5 6

•Up to 50% Increase inCabinet Density

•50% Reduction in foot print design

The Zero U Advantage

Traditional System withHorizontal Cable managers

AMP Hi-D System

Zero U Cable Management on LAN equipment

Cisco Catalyst 4500 & 6500 series

Zero U Cable Management: Return on Investment

• Space Savings– Rack density increase up to

40%

• Operational Savings– Time saving for move, adds

and changes– Minimize troubleshooting time– Ensure network uptime

• Airflow support– Reduces cooling cost

Operational Cost

1 2 3 4 5YearTo

tal C

ost o

f Ow

ners

hip

AMP-HiD Traditional Cable Mgmt System

MPO High Grade

ISO/IEC 24764 Data Center Standard

external network interface (ENI)

local distribution point (LDP);

equipment outlet (EO).

Standard allows to connect subsystems.With MPO this results in channels of 8 or 12 connections

4 connectors

8 connectors

Links > 2.6 dB = 0 %

Average = 1.3 dB

Cable length: 100mtr

Links > 2.6 dB = 10 %

Average = 2.2 dB

Cable length: 100mtr

Standard Grade MPO with 10GBase-SR

4 connectors

8 connectors

Links > 2.6 dB = 0 %

Average = 0.97 dB

Cable length: 100 m

Links > 2.6 dB = 0 %

Average = 1.58 dB

Cable length: 100 m

High Grade MPO with 10GBase-SR

• Advantages

– Longer link length– More trunks/cassettes in a channel– More flexibility in data center design– Allows „full-fiber“ data center– Less electronics saves power

MPO High Grade

Fiber Solutions for 40/100 Gig

• Highest Fiber Density fortoday’s application

• 8x MPO to 48 LC-D

• Upgrade option to 8 x 40/100GBE channels in 1 U !!!!

Hi-Density 96-fiber /1U Enclosure

MPO - Super High Density

• Pre-Populated Optical Patch Panel– 72 fiber/ 1U – Pre-installed cable management– 72 fiber MPO connector interface into tray– Pre-tested and ready to install– Immense time saving during installation

• Applications– SAN equipment panel– 40/100 GBE ready (6 channels per MPO)

QSFP-style Active Cable Assemblies for

InfiniBand Applications

Why Active Optical Cable Assemblies?

�Up to 200mtr.!

�Bend radius 25mm!

�20 GB Bi- directional (Up to 40Gb)

�Multi Mode fiber optic cable

Copper compared to Fiber

�Limited lengths, max 20mtr.

�Large Bend radius

�28-26 AWG Copper cable

�Max. 10 GB Bi- directional

Longer lengthsare

not possible due to

Noise and Crosstalk

�28-26 AWG Copper cable

Solution Overview

– DDR4 - 4 Channels of 5 Gb/s• 20 Gb/s Up to 200 Meter Reach

– QDR4 - 4 Channels of 10 Gb/s• 40 Gb/s up to 120 Meter Reach

– Next steps to develop• Product DDR12 -12 Ch 5 Gb/s (60 Gb/s) Up to 120 Meter

Reach• Product QDR12 – 12 Ch 10 Gb/s (120 Gb/s) Up to 120 Meter

Reach

Data Center Solutions

• Service oriented Plug & Go Fiber & CopperSolutions

• Effective Cable Environment & Management • Infrastructure Management • Traditional Cat7a & XG STP Cabling Solutions