an industry update

1Copyright © 2009 Force10 Networks, Inc. All rights reserved. 1

100 Gigabit Ethernet

An Industry Update

John D’AmbrosiaChair, IEEE P802.3ba Task Force

Senior Scientist, Force10 NetworksOctober 8, 2009

Copyright © 2009 Force10 Networks, Inc. All rights reserved.

Copyright © 2009 Force10 Networks, Inc. All rights reserved. 2

• Per IEEE-SA Standards Board Operations Manual, January 2005:“At lectures, symposia, seminars, or educational courses, an individual presenting information on IEEE standards shall make it clear that his or her views should be considered the personal views of that individual rather than the formal position, explanation, or interpretation of the IEEE.”

• The views I am expressing on IEEE standards and related products should NOT be considered the formal position, explanation, or interpretation of the Ethernet Alliance.

Regarding the Views Expressed


The Ethernet Ecosystem

Research, Education and Government

Facilities

ResearchNetworks

Broadband Access

Data Centers and Enterprise

EnterpriseNetworks

Content Providers

ContentNetworks

Internet BackboneNetworks

Internet BackboneNetworks

Internet eXchange andInterconnection Points

BroadbandAccess Networks


• IEEE 802.3 • ITU-T• Optical Internetworking Forum (OIF) • Industry MSA Efforts• Industry Alliance Efforts

Industry Efforts


100

1,000

10,000

100,000

1,000,000

1995 2000 2005 2010 2015 2020Date

Rat

e M

b/s

CoreNetworkingDoubling≈18 mos

ServerI/O

Doubling≈24 mos

Gigabit Ethernet

10 Gigabit Ethernet

100 Gigabit Ethernet40 Gigabit Ethernet

Source HSSG Tutorial, Nov 07

40GbE and 100GbE: Computing and Networking


The Dilemma for IEEE P802.3ba

• Challenges:– Multiple rates – 40 Gb/s and 100 Gb/s– Multiple physical layer specifications– Multiple possible solutions

• 40 Gb/s: 4 x 10 Gb/s, 2 x 20 Gb/s, 1 x 40 Gb/s• 100 Gb/s: 10 x 10 Gb/s, 4 x 25Gb/s, 2 x 50 Gb/s, 1 x 100 Gb/s

– Technology development / maturity for electrical and optical signaling

– Market Need – Cost Targets

• Problem Statement: Develop an architecture that can enable implementations for today and tomorrow


IEEE P802.3ba:The Different Basic Architectures

LLCMACRS

XLGMII

PMD

MDI

PMA (4:4)

PCS

MEDIUM

FEC

40GBASE-CR440GBASE-KR4

AN

LLCMACRS

CGMII

PMD

MDI

PMA (20:10)

PCS

MEDIUM

FEC

100GBASE-CR10

AN

LLCMACRS

CGMII

PMDMDI

PMA (20:10)PCS

MEDIUM

100GBASE-SR10

LLCMACRS

XLGMII

PMDMDI

PMA (4:4)PCS

MEDIUM

40GBASE-SR440GBASE-LR4


100GBASE-ER4

100GBASE-LR4

40GBASE-LR4

40GBASE-SR4100GBASE-SR10

40GBASE-CR4100GBASE-CR10

40GBASE-KR4

Port Type

“n” x 10 Gb/s√√At least 7m cu (twin-ax) cable

4 x 10 Gb/s√At least 10km SMF



“n” x 10 Gb/s√√At least 100m OM3 MMF(125m OM4 MMF)

100GbE

4 x 10 Gb/s√At least 1m backplane

40GbE Solution SpaceDescription

Summary: IEEE P802.3baPhysical Layer Specifications


20092008

J M M J S N J M M J S N J M M JN

Task ForceFormation

TFReview

WGBallot

LMSCBallot

Standard

TF Reviews WG Ballots LMSC Ballots

2010

D F A J A O D J M J S NF A J A O D M JM JF A J

Proposal Selection

YouAreHere

IEEE P802.3ba Task Force Timeline


The ITU-T Study Group 15

• G.709 Revision: – Creation of OTU4: 100GbE across a single wavelength – Defines OTU4 rates and formats

• including multi-lane formats that will allow transport over modules targeting 40GBASE-LR4 and 100GBASE-L/ER4

– Modulation scheme to be standardized in future• Potential Revisions to G.695 / G.959.1

– Define short reach 4 lane optical power budgets for OTU3 / OTU4 that are compatible with 40GBASE-LR4, 100GBASE-LR4, and 100GBASE-ER4

• Revision to G.798– Take into account changes needed for striping across 4 lanes for OTU3

and OTU4

• Cooperative relationship with IEEE p802.3ba Task Force


OIF Efforts

• The 100G Ultra Long Haul DWDM Framework Document– Integrated Photonic Modules – Forward Error Correction– MSA Module (Electromechanical)

• The CEI-28G Project– Chip-to-chip signaling at 28Gb/s

• The CEI-25G Project– Backplane signaling at 25 Gb/s

• Cooperative relationship with IEEE p802.3ba Task Force


Industry MSA Efforts

• CFP– Developed by the CFP MSA (www.cfp-msa.org) – Common form factor to support

• Multiple protocols- 40 GbE, 100 GbE, OC-768/STM-256, and OTU3 • Media Types – multi-mode fiber and single-mode fiber• Link Distances

• CXP– Developed within the Infiniband Trade Association (IBTA)– Common form factor to supports 100GBASE-CR10 or 100GBASE-SR10– Smaller module size than CFP

• Based on a two-high stacked connector• Limited power dissipation (< 6 W)

• Both MSA’s are based on 10Gb/s electrical signaling interfaces


Industry Alliance Efforts

• Ethernet Alliance– Interoperability Events

• OIDA– Raising awareness for need for continuing research in photonics


Possible Future Development Effortsfor the Industry

• IEEE project optimizing 40GbE for Carrier Networks• New Industry MSA for 100GBASE-L/ER4 module based

on 25Gb/s electrical signaling• 100Gb/s over duplex multi-mode fiber• 25Gb/s Backplane Signaling• 100Gb/s Modulation• Next Rate of Ethernet

– 400GbE (Possible Options - 16x25Gb/s, 10x40Gb/s, 4x100Gb/s)– Terabit Ethernet


582 Gb/s

Data provided by Henk Steenman, AMS-IX

December 2008

Looking to the Future:Data from AMS-IX


Summary

• 40GbE and 100GbE Scheduled Ratification –June 2010

• An eco-system of solutions is under development• Projected need for Terabit Ethernet – 2015• Industry Challenges

– Introduction of 100GbE– Lower cost / higher density 100GbE ports– The next rate is coming!


Thank You

an industry update

Documents