introduction 400 gigabit ethernet · 400 gigabit ethernet john d’ambrosia, huawei chairman,...
TRANSCRIPT
© 2018 Ethernet Alliancewww.ethernetalliance.org
INTRODUCTION400 GIGABIT ETHERNET
John D’Ambrosia, HuaweiChairman, Ethernet Alliance
1
March 14, 2018
© 2018 Ethernet Alliance
Regarding the Views ExpressedThe views I am expressing on IEEE standards and related products should NOT be considered the position, explanation, or interpretation of the Ethernet Alliance.
Per IEEE-SA Standards Board Bylaws, Dec 2016“At lectures, symposia, seminars, or educational courses, an individual presenting information on IEEE standards shall make it clear that his or her views should be considered the personal views of that individual rather than the formal position of IEEE. ”
2
© 2018 Ethernet Alliance
This Chart Helped Launch 400GbE
Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf
• Diverse applications!
• Diverse bandwidth growth rates!
3
© 2018 Ethernet Alliance
4
© 2018 Ethernet Alliance
Families of Ethernet Lane Rates
5
© 2018 Ethernet Alliance
How Many Lanes?• 400GbE has used 4, 8
and 16 lanes for various links
• 100GbE electrical lanes being developed now to enable 4 x100 Gb/s for 400GbE
6
© 2018 Ethernet Alliance
The 400 GbE Optical Family
7
Port Type Reach Description
400GBASE-SR16 At least 100m16 x 25 Gb/s NRZ
Use of 16 parallel multi-mode fiber
400GBASE-DR4 At least 500m SMF4 x 100 Gb/s PAM4
Use of 4 parallel single mode fibers
400GBASE-FR8 At least 2km SMF8 x 50 Gb/s PAM4
Use of duplex single mode fiber
400GBASE-LR8 At least 10km SMF8 x 50 Gb/s PAM4
Use of duplex single mode fiber
© 2018 Ethernet Alliance
400 Gigabit Ethernet Nomenclature
8
© 2018 Ethernet Alliance
9
400 Gigabit Ethernet Form Factors
CFP2
© 2018 Ethernet Alliance
The Importance of Multi-vendor Interoperability
• 400 GbE Standard ratified Dec 2017• Ethernet Alliance 400 GbE Demonstrations
– OFC 2017– SuperComputing 2017– OFC 2018 (Booth #2648)
• Ethernet Alliance 400GbE Plugfests in planning stages!
10
Mark NowellDistinguished Engineer, Data Center SwitchingCo-chair 100G Lambda MSAMarch 2018, OFC
Enabling low-cost 100 GbE and 400 GbE solutions100 Gb/s Lambda MSA
© 2018 Cisco and/or its affiliates. All rights reserved.
Technology Transitioning to 400 GbE40
0 G
bE10
0 G
bE10
GbE
Source: Dell’Oro
2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022
400 GbE Dominated50G -> 100G ASIC SERDES
100 GbE Dominated25G ASIC SERDES
10 GbE Dominated10G ASIC SERDES
© 2018 Cisco and/or its affiliates. All rights reserved.
Optics cost is becoming a barrier to transitionReduction of ASIC cost-per-bit is outpacing that of optics
Critical to upcoming 400 GbE transition that optics cost reductions are accelerated
Market Transition Barriers
© 2018 Cisco and/or its affiliates. All rights reserved.
Motivated by reducing the manufacturing complexity due to reduced component count.Initially specified in IEEE 802.3bs (400 Gb/s Ethernet) for:• 400GBASE-DR4: 500m over parallel SMF
MSA formed to broaden application of technology• concern over cost reduction opportunities for “existing” 400 GbE
solutions based on 8 optical lanes• Ongoing cost pressures for 100 GbE optics
Market interest in 100 Gb/s optical modulation
© 2018 Cisco and/or its affiliates. All rights reserved.
100 Gb/s Lambda MSA • Initiated in Sept 2017
• 22 initial member companies• Membership open and growing• Now 27 members
www.100GLambda.com
© 2018 Cisco and/or its affiliates. All rights reserved.
100 Gb/s Lambda MSA scope & progress
Phase 1
100G-FR 2 km D1.0 Published publicly
Internal updates in progress**
Target public D2.0 May/June
100G-LR 10 km
400G-FR4 2 km
Phase 2
400G-LR4 10 km Work about to initiate
** Strong member desire to maintain methodology alignment with IEEE 802.3cd
© 2018 Cisco and/or its affiliates. All rights reserved.
Implementation Cost Considerations400 GbE SMF PAM4 Module internals
Ser
Ser
FEC
FEC EQ
EQ 4 or 8 x DAC4 or 8
4 or 8
4 or 8
4 or 8
4 or 8Driver Mod Laser
Mux/demux(if nessecary)
TIA Det4 or 8 x ADC
400GAUI-8
400 GbE: Half the lane count
100 GbE: Quarter the lane count (vs. CWDM4/LR4)
cost, yield, power, scalability
© 2018 Cisco and/or its affiliates. All rights reserved.
• Products are hitting the labs right now!!
• Validation of specifications
• Possible interop testing
100 Gb/s Lambda MSA Next Steps
• Phase 2 work on 400G-LR4 specification
• Discussion around proposing IEEE project initiation with same PMD objectives
© 2018 Cisco and/or its affiliates. All rights reserved.
Questions?
Click to edit Master title styleClick to edit Master subtitle style
400Gbps Form Factors For Input/Output (I/O)
Connectivity
Nathan Tracy3/14/18
400G Form Factors Form Factor Electrical InterfaceCDFP 16x25GCFP8 16x25GCOBO 8x50GOSFP 8x50GQSFP-DD Type 1 8x50GQSFP-DD Type 2 8x50G
This discussion will focus on the 8x50G form factors
▪ Challenges
▪ Next Gen I/O
▪ Equipment Impact
o Density
o Electrical Performance
o PCB Issues
o Reach
o Thermal Management
o Air Flow
▪ Summary
Agenda
3
▪ I/O ports are valued for their flexibility
▪ Consist of connectors and cages that
accept pluggable modules
o Passive direct attach copper cable
o Short reach optical modules
o Medium reach optical modules
o Long reach optical modules
▪ Allows end users to flexibly choose the
appropriate reach and cost solution
▪ Provide good signal integrity
What’s a Port? Key Equipment Considerations
▪ Optimize thermal dissipation from the optics
▪ Different channel counts
▪ Port selection determines aggregate bandwidth and granular bandwidth
4
COBO Form Factor
▪ Embedded optics solution
▪ Eight channel and sixteen channel versions
operate with 50Gbps electrical interfaces to
provide 1x400 and 2x400G versions
▪ Three sizes of both versions on common
footprint
▪ Allows at least 32 400G modules to be
distributed around the host PCB instead of
crowded at the faceplate
▪ Opens the face plate airflow and allows full
height heat sinks providing best thermal
capability
▪ Electrical connector validated for 100Gbps
operation
At least 32 ports per 1RU
5
OSFP Form Factor
▪ OSFP is an eight channel port that
accommodates up to 36 modules in 1RU
▪ It achieves density by using a 0.6mm
connector contact pitch (vs. today’s
typical 0.8mm contact pitch)
▪ Like microQSFP, it implements a module
integrated heat sink to achieve higher
levels of power dissipation
▪ Can provide backward compatibility to
QSFP modules with the use of an adapter
▪ Electrical connector has been validated to
support 100Gbps operationUp to 36 ports per 1RU
Integrated heat sink
QSFP to OSFP adapter
6
QSFP-DD Form Factor
▪ QSFP-DD is a new form factor port that
enables backwards compatibility for
existing QSFP modules
▪ Because of the backwards compatibility, it
keeps the connector contacts on 0.8 mm
pitch and adds additional rows of
recessed contacts
▪ It uses the traditional riding heat sink
thermal management methodology
▪ QSFP-DD allows an extra 15mm of
module length outside the faceplate
▪ QSFP-DD can support 36 modules in 1RU,
same as QSFP
Up to 36 ports per 1RU
Riding heat sink
7
Equipment Impact
8
Density and Airflow
Signal Integrity
PCB layout
Thermal Capacity
Thermal Management
QSFP-DD, 35% Open
OSFP, 25% Open
COBO, 47% Open
COBO
OSFP
QSFP-DD
Connector Structure
SummarySignal
Integrity
Thermal
mgmt
Larger
Wire
AWG
Channel
Density
Backwards
Compatibility
COBO
Result #2 for RL and crosstalk
Up to 20W per module
26AWG fits
At least 32 modules
New form factor, no backwards compatibility
OSFP
Result #1 for RL and crosstalk
At least 15W per module
26AWG fits
Up to 36 modules
QSFP with adapter
QSFP-DD
Result #3 for RL and crosstalk
15W may be possible
26AWG is difficult
Up to 36 modules
Directly accepts legacy QSFP COBO OSFP QSFP-DD
9
1 OFC 2018 400G Standards Update: What Is on the Horizon? | OFC 2018 - 400G Standards Update: What Is on the Horizon?
400G Standards Update:
What Is on the Horizon?
Rob Stone
2 OFC 2018 400G Standards Update: What Is on the Horizon? |
Package Design Considerations for Switches
LGA
BGA
Larger Packages
Higher package loss
Additional Cost
Mature technology
Lowest cost packaging 25G / Lane Products
50G / Lane Products
3 OFC 2018 400G Standards Update: What Is on the Horizon? |
Increasing Switch Bandwidth Forces Higher Lane Speeds
10G / Lane
25G / Lane
50G / Lane
100G IO
70mm package approx. limit @ 50G / Lane
4 OFC 2018 400G Standards Update: What Is on the Horizon? |
• For Leaf / Spine Switch Applications, market demands highest number of ports (largest radix)
– minimize number of switch stages in the fabric, enables an efficient design
• Current technology offers 32 ports at 400GE, 64 ports at 200GE, or 128 ports at 100GE
• Will future switches require higher port speeds > 400GE? – Economics of higher rate optical interconnects needs to scale favorably (fiber plant + transceivers)
Port Speed vs ASIC Bandwidth
Total Number of Ports Possible
Total ASIC
IO (Tb/s) @ 100GE @ 200GE @ 400GE
3.2 32 16 8
4.8 48 24 12
6.4 64 32 16
12.8 128 64 32
5 OFC 2018 400G Standards Update: What Is on the Horizon? |
• Switch IO is being driven to higher per lane speed as total bandwidths increase – Due to package size limitations
• Standardization activities to support these new electrical interface speeds
– 25 & 50G / lane electrical IO DONE
– 100G / lane electrical IO: Chip to Chip, Chip to Module, Backplanes, Copper Cables – IN PROCESS
• Challenges ahead: – Continue to scale $/Gb/s and pJ/bit of optical interconnects to enable cost effective, high bandwidth
large radix switch systems
Summary
6 OFC 2018 400G Standards Update: What Is on the Horizon? | OFC 2018 - 400G Standards Update: What Is on the Horizon?
Thank You
Recent Activities at TIA
Rakesh SAMBARAJUNexans Data Center SolutionsOFC 2018: 400G Standards, MSAs and Related Technologies: What is on the Horizon?
Introduction to Nexans
2 I
Worldwide leader in the cable industry-Started 120 years ago with electrical wiring-Became part of Alcatel in 1991-Became Nexans in 2000, listed on the European Stock Exchange since 2001-Today – have an industrial presence in 40 countries with commercial activities worldwide, close to 26,000 employees, and sales of 7.8 billion (USD) in 2017
OFC 2018, San Diego, CA. 03/13/2018
Path to 400G
3 I OFC 2018, San Diego, CA. 03/13/2018
Fiber Capacity
Para
llel T
rans
miss
ion
-New MMF – OM5-Study WDM over OM3/OM4-Study VCSEL performance for DMD measurements
-16F MPO-32F MPO
-Performance guidelines for cable/connectivity
New Fiber Type – MMF TIA-492AAAE standard for WDM capable MMF
OM5 is designed to supports 4 channel WDM (850 – 950 nm) over MMF Cable jacket, connector boot, adapters color – Lime Green
TIA considering studying wideband performance of OM3/OM4 Includes studying the VCSEL weighting functions at higher wavelengths Will provide for better system modeling to IEEE Q: Can WDM performance on existing OM3/OM4 be ‘guaranteed?’
4 I OFC 2018, San Diego, CA. 03/13/2018
MUX
WDM
DeMux
Parameter OM3 (TIA 492AAAC) OM4 (TIA 492AAAD) OM5 (TIA 492AAAE)
EMB@ 850 nm 2000 MHz.km 4700 MHz.km 4700 MHz.km
EMB@ 953 nm Not specified Not specified 2470 MHz.km
New Connector Types – MPO TIA 604-18/FOCIS-18: one/two row16F MPO Standard
MPO-16 Can support 8Tx/8Rx lanes Part of QSFP-DD and OSFP MSA Potential connector for 400G-SR8
MPO-32 2 rows of 16 fibers MDI for 400G-SR16; part of CDFP MSA
5 I OFC 2018, San Diego, CA. 03/13/2018
Cable/Connectivity Cable:
Reduce cable attenuation for MMF to 3.0 dB/km (previously 3.5 dB/km) Recommends armored/thick jacketed cables to avoid microbends in non-continuous cable
supports
Connectivity: Increase SM Splice return loss requirement to 35 dB (previously 26 dB) Specified break-out configurations to accommodate 2-row connectors Recommends pre-term cabling for quality consistence
Q: Address requirements for RL on SM MPO for PAM-4 systems?
6 I OFC 2018, San Diego, CA. 03/13/2018
Summary Standardized new MMF called OM5
Will enable consistent WDM over MMF
New 16 and 32 Fiber MPO Connectors for upcoming 400G PMDs Already part of 8x and 16x form factors
Tightened the specs for cabling/connectivity Will help with high baud-rate/multi-level signaling
Need to address SM connectivity reflectance for PAM-4?7 I OFC 2018, San Diego, CA. 03/13/2018