MPLS & Ethernet Infrastructure & Services: BT’s PerspectiveBen Niven-Jenkins (benjamin.niven-jenkins@bt.com)

Chief Designer Content & Media Services

© British Telecommunications plc

2

• “Standard Services”– MPLS VPN – Ethernet E-LINE– Ethernet E-LAN– Wholesale Broadband

• Other Services– Mobile (Cellular) Backhaul

• E1, ATM & Ethernet PWE3s– High performance Financial Markets Services– Content Services

• Broadcast Video• CDN, IP (Linear) TV & Canvas

• Converging onto a single Ethernet/MPLS platform– How 21CN underpins Ethernet, Mobile Backhaul, Broadband &

Content services

Describe the diverse range of services that BT supports using Ethernet and MPLS

© British Telecommunications plc

3

MPLS VPN

• 172 Countries– >230000 customer ports

• >100000 outside UK– >200 PoPs

• >180 outside UK– Still seeing significant growth

• Market Share (IDC)– UK: 40%– Global: 16%

• Customers include– Large financial institutes

• Some of the world's largest financial market data vendors

• Multiple banks– Public Sector / Government– Transport Industry– Retail & Food Industries– Pharmaceutical Industry

• Hierarchy– Tier 1: Aggregation & Routing– Tier 2: Aggregation & Customer

access– Regional Route Reflectors

• Resilience– Intra & Inter PoP

• Dual Vendor Core– Dual Tier 1 Core– Physical separation

• 6 CoS• Multicast enabled• Future evolution

– Even more Ethernet access– Further NNIs to complement

traditional PoP expansion• Expand in-country coverage

– IPv6

Scale Architecture

© British Telecommunications plc

4

E-LINE & Mobile (Cellular) Backhaul

• Etherflow UK– P2P Service

• VLAN access• Ethernet PWE3 backhaul/core

– >700 PoPs– >100 PoPs of EEA

• Access & Aggregation layer– ~600 PoPs of EES

• Access layer– Port speeds from 10 Mbps to 1 Gig

• Sub rates from 1 Mbps

• Mobile (Cellular) Backhaul– Built on top of Etherflow– E1 & ATM PWE3s

• From base station to mobile switch site– 4 out 5 UK Mobile Operators– Still in deployment

• Contracts total ~20k base stations– Future direction:

• Near term: Ethernet presentation & synchronisation

• Long term: supporting LTE with IP layer & any to any capabilities

© British Telecommunications plc

5

• Managed VPLS service covering Spain– First launched in 2004

• Mainly E-LAN Any to Any connectivity– Some E-LINE (P2P) and Hub & Spoke– Access port speeds from 10 Mbps up to 1

Gbps• Mixture of technoogies including EFM

– Access sub-rates from 1 Mbps to 990 Mbps

– 6 CoS• HVPLS implementation.

– Core of 4 nodes in 4 PoPs• Madrid and Barcelona

– 10 VPLS regions covering different geographical areas.

– 46 PoPs covering all 51 provinces.• Including the Canary and Balearic Islands.

– Gateways to• BT MPLS VPN• Internet• Voice Softswitches

E-LAN (VPLS)

• Standalone managed VPLS service covering London

– E-LAN Any to Any connectivity• Access port speeds from 10 Mbps up to 1

Gbps• Access sub-rates from 2 Mbps to 900 Mbps• 2 CoS

– 6 Access PoPs– 2 Core PoPs

• VPLS used for some internal management (DCN) on 21CN

• Planning VPLS for supporting Wholesale IPTV services

SPAIN UK

© British Telecommunications plc

6

ISP’s Network21CN

Ethernet(PWE3)

21CN

ADSL2+

ISP’s Network

Wholesale Broadband

• 20CN IP Stream Connect– Up to 8 Mbps ADSL2– Available to >99% of UK population

• >5500 Exchanges (Central Offices)– ATM backhaul

• 21CN Wholesale Broadband Connect (wBC)

– Up to 24 Mbps ADSL2+– Available to:

• 45% of UK population (March 2009)• 55% of UK population (March 2010)

– Ethernet (VLAN & PWE3) backhaul• 21CN Next Generation Access /

“Super Fast Broadband”– Extension to wBC– Up to 100 Mbps FTTx

• Up to 40 Mbps VDSL• Up to 100 Mbps GPON

– In trials• Pledged £1.5 Billion to deliver SFBB

to 40% of population by 2012

VDSL & GPON

20CN ATM

ISP’s Network

WWW(Internet)

Colossus IP

ADSL2

21CN MPLS VPN

VLAN PWE3

© British Telecommunications plc

7

“When talking about low latency connectivity to execution venues, no one else compares [to BT].” Bryce Byers – President & CEO, Neovest

Ultra Access voted “Best New Vendor Solution” Financial News, 2007

ULTRA

• Capital markets participants require:

– Fast, direct connectivity to execution venues in major financial markets

– Extremely low, deterministic latency• “Yesterday’s ultra-low latency is merely

today’s low-latency.” Tabb Group– Extremely High SLAs

• ULTRA offers:– Services in New York, Chicago, London– Up to 10 Gbps Access– Deterministic latency & RTD <1 ms– 100% Uptime Guarantee– Fully resilient, non-blocking architecture

• Single Telco hop– Multicast replication– Direct Market Access Speedometer– Network visibility tools– Bandwidth management

“If a broker’s electronic trading platform is 5 milliseconds behind the competition, it could lose at least 1% of its flow; that’s $4 million in revenues per millisecond” Tabb Group

As if the exchange is connected in their basementAlgorithmic trading and direct market access are the biggest disruptors in

modern-day markets

Gone from virtually 0% to 35% of institutional order flow in 5 years.

© British Telecommunications plc

8

Media & Broadcast Global MPLS Media Network

• Broadcast applications– Dynamic ‘contribution’– Permanent contribution &

distribution– High priority data

• Non RT programmes, VoIP, CES– Lower priority data

• Broadcast requirements– Low latency, Low Jitter– Zero packet loss– Flexible control path– Bandwidth on demand

Isle of Lewis

Isle of Skye

Mull

Islay

Arran

OF/EX

HY/E

ACM

CU

Caradon Hill

Plympton

Beacon Hill

Sailsbury

Bristol ICBristol KWWenvoe

Kilvey Hill

Preselli

Carmel

AberdarePontypool

Midhurst

Whitehawk Hill

Heathfield

Tunbridge WellsDover

ReigateGuildford

Hemel Hempstead

Ebbw Vale

Malvern

Larkstoke

Blaen Plwyf Bromsgrove

Brierly Hill

The Wrekin

Sutton Coldfield

Nottingham

Chesterfield

Fenton

Moel y Parc

LlandonaStoreton

Saddleworth

Idle

Keighley

Pendle ForestLancaster

Olivers Mount

Fenham

ChattonDarvel

Limavady

Londonderry

Brougher Mt.

Rosneath

Craigkelly

Tay Bridge

Angus

Torosay

Knockmore

Skriaig

Rosemarkie

EitshalRumster Forest

Bressay

Borve

Gorey

St HelierSt Breades

Les TouilletsTorteval

YBEL/D

YFDRB/FB

YXQM

YJZCZ

YTVC

YNBR/B

YGPDD/B

YNLLR

YZIT/A

YDRRD/B

YKRS/M

YYOT/B

UTC/C

YPCB/W

YJSI YOWT/A

CCM South

CCM NorthYYZZ/E

Fremont

Sudbury

Redruth

Huntshaw Cross

Stockland Hill

Mendip

Rowridge

Hannington

Hastings

Bluebell Hill

Crystal Palace

Ridge Hill

Oxford

Tacolneston

Sandy Heath

Waltham

BelmontSheffield

Emley Moor

Winter Hill

Bilsdale

DivisCaldbeck

Pontop Pike

Selkirk

Black Hill

Durris

MargateBroadstairs

Ramsgate

Rouncefall

Berrynarbour CoombeMartin

Boscastle

Monk Silver

Llangollen

London

Norwich

Martlesham

Southampton

Nottingham

Cambridge

Birmingham

Newcastle

Leeds

Manchester

Carlisle

Belfast

Glasgow Edinburgh

Aberdeen

Cardiff

Plymouth

Bristol YTOW

BR/CCHA

SO/EX/B

L/ER

PY/F

CB/EYMHR

NC/G

YCOV/J

BM/PY

BS/L

CF/F

MR/DY

NG/F

CE/D

NT/H

BE/SEY

GW/TEH/L

AB

TI

Chester

Chichester

Brighton

Thirsk

Esher

Gloucester

CS

GR

HMC

PT/TK

GI

TW/A

SVMA/B AD

EX/D

EX/E

CIP/B

BME

IH

NC/C

BHR

EV

WR/D

RJ/HC

BS/D

BNP

CT/AFT

CG

AE

BG

LV/C

HKU

WI

BL

CD NBD/B

SF

LS/WGT

DU

BE/BML

GW/SCO

FK

GL/A

JH

CH/EX

DE

IV/SR1

IV/MD/SR1

CE/H

SA/B

TU/D

BP/EX

LQT

SY

RE

Long Mountain

Kerry

Llandinam

Portnhaven

Mottram

Middlesbrough

LS/BAS

Jurby

LTH

Kendal

YQADS

Cambret Hill

Conway

Slapton

Tomich

Keelylang Hill

YPDNA/A

Budleigh Salterton

Clachan

Cushendall

Dunure

Easdale

Glenariff

Llangynog

Llanidloes

Myndd Machen

West Kilbride

JD

• 75 core nodes & 200 transmitter nodes

• Dual diverse signal routing over network

• Over 150 video end points

• Total of over 800 MVPN destinations

• 2000 Multicast destinations @ 30 Mbps each

© British Telecommunications plc

9

Wholesale Content Services

• Wholesale Content Connect (wCC)• Establishing broadband as a

content delivery platform– Reduce impact of OTT content for

ISPs• Insert ISPs into the commercial value

chain for distribution of OTT content over broadband

– Enable ISPs/CSPs to launch Quality Assured content services

• Harnessing QoS & BB to deliver a fantastic content experience for End Users

• Co-locating Content Caches with BB IP Service Edge

– QoS enabled CDN & BB– Distribution via MPLS VPN

• Wholesale IPTV services– VPLS or MPLS VPN

• Future: Move BB IP Service Edge closer to End Users

InternetCDN

CSP

InternetTransit

Provider£

BT Wholesale £

£

ISP

£

BT Wholesale £

CSP

ISP

£

Today wCC

0

20

40

60

80

100

120

140

160

Th

rou

pu

t/L

ine

Kb

ps

2009/10 2010/11 2011/12 2012/13 2013/14

Impact of OTT Video in Broadband Traffic

Web traffic forecast

OTT Video to PC

OTT Video to TV

Canvas uplift

0

20

40

60

80

100

120

140

160

Th

rou

pu

t/L

ine

Kb

ps

2009/10 2010/11 2011/12 2012/13 2013/14

Impact of OTT Video in Broadband Traffic

Web traffic forecast

OTT Video to PC

OTT Video to TV

Canvas uplift

ISP’s/CSP’s Network

21C Ethernet(PWE3) 21C

ADSL2+

21C MPLS VPN

VDSL & GPON

20C ATM

ADSL2

WWW(Internet)

Content Caches (CDN)

© British Telecommunications plc

10

Canvas (http://www.projectcanvas.info)

• Free TV & VoD• Over 40 Freeview channels• HD Freeview (Optional)• Catch up TV• Archive TV

• Paid TV• Premium VoD

• PVR (Optional)• Selected online sites such as Flickr &

YouTube (not confirmed)

• Free TV & VoD• Over 40 Freeview channels• HD Freeview (Optional)• Catch up TV• Archive TV

• Paid TV• Premium VoD

• PVR (Optional)• Selected online sites such as Flickr &

YouTube (not confirmed)

Canvas Offer

A ‘front door’ to Linear & On Demand content & Web Applications via your TV.

Key Principles

• Hybrid Digital Terrestrial and IP Content Delivery

• Common Canvas UI that fuses Linear and On Demand content.

• Discover and access individual Content Providers’ portals.

• Search across multiple Content Providers for a particular item of content (On Demand, Broadcast & locally stored)

• Hybrid Digital Terrestrial and IP Content Delivery

• Common Canvas UI that fuses Linear and On Demand content.

• Discover and access individual Content Providers’ portals.

• Search across multiple Content Providers for a particular item of content (On Demand, Broadcast & locally stored)

© British Telecommunications plc

11

Canvas

Canvas Venture

Can

vas

Ven

ture

• Publishes common standard

• Markets venture• Develops and operates

top level UI

STB Manufacturers

Dev

ices • Develop and sell

Canvas devices

Defining and promoting a standards based, open environment, for Internet connected TV.

BT(+Wholesale CDN) Other ISPs / CDNs

ISP

s

• Deliver VoD services to customers

• Commercial agreement for Streamed content

• Retail to customers and provide CS

Con

tent

P

rovi

ders

• Publish VoD content to Canvas

• Operate ‘Store’• Bill customer• Deliver Adverts

© British Telecommunications plc

12

ISP’s Network(e.g. BT Retail)

WWW(Internet)

Convergence on 21CN

20 Core PoPs (including Ethernet PWE3)

+86 Metro PoPs (including Ethernet PWE3)

+ ~1000 Tier 1 Aggregation PoPs (~600 with Ethernet PWE3)

+ ~4400 Tier 2 & 3 Access/Aggregation PoPs

2005-7

2008-92010+

Multiple Services

Single Ethernet/MPLS infrastructure

• Ethernet• Circuit Emulation• Broadband• Content

Multiple Services

Single Ethernet/MPLS infrastructure

• Ethernet• Circuit Emulation• Broadband• Content

© British Telecommunications plc

QUESTIONS?