keynote cambron

© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.

Designing Global Networks

Keith Cambron President & CEO, AT&T Labs


Networks – before 1990 - Shaped by the PSTN providers & standards - Largely voice, ISDN introduced in mid 1980s.

- One converged network for voice and data - Predictable port growth, about 3% per year - Predictable traffic patterns

- 3 ccs residence or 8% line occupancy in the busy hour

- 5 ccs business or 14% line occupancy in the busy hour

2

How have networks changed, and how do we design and operate them?

© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 3

Networks – before 1990 ...

- Hierarchical networks - Static routing set by PSTN engineers - Clear division, networks & terminals

- Backbone traffic throttled by access - All traffic is unicast - All sessions used 64 kbps bandwidth

- Common channel signaling - Sessions are blocked, not queued - Blocking occurs at origination


Networks – after 2010

- Mesh - network of networks - Dynamic routing set by the network

- Mobility and IP are the centerpieces

- Blurred boundary, apps & net - No explicit congestion control

- Traffic is unicast & multicast - Session bandwidth is unspecified

- Services fail at the weakest point

- No end to end service management - Lack of global standards for services

Backbone ConsumersContent

Peers

Wireless

EnterpriseRegionalAccess


Foundational Changes in Networks

Then –

Converged networks optimized capital deployment. Networks were predictable and centrally managed. The network and the service were one. Devices and applications followed the network.

Now –

Devices and applications lead the networks. Traffic demand and modalities shift in dramatic fashion. There is no clear owner of service management. Global mobility and video drive investment.


•  IP in over 200 countries •  Over 4,000 nodes

•  1,000,000+ ports

•  Over 900,000 fiber miles

•  38 Internet data centers •  168,000 routers

•  Over 135,000 WiFi Hotspots

•  Ethernet at 1,500 access points

Simplified map: not all nodes/links/routes shown * Enough data to transmit the digitized contents of the Library of Congress more than 400 times every day ** MPLS technology enables high-quality delivery to multiple services over a single IP Network Infrastructure

The AT&T network carries more than 21 Petabytes* of data traffic on average business day

Existing Fiber Routes New Undersea Fiber

New to AT&T Global Network New Core Routers

Existing IP/MPLS Hubs

Today’s Network Global Reach and Consistency


Sydney-Hawaii

TPE

AAG

•  60,000 cell sites in US •  93M wireless subscribers

•  19,000 text msgs/second

•  7.5B records/day


• Trends That Matter • Technologies That Matter • The Technology Pipeline

• The Operational Model

7

Designing & Operating Today’s Networks How do we begin?


Trends That Matter Device Adoption

Computer Industry Almanac

PC Adoption

Mobile Phone Adoption

WikiInvest.com

Device adoption is going to mobile in US, and growing at 15 - 30% CAGR globally.

Device bandwidth consumption is growing at ~ 40% CAGR for smart devices.


Trends That Matter Internet Video

Un-cached Unicast

2000

4000

6000

8000

10000

12000

20 40 60 80 100 120 140 160 180 200 Number of Subscribers to a Live Event in 1000s

BW

x M

iles

March Madness

2008

Oprah Book Club 2008

Well-Cached Unicast

Multi-cast

2009

Inauguration

Video accounts for 40% of backbone traffic, and is growing at 75% CAGR


• iPad, iTablets – dramatic increases in screens • Multi-tasking – Pandora • Mobile LANs – tethering and vans

• Invisible Computing – 4G pallets & collars • Venues – replays and captures at the stadium • IPV6 – interworking and routing tables

10

Trends That Matter Cutting the cord


• MPLS/IP Core – foundational • Access Technologies – opening the gates • Optical Technologies – trenching & Moore’s Law

• Information Sciences – processing, data mining • IP & Media Evolution – IPv6, HTML5

11

Technologies that Matter


• Applications – daily change, dramatic shifts in months with long periods of stability

• Devices – 2x in 2 years, Moore’s Law • MPLS/IP Core – 4x improvement every 6 years • Wireline Access – 10x every 10 years

• Mobility Access – 4x every 4 years

Access technologies have long deployment cycles and are capital intensive. You’d better be right.

12

Velocity of Transformation The rate and periodicity of change


The Technology Pipeline

Demand – application & device driven Capacity –

technology & capital driven

Research Develop Deploy Operate

time

Keeping Pace With Demand

Volume


The Technology Pipeline Components and Chips to Systems

Research

Transmission Systems Eng

IC Design Systems Eng

IC Supplier AT&T Labs

Network Characteristics & Models, Use Cases & Models

Transmission Engineering Element Systems Engineering

Systems Supplier

Network Element Design

Network Element Certification

Systems Integration


The Technology Pipeline Systems to Networks and Services

Network Engineer

IT Engineer

Info Tech AT&T Labs Marketing & Sales

Service Definition Services Design & Integration

Systems Integration

Network Topology, Flows and Policies

Network Design & Engineering Operations & Systems Design

Operations

Operations & Performance Engr


Network Technology Introduction Research and Engineering Teams

Core Research

Development

Incubation & Ops

Systems Engineers

Test Engineers

Network Engineers

Σ (1 + x) n

for( int i = 0; i < x; i++ ) { Node n = new Node(i);


The Operational Model

17

Customer Care NOC

Network Management

Reporting Visualization Analysis Planning

Data Collection

NOC Service Management

Field Operations

Networks Topology Performance Events Customer

Data

Engineering

Design Audits Fault Engineering Fraud


The Operational Model AT&T Labs Mobility Network Design Regime

InstallationGuides / MOPs

Testing /Certification

Element/EMS MIBInventory

Data CollectorDesign & Impl.

Engr & FaultAnalysis Platforms

Work GroupReports, Portals & Views

Element & EMSRequirements

Configuration /Gold Standards

Engr & Ops Rules /Guidelines

Element Engr. &Ops Review

Element DrivenDesign Work

Network DrivenDesign Work

Service DrivenDesign Work

Availability &Failover Analysis

A – Z NetworkAnalysis &Design

Control PlaneDesign

QoS & PolicyDesign

Traffic DemandModels

Network Optimization& Design

End to End ServiceRequirements

Service/NetworkDesign & Budgets

Customer Churn Analysis

Service Trendingand Impacts

DeviceAnalysis

Chronic TroubleAnalysis

ConfigurationAudits & Tools

Tier 4Support

PSL

Operations DrivenDesign Work

MD&E (McElroy)Responsibility

AT&T Proprietary (Restricted)


Site 2

MPLS Transport

OSPF selected path using network topology

Network & Application Aware – Load Balancing

Edge Routers

Backbone Switch

IRSCP/RR servers

Content Servers

Altered policy injected into IRSCP/RR servers

Site 1

Topology independent preferred path based on latency or other factors

Applying Research – Dynamic Control Intelligent Routing Service Control Point (IRSCP)

19


Applying Research Traffic Analysis System

TAS was delivered within 45 days; from technology into a documented system operating in a production environment

Technology components quickly assembled, hardened and delivered to customers

Analytics

Algorithms

Production Processes: • Testing • Release Mgmt • Operations • Tier 3 Application Support • ETE Security • Audits/Controls

U S E R S U P P O R T

Documentation/Training

Production Environment Stable/scalable code

Daytona


Applying Research Traffic Analysis System

21


Loss of many links out of

Japan

Snapshot from March 15th 2011

Applying Research Ptolemy


Loss of many links out of

Japan. What’s left?



Ptolemy is built on top of a wide range of research innovations: •  Darkstar/Data: Massive repository of network data, normalized for easy correlation

•  OSPFMON: Monitoring link status

•  NETDB: Topology views, capacities

•  Graphivz: Logical topology views

•  …

Ptolemy design detected issues in other systems e.g., •  Missing alarms

•  Majority performance alarms erroneously turned off for 6 months – Ops flying blind!

•  System bugs (e.g., NetDB capacities)…



• 400 platforms – ADSL modem to CRS-1 • > 10,000 services – POTS to AVPN, Cloud • > 1,000 active projects

• > 100 software projects • Staffing – Talent, breadth, depth • Supplier engagement – Quality, R&D

25

Our Biggest Challenge Excellence at Scale

keynote cambron

Documents