end to end performance initiative russ hobby

32
End to End Performance Initiative Russ Hobby <[email protected]> HENP Networking Working Group Meeting, Ann Arbor, Michigan 26 October 2001

Upload: ami

Post on 20-Mar-2016

50 views

Category:

Documents


0 download

DESCRIPTION

p. End to End Performance Initiative Russ Hobby HENP Networking Working Group Meeting, Ann Arbor, Michigan 26 October 2001. Context for E2E Performance . Even with high bandwidth network links, the Internet2 community often does not see expected performance. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: End to End Performance Initiative Russ Hobby

End to End Performance InitiativeRuss Hobby <[email protected]>HENP Networking Working Group Meeting,Ann Arbor, Michigan26 October 2001

Page 2: End to End Performance Initiative Russ Hobby

Context for E2E Performance

Even with high bandwidth network links, the Internet2 community often does not see expected performance.

Page 3: End to End Performance Initiative Russ Hobby

The Wizard Gap

Page 4: End to End Performance Initiative Russ Hobby

The E2Epi Mission

To enable the researchers, faculty, students and staff who use high performance networks to obtain optimal performance from the current infrastructure on a consistent basis.

Raw Connectivity

Applications Performance

Page 5: End to End Performance Initiative Russ Hobby

True End-to-End Experience

•User perception •Application•Operating system•Host IP stack•Host network card•Local Area Network •Campus backbone network•Campus link to regional network/GigaPoP•GigaPoP link to Internet2 national backbones•International connections

EYEBALL

APPLICATION

STACK

JACK

NETWORK

. . .

. . .

. . .

. . .

Page 6: End to End Performance Initiative Russ Hobby

First Steps

Workshop in Ann Arbor on 9 January, 2001

• 40+ participants• Each participant provided a short paper on “What does E2EPerformance Mean?”

• Planned agenda was not used in order to respond to more pressing issues from participants.

• Design team formed to create an overall vision paper.

Page 7: End to End Performance Initiative Russ Hobby

The Problem

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

How do you solvea problem along a path?

Hey, this is not working right!

The computerIs working OK

Talk to the other guys

Everything isAOK

No othercomplaints

The network is lightly loaded

All the lights are green

We don’t see anything wrong

Looks fine

Others are getting in ok

Not our problem

7

Page 8: End to End Performance Initiative Russ Hobby

Areas of the Initiative

ApplicationsHost/OS TuningMeasurement InfrastructurePerformance Improvement Environment (PIE)Operations and Human CommunicationsPerformance Evaluation and Review Framework (PERF)

Page 9: End to End Performance Initiative Russ Hobby

Applications

•Work with specific application communities to help solve their performance problems.

• High Energy Physics• Medical Sciences – Visible Human Project

•Use a few key, general purpose applications for performance testing.

• FTP• Video Conferencing

Page 10: End to End Performance Initiative Russ Hobby

Host/OS Tuning

•Web100 has a leading role•Provide Best Practices for getting the most from your computer.•Locate or build tools for Host/OS performance diagnostics.•Work with computer vendors on Internet2 Performance Packages.

Page 11: End to End Performance Initiative Russ Hobby

Measurement Infrastructure

•Bring together current measurement efforts and projects in the community.•Establish an End-to-End Measurement Infrastructure from the intersection of these works.•Create diagnostic tools to determine the health of the network and locate performance problems.

Page 12: End to End Performance Initiative Russ Hobby

Standard Operational Info

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

Information fromAll Parts of the Network

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info Ops Info

Ops InfoOps Info

12

Page 13: End to End Performance Initiative Russ Hobby

Standard Operational Info

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

Know the Healthof the Network

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info Ops Info

Ops InfoOps Info

End-to-End Analyzer

13

Page 14: End to End Performance Initiative Russ Hobby

Standard Operational Info

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

ApplicationsAdapt to the Network

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info

Ops Info Ops Info

Ops InfoOps Info

End-to-End AnalyzerApps Tuning

14

Page 15: End to End Performance Initiative Russ Hobby

Performance Improvement Environment (PIE)

•Develop a dynamic environment where collaboration and information sharing will happen.•Identify, collect and disseminate appropriate information for end-to-end related information.•Include success stories,measurement statistics, reference materials, measurement tool documentation.•Include pointers to materials already developed by other communities.

Page 16: End to End Performance Initiative Russ Hobby

E2Epie – Current Status

• Developing web site content to reflect recommendations of the Design Team and Consultant documents.

• http://www.internet2.edu/e2epi/

• Actively looking for supporting materials and resources to include in web site.

• Mail to: [email protected]

Page 17: End to End Performance Initiative Russ Hobby

E2Epie – next steps

• Begin collecting stories.• Using interviews and other channels we will begin collecting

stories about performance improvement issues.• We will work with EDUCAUSE Effective Practices and Solutions

database for publishing the E2Epi stories.

• Identify and collect information about projects, resources, and tools.

• With help of Technical Advisory Group and other E2Epi participants we will make sure to have up-to-date and correct information.

• Explore resources and tools for collaboration efforts.• Discussion forum: http://e2edev.internet2.edu/discus/

Page 18: End to End Performance Initiative Russ Hobby

Operations and Human Communications

Establish communications among common interest groups

• System administrators• LAN administrators• Campus NOCs• GigaPoP• Application support staff

Establish communications between groups for operations and problem resolution.

Page 19: End to End Performance Initiative Russ Hobby

Groups of Common Interest

Applications Developer

System Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

Provide a means of communications

Let them shareexperiences.

I don’t know how to solve this problem! I do! I do!

LAN Administrator

Page 20: End to End Performance Initiative Russ Hobby

Find a Solution?

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

A System to Check aSpecific Problem

Hmm, Time to Check the PIE and

Talk to others

Performance OK here

Throughput OK

Everything isStill AOK

Not a bottleneckAt this point

The network is still lightly loaded

All the lights are green

We don’t see anything wrong

Yup. DuplexDoes notAgree!

It is slow for others too!

Ah ha, an Ethernet Duplex

problem!

Page 21: End to End Performance Initiative Russ Hobby

Can You Go Direct to the Problem?

How can you tell where is the problem?Need a tool to tell you:

• Where the problem is.• The type of problem• Who to contact to get it fixed

Terry Gray, University of Washington“We Need a Finger Pointing Tool”

Page 22: End to End Performance Initiative Russ Hobby

Gray Finger Pointing Tool

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

Locate the ProblemGray Finger Pointing ToolTerry GrayUniversity of Washington

Finger Pointing Tool Time!

Page 23: End to End Performance Initiative Russ Hobby

Gray Finger Pointing Tool

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

Finger Pointing Tool Time

You ARE the Weakest Link!

OK, I’ll fix it

Page 24: End to End Performance Initiative Russ Hobby

Performance Evaluation and Review Framework (PERF)

Establish a framework for resolving performance problems

• Provide known solutions by using the PIE• Tap community knowledge by facilitating group communications

• Coordinate a team of experts to solve hard problems

Page 25: End to End Performance Initiative Russ Hobby

The Hard Problems

Applications Developer

System Administrator

LAN Administrator

CampusNetworking

Gigapop Gigapop

Backbone

CampusNetworking

LAN Administrator

System Administrator

Applications Developer

What if no one has the answer?

Hey, Its is not working again!

I don’t know what is wrong

No clue here

I’m stumped

This is strange

It looks normal here

Doh!

We can’t figure it out

I amCluefully

Challenged

Others are getting in ok

I don’t know

Need a Tiger Team of Experts to Research the Problem

Page 26: End to End Performance Initiative Russ Hobby

Internet2 Organization Role

Staffing• Cheryl Munn-Fremon, Initiative Director• Russ Hobby, Technical Architect• George Brett, Information Architect• Lisa Wilberding, Communications Coordinator• Terri Saarinen, Program Assistant

Page 27: End to End Performance Initiative Russ Hobby

Internet2 Organization Role cont’d.

Funding• Facilitate seeking sources of funding• Internet2 will invest about $1.5 million per year

Communications coordination• Web site• Workshops, meeting presentations, …

Page 28: End to End Performance Initiative Russ Hobby

Anticipated Partners

CampusesFaculty and discipline communitiesGigaPoPsInternational partnersNSF-sponsored engineering efforts

• NLANR, www.nlanr.net• Web100 Project, www.web100.org

Internet2 corporate membersFederal labs and agencies

Page 29: End to End Performance Initiative Russ Hobby

Calls For Participation

Identify core applications and servicesSeek participants in the various work areasSeek stories and best practicesIssue later this Fall

Page 30: End to End Performance Initiative Russ Hobby

Success Criteria

•Community is involved and integrating what is learned•Performance Improvement Environment (E2Epie) provides satisfactory resources to the community•Operational environment meets the needs of application users and supporters•End-users understand what to expect and how to get it

Page 31: End to End Performance Initiative Russ Hobby

For More Information

[email protected]://e2edev.internet2.edu/discus/index.html

http://www.internet2.edu/e2e/

Page 32: End to End Performance Initiative Russ Hobby

www.internet2.edu