fight back against isp scorecards
TRANSCRIPT
Fight Back Against ISP Scorecards
ProceraVP of Global Marketing
Cam Cullen
Anyone Seen This Before?
Interesting…But not Actionable
What about this one?
OTT Providers are Winning the PR WAR on Performance
HoweverSpeed Quality
FCC Network Neutrality “With respect to network performance, we adopt the following enhancements:
- The existing transparency rule requires disclosure of actual network performance. In adopting that requirement, the Commission mentioned speed and latency as two key measures. Today we include packet loss as a necessary part of the network performance disclosure.
- We expect that disclosures to consumers of actual network performance data should be reasonably related to the performance the consumer would likely experience in the geographic area in which the consumer is purchasing service.
- We also expect that network performance will be measured in terms of average performance over a reasonable period of time and during times of peak usage.
Source: page 73-74 of FCC-15-24A1, Emphasis Added
Exploring Subscriber Experience Metrics
Take The Subscriber’s Perspective
Throughput/Bandwidth/Speed
Application Type Throughput NeedsWeb Needs short bursts of download performanceVideo Sustained throughput delivers good qualitySocial Media Needs short bursts of download/upload performanceGaming Most games do not require high bandwidthUpload Sustained bursts of upload performance Download Sustained bursts of download performanceVoice Low throughput requirements
Latency
Application Type Throughput NeedsWeb High latency leads to slow page load timesVideo Not usually a concern except for initial loading of videoSocial Media High latency can slow interactive sharing experienceGaming High latency leads to lag in real-time gamesUpload N/ADownload N/AVoice High latency leads to poor voice experience
Packet Loss
Application Type Throughput NeedsWeb Packet Loss can lead to slow page load times.Video Less sensitive to loss unless it affects throughputSocial Media Packet Loss can slow interactive sharing experience Gaming Packet Loss leads to lag in real-time gamesUpload N/ADownload N/AVoice Some loss can be tolerated, high loss leads to perceived
latency
Collecting SX Metrics• Sampling
– Does not provide consistent data for entire footprint• Active Probes
– Can affect the actual performance of network, especially during peak hours
• All subscriber traffic, all the time– Meets FCC guidance:
• Actual customer experience• Over reasonable period of time• During Peak Usage
Measuring All Traffic, All the Time Enables an MSO to create
their own ScoreCard
Putting it All TogetherApplication Type Throughput Latency Loss
Web Needs short bursts of download performance
High latency leads to slow page load times
Packet Loss can lead to slow page load times.
Video Sustained throughput delivers good quality
Not usually a concern except for initial loading of video
Less sensitive to loss unless it affects throughput
Social Media Needs short bursts of download/upload performance
High latency can slow interactive sharing experience
Packet Loss can slow interactive sharing experience
Gaming Most games do not require high bandwidth
High latency leads to lag in real-time games
Packet Loss leads to lag in real-time games
Upload Sustained bursts of upload performance
N/A N/A
Download Sustained bursts of download performance
N/A N/A
Voice Low throughput requirements
High latency leads to poor voice experience
Some loss can be tolerated, high loss leads to perceived latency
“Grading” Performance
Score ThroughputA Awesome experienceB Almost perfect, but some slight impairments noticedC Good experience but noticeable impairmentsD Usable with frustrating impairmentsE Really poorF Unusable
Network Experience Scoring
ScoreCard Uses• Reporting to regulators on network performance
with actual subscriber metrics• Marketing to subscribers
– Targeted service offerings “Good for Gaming!” – High Value SLA-based offerings– Scoring Service Plans by performance “An A for Video”– Touting network capabilities
• Improving the network where deficiencies occur
