![Page 1: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/1.jpg)
Visualizing 4G Experienceby country, across networks
James Robinson, CTO OpenSignal
![Page 2: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/2.jpg)
#bigdatashow @jamesCRROpenSignal
We collect data.• We’ve built the world’s largest global
database of cellular data• Our data comes via Android and iOS apps
(a sensor network)• SmartUK: UK’s Most Innovative Mobile Co.
And visualize it.
3.5M devices
9.0Mmap tiles
• Market reports for mobile network operators
• Independent coverage maps for consumers
• One-off reports for everybody4G is in focus now.
![Page 3: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/3.jpg)
#bigdatashow @jamesCRROpenSignal
How and why we made these
coverage rollout
speeds
![Page 4: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/4.jpg)
#bigdatashow @jamesCRROpenSignal
opensignal.com/jr/big-data-show
![Page 5: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/5.jpg)
#bigdatashow @jamesCRROpenSignal
The Lifecycle of a Data point
1. Acquisition
2. Storage
3. Visualization
![Page 6: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/6.jpg)
#bigdatashow @jamesCRROpenSignal
AcquisitionAutomated crowd-sourcing: a sensor network
Smartphones are ideal probes of network
performance.
We’re re-purposing sensors.
Consumers come first, data comes second.
![Page 7: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/7.jpg)
#bigdatashow @jamesCRROpenSignal
AcquisitionOther sensor networks
• Google maps • Waze (traffic)
Similar to OpenSignal:• Rootmetrics• Sensorly
Sensor creep Galaxy S (S4 has 3 more!)
![Page 8: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/8.jpg)
#bigdatashow @jamesCRROpenSignal
StorageAutomated crowd-sourcing: a sensor network
Going via MySQL:• Analysis on the
datastream• Quick temperature check
on the app• S3 not ideal for appending
data to files
Relatively easy to bring files from S3 into Hadoop running on EC2
Compressed in app MySQL buffer
Amazon S3
![Page 9: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/9.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization: themes
A varied tool box.Use of open-source &
web technologies.
![Page 10: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/10.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 1: 4G Coverage
We wanted to create a resource where people could compare
networks for areas that matter to them.
Google Maps was the natural choice.
• Familiar - to designers and consumers • Scalable - and battle tested• Flexible – Bayeux tapestry
![Page 11: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/11.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 1: 4G CoverageWhat we didn’t want.
• We’re mapping user experience, not modelling cellular propagation
• Coverage feels organic, maps should reflect that
• Everything should be in one place and easily filterable
![Page 12: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/12.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 1: 4G CoverageHow we do it.
Pull data into HadoopPre-aggregate for different zoom levelsOutput MySQL tables
Generate tiles when needed- When users scroll to an area on the map,
query the server- Check if a tile already exists- Tiles generated in PHP (i.e. on server)- Could move to HTML5 or a javascript
language (D3!) – client based- Store new tiles on server
MTS (network)3G (10 poss)
Zoom 10Novosibirsk (x,y)
![Page 13: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/13.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 2: 4G RolloutWe wanted to show:• Countries with LTE• When it was
deployed• Planned
deployments• Individual networks
D3 DATA DRIVEN DOCUMENTS
• Created by Mike Bostock of NYT.
• Opensource.• JS & SVG
based.• Engineers
should love it.
& it had to look good
![Page 14: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/14.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 2: 4G RolloutWhat we could have done.
• Don’t use pins for country level data!• Better & simpler: Google Fusion Tables, or
Google Viz (but no time dimension)• Custom tiles (time dimension but hard to
make interactive)
Pins are OK for cities.
Fusion tables: shallow learning curve, more flexible than you initially think, but less flexible than you’d like:
![Page 15: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/15.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 2: 4G RolloutHow we do it.
• Countries defined by geojson (various sources available)
• Data on rollout also in json
• The result of a graphic designer/front-end code, working with a data analyst and a copy writer
• One data analyst with knowledge of javascript could get similar results
![Page 16: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/16.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 3: 4G Speed
• We had 11 countries and 22 networks with good data on 3G speed.
• We could have just put everything in one chart (33 bars) or two charts (11 and 22)
• But it wouldn’t be extensible or so easily navigable.
![Page 17: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/17.jpg)
#bigdatashow @jamesCRROpenSignal
Visualization 3: 4G SpeedHow we do it.
• Use interactivity as a way of hiding data• Give hints that the data can be explored• Re-scaling axes can be confusing
![Page 18: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/18.jpg)
#bigdatashow @jamesCRROpenSignal
Final Thoughts 1D3 powerful for• Transitioning between data sets / visualization
types• Your company already has people who’d love
to use it (they just don’t know it yet)But … it takes more time to set up each visualization than Excel/Tableau/R
When starting to analyse, don’t have one tool or visualization in mind
But know what’s out there
![Page 19: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/19.jpg)
#bigdatashow @jamesCRROpenSignal
Final thoughts 2
You use open-source tools for analysis – why not visualization?Excel could make a comeback – but unlikely to be cutting edgeA visualization is great when everyone can understand it4G rollouts are a very mixed bag
![Page 20: Visualizing 4G experience by country, across networks, OpenSignal](https://reader033.vdocuments.site/reader033/viewer/2022061202/547bb1735906b581798b4613/html5/thumbnails/20.jpg)
Thank youOpenSignal.com
@jamesCRR