data science and visualization - ihub · data science and visualization @ihubresearch . data in...

23
Data Science and Visualization @iHubResearch

Upload: others

Post on 28-Oct-2019

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Science and Visualization

@iHubResearch

Page 2: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data in Africa

Common challenges – Accessibility/ Availability and Quality

How can we discover data and surface

information?

Page 3: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

– How does Facebook and Amazon suggest friends you may know and recommended items to purchase?

– How can we solve the never ending traffic problems in the city?

– How does NYC determine the frequency of

subway trains all day; all weekend?

Photo courtesy of #kenya365

Page 4: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

What is Data Science?

The process of using data to surface information and tell stories Data Science includes collecting data, cleaning and managing the data, making it tell its story, and presenting that story to others

Page 5: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

An ideal Data Scientist is: 1/3 part Mathematician 1/3 part Computer Scientist 1/3 part Artist

Page 6: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

How can we innovate in each of these processes?

Page 7: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Collection

•  Survey management processes: – Mobile and web data

collections tools

– Open Data Portals – Crowdsourcing tools

Page 8: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

KODI

Page 9: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Storage

•  Data Storage/Warehousing:

–  MySQL; NoSQL; SparQL; Linked Data; Azure; Amazon Cloud Services; Dropbox

–  What formats is the data stored in?

–  Data Cleaning processes – Need tools such as Google

Refine?

Page 10: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Analysis

Analytical Tools: Excel; SPSS; S; R; Python; Stata; Pivot Tables

Data Mining Processes:

Hadoop; Weka

Page 11: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Visualization

•  Data Visualization: Charts; graphs; pictures; maps

•  Infographic tools:

Illustrator; Infogr.am; ManyEyes; GIS mapping; Tableau

•  HOW NOT TO VISUALIZE YOUR DATA!!!

Page 12: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

*iHub Research_ Data Science and Visualization Lab

Page 13: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Visualization

We are surfacing new data - Latest stats in African tech. sector.

Page 14: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Visualization

We are providing a melting pot for different industries/sectors to utilize technology to discover and use data for decision making.

Page 15: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Visualization

We are setting local industry standards on the use of data and influencing critical data focusing policies:

Data Protection laws; FOIs; Privacy and Security.

Page 16: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Data Visualization

We are innovating on new ways to effectively discover and use data in our local settings

Page 17: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover
Page 18: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover
Page 19: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Gsma

Page 20: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

On-going Projects •  Umati II – automation of hate-speech monitoring process

•  3Vs Crowdsourcing Framework– viability, validation and verification

•  Investment Research– Mapping the Tech. Investment

Landscape in Kenya •  Infographics– Africa infographics; Tech statistics and data

•  Data Warehousing solutions - Tools to archive and discover our own research data and information

Page 21: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

How can you be part of this?

Training Business Support Consultancy Use Cases for iHub Cluster Data Challenges 

Page 22: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover

Example of sites developed by Code4Kenya

Page 23: Data Science and Visualization - iHub · Data Science and Visualization @iHubResearch . Data in Africa Common challenges – Accessibility/ Availability and Quality How can we discover