Become an Expert Data Scientist Role of Technology !!

Rajesh K Jeyapaul (jrkumar@in.ibm.com)

Solution Architect, Advocate, Start-up Mentor

IBM

Citizen Data Science Augments Data Discovery and Simplifies Data Science-Gartner

Citizen data scientists - who can perform both simple and moderately sophisticated analytical tasks that would previously have required more expertise.

By 2019, citizen data scientists will surpass highly skilled data scientists in terms of the amount of advanced analysis they produce

With proper training and the right support, information analysts — business users — can become citizen data scientists, thereby increasing the breadth and depth of an organization's analytics-derived insight.

Next 26 mins..

Quick view of AI - 2mins

How Indian startup adopts AI ? – 10mins

Role of an (Expert) data scientist.. - 2mins

Data Science Experience – Tool for an Expert Data Scientist

Demo on Dimensionality Reduction technique - 10mins

Developer Challenges - 2mins

• Data modelling using cloud tool

• AI challenges - India context

Understand AI , ML and DL

AI , ML and DL

Image Courtesy:codeproject.com

Indian EcoSystem: Healthcare: Lyfas The Revolutional portable cardio Analysis

Cardio solution, capable of detecting Myocardial Ischemia, Infraction and Ventricular Tachycardia with a single lead ECG

• Glycemia Monitoring for Diabetic Patients

• Hypertension monitoring

• Ventricular Techyarrhythima monitoring

• Post-Infraction heart monitoring

(courtesy : Rupam- CEO Lyfus )

How Machine Learning Applied (example scenario )?

Objective: Is a person stressed or not …

Step 1: Train the model using the real time

ECG data

Step 2: Generate LIVE pulse data using Lyfas device

Step 3:Fit the data to the model for prediction

The Revolutional portable cardio Analysis from Lyfus – Powered by Watson IoT

MQTT

Watson IoT Platform

Bluemix Bluemix

Node Red

Cloudant

Analytics

Watson Analytics

Watson Machine Learning

Apache spark powered DSX

Further Reading: • https://Bluemix.net • https://ibm.biz/heartemotion

• https://rajeshkj.blog

Heart Emotion ML Model - https://ibm.biz/heartemotion - Case Study

GST (Nao ) Robot – Watson service Implementation – Example of Deep Learning – NJR Institute , Udaipur

Watson conversation service

Watson image recognition

Watson speech to text

Watson text to speech

Watson Discovery service

Refer Bluemix.net for further details

Agriculture : Avanijal Technologies – Watson Enabled Agri Solution - Grow more Crop with less Water, Labour and Electricity...

Terra Blue – TJay – Epilepsy Prediction

Machine/Deep Learning - Multiple Skills Needed…Collaborating Is Key

Data Engineers

Data Scientists

Business Analysts

App Developers

Ingest

data

Transform:

clean

Create

and build

model

Evaluate

Deliver

and deploy

model

Communicate

results

Understand

problem and

domain

Explore &

understand

data

Transform:

shape

OUTPUT

ANALYSIS

INPUT

So , what should I do ?

Citizen Data Scientist

Have Good understanding of ML and DL

Quick plotting of data

Getting high level statistical Information

Using Pre-built and Pre-trained Mathematical Models (Ex: Watson API )

Using available SaaS tools (Ex:Watson Explorer)

Expert Data Scientist

Good understanding of ML and DL platforms, algorithms and libraries (SVM, Keras,SciKit,Apache )

Working with Data set , pre-processing the data

Train and Validate the data (Ex: Watson API, Watson Machine Learning)

Improve the accuracy of the predictive/classification model (Ex: Watson API , IBM Data Science Experience )

Role of an ^Data Scientist – Dimensionality Reduction

PCA - 1200

Expert

Role of an ^ Data Scientist – Dimensionality Reduction

PCA - 50

PCA - 300

Expert

River Pollution Open data – data.gov.in How to represent data with different dimensions ?

Principal Component Analysis (PCA)

Co-variance matrix , Eigen vector

Libraries:

–Scikit – sklearn modules

–Spark ML Libraries

–Tensor flow

Deep Learning Challenges – India Context

Fancy number plates

Language acoustic model

• Varying pronunciation in different zones

• Example – Sim as Seem

• Mix of Language

• Example – Bhaiya , give me sim details

• Noise in the signal

• Example – call Center

• Domain specific words

• Example – ―Call Drop‖

• Tempo , Articulation , Dynamics

Deep Learning Challenges – India Context

Vehicle recognition @ Toll booth

• Noise in CCTV images

IBM Developer Journey – Try it out !!

Stay Connected and continue coding !

Code & instructions available here https://github.com/IBMDevConnect17/

Join developerWorks India Community https://developer.ibm.com/in/ Check out the cool developer journeys https://developer.ibm.com/code/

Join our Slack team and stay in touch with the experts https://ibmdevconnect.slack.com Send in your request to - http://ibm.biz/slackrequest

Join our Meetup groups Mumbai : https://www.meetup.com/Cloud-Mumbai-Meetup/ Hyderabad: https://www.meetup.com/Hyderabad-Cognitive-with-Cloud Bangalore : https://www.meetup.com/IBMDevConnect-Bangalore

What do you want to become ?

Expert Data Scientist !!

Start from the basics of Maths to Libraries to tools and platform

!!

jrkumar@in.ibm.com

rajeshkj.blog

RajeshJeyapaul

@greatindiandev bit.ly/gidslinkedin www.developersummit.com

Conference and Deep Dive Sessions

April 24-28, IISc Bangalore

TM

2018

Register early and get the best discounts!