microsoft data science technologies: architecture edition 201509

51
Microsoft Technologies for Data Science Architecture Edition Mark Tabladillo, Ph.D. Senior Data Scientist LogicBlox/Predictix

Upload: mark-tabladillo

Post on 16-Apr-2017

1.555 views

Category:

Data & Analytics


2 download

TRANSCRIPT

Page 1: Microsoft Data Science Technologies: Architecture Edition 201509

Microsoft Technologies for Data ScienceArchitecture Edition

Mark Tabladillo, Ph.D.

Senior Data Scientist

LogicBlox/Predictix

Page 2: Microsoft Data Science Technologies: Architecture Edition 201509

Networking

Interactive

Page 3: Microsoft Data Science Technologies: Architecture Edition 201509
Page 4: Microsoft Data Science Technologies: Architecture Edition 201509
Page 5: Microsoft Data Science Technologies: Architecture Edition 201509

http://www.bizjournals.com/atlanta/subscriber-only/2014/07/11/top-employers-in-metro-atlanta.html

Page 6: Microsoft Data Science Technologies: Architecture Edition 201509
Page 7: Microsoft Data Science Technologies: Architecture Edition 201509
Page 8: Microsoft Data Science Technologies: Architecture Edition 201509
Page 9: Microsoft Data Science Technologies: Architecture Edition 201509
Page 10: Microsoft Data Science Technologies: Architecture Edition 201509

http://www.kdnuggets.com/polls/2015/analytics-

data-mining-data-science-software-used.html

http://products.office.com/en-us/excel

http://www.microsoft.com/en-us/server-cloud/products/sql-server/

http://pytools.codeplex.com/

http://azure.microsoft.com/en-us/services/hdinsight/

http://www.revolutionanalytics.com/

Page 11: Microsoft Data Science Technologies: Architecture Edition 201509
Page 12: Microsoft Data Science Technologies: Architecture Edition 201509
Page 13: Microsoft Data Science Technologies: Architecture Edition 201509

http://download.microsoft.com/download/F/C/2/FC21C981-

4351-4434-A78A-

3384CA7515BF/SQL_Server_2016_Deeper_Insights_Across_D

ata_White_Paper.pdf

Page 14: Microsoft Data Science Technologies: Architecture Edition 201509

SS

SQL

AS

NoSQL

Page 15: Microsoft Data Science Technologies: Architecture Edition 201509

SQL Server Data Mining: Analysis Serviceshttp://sqlserverdatamining.com

Page 16: Microsoft Data Science Technologies: Architecture Edition 201509
Page 17: Microsoft Data Science Technologies: Architecture Edition 201509

Data mining add-in for business analysts

• Ease of use

• Rich data mining

• Scalable

Page 18: Microsoft Data Science Technologies: Architecture Edition 201509
Page 19: Microsoft Data Science Technologies: Architecture Edition 201509
Page 20: Microsoft Data Science Technologies: Architecture Edition 201509
Page 21: Microsoft Data Science Technologies: Architecture Edition 201509

Rowset

Output

with Scores

Varchar

NVarchar

Office

PDF

Page 22: Microsoft Data Science Technologies: Architecture Edition 201509

Documents

Full-Text

Keyword

Index

“FTI”

iFilters

Semantic Document

Similarity Index “DSI”

Semantic

Database

Semantic

Key Phrase

Index –

Tag Index

“TI”

Page 23: Microsoft Data Science Technologies: Architecture Edition 201509

Simplified Chinese

British English

Portuguese

Chinese (Hong Kong SAR, PRC)

Spanish

Chinese (Singapore)

Chinese (Macau SAR)

Page 24: Microsoft Data Science Technologies: Architecture Edition 201509

Time in Seconds vs. Number of Documents

(2011 – K. Mukerjee, T. Porter, S. Gherman – Microsoft)

http://users.cis.fiu.edu/~lzhen001/activities/KDD2011Program/docs/p213.pdf

Page 25: Microsoft Data Science Technologies: Architecture Edition 201509
Page 26: Microsoft Data Science Technologies: Architecture Edition 201509
Page 27: Microsoft Data Science Technologies: Architecture Edition 201509

http://download.microsoft.com/download/3/B/9/3B9FBA69-8AAD-4707-830F-6C70A545C389/Introducing_Azure_Machine_Learning.pdf

Page 28: Microsoft Data Science Technologies: Architecture Edition 201509

http://datacamp.com

Page 29: Microsoft Data Science Technologies: Architecture Edition 201509

https://github.com/jakevdp/sklearn_pycon2015

Page 30: Microsoft Data Science Technologies: Architecture Edition 201509

http://azure.microsoft.com/en-us/services/machine-learning/

Page 31: Microsoft Data Science Technologies: Architecture Edition 201509
Page 32: Microsoft Data Science Technologies: Architecture Edition 201509
Page 33: Microsoft Data Science Technologies: Architecture Edition 201509
Page 34: Microsoft Data Science Technologies: Architecture Edition 201509
Page 35: Microsoft Data Science Technologies: Architecture Edition 201509

Mutable Immutable

Classic Open

Source

Java Scala

.NETNow Open Source

C#, C++,

VB.NET

F#

Page 36: Microsoft Data Science Technologies: Architecture Edition 201509

http://channel9.msdn.com/posts/Erik-Meijer-Functional-Programming-From-First-Principles

http://tomasp.net/

Page 37: Microsoft Data Science Technologies: Architecture Edition 201509
Page 38: Microsoft Data Science Technologies: Architecture Edition 201509

Technology Use Case

SQL Server Analysis

Services

SQL Server Licensed

Input: SQL Server, SSAS

Excel Add-In for SSAS

Semantic Search

Azure Machine

Learning

F#

Page 39: Microsoft Data Science Technologies: Architecture Edition 201509

Technology Use Case

SQL Server Analysis

Services

SQL Server Licensed

Input: SQL Server, SSAS

Excel Add-In for SSAS (Ditto) + Excellent Bridge for Excel Users

Semantic Search

Azure Machine

Learning

F#

Page 40: Microsoft Data Science Technologies: Architecture Edition 201509

Technology Use Case

SQL Server Analysis

Services

SQL Server Licensed

Input: SQL Server, SSAS

Excel Add-In for SSAS (Ditto) + Excellent Bridge for Excel Users

Semantic Search SQL Server: Volume Text Processing

Azure Machine

Learning

F#

Page 41: Microsoft Data Science Technologies: Architecture Edition 201509

Technology Use Case

SQL Server Analysis

Services

SQL Server Licensed

Input: SQL Server, SSAS

Excel Add-In for SSAS (Ditto) + Excellent Bridge for Excel Users

Semantic Search SQL Server: Volume Text Processing

Azure Machine

Learning

Students; Web Applications (R & Python)

Input: Azure-based Sources

F#

Page 42: Microsoft Data Science Technologies: Architecture Edition 201509

Technology Use Case

SQL Server Analysis

Services

SQL Server Licensed

Input: SQL Server, SSAS

Excel Add-In for SSAS (Ditto) + Excellent Bridge for Excel Users

Semantic Search SQL Server: Volume Text Processing

Azure Machine

Learning

Students; Web Applications (R & Python)

Input: Azure-based Sources

F# .NET Developers

Page 43: Microsoft Data Science Technologies: Architecture Edition 201509
Page 44: Microsoft Data Science Technologies: Architecture Edition 201509

Conference: http://www.kdd.org/

Page 45: Microsoft Data Science Technologies: Architecture Edition 201509
Page 46: Microsoft Data Science Technologies: Architecture Edition 201509
Page 47: Microsoft Data Science Technologies: Architecture Edition 201509
Page 48: Microsoft Data Science Technologies: Architecture Edition 201509
Page 49: Microsoft Data Science Technologies: Architecture Edition 201509

http://blogs.technet.com/b/machinelearning/

http://social.msdn.microsoft.com/forums/azure/en-US/home?forum=MachineLearning

http://sqlserverdatamining.com

http://marktab.net

http://curah.microsoft.com/342704/azure-machine-learning-videos-february-2015

Page 50: Microsoft Data Science Technologies: Architecture Edition 201509

http://datascience.sqlpass.org

Page 51: Microsoft Data Science Technologies: Architecture Edition 201509