big data do-it-yourself · big data do-it-yourself mit microsoft olivia klose technical evangelist,...

26

Upload: others

Post on 22-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Big Data Do-It-Yourself mit MicrosoftOlivia Klose

Technical Evangelist, Microsoft Deutschland GmbH

aka.ms/oliviaklose, @oliviaklose

Die 3 Vs

MB

GB

TB

PB

batch

periodic

real

time

table

data

base

un-

struc-

tured

web

Big Data, Gesellschaft für Informatik, 2013,

http://www.gi.de/service/informatiklexikon/

detailansicht/article/big-data.html

Daten

Demo

DemoTweets extrahieren: Echtzeit-Dashboard

StreamInsight

Extract

StreamInsight

Azure SQL

Azure Blob

Storage

Real-Time

Dashboard

Twitter

Tweets extrahieren

Demo

DemoTweets speichern im Windows Azure Blob Storage

Hadoop

Hadoop

MapReduce

MapReduce

MapReduce: Map

MapReduce: Reduce

Analyze

Hive Tables

Azure Blob

Storage

Azure Blob

Storage

Mash Up &

Visualise

Tweets in HDInsight Analyze

Azure SQL

Real-Time

Dashboard

Twitter

Extract

StreamInsight

HDInsight auf PowerShell

Analyze

Hive Tables

Azure Blob

Storage

Azure Blob

Storage

Mash Up &

Visualise

Hive in HDInsight Analyze

Hive Tables

Azure SQL

Real-Time

Dashboard

Twitter

Extract

StreamInsight

Mash Up &

VisualiseAzure SQL

Tweets visualisieren

Mash Up &

Visualise

Analyze

Hive Tables

Real-Time

Dashboard

Twitter

Extract

StreamInsight

Azure SQL

Azure Blob

Storage

Demo

DemoTweets visualisieren

Demo

DemoTweets visualisieren

Extract

StreamInsight

Azure SQL

Azure Blob

Storage

Real-Time

Dashboard

Twitter

Big Data Twitter Infrastruktur

Mash Up &

Visualise

Analyze

Hive Tables

Big Data DIY in der MVA

http://aka.ms/BigDataDIY

Weitere Informationen

[email protected]

aka.ms/oliviaklose

Twitter:@oliviaklose

Big Data DIY Kurshttp://aka.ms/BigDataDIY

Windows Azure Trialhttp://aka.ms/azurenow

HDInsighthttp://tinyurl.com/hdinsight

Hortonworks for Windowshttp://aka.ms/hdp

Microsoft Big Data Supporthttp://aka.ms/bigdatasupport