azure hdinsight 介紹

Download Azure HDInsight 介紹

Post on 08-Jan-2017

45 views

Category:

Data & Analytics

2 download

Embed Size (px)

TRANSCRIPT

  • Apache Hadoop

  • Hadoop platform

    = HDFS + MapReduce + YARN

    + ecosystem of tools and frameworks

  • Hadoop

  • Microsoft Hadoop

  • Hadoop

    1.(Sentiment)Understand how your customers feel about your brand

    2. ClickstreamCapture and analyze website visitors data trails and optimize your website

    3.(Sensor)/Discover patterns in data streaming automatically from remote sensors and machines

    4.Analyze location-based data to manage operations where they occur

    5. LogsResearch logs to diagnose process failures and prevent security breaches

    6. (txt, video, pictures, etc..)Understand patterns in files across millions of web pages, emails, and documents

  • Azure HDInsight

    Hadoop Meets the CloudHadoop

    100% Apache Hadoop

    .Net Java

    Hadoop

    ,

    Windows Linux

    , ,

  • Microsoft + Hortonworks

  • Hadoop Distribution

  • Hadoop 2.0

  • Data Node Data Node Data Node Data Node

    Task Tracker Task Tracker Task Tracker Task Tracker

    Name Node

    Job Tracker

    HMasterCoordination

    Region Server Region Server Region Server Region Server

  • Stream processin

    g

    Search and query

    Data analytics (Excel)

    Web/thick client

    dashboards

    Devices to take action

    RabbitMQ /

    ActiveMQ

  • Azure

    HDInsight

    In Memory

    Spark

  • Hadoop Ambari: Cluster provisioning, management, and monitoring.Avro (Microsoft .NET Library for Avro): Data serialization for the Microsoft .NET environmentMapReduce and YARN: Distributed processing and resource managementOozie: Workflow managementPhoenix: Relational database layer over HBasePig: Simpler scripting for MapReduce transformationsSqoop: Data import and exportTez: Allows data-intensive processes to run efficiently at scaleZooKeeper: Coordination of processes in distributed systems

  • $

  • Hodoop

    Hadoop

    Hadoop

  • Hadoop

    Cloud

  • HDInsight

    Hadoop clusters

    , Hadoop

    Azure Blob storage,

    Azure , Web apps SQL Database

  • Hadoop

  • Hadoop

  • be removed January 1, 2017

    https://portal.azure.com

    https://azure.microsoft.com/en-us/documentation/templates/?term=hdinsight

    https://portal.azure.com/https://azure.microsoft.com/en-us/documentation/templates/?term=hdinsight