›µ†¸ 11....

Download ›µ†¸ 11. ’‹‡¸»¸‚µ»Œ½° ¼¾´µ»Œ Pregel

Post on 19-Jul-2015

403 views

Category:

Education

2 download

Embed Size (px)

TRANSCRIPT

  • Hadoop

    2014

  • -

    Pregel

    Pregel: Apache Giraph

  • -

    Web 2.0

    861

  • -

    -

  • -

    (Kruskal, Prim) (Bellman-Ford, Dijkstra)

    (Affinity Propagation, GirvanNewman)

    Centralities: degree, betweenness, closeness, PageRank, HITS

  • -

    (Hadoop)

    (NetworkX, Gephi, LEDA, GraphBase)

    (Giraph, Bagel, Parallel BGL)

  • -

    Pregel

    ( )

    (, )

    ( )

    ( )

    ( )

  • -

    Pregel

    (supersteps)

    (value), (edges) : active vote to halt

    (messages),

    compute, .

  • -

    Vertex

  • -

    compute

    Vertex, compute, :

    1. , 2. , value 3. ,

  • -

    compute

  • -

    Combiner: : ( )

  • -

    Aggregator : S Pregel S+1

    :

  • -

    Minimum Spanning Tree Divisive Hierarchical Clustering :

    1) 2) 3) 4)

  • -

    Giraph

    : map-only Hadoop job

    master master worker supersteps

    worker InputSplit ,

    zookeeper global application state

  • -

    Giraph

  • -

    Giraph

    master master , ( zookeeper)

    worker worker ,

    zookeeper fault-tolerant

  • -

    PageRank

  • -

    PageRank

  • -

    Shortest paths

  • -

    300

  • -

    : pregel.py Pregel roadnet.py Vertex

    : degree pagerank

    : h-index ( , degree )

  • -