clouding computing final presentation - gaeblogx · clouding computing final presentation team king...

23
Clouding Computing Final Presentation Team King Crab: Xujia Cao,Yanxi Chen, Shaoyi Zhang

Upload: others

Post on 14-Jun-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Clouding Computing Final Presentation

Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang

Page 2: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Presentation Outline

What doesn’t work

What does work

System Design and Others

Computation Model

Page 3: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Computation Model

Page 4: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

What doesn’t work — things that we tried but not included in final implementation

Simulated Annealing

Stochastic Tunneling

Detrended Fluctuation Analysis

Clique Counts Approximation

Page 5: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Simulated Annealing/Stochastic Tunneling

• Reset parameters

Challenges

• Too slow!!!!

Page 6: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Detrended Fluctuation Analysis (DFA)

Improving FPGA Placement with Dynamically Adaptive Stochastic Tunneling

Page 7: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Clique Counts Approximation

A Fast and Provable Method for Estimating Clique Counts Using Turán’s Theorem

Page 8: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Things that works

Tabu Search*

• Use “Tabu Search” to avoid walking to the same graph twice• Tabu Search uses linked-list to store history• However, we use a global Bloom Filter to replace linked-list

Page 9: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Global Bloom Filter (GBF)

• Client ask GBF whether graph G has been checked before• Case 1:

• If G is indeed checked before, GBF will tell us G has been reached with probability 1

• Case 2:• If G hasn’t been checked before, GBF might give a False

Positive response (yeah, G has been checked) with probability p

Page 10: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Global Bloom Filter (GBF)

• Benefits of GBF• Space efficient because:

• only store bits (similar to hash) instead of the giant graph/matrix representation

• Parametrizable because:• Configure possible solution number N and false

positive rate P• For example,

• N = 40,000,000, p =1.0E-10: size = 228.53MB

Page 11: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

The main trick

• When move to larger problem size• Count 10 cliques once• Maintain a Map: {Edges} -> {clique counts}

• After the first and only10-clique count check, we start to flip edges• During flipping, We also maintain the

“complement” of G, because:• To check R(m,n) is the same to check:

1. m-clique on G2. n-clique on G^c

Page 12: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

G’s complement and (n-2)-clique

G G^c

Flip one edge

Search for (n-2)-clique in the set of intersected neighbors

G G^c

+1-1

-1-1

+1 +1

Update Edge-Counts

Page 13: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

I am a Client

Backup server addressBackup server portCurrent sizeCurrent clique sizeCurrent GraphIs SetupMap

I am a backup server

First candidate backup addressFirst candidate backup server portFirst candidate confirmed / Normal backupCurrent sizeCurrent clique sizeCurrent GraphIs SetupMap

Server-Client Protocol

Page 14: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Current sizeBest clique

Server-Client Protocol

Page 15: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Current sizeBest clique

Request

Server-Client Protocol

Page 16: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Current Graph + Map

Server-Client Protocol

Page 17: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Current sizeBest clique

Current sizeCurrent clique sizeCurrent GraphIs SetupMap

Server-Client Protocol

Page 18: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Sync request

Server-Client Protocol

Page 19: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Sync request

Current sizeCurrent clique sizeCurrent GraphIs SetupMap

Server-Client Protocol

Page 20: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Server-Client Protocol

Page 21: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Server-Client Protocol

Page 22: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Results

Best Clique Size:340

CPU counts:

885842(iteration per day) * 7*10^6(CPU per iteration) * 35(days)

=2.14*10^14

Page 23: Clouding Computing Final Presentation - GaeBlogX · Clouding Computing Final Presentation Team King Crab: Xujia Cao, Yanxi Chen, Shaoyi Zhang. Presentation Outline What doesn’t

Takeaways

Start early and do more logging