1 intelligent management of virtualized resources for database systems in cloud environment...
TRANSCRIPT
![Page 1: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/1.jpg)
1
Intelligent Management of Virtualized Resources for
Database Systems in Cloud Environment
Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America); Shenghuo Zhu (NEC Labs America); Hyun
Moon (NEC Labs America); Calton Pu (Georgia Tech); Hakan Hacigumus (NEC Labs America)
![Page 2: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/2.jpg)
Overview
Motivation Background System modeling Resource Allocation Conclusions
2
![Page 3: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/3.jpg)
Overview
Motivation Background System modeling Resource Allocation Conclusions
3
![Page 4: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/4.jpg)
Hosting database management systems
Common practice: One-to-one mapping of DBMSs to nodes
![Page 5: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/5.jpg)
Problem: Poor utilization
(1)Both nodes are utilized under 10% most of the time. (2) The maximum CPU usage is much higher than the average CPU usage.
Pradeep Padala et al, Adaptive control of virtualized resources in utility computing environments(EuroSys '07)
![Page 6: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/6.jpg)
Solution: consolidation based on virtualization
6
![Page 7: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/7.jpg)
Solution: consolidation based on virtualization
3 CPUs
2 CPUs
4 is enough!
![Page 8: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/8.jpg)
Problem: Provisioning under variable workload
8
![Page 9: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/9.jpg)
Solution: Adaptive provisioning under variable
workload
9
![Page 10: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/10.jpg)
GoalsGood performance
Maintain SLAService differentiation
Good resource utilization
10
![Page 11: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/11.jpg)
Overview
Motivation Background System modeling Resource Allocation Conclusions
11
![Page 12: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/12.jpg)
Background
1212
Virtualized Server I Virtualized Server II
VM 1
VM 2
VM 3
VM 4
MySQLMaster
MySQLSlave
MySQLMaster
MySQLSlave
Gold Client
Silver Client
Gold Client
Silver Client
![Page 13: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/13.jpg)
13
What are we controlling ?
Inner level controller
GoalsSLA penalty cost =>Good
performanceInfrastructure cost=>Good
utilizationAction cost+)------------------------------------Total costMinimized? NO
Set CPU/Memory
shares
Outer level controller
Set number of
replicas
![Page 14: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/14.jpg)
14
Related work Existing research
Resource allocation & scheduling Service differentiation
Our contribution: Non-linear model of DBMS behavior Two level controller
High resource utilization Low query response time, less SLA penalty cost,
Service differentiation Action cost
![Page 15: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/15.jpg)
15
System overview
![Page 16: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/16.jpg)
Overview
Motivation Background System modeling Resource Allocation Conclusions
16
![Page 17: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/17.jpg)
System modeling How is the average SLA penalty
cost correlated with the system configuration? Statistic analysis, draw marginal
distribution How can we accurately predict
the average SLA penalty cost? Machine learning techniques,
linear and non-linear models17
![Page 18: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/18.jpg)
System modeling: statistical analysis
18
Looks like straight line Non-straight line
![Page 19: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/19.jpg)
System modeling: machine learning
19
![Page 20: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/20.jpg)
Overview
Motivation Background System modeling Resource Allocation Conclusions
20
![Page 21: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/21.jpg)
Resource allocation: two level controller
21
Find the next direction which can minimize the total costPerformance cost (related to SLA)Infrastructure cost (related to replicas)Action cost
![Page 22: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/22.jpg)
22
Evaluation Experiment Environment
MySQL v5.0, MySQL replication Xen hypervisor
Workload Generator Dynamic arrival rate follows Poisson
distribution TPC-W Ordering (the browsing requests
and the ordering requests are 50%, respectively.)
TPC-W 100 EBs, 10K items. The whole database size is about 280MB.
![Page 23: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/23.jpg)
Baseline
23
The total SLA penalty cost is 2802
![Page 24: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/24.jpg)
Inner Level Controller
24
The total SLA penalty cost is 2363
![Page 25: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/25.jpg)
Inner Level Controller Total SLA penalty cost under different
number of replicas
25
![Page 26: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/26.jpg)
Outer level controller without action cost
26
<-EC2, Small instance, $0.085 per hour
![Page 27: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/27.jpg)
Action cost modeling
27
![Page 28: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/28.jpg)
Amortization factor Factor=0:the action cost will
be distributed along the infinity intervals. (optimistic)
Factor=1:the action cost can be compensated in the next interval. (pessimistic)
Factor between (0,1):the action cost can be compensated in several intervals.
28
![Page 29: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/29.jpg)
Outer level controller with action cost
29
![Page 30: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/30.jpg)
30
Conclusion Virtual resource management for
database management systems in Cloud computing Good performance
Maintain SLA Service differentiation
Good utilization SmartSLA
Non-linear model of DBMS behavior Two level controller which takes in to
consideration of SLA penalty cost, infrastructure cost and also action cost.
![Page 31: 1 Intelligent Management of Virtualized Resources for Database Systems in Cloud Environment Pengcheng Xiong (Georgia Tech); Yun Chi (NEC Labs America);](https://reader030.vdocuments.site/reader030/viewer/2022032723/56649cff5503460f949d0d8f/html5/thumbnails/31.jpg)
31
Thank you!
ELBA project page: http://www.cc.gatech.edu/systems/projects/Elba/index.html
E-mail: [email protected]