Download - Quality Contracts for Real-Time Enterprises
![Page 1: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/1.jpg)
Quality Contracts for
Real-Time Enterprises
Alexandros Labrinidis, Huiming Qu, Jie Xu
Advanced Data Management Technologies LabDepartment of Computer Science
University of Pittsburgh
http://db.cs.pitt.edu
BIRTE 06 - Business Intelligence for the Real Time EnterpriseSeptember 11, 2006 - Seoul, South Korea (in conjunction with VLDB 2006)
![Page 2: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/2.jpg)
09/11/06 2ADMT Lab, Department of Computer Science, University of Pittsburgh
Quality in Real Time Enterprises
� In real time enterprises:
� Response time is critical
� However, it is not the only concern
� Quality concerns may include
� Response time, or Quality of Service (QoS)
� Freshness, or Quality of Data (QoD)
� Examples
� Case 1: web database systems
� Case 2: distributed database systems
![Page 3: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/3.jpg)
09/11/06 3ADMT Lab, Department of Computer Science, University of Pittsburgh
UPDATESQUERIES
Case 1: Update-intensive Web database
system (e.g., stock info portal)
GOOG
IBM
$367.9
$75.8
GOOG
IBM
![Page 4: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/4.jpg)
09/11/06 4ADMT Lab, Department of Computer Science, University of Pittsburgh
Case 2: Distributed database system
� Hierarchical loosely-coupled distributed system
IndexIndex
? IndexIndex
IndexIndex
![Page 5: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/5.jpg)
09/11/06 5ADMT Lab, Department of Computer Science, University of Pittsburgh
Desired properties
� support user preferences:
� help system survive a broader spectrum of workloads when high number of tasks are competing for CPU
� User preferences guide system decisions
� E.g., Web-database, competing queries and updates
� help system choose the appropriate service site when multiple service providers are competing
� E.g., distributed database with replication
� provide a unified metric to measure system performance
![Page 6: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/6.jpg)
09/11/06 6ADMT Lab, Department of Computer Science, University of Pittsburgh
Outline
� Introduction
� Quality Contracts Framework (QC)
� Case 1 – Transaction scheduling under QC
� Case 2 – Distributed query processing under QC
� Related work
� Conclusions
![Page 7: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/7.jpg)
09/11/06 7ADMT Lab, Department of Computer Science, University of Pittsburgh
Quality Contracts (QC)
� QC is a set of functions that match performance metrics to how much they are worth to users
� Performance metrics could be
� Real metrics such as response time (rt)
� Virtual metrics such as rt – avg(rt)
(a) QoS function (b) QoD function
![Page 8: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/8.jpg)
09/11/06 8ADMT Lab, Department of Computer Science, University of Pittsburgh
Optimization under Quality Contracts
� QCs enable the specification of user preferences
� Among different quality metrics
� Among different queries
� Micro-economic Paradigm
� Servers get profit according to QC for satisfying users’ preferences
� Optimization goal:
� Maximize overall system profit P
� P = f(QoS) + (f(QoS)>0 ? f(QoD) : 0)
![Page 9: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/9.jpg)
09/11/06 9ADMT Lab, Department of Computer Science, University of Pittsburgh
Applicability of Quality Contracts
� Payment for regular DBMS queries
� e.g., $10 for ideal execution of one query
� Payment stream for DSMS queries
� e.g., $10/hour for a continuous query
� QC framework is applicable for both!
![Page 10: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/10.jpg)
09/11/06 10ADMT Lab, Department of Computer Science, University of Pittsburgh
Usability of Quality Contracts
� Parameterized versions of QCs reduce the burden of user preference specification� servers identify different classes of QCs for each type of user (e.g., silver, gold, platinum levels)
� Real-life example:classes of pre-configured cell phone plans� a user only needs to choose
� the total budget, and
� whether his/her preference is
� QoS (local plan with more minutes) or
� QoD (national plan with fewer minutes)
![Page 11: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/11.jpg)
09/11/06 11ADMT Lab, Department of Computer Science, University of Pittsburgh
Outline
� Introduction
� Quality Contracts Framework (QC)
� Case 1 – Transaction scheduling under QC
� Case 2 – Distributed query processing under QC
� Related work
� Conclusions
![Page 12: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/12.jpg)
09/11/06 12ADMT Lab, Department of Computer Science, University of Pittsburgh
Case 1 - transaction scheduling under
quality contracts
� Transaction types
� Read-only queries, write-only updates
� Each query is associated with a QC
� Queries and updates are competing for system CPU
� more cpu to queries, higher profit from f(QoS)
� more cpu to updates, higher profit from f(QoD)
� Optimization Goal
� Maximize overall system profit through balancing the load of query and update transactions
![Page 13: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/13.jpg)
09/11/06 13ADMT Lab, Department of Computer Science, University of Pittsburgh
QUTS - overview
� Two-level scheduling scheme
� At the high level
� resource allocation (which queue to execute) according to the QCs.
� At the low level
� Query queue uses PRD
� Update queue uses HDP
� Dual priority queue with dynamic concatenation
time
CPU time for updates
CPU time for queries
![Page 14: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/14.jpg)
09/11/06 14ADMT Lab, Department of Computer Science, University of Pittsburgh
Exp 1. Performance (pd and ps) � QUTS consistently achieves over 85% profit over the entire ranges.
� Both UH (Update-High) and GP (Global-Priority) have are biased for freshness, thus performance increases while QoD worth increases.
0
0.2
0.4
0.6
0.8
1
1 2 3 4 5 6 7 8 9 10
pd ($)
TPP
UH GP QUTS
0
0.2
0.4
0.6
0.8
1
1 2 3 4 5 6 7 8 9 10
ps ($)
TPP
UH GP QUTS
![Page 15: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/15.jpg)
09/11/06 15ADMT Lab, Department of Computer Science, University of Pittsburgh
Exp 2. Adaptability � Time is divided into
four segments.
� In odd segments,
� pd = 5 x ps
� In even segments,
� ps = 5 x pd
Similar pattern
![Page 16: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/16.jpg)
09/11/06 16ADMT Lab, Department of Computer Science, University of Pittsburgh
Outline
� Introduction
� Quality Contracts Framework (QC)
� Case 1 – Transaction scheduling under QC
� Case 2 – Distributed query processing under QC
� Related work
� Conclusions
![Page 17: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/17.jpg)
09/11/06 17ADMT Lab, Department of Computer Science, University of Pittsburgh
Case 2 – Distributed query processing under quality contracts
� Hierarchical loosely-coupled distributed system
IndexIndex
? IndexIndex
IndexIndex
![Page 18: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/18.jpg)
09/11/06 18ADMT Lab, Department of Computer Science, University of Pittsburgh
Replication Selection Problem
� DataReplicationEach replication
� Query execution plan� Processing operator� Transmission operator
� Goal:� Label each replica as winning or losing
� Maximize processing node’s revenue
![Page 19: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/19.jpg)
09/11/06 19ADMT Lab, Department of Computer Science, University of Pittsburgh
Replication-Aware Query Processing (RAQP)
� Two-step query optimization
� Generate statically-optimized logical execution plan� Dynamic programming algorithm [system R]
� Lifted constraint of left-deep trees
� Select execution site for each operator and replica to use
� Initial Query Unit Allocation
� Iterative Improvement
� [Xu & Labrinidis, WebDB 2006]
![Page 20: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/20.jpg)
09/11/06 20ADMT Lab, Department of Computer Science, University of Pittsburgh
Experimental Results - Profit
Algorithm adapts well to user preferences
![Page 21: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/21.jpg)
09/11/06 21ADMT Lab, Department of Computer Science, University of Pittsburgh
Related work� Economic Models
� [Ferguson et al., 1996]� [Stonebraker et al., 1996]
� Real time DB and Web-DB � [Abbott et al., 1988]� [Sha et al., 1991]� [Haritsa et al., 1993]� [Haritsa et al., 1993]� [Ramamritham et al., 1994]� [Burns et al., 2000]� [Challenger et al. 2000]� [Luo et al. 2002]� [Datta et al. 2002]� [Labrinidis et al. 2004]
� Stream Processing� [Carney et al., 2002]� [Das et al., 2003]� [Babcock et al., 2004]� [Sharaf et al., 2005]� [Abadi et al., 2005]
� Query Optimization� System R [Selinger79]� Volcano [Graefe89, Cole94]� Eddies [Avnur00], Rio [Babu05]� R* [Mackert86]� LBQP [Carey86]� Distributed eddies [Tian03]
![Page 22: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/22.jpg)
09/11/06 22ADMT Lab, Department of Computer Science, University of Pittsburgh
Conclusions
� We proposed Quality Contracts
� a unified framework to specify user preferences on multiple quality metrics.
� We showed two application examples which utilize the Quality Contracts framework
� Transaction scheduling in update-intensive Web-databases
� Replica selection in distributed databases
� Future work
� Extend QC framework to other domains
![Page 23: Quality Contracts for Real-Time Enterprises](https://reader034.vdocuments.site/reader034/viewer/2022051716/58a19db31a28abda018b8908/html5/thumbnails/23.jpg)
09/11/06 23ADMT Lab, Department of Computer Science, University of Pittsburgh
Thank you
Alex(andros) Labrinidis
Questions