christian mayerl, kai moritz hüner, jens-uwe gaspar, christof momm, sebastian abeck
DESCRIPTION
Definition of Metric Dependencies for Monitoring the Impact of Quality of Services on Quality of Processes. Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck - PowerPoint PPT PresentationTRANSCRIPT
Definition of Metric DependenciesDefinition of Metric Dependenciesfor Monitoring the Impact of Quality of Servicesfor Monitoring the Impact of Quality of Services
on Quality of Processeson Quality of Processes
Christian Mayerl, Kai Moritz Hüner, Jens-Uwe Gaspar, Christof Momm, Sebastian Abeck
Cooperation & Management, Institute of Telematics,Faculty of Computer Science, Universität Karlsruhe (TH)
76128 Karlsruhe, Germany
{mayerl | huener | gaspar | momm | abeck}@cm-tm.uka.de
221st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
INTRODUCTION – OverviewINTRODUCTION – Overview
Introduction
Related Work
Metric Dependency Model Elements for modeling metric dependencies Formalism for calculating metric dependencies
Example – Performance Metric Dependencies Dependency model of response time Application of response time metrics
Monitoring Architecture Components processing metric definitions Implementation experiences and evaluation
Conclusion and Outlook
321st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
INTRODUCTION – Scenario and QuestionsINTRODUCTION – Scenario and Questions
Which elements needed to define dependencies between metrics related to processes, invoked services and components implementing
services?
How to define metric dependencies to allow mapping of metric dependency definitions to an monitoring architecture?
ProcessLogic
Service
ApplicationLogic
Component FunctionStudentDBAccess.getCompleteSet
Service OperationStudentDBService.getCompleteSet
Business Process ActivityToRProcess.CollectStudentInformation
functionaldependency
functionaldependency
MetricComponent
MetricService
MetricProcess
related
related
related
metricdependency
metricdependency
421st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
RELATED WORK – OverviewRELATED WORK – Overview
Basics of quality definitions UML Profile for Modeling Quality of Service
basic terminology and structure, no calculable quality dependencies Quality of Web Services
raw and aggregated metrics, no dependencies between services and processes
Metric dependencies Business-driven IT Management (BDIM)
optimize SLOs from business perspective, not monitoring dependencies at runtime Dependencies between service and process metrics
e-business processes based on Web services, no management function to monitor Quality of Service (QoS) and to calculate the impact on Quality of Process (QoP)
Management architectures and applications Common Information Model (CIM) – Metrics Model
metrics related to functional units, no definition of calculable metric dependencies
521st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
RELATED WORK – Common Information Model (CIM) Metrics ModelRELATED WORK – Common Information Model (CIM) Metrics Model
CIM
_StartedU
oW
CIM_UnitOfWorkDefinition
ID : string {key}Context : stringTraceLevelTypeID : string
CIM
_SubU
oWD
ef
CIM_UoWMetric
CIM_UoWMetric
Value : string
CIM_BaseMetricDefinition
Id : string {key}Name : stringDateType : uint16 {enum}Calculable : uint16 {enum}Units : stringBreakdownDimensions : string[]IsContinous : booleanChangeType : uint16 {enum}TimeScope : uint16 {enum}GatheringType : uint16 {enum}
CIM_BaseMetricValue
Id : string {key}MetricDefinitionId : string {required}MeasuredElementName : stringTimeStamp : datetimeDuration : datetimeMetricValue : stringBreakdownDimension : stringBrekDownValue : stringVolatile : boolean
CIM_MetricInstance
CIM_LogicalElement
CIM
_Metric
-D
efForM
E
CIM
_LogicalElem
entPerform
sUo
W
CIM_LogicalElement-UnitOfWorkDef
CIM_ManagedSystemElement
…
CIM_ManagedElement
…
CIM
_MetricF
orME
*
*
*
*
*
1..*
*
*
CIM_MetricDefinition
Validity : uint16
*
CIM
_SubU
oW
*
0..1
*
1
CIM_UoWMetricDefinition
CIM_UnitOfWork
ID : sint64 {key}UoWDefID : string {key, propagated}UserName : stringStartTime : dateTimeElapsedTime : datetimeStatus : uint16 {enum}MutualContextId : stringTraceLevel : uint32
*
*
*
*
*
1
*
Modeling of runtime management information Metric dependencies associated with relation CIM_SubUoW between units of work
621st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
METRIC DEPENDENCY MODEL – Assumptions and RequirementsMETRIC DEPENDENCY MODEL – Assumptions and Requirements
Assumptions focus on one process activity and one invoked service operation process implemented with Business Process Execution Language (BPEL) services described with Web Service Description Language (WSDL) services implemented by component-based applications functional dependencies between services and processes are well-known
Requirements provider monitoring Quality of Services (QoS) should be able to estimate
impacts on Quality of Processes (QoP) formal model of metric dependencies needed to be calculated mapping on existing standard management information models
(e. g. Common Information Model, CIM)
721st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
Ap
pli
ca
tio
n L
ay
er
Se
rvic
e L
ay
er
Pro
ce
ss
La
ye
rMETRIC DEPENDENCY MODEL – Metrics and Metric DependenciesMETRIC DEPENDENCY MODEL – Metrics and Metric Dependencies
Metric Dependencies
Component
ComponentFunction
*
**
DependencyFunction
1
*
*
*
MetricCategory
MetricDimension
1..*
*
*
MetricCharacteristic
MetricDefinition
1
UnitOfWorkDefinition1..*
MetricValue
*
UnitOfWork*
*
*
Service
*
*1
Interface InterfaceOperation*
1
*
1..*
*
depends on
depends on
1
1
0..1
0..1
0..1
1
Process
Role
1..2
*PartnerLink
1
*
1InvokeActivity
StructuredActivity
*
BasicActivity1..*
1..*Activity
821st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
METRIC DEPENDENCY MODEL – Formalizing Metric DependenciesMETRIC DEPENDENCY MODEL – Formalizing Metric Dependencies
mQ
mE
e qQuality Value
Metric Value
E Q
Functional Entity
me mq
m m
m m
e E
q Q
:
:m m
m E Q
m e q
0 1 0, , , ,E E nd e e d e e
1 0
1 0
calc
calc 1,1 1, , 0
1,1 ,1 , , 0
:
: , , , ,
, , , , ,
k
k
n
m m m
k n k
n n k n km m m
f Q Q Q
f q q q q
q q Q q q Q q Q
0 0 calc 1 1 1 1 2 2 1, , , , , , , , ,k k n k nm e f m e m e m e m e m e m e
0 1 0, , , ,M M kd m m d m m
921st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESIntroduced Example ScenarioIntroduced Example Scenario
Process activity invokes a service operation
Service implemented by application component functions
ProcessLogic
Service
ApplicationLogic
Component FunctionStudentDBAccess.getCompleteSet
Service OperationStudentDBService.getCompleteSet
Business Process ActivityToRProcess.CollectStudentInformation
functionaldependency
functionaldependency
1021st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESMetric Dependency Pattern for PerformanceMetric Dependency Pattern for Performance
requestsent
processingstarted
responsesent
responsereceived
requestreceived
Pro
ce
ss
La
ye
r
durationTm
Ap
pli
ca
tio
nL
ay
er
waitingTm processingTmrequesttransmissionTm response
transmissionTm
Se
rvic
eL
ay
er
responseTm responsetransmissionTmrequest
transmissionTm
Metric dependency patterns based on existing approaches
Pattern applied to specific SOA by assigning concrete architectural elements to each metric
1121st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESModel for StudentDBService and ToRProcessModel for StudentDBService and ToRProcess
:Process
name = “ToRProcess”:InvokeActivity
name = “LookupStudent”:StructuredActivity
name = “main”
:Service
name = “StudentDBService”
:Interface
name = “IStudentDBService”
:InterfaceOperation
name = “isStudent”
:Component
name = “StudentDBAccess”
:ComponentFunction
name = “getCompleteSet”
:ComponentFunction
name = “isStudent”
:MetricCharacteristic
name = “ResponseTime”
:UnitOfWorkDefinition
name = “isStudentOp”
:MetricDimension
name = “WaitingTime”
:MetricDimension
name = “ProcessingTime”
:UnitOfWorkDefinition
name = “isStudentF”
:MetricCharacteristic
name = “DurationTime”
:MetricCategory
name = “Performance”: UnitOfWorkDefinition
name = “LookupStudent”
: UnitOfWorkDefinition
name = “useNetwork”
:MetricCharacteristic
name = “TransmissionTime”
:DependencyFunction
name = “CalcDurationTime”
:DependencyFunction
name = “CalcResponseTime”
1221st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
EXAMPLE – PERFORMANCE METRIC DEPENDENCIESEXAMPLE – PERFORMANCE METRIC DEPENDENCIESSimple Metric Dependency FunctionSimple Metric Dependency Function
Assumptions
Dependency functions
LookupStudent
durationT transmissionT durationT resp
isStudent isStudent isStude
onseT
responseT waitingT responseT processiong
n
T
t, ,
, ,
, ,
E E
M M
M M
d p s d s c
d m m d m m
d m m d m m
request responsedurationT LookupStudent timeAdd transmissionT responseT transmissionT LookupisStudent isStudent
isStudent isStudent isSt
Student
responseT timeAdd waitingT processingT
timeA
uden
d
t
, ,
,
m p f m s m s m p
m s f m c m c
f d 11
, ,
n
n ii
t t t
1321st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
MONITORING ARCHITECTURE – Component OverviewMONITORING ARCHITECTURE – Component Overview
«component»
BPEL Process
«component»
Web service Implementation
«component»
Agreement Repository
«component»
Agreement Monitor
«component»
Metric Comparator
«component»
Metric Collector
«component»
Storage
«component»
Process Manager
ManagementPort
ManagementPort
ProvideService(WSDL)
EstablishAgreement
ProvideReport
ProvideAgreement
Deployed on BPEL Engine
NotifyImpact
«component»
Metric Aggregator
ProvideMetrics
«delegate»«delegate»
«delegate»
«component»
Report Generator
«component»
Application Server
«deployed on»
ManagementPort
Implemented as CIM Provider Implemented as CIM Server
«delegate»
Store & Provide Data
GetMetrics
1421st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
MONITORING ARCHITECTURE – Component DetailsMONITORING ARCHITECTURE – Component Details
AgreementMonitor MetricAggregator
calculating metric values based on functional and metric dependencies MetricComparator
comparing SLOs with calculated metric values MetricCollector
collection of metric values and transformation to management information standards (e. g. CIM)
Others Storage
Archiving of measured values Associating values with functional and metric entities
Instrumentation manageability capabilities of functional elements provision of sufficient management information
1521st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – DemonstratorIMPLEMENTATION EXPERIENCES – Demonstrator
10.000 requests for collecting and aggregating metric values
«device»:AlfiVM01
CourseUnitDBService.aar
ExaminationDBService.aar
OrganizationDBService.aar
StudentDBService.aar
«executionEnvironment»:Axis2webApp
«device»:AlfiVM02
ToRProcess.jar
«executionEnvironment»:OracleBPELengine
courseunitdata
examinationdb
…
«device»:MySQLServer
«device»:AlfiVM03
CIM_UnitOfWork.mof
QoS_ …
…
«executionEnvironment»:CIMMOM
«executionEnvironment»:Axis2webApp
«artifact»AgreementMonitorService.aar
«artifact»AgreementMonitor.jar
«artifact»MetricComparator.jar
«artifact»MetricAggregator.jar
«artifact»ReportGenerator.jar
«artifact»AgreementService.aar
«artifact»AgreementRepository.jar
«artifact»DimensionValueService.aar
«artifact»CIMOMwrapper.jar
«artifact»MetricDependencyMgmtService.aar
«artifact»CIMOMwrapper.jar
1621st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – IMPLEMENTATION EXPERIENCES – Evaluation of MetricCollector and MetricAggregatorEvaluation of MetricCollector and MetricAggregator
Useful medians 141 milliseconds for MetricCollector 437 milliseconds for MetricAggregator
Metric Collector Metric Aggregator
100
200
300
400
500
600
mill
iseco
nds
1721st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES –IMPLEMENTATION EXPERIENCES –Evaluation of Metric Dependencies Evaluation of Metric Dependencies (Component, Service, Process)
0 200 400 600 800 1000
20
00
30
00
40
00
50
00
60
00
70
00
Mill
ise
kun
de
nm
illi
sec
on
ds
1821st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – IMPLEMENTATION EXPERIENCES – EVALUATIONEVALUATIONSorted Measurement DataSorted Measurement Data
0 200 400 600 800 1000
20
00
30
00
40
00
50
00
60
00
70
00
Mill
ise
kun
de
nm
illi
sec
on
ds
1921st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
IMPLEMENTATION EXPERIENCES – IMPLEMENTATION EXPERIENCES – EVALUATIONEVALUATIONCorrelation of Correlation of Measurement DataMeasurement Data
2000 3000 4000 5000 6000 7000
1000
2000
3000
4000
5000
ToR-Service
Die
nst
e
2000 3000 4000 5000 6000 7000
1000
2000
3000
4000
5000
ToR-Service
Kom
ponente
n
1000 2000 3000 4000 5000
1000
2000
3000
4000
5000
Dienste
Kom
ponente
n
Ser
vice
Co
mp
on
ent
Co
mp
on
ent
Service
Process Process
2021st May, 2007 IEEE/IFIP International Workshop on Business-driven IT Management Dr. Christian Mayerl
CONCLUSION AND OUTLOOKCONCLUSION AND OUTLOOK
Conclusion Modeling metric dependencies between elements of a SOA
Formalism to calculate metric dependencies Example – response time dependencies
Monitoring quality impacts at run time Development of a monitoring architecture Evaluation of monitoring metric dependencies
Outlook Definition of a UML profile to model metric dependencies
Support for development of manageable SOA elements Integrated development of SOA and manageability capabilities
Extensions of the management instrumentations Development of adequate management interfaces Provision of management information for calculating metric dependencies