performance management with rational insight and …. ibm software group ... manual data customer...

®

IBM Software Group

© 2009 IBM CorporationInnovation for a smarter planet

Dr. Einar KarlsenCertified IT SpecialistSolution [email protected]

Performance Management with MCIF and IBM Rational Insight

IBM Software Group | Rational software

2Innovation for a smarter planet

Agenda

� Background

� IBM Rational Insight Overview

� Measured Capability Improvement Framework (MCIF) Overview

� Executive Dashboard

� Conclusion

� Demo



You can‘t manage, what you can‘t measure!

Control Settings

Results

Better

Quality of Data

Quantity of Data

Time Delay

Stable

Non-Intrusive

You cannot IMPROVE what you cannot MANAGE!



Problems and Implications

Lack of timely information and in-context insight

Disparate data sources, formats,

and definitions

Lack of relevant, timely actionable

information

Inability to baseline and benchmark

status and progress

Inability to measure and assess

unobtrusively

“2/3 of executives make more than half

of their decisions based on ‘gut feel’rather than verifiable information”

“77% of managers are aware of

bad decisions made due to lack of access to accurate information”

“Poor decisions have generated

revenue 75% or morebelow expectations”



IBM Rational Insight

� Automatic collection, measurement and analysis

of real-time data across projects for informed

decision making

� Built-in library of metrics and dashboards based

on best practices and optimized for software and

systems development and delivery

� Customizable performance management

framework guides customers with best practices

to continuously improve process

� Built upon an open Jazz architecture, leveraging

legacy Rational and 3rd-party data

� Built on a best-in-class business intelligence

platform from IBM Cognos, clear leader in the

2008 Gartner Magic Quadrant for BI



Application Lifecycle Management Reports



Rational Insight

Project

Management

Project

Management

Build

Management

Build

Management

Architecture

Management

Architecture

Management

Requirements

Management

Requirements

Management

Change

Management

Change

Management

Configuration

Management

Configuration

Management

Portfolio

Management

Portfolio

Management

Quality

Management

Quality

Management

CxO

Project Manager

Collaborate across disparate development artifacts

In the context of business objectives

Process Lead



Performance Management Across the Lifecycle

Open Lifecycle Service Integrations

Best Practice Guidance

ClearCase

MS Project

XML

Quality Manager

Partners

Single View into Your Organizational Performance

ClearQuest

RequisitePro

Team Concert

Insight

Requirements Composer

Powered by

Measured Capability Improvement Framework

(MCIF)

Powered By Cognos

3rd Party

HP Quality Center

DOORS



Da

taS

tre

am

Da

taS

tre

am

Extract, Transform, Load

Reporting Server

Data Warehouse

M e t a d a t a

XML – ODBC Mapping | DB Access

Rational Insight High-Level Domains

Project

Management

Project

ManagementBuild

Management

Build

Management

Architecture

Management

Architecture

ManagementRequirements

Management

Requirements

Management

Change

Management

Change

Management Configuration

Management

Configuration

Management

Portfolio

Management

Portfolio

ManagementQuality

Management

Quality

Management

CxO Process LeadSelf Service

Report Authoring

REST API - native REST API – adapter

XML DB

Project Manager

Open Data Architecture

Enterprise Data Warehouse

Industry Proven BI Platform

Web architecture to retrieve product data in XML

(REST get)


Innovation for a smarter planet

Measured Capability Improvement Framework (MCIF)

� Best Practice Adoption a systematic approach to best practice adoption

� Rational Health Assessment to benchmark against proven improvement roadmaps

� Rational Self Checks to provide ongoing self assessment

Ongoing Adoption Assessment

Adopt Practices



Performance Measurement Practices shipped with Rational Insight

•This practice

(included with

Insight) gives

detailed

process

guidance on

how to

implement

performance

measurement.

•Rational

Insight

provides the

tooling to

implement the

performance

measurement

practice.

•This practice

(included with

Insight) gives

detailed

process

guidance on

how to

implement

performance

measurement.

•Rational

Insight

provides the

tooling to

implement the

performance

measurement

practice.



Available Reports in IBM Rational Insight

�Test Lab Utilization

�Tested Use Cases to Implemented

Use Cases

�Requirement Volatility Churn

�Requirements Distribution

�Requirements Traceability Matrix

�Requirement and related UCM Activities

�Release Readiness (Defect)

�Request Trends

�Run Rate

�Tasks per Project

�Tasks per State Type Owner

�Workload

�SLOC per Defect

�Defect Distribution

�Defect Verification Failure Rate

�SLOC by component

�Test Case Execution Status

�Test Coverage by Requirement

Test management sample

reports

�Defect per Requirement

�Release Readiness (Requirement)

�Requirement Delivery

�Requirement List

Requirement practices sample

reports

�Blocking Defects

�Build Health

�Defect Aging

�Defect Status and Distribution

�Iteration Velocity

�Project Burndown

�Project Performance

Iterative development sample

reports

�Activities per Person

�Defect Glide Path

Change management reports

�Code Churn

�Code Contributions

�Defect Arrival Rate

Change control Reports



An Executive Dashboard – One PossibilityExecutiveDashboard

ProjectHealth

StrategicHealth

DevelopmentQuality

CustomerQuality

� Defect Backlog

� Test Escapes

� Functional Test Trends

� Critical Situations

� System Test Trends

� S-Curve Progress

� Automation Percentage

� Customer Testcases

� Consumability Scorecard

� Defect Latency

� Quality Plan Commitments

� Test Coverage

� Defect Backlog

� Defect Density

� Defect Repair Latency

� Build Health

� Project Velocity

� Staffing Actuals

� Process Timeliness

� Milestone Status

� Severity Analysis

� Security Vulnerabilities

� Static Code Analysis

� Requirements Met

� IPD Timeliness

� Transactional Survey

� PMR / Call Rates

� Critical Situations

� Cost of Support

� Installability

� Enhancement SLA

� Useability

� Consumability

� Perceived Performance

� Scalability

� Integrations with other

products

� User Experience / Doc

Time to Resolution

� Sales Plays

� Partner Enablement

� Support Enablement

� Technical Enablement

� Sales Enablement

� Localization

� MCIF Index

� Competition

� Integrated into Story

� Green Threads

� LCM

� Pipeline / Multiplier

� Revenue

PracticesVulnerability Assessment

Concurrent Testing

Test Driven Development

Whole Team

Team Change Management

Evolutionary Architecture

Requirements Management



Rational Data Sources

RationalRequirements

Composer

RationalClearQuest

RationalTest

Manager

RationalTeam

Concert

RationalRequisite

Pro

RationalClearCase

RationalQuality

Manager

Headcount&

Financials

Sales&

Pipeline

ManualData

CustomerSupport

3rd Party Data Sources

ProjectData

DB2

Oracle

SQL Server

RationalInsight

Quantitative and Qualitative Data

REST Open Services / ODBC / XML

Where You Are� Productivity Rates

� Quality Levels

Why You Are� Process Assess

� Product Health

Rational Executive Dashboard



This top-level dashboard showcases schedule

variance, project health, size, and % complete for each project. Drill down on project for more info.

Project health by region. Drill down for regional information, including headcount

and cost-related information.

Dashboards are organized around business objectives to ensure focus on potential problem areas preventing

us to reach stated business objectives.



Project health dashboard provides a scorecard of 12

different quality related metrics. Drill down enables

further analysis.

Control metrics for practices including Test Management,

Iterative Development, Continuous Integration, and 2-Level Planning are provided.

Online Auction is a fictive project.

Guidance on how to set up a performance measurement system

and how to effectively leverage metrics to manage your business

is provided (from RMC)

Plugging in acquired products into our

dashboard allows us to rapidly identify strengths

and weaknesses.



Individual reports are among others organized around

practices. For each practice, you can run a set of reports for a

project, or a set of projects, to understand how well they follow discriminating practices. Poor

metrics indicating need for process improvement.

Build health is an example of a control metric for practices such as

iterative development and continuous integration. Seems like most teams have daily builds that pass our automated build tests.



360-degree view protects top-line, bottom line and manages risk Integrating and balancing for Real Return on IT Assets

Benefits

Total Asset Cost( )( Risk )

Prevent issues that create rework that

drives projects over budget 30%

Reduce Analysis-paralysis that puts delays projects up to 10% of the time

Automate project and process

measurement to improve team

productively 10%

Reallocate from troubled projects to get winners to market faster for

higher ROI



Gain insight into development projects which span

organizational and geographic boundaries

Raise enterprise transparency to reduce costs and risks by

mapping operational activities to strategic objectives

Drive business innovation and reduce costs through measured

and continuous process improvement

IBM Rational Insight Added Value

You cannot IMPROVE what you cannot MEASURE!



Demo: IBM Rational Insight Overview

� Executive Dashboard

� KPIs

� Staffing

� Project Size

� Project Status

� Quality

� Project View

� Build Health

� Defects

� Enhancement Requests

� Test Coverage

� Uncovered Test Cases

� Requirement Volatility

� Out-of-the-Box (OOTB) Reports

� Functional Hierarchy>Defect Management>Defect Distribution

� Practice Oriented Hierarchy>Change Control>Code Contributions



© Copyright IBM Corporation 2009. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

performance management with rational insight and …. ibm software group ... manual data customer...

Documents