A journey to testing excellence

October 2015

International Paper Overview

International Paper’s vision is to be one of the best

and most respected companies in the world.

2

People Customers

Operational Excellence Sustainability

Our Key Drivers

A Global Leader in Packaging, Paper & Pulp

3

Global Business Overview

4

Recent Recognition!

5

Applications Services Profile

6

Background

• Business Demand

– Increase release frequency

– Increase test coverage

• Legacy Platforms

– Impending retirement of Lotus Notes

• Test management

• Document management

• Change requests

• Sustainability

– Re-usable test assets

– Real-time reporting

– Ease of use

– Governance

7

Delivery Acceleration Sustain Improvement

8

Test Management

Automation

Change Impact Analysis

Document Management

Release Strategy

Business

Demand

Platform

Capability Sustainability Governance

Cost Savings Speed to Market

• Improve quality, efficiency, speed of business, and cost performance

• Improve processes in the areas of people, process and technology

Test Management Overview

9

Release Mgmt

Requirements

Test Plan

Test Lab

Defect Mgmt

HP

UFT v12.02

HP QC SolMan Adapter

Functional Automation

Testers

HP Load Runner

Performance

GUI

API

HP BPT

GUI: Graphical User Interface, automated testing

API: Application Program Interface, automated testing

Tool Description Capability

Soldoc SAP Solution Documentation [Solution Manager] Document management

HP ALM HP Application Lifecycle Management Test management

HP UFT HP Unified Functional Testing Test automation tool

SAP TAO SAP Test Accelerator and Optimizer Automation accelerator

BPCA Business Process Change Analyzer [Solution Manager] Change impact analysis

HP BPT HP Business Process Testing Test methodology

Adapter HP Quality Center (QC) Solman Adapter ALM / Solman Integration

v12.01

HP ALM

v3.05

SAP TAO

Soldoc BPCA

Solution

Manager

Delivery Sustain Acceleration Improvement

Release Strategy

Documentation

Test Management

Change Impact Analysis

Automation

10

Alternate Release Strategy

• Monthly Releases

– Weekly off-release eliminated

– Automation used to support a 12.5 day regression test cycle for each release

– Exception process for priority moves and emergency break/fix

– Releases & cycles managed in HP ALM

11

Monthly Releases

• Enhancements

Technical

Releases

• Tech Upgrades

Weekly Releases

• Break-Fix

• Priority Move

Daily Releases

• Emergency

• Unplanned

Monthly Outages

Hardware / OS

Maintenance

Year-End HR

Support Packs

Delivery Sustain Acceleration Improvement

Release Strategy

Documentation

Test Management

Change Impact Analysis

Automation

12

Requirements

Solution Documentation in SAP Solution Manager

• Central, focused, up-to-date, and easy to understand

process documentation

– Business process documentation

– Storage of technical objects

– Integration to HP ALM

13

Solution Manager HP ALM

Requirements

Coverage

Functional Specs

Design Docs

Cutover &

Conversion

Process Steps

Programs

Configuration

Process

Models

Test requirements are documented within the solution

14

Solution Documentation

Transactions, configurations Test requirements

3 level hierarchy

• Scenarios

• Processes

• Steps

Test requirements

automatically transfer to

HP ALM

Delivery Sustain Acceleration Improvement

Release Strategy

Documentation

Test Management

Change Impact Analysis

Automation

15

HP ALM Overview

16

Application Lifecycle Management SAP

Solution

Manager Requirements Releases Test Plan Test Lab Defects

Business Blueprint Test

requirements

Releases &

Cycles

Test sets &

execution

Test scripts &

components

Defect tracking

& reporting

Test

Requirements Cycles

Test Scripts

Test

Configurations Test Sets

Test

Instances

Test Runs

Solman /

ALM Adapter

Planned

Functionality

Changes Releases

Quality management tool used to establish consistent, repeatable

processes for managing requirements, tests, and business components

ALM Test Requirement Example

17

• Requirements in ALM

– Test scripts link to requirements for

coverage

– Requirements pass when all linked

test scripts pass

– Full requirements traceability for

changes

Test requirement

transferred in from

Solution Manager

ALM Reporting & Project Status

18

Example of a project scheduled to be released in November

Defect Tracking and Status Execution Progress Defect Opening Rate

Release Strategy

Documentation

Test Management

Change Impact Analysis

Automation

Delivery Sustain Acceleration Improvement

19

Business Process Change Analyzer /

Scope & Effort Analyzer

• Impact analysis of software changes on business

processes

• Test scope optimization with reduced test scope and

test effort

• Transparency about change impact of enhancement

packs before physical installation

• Tailored impact analysis for custom code and

modifications

20

100% test coverage reached

Manual effort avoided

Business Process Steps (nodes) impacted by change

20

Custom code using obsolete SAP functions

Clones with changed SAP original

Custom Development by Impact

Categories (targeted retrofit)

Clones with changed SAP references

Custom code using changed SAP functions

Custom code using changed SAP references

Delivery Sustain Acceleration Improvement

Release Strategy

Documentation

Test Management

Change Impact Analysis

Automation

21

Motivation for Automated Testing

22

Manual Testing Pre-DASI Automated Testing

Limited time results in insufficient

coverage

High risk of defects

High cost in repetitive tasks

Reliant on SME’s who understand

the business process, not always

available or allocated for testing

Faster, more frequent test

execution

Increased test coverage and

accuracy

Productivity gains through focus on

value-add activities; increased test

efficiency

Pre-built test sets define steps and

data upfront; quick on-boarding,

reduced need to pull in business

resources

23

Automation Usability

• Simple test execution for non-technical testers

• Rich and visual test logs to support validation

• Ease of use when combining manual and automated scripts together in

test sets

• Limited developers to support a large deployment

• Test composition using pre-built components

• Data driven scripts; separation of data and test logic

Using Automation Across Environments

• Role based security for each test

• Scripts used across environments simply by changing the login

24

5

5

Automated Regression Testing

25

• Global Supply Chain critical business processes tested with each release

– 1,384 regression test scripts, 15 end-to-ends, 74% automated

• Execution in as little as 7 days (12.5 days allotted)

• Major functionality tested across all lines of business

# End-to-End Business Process Test Sets Automated Manual Total

1 Domestic - MTO Rewind Rolls 67 20 87

2 Domestic - MTO Skids 76 26 102

3 Return Orders MTO_MTS_Rolls_Cartons or Skids 9 4 13

4 Export - Port as Plant ZKE Consignment MTO Rolls 94 25 119

5 Extruding - Enhance DPR - Riegelwood to Prosperity - MTO Rolls 112 35 147

6 Extruding - Third Stage Rewinding at Texarkana 79 35 114

7 Export - Port as Plant - Riegelwood MTS Bale Pulp (Containerized Shipments) 75 17 92

8 MTO Outsourcing Rewinder Bundled Rolls - Mill to Outsourcer to Customer 79 27 106

9 Domestic MTS Replenishment Case to Box Plant Manual VMI Sales Orders 50 23 73

10 MTS Replenishment (Skids_Cartons) from Mill to RDC to Customer 79 36 115

11 Replenish MTS to DC using PReqs and receipt 53 22 75

12 Replenish Outsourcing MTS Pallets - (Mill to Outsourcer to RDC) 71 38 109

13 QTA Rolls 67 21 88

14 Domestic - MTO Trade Sales (ZTRD) Mill to Customer 55 19 74

15 MTS Replenishment (Rolls) at Mill Shipping to Customer 53 17 70

1384 1019 365

Considerations

• Technical Infrastructure

– Support and compatibility for all applications

– Vendor collaboration

– Server sizing

– Licensing

• End User Evaluation

– Internal users (domestic, regional, remote, etc.)

– External access required (consultants, third-party vendors)

– Localization requirements (multi-language support)

• Training

– Decentralized internal training program

– End-user documentation readily available

26 26

Next Steps

• Continue implementation rollout to additional teams and regions

• Increase use of native ALM reporting and dashboards

• Refine Solution Documentation to improve change impact analysis

• Increase automation footprint

27

Q & A

28