oracle application testing suite hands -on workshop · pdf fileoracle application testing...

86
Oracle Application Testing Suite Hands-On Workshop Hands-On Workshop Mikael Fries Principal Product Manager / Oracle [email protected]

Upload: duongque

Post on 06-Feb-2018

227 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Application Testing Suite

Hands-On Workshop Hands-On Workshop

Mikael FriesPrincipal Product Manager / [email protected]

Page 2: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

• Proper Approach requires many complex steps

• Automation and tracking is key

• Understand types of change

Methodical Approach To Quality ManagementUnderstand the testing challenges

• Understand types of change

• Application Change

• Infrastructure Change

• Both

• Use specialized tools depending on your task

Page 3: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Application Quality Solutions

Application Testing Products

Infrastructure Testing Products

Application Testing Suite

Oracle Functional

TestingOracle Load

Testing

Oracle Test

Manager

SQL Performance

Analyzer

Application

ReplayDatabase Replay

Test Data and Lab Management Products

Cloud Delivery Platform Testing-as-a-Service

Data Discovery

and ModelingData Sub setting Data Masking

�Production Workload�Synthetic Workload �Test Data Management

Page 4: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Storage

DBMS

Middleware

Proper Approach to Quality Management

Infrastructure Testing Tools

InfrastructureTesting tools

Application Testing tools

Application Replay

Real Application Testing

Application Testing Suite

Application Infrastructure

Changes

Application Changes

O/S

• Test infrastructure changes separately from application changes

• Test one change at a time

• Specialized tools can result in much higher quality and efficient testing

• Proper test systems and test data mandatory for good testing results

Page 5: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

What Solution To Use

• If change is with-in the application

• UI Changes

• Business Logic Changes

• Patches of different layers (OS, Security, AS, etc.)

Application changes

Oracle Application Testing Suite (Functional and Load Testing and Test Management)

• Synthetic testing of any changes to application stack

or the application logic

Page 6: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Application Testing Suite 12.3.0.1

• Supports • Functional/regression testing

• Load/Performance testing

• Test Management

• Web, Siebel, EBS/Forms, Fusion/ADF, JD Edwards E1, Hyperion*, Peoplesoft*, , Adobe ® Flex, Database & WebServices

• Reduce scripting time by ~50%

* Hyperion and Peoplesoft accelerators are for load test only.

• Automatic script generation

• Load/Performance test Scripts generated using RUEI andReal Application Testing

• Smart integration with EM Diagnostics

• JVM Diagnostics for mid-tier

• DB Diagnostics for DB-tier

• DB Profiles for Oracle Database

Page 7: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Standard Testing Solution @ Oracle

• All testing done on massive internal clouds (Farms)

• Examples of teams using ATS @ Oracle

• Product teams: Fusion, EBS, Siebel, JDE, Hyperion, Peoplesoft, FMW, CS,

ITT, Retail, FlexCube, UGBU...

• IT Operations: PDIT, AIT...

Co-developed with internal Oracle Teams for optimal testing of Oracle Apps

• IT Operations: PDIT, AIT...

• More than 3000 users within Oracle alone

• E-Business Suite QA has 41,000+ functional scripts

• Load testing benchmarks up to 100 000 concurrent users

• Fusion MiddleWare QA has: 2.5 million test cases and over 1000

users on ONE single Oracle Test Manager instance

Page 8: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Test Manager

Page 9: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Test Manager

Key Benefits

• Integrated modules for total test

process management

• Common repository for all assets

• Web-based interface

• Manual and automated tests

Bring structure, repeatability and visibility to testing efforts.

• Manual and automated tests

• User-defined roles and fields

• Field based security model including

restrictions on what values different

users may select

• Increase visibility of app readiness

• Pre-packaged reports

Page 10: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Functional Testing

Page 11: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Functional Testing

Key Benefits

• Single unified scripting platform

for creating Functional and Load test

scripts

• JAVA/Eclipse based IDE

• Different perspectives/views

Easy to use, best-in-class functional test automation tool

Robust Object • Different perspectives/views• Non-technical users (GUI)

• Technical users (JAVA code UI)

• Support for Web 2.0, SOA and Oracle

applications

• Robust object identification for better scripting

Robust Object identification

Page 12: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Optimized Testing For Oracle Applications

Oracle Fusion Applications

Oracle Ebusiness Suite

Siebel

JD Edwards Enterprise ONE

PeopleSoft

Hyperion

Application Testing Suite Testing Accelerators

OpenScript

Web

Accelerators

WebServices

Fusion/ADF

EBS/FORMSSiebel Database Hyperion*

JDEdwards

Peoplesoft*

* Load Testing Accelerator only, Functional testing can be done with the normal Web module

Page 13: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Robust scripts and less maintenanceAccelerators

Reduce your scripting time

Page 14: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Benefits According To Oracle EBS QA team

• Robust scripts � less script maintenance

• Less time required for script stabilization

• 50% over all reduction in scripting time compared to HP

• 20% less effort for stabilization of scripts

Accelerators – E-Business Suite / Oracle Forms

• 20% less effort for stabilization of scripts

• 30% less effort working with check-points

• 50% less effort for debugging

• 80% less effort for parameterization

• Easy extendible using Java

Page 15: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Automatic Script Creation For Oracle ApplicationsGenerate load test scripts from RUEI

• ”Zero” effort load script creation for Oracle Applications

‒ No need to record scripts manually

• Support for Oracle e-Business Suite, Siebel, JD Edwards, Peoplesoft etc...

• Export real user sessions from Oracle Real User Experience Insight (RUEI) as Load scripts for Oracle Load Testing for realistic scenarios or synthetic testing of user sessions with issues...

Page 16: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Load Testing

Page 17: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Load Testing

Key Benefits

• Oracle infrastructure included • Weblogic 11g

• Oracle 11g Enterprise Edition

• Runs on Linux or Windows

• Scalable automatic content validation

Eliminate performance bottlenecks in your applications

• Scalable automatic content validation

• Comprehensive performance monitors

• Deep level diagnostics integrations

• Cloud support

• Web-based interface• Easy to use real-time data views

• Extensive analysis capabilities

• Support for collaborative testing

Page 18: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Load Testing Set-up

OLT Controller

VU Load

OLT Agent(s)

Remote DCMonitoring Data

VU Load

Page 19: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Better Insight In End-user Experience

Oracle Load Testing allows customers to messure browser time in addition to the

more ”traditional” server time by using functional test scripts* running in addition

to load test scripts.

Combine traditional load testing scripts with functional test scripts

OFT script

* This feature is supported on Load agents using Windows 7, Windows 2008 and Linux

Page 20: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Quick and easy defenitions of scenariosJust pick scripts and define Vus etc...

Page 21: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Integrated Hardware Estimation

Save time and hardware resources by knowing how much hardware resources you

expect to need before starting your test

Estimate hardware and memory settings required for running a load tests

Page 22: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

True Cloud Support

Based on Oracle Enterprise Managers 12c IaaS offering:True cloud usage for load testing allows elastic agent allocation based on user definable metrics and thresholds.

Support for elastic load agent allocation during load testing

Page 23: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Database Diagnostics Integration

Key Benefits

• Oracle Load Testing integration

with Oracle Diagnostics Pack

for Oracle databases

• ADDM & AWR reports directly

in the Oracle Load Testing console

Easier database related trouble-shooting during load tests

in the Oracle Load Testing console

This is especially useful for packaged

applications as the depends heavily on

databases

Page 24: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Using Database diagnostics with ATS

Page 25: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Load Testing – Finding Your Bottlenecks...

Oracle Database

Application Under Test Oracle Load Testing

Monitors the performance with Enterprise Manager

Bottlenecks are frequently found in the database tier (especially for packaged applications).Oracle Load Testing offers a unique integration into Enterprise Manager to simplifyidentification of these bottlenecks and automatic advice on how to address them.

Page 26: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

• Tuning requires expertise and is time consuming

• Performance and Workload Data Capture

• System Statistics, Wait Information, SQL Statistics, etc.

• Analysis

• What types of operations database is spending most time on?

• Which resources is the database bottlenecked on?

Tuning Challenges

• Which resources is the database bottlenecked on?

• What is causing these bottlenecks?

• What can be done to resolve the problem?

• Problem Resolution

• If multiple problems identified, which is most critical?

• How much performance gain is expected if M.???

Page 27: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Run A Load Test Againt Your Application...

Page 28: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Monitor Application Through EM and OLT...

The tested applications database CPU load is high. This is seen in Oracle Load Testing’s ServerStats monitoring or external solutions like Oracle Enterprise Manager Grid Control

Page 29: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Access Diagnostics Reports From OLT

After the load test is completed:

The Automatic Workload Repository

(AWR) and the Automatic Database

Diagnostic Monitor (ADDM) reports for

the selected session is loaded in the

OLT console.

‒ AWR report provides a detailed report of the statistics collected report of the statistics collected during the load session

‒ ADDM report analyzes snapshots taken by the AWR during thesession to identify potential performance bottlenecks

Page 30: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Identify���� Impact ���� Cause ���� Recommendation...

ADDM report findings and Recommendations----------------------------

Finding 1: Hard Parse Due to Literal UsageImpact is .85 active sessions, 84.84% of total activity.--------------------------------------------------------SQL statements were not shared due to the usage of literals. This resulted inadditional hard parses which were consuming significant database time.

Recommendation 1: Application Analysis

Identifies the performance bottlenecks

Estimates the impact of the problem

Drills down to the root cause

Recommendation 1: Application AnalysisEstimated benefit is .86 active sessions, 84.84% of total activity.-------------------------------------------------------------------ActionInvestigate application logic for possible use of bind variables insteadof literals.ActionAlternatively, you may set the parameter "cursor_sharing" to "force".

Gives recommendations & suggests the estimated benefit

Provides specific actions to correct the problem

Page 31: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Application Testing Suit Benefits

• Used & co-developed by the Oracle application QA teams

• Faster scripting (Built-in knowhow and optimized for Oracle Apps)

• Robust scripts � Less time for scripting & maintenance

• Automatic correlations

Testing Oracle applications

• Better integrations for diagnostics

Page 32: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Superior Test automation of Oracle Applications

• Oracle Functional Testing (OFT)

• Reduce scripting with up to 50%

• Better Object identification for EBS/Forms

(other solutions uses object Labels, OFT uses

ObjectName)

• Oracle Load Testing (OLT)

• Reduce scripting time with upto 73%

• Best correlation coverage compared to other

EBS/Siebel solutions

• Does not require additional Siebel licenses

• Oracle Application Testing Suite (OFT, OTM & OLT)

• Fully integrated, synthetic test automation solution with one single scripting platform that utilizes JAVA as

programming language. Supports Web, SOA and packaged applications (EBS, Siebel, JD Edwards, Peoplesoft & Hyperion)

• Does not require additional Siebel licenses

(Siebel Test Automation Interfaces) like other

test tool vendors

• Oracle Test Manager (OTM)

• Easy to use test process management solution

• Browser based UI

• Support for manual testing, Test Automation

(OFT) and 3rd party solutions

• Does not require additional Siebel licenses

(Siebel Test Automation Interfaces) like other

test tool vendors

• Zero effort scripting for RUEI customers

• Integration to EM diagnostics (Java/Database)

• Oracle Fusion support

• Browser based UI

Page 33: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Key Take-a-ways

• The goal of testing is to ensure the expected quality for your

application under test

• Understand the testing challanges and make sure to use right solution

for your needs

• Oracle offers multiple solutions for testing and quality management• Oracle offers multiple solutions for testing and quality management

• Test automation can help to ensure quality

• ATS has been co-designed with Oracle Apps QA teams to ensure the

best possible solution for testing Oracle Applications

Page 34: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

EBS Testing

Page 35: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

EBS Accelerators

Key Benefits

• Supports EBS Functional Testing• Optimized object identification

• Supports both Forms and Web

• Most robust test scripts in the market

• Supports EBS Load Testing

Optimized testing of EBS applications

• Supports EBS Load Testing• Optimized correlation rules for dynamic

and session variables

• Correlation rules from EBSPersformance

Team

• Supports both Forms and Web

• Most accurate testing solution for EBS

• Supports EBS 11i

• Supports EBS R12

Page 36: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

EBS Testing Best PracticesTest Starter Kits

Make use of accelerators & Test Starter Kits

Oracle OpenScript EBS Test Accelerator extends the web testing module with EBS

specific testing functionality

• Support for EBS 11i & R12 (socket & servlet mode)

• Supports both FORMS and Web actions (back-office/self service)

• EBS specific object identification rules

• EBS specific correlations

• Automatic test case creation

• EBS Test Starter Kit (~75 pre-build scripts)

Page 37: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

EBS Test Starter Kit Coverage

• Financial Products:• Oracle Payables

• Oracle Receivables

• Oracle General Ledger

• Oracle Assets

• Oracle Internet Expenses

• Manufacturing Products:• Oracle Purchasing

• CRM Products:• Oracle Contracts

• Oracle Service

• Oracle Marketing

• Human Resources Product:• Oracle Human Resources

• Projects Product:• Oracle Purchasing

• Oracle Inventory

• Oracle Order Management

• Oracle Cost Management

• Oracle Materials Requirement Planning

• Oracle Process Manufacturing Products

• Oracle Projects

• Technology Product:• Oracle Application Object Library

Page 38: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Load TestingReliable and accurate load tests

Oracle Load Testing offers the most accurate and reliable load

testing results for Oracle E-Business Suite.

Oracle offers superior load test scripting for EBS by correlatingOracle offers superior load test scripting for EBS by correlating

all dynamic values for EBS and other Oracle applications

automatically, giving testers more time for testingB

Page 39: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

EBS QA & PSR

• Oracle EBS QA and Performance team are using ATS

• ATS offers a solution, second to none for EBS testing

• Support for EBS 11i and R12

• Forms support for 6i, 10g and 11g• Forms support for 6i, 10g and 11g

• Support for Servlet and Socket communication

Page 40: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Benefits according to Oracle EBS QA team

• Robust scripts � less script maintenance

• Less time required for script stabilization

• 50% over all reduction in scripting time compared to HP

• 20% less effort for stabilization of scripts

Accelerators – E-Business Suite / Oracle Forms

• 20% less effort for stabilization of scripts

• 30% less effort working with check-points

• 50% less effort for debugging

• 80% less effort for parameterization

• Easy extendible using Java

Page 41: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Siebel Testing

Page 42: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Siebel Accelerators

Key Benefits

• Supports Siebel Functional Testing• Optimized object identification

• Integartion of Siebel Test Automation Interfaces

• License for Siebel Test Automation Interfaces

included!

• Supports Siebel Load Testing

Optimized testing of Siebel applications

• Supports Siebel Load Testing• Optimized correlation rules for dynamic

and session variables

• Correlation rules from Siebel Persformance

Team

• Supports Siebel 7.7+

• Support Siebel 8.x

• Supports OpenUI

Page 43: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Siebel – Functional Testing

Robust scripts though the Siebel Accelerator and Siebel Test Automation Interfaces

Page 44: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Dedicated Siebel SupportVisual scriptsHuman Readable scripts

Page 45: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Key highlights

• ATS used by leading Telkos to test their

Siebel deployments

• The Siebel accelerator is co-developed with

Siebel QA & PSR teams

• Used for IBM benchmark for 21 000 Users• Used for IBM benchmark for 21 000 Users

• Used for Cisco benchmark for 10 000 Usershttp://www.oracle.com/us/solutions/benchmark/apps-

benchmark/siebel-81-pspp-cisco-10k-users-1873554.pdf

http://www.oracle.com/us/solutions/benchmark/apps-benchmark/siebel-81-pspp-power-740-750-1428419.pdf

Page 46: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

JD Edwards Testing

Page 47: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Benefits According to Oracle JD Edwards QA Team

“Since moving from our old tooling to ATS, we have been able to

reduce our OVERALL TESTING EFFORTS by 25%!

This is due to a number of factors including the speed that test cases now

execute, the ease and speed of identifying and understanding the

Accelerators – JD Edwards

execute, the ease and speed of identifying and understanding the

application context of failures, as well more technical script automation

failures.“

Kishorekumar Yerra – Senior QA Manager, JD Edwards EnterpriseONE Quality Assurance

Page 48: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

JD Edwards QA rely on ATS

“The JD Edwards E1 QA team is taking full advantage of the Oracle Application Testing Suite. All of our automated test scripts have been migrated to ATS and are being used in our weekly and monthly testing phases.

The Oracle Application Testing Suite provides a stable platform for The Oracle Application Testing Suite provides a stable platform for us to create and execute our automated tests, and should provide excellent value for our customers wishing to expand their automated testing capabilities.”

Gregory Shook – Senior Director, JD Edwards EnterpriseONE Quality Assurance

Page 49: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

JD Edwards Accelerators

Key Benefits

• Supports JDE E1 Functional Testing• Optimized object identification

• Full DataGrid support (unique to OFT)

• Supports JDE E1 Load Testing

Optimized testing of JD Edwards applications

• Supports JDE E1 Load Testing• Optimized correlation rules for dynamic

and session variables

• Correlation rules from JDE Persformance

Team

Page 50: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

References

Public Reference

Silent Night (UK)

Non-Public ReferencesNon-Public References

”International Oil company” with 20 000+ employees

”Pharmaceutical company” with 600+ employees

Page 51: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

JDE Test Starter Kit Coverage

Total of 12 scripts

� Example Test Scripts and documentation

� Test Data

� PAR file

Package includes

Benefit from example scripts to help you understand how to build your own

• Order Fulfillment Processing (OFP)

• Customer Relationship Management (CRM)

• Sales Order Entry (SOE)

• Human Capital Management (HCM)

• Financial Management System (FMS)

• Manufacturing (MFG)

• Supplier Relationship Management (SRM)

Total of 12 scripts

Page 52: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Flow Builder

(feature of Oracle Functional Testing)

Page 53: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How Is Testing Done Today?

• Testing team have to wait for application

• Test automation project is started once the application is available

• Teams of testers and application users are required for

Typical scenario

• Teams of testers and application users are required for

testing

• Test team works with application users to understand scenarios and

flows for testing as well as the scope of the testing project

• Test automation begins

• Test team is provided access to a test environment

• Test team begins to build test automation scripts

• Test team consults application users for clarification of scenarios

Page 54: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Application Quality Solutions

Application Testing Products

Infrastructure Testing Products

Application Testing Suite

Oracle Functional

TestingOracle Load

Testing

Oracle Test

Manager

SQL Performance

Analyzer

Application

ReplayDatabase Replay

Test Data and Lab Management Products

Cloud Delivery Platform Testing-as-a-Service

Data Discovery

and ModelingData Sub setting Data Masking

�Production Workload�Synthetic Workload �Test Data Management

Page 55: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

• Oracle Functional Testing Suite

for Oracle Applications• Functional & regression testing

• Supports Web & Oracle Applications

• Oracle Load Testing Suite for

Oracle Applications• Load & Performance style testing

• Supports Web & Oracle Applications

• Smart integration with EM Diagnostics

Oracle Application Testing SuiteOracle’s solution for testing Oracle Applications

• Smart integration with EM Diagnostics

• Test Management• Test Process Management solution for

• Test Planing

• Requirements

• Test cases

• Defects tracking

• Reporting

Page 56: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Testing Challenges

• Manual testing takes too long

• Business users do not have time to test every change (repeatedly)

• Difficult to find technical resources for test automation

Growing complexity of applications requires more testing

• Difficult to find technical resources for test automation

• Unable to leverage automated testing due to unavailability of

technical resources

• Constant business process changes render test assets

obsolete

• Scripts needs to be maintained/recreated after changes to the

applications

Page 57: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

New Approach to Testing

• Dramatically reduces testing time

• Minimizes the need for technical

resources

Making sure your application is tested

?resources

• Reduces the testing complexity

• Minimizes the effort to keep you

test assets current

?

Page 58: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

INTRODUCING

ORACLE ORACLE FLOW BUILDER- KEYWORD DRIVEN TESTING

Page 59: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

What Is Keyword Driven Testing?

• Keyword-driven testing is another way of creating

automated tests

• It enables non-technical testers to compose test flows by • It enables non-technical testers to compose test flows by

defining series of user actions that together define an

application user flow

• User actions are defined using pre-defined keywords such

as

Click, SetText, Select, etc.

• Test flows are then transformed into executable test

automation scripts at run time

Page 60: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How Is Keyword Driven Testing Implemented?

• Use a Keyword driven testing

framework as harness

• Testers analyze the

• Non-technical testers use

Keywords to mimic actions in

Example

• Testers analyze the

application to test and define

Keywords

• Technical testers implement

Keywords and map these to

code

• Keywords ”Click” & ”Button”

could for example generate the

Keywords to mimic actions in

Flows• SetText Id_UserName John Doe

• SetText Id_PasswordMyS3Cr3T

• Click Button OK

• Bind test data to Flows

• Generate test automation

scripts

Page 61: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Pros and Cons of Keyword Driven TestingKeyword driven testing

Pros Cons

Maintenance is lower (over time)

• Test cases are concise

• Readable test cases for stake holders

• Test cases are easy to modify

Requires technical resource for keyword

implementation

Test cases can reuse keywords Only suitable for applications where keywords / Test cases can reuse keywords Only suitable for applications where keywords /

user actions can be re-used in many places

More ‘robust’ test scripts Longer Time to Market

• Build framework

• Define keywords & code

Framework may support multiple

test automation tool

Steeper initial learning curve

Page 62: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Functional Testing Suite for Oracle AppsIncludes both record/playback and keyword driven testing framework

Flows & Compoenents

EBS Pre-Built Test Content

Your Data

Your Flows

Ora

cle

Fu

ncti

on

al Testi

ng

Su

ite

for

Ora

cle

Ap

pli

cati

on

s Oracle EBS

Record Manually

Generate

Test Automation

Scripts

OpenScript

Record & Playback+ AdvancedScripting

Flow Builder

Framework to combine flows and data to

generate test scripts

Test Content

Ora

cle

Fu

ncti

on

al Testi

ng

Su

ite

for

Ora

cle

Ap

pli

cati

on

s Oracle EBS

Page 63: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Flow Builder

• Keyword driven testing framework for non-

technical testers

• Key differentiators for Oracle Flow Builder

New feature of Oracle Functional Testing Suite for Oracle Applications

• Key differentiators for Oracle Flow Builder

• Optimized for Oracle e-Business Suite (EBS) testing with

pre-defined Keywords

• Rich library of pre-defined

test flows & components

• 2100+ components

• 200+ sanity flows

• Supports all key EBS modules

Page 64: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

<Keyword>

<Keyword>

<Keyword>

Oracle Flow Builder Concept

<Keyword><Keyword>

Co

mp

on

en

t S

et

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t S

et

Flo

w

Co

mp

on

en

t

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Test Script

Page 65: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Flow Builder

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t S

et

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

<Keyword><Keyword>• Create components of commonly

seen user actions through Flow

Builder’s Web UI or through MS

Co

mp

on

en

t S

et

Flo

w

Co

mp

on

en

t

Co

mp

on

en

t

<Keyword>

<Keyword>

<Keyword>

Test Script

Builder’s Web UI or through MS

Excel

• Components can be re-used

• Components can be easily changed

when

application changes or for

customizations

Page 66: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Flow BuilderHow to define a component

Page 67: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How To Work With Components SetsOracle Flow Builder components

Co

mp

on

en

ts

Login to App

Update Item BOM

Navigate to Form

Assign Serial Tag

Search Item

Close Form

Define Revision

Logout of App

Page 68: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How To Work With Components SetsYou can use the components to build Flows

Co

mp

on

en

ts

Login to App

Update Item BOM

Navigate to Form

Assign Serial Tag

Search Item

Close Form

Define Revision

Logout of App

Navigate to Form

Search Item Define Revision

Update Item BOM

Login to App

Flo

w 1

Flo

w 2

Page 69: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How To Work With Components SetsYou can use the components to build Flows

Co

mp

on

en

ts

Login to App

Update Item BOM

Navigate to Form

Assign Serial Tag

Search Item

Close Form

Define Revision

Logout of App

Login to AppNavigate to

FormSearch Item Define Revision

Update Item BOM

Assign Serial Tag

Flo

w 1

Flo

w 2

Page 70: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How To Work With Components SetsUse Component Sets to combine frequently used components

Co

mp

on

en

ts

Update Item BOM

Navigate to Form

Assign Serial Tag

Search Item

Close Form

Define Revision

Logout of AppUpdate Item

BOM

Login to AppLogin to App

SAME

Login to App

Flo

w 1

Login to App

Navigate to Form

Search Item

Define Revision

Update Item BOM

Navigate to Form

Search Item

Define Revision

Assign Serial TagF

low

2SAME

CreateComponent Set

”Define Item Revision”

Page 71: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

How To Work With Components SetsUsing Components Sets will simplify Flow creation

Co

mp

on

en

ts

Login to App

Update Item BOM

Navigate to Form

Assign Serial Tag

Search Item

Close Form

Define Revision

Logout of AppUpdate Item

BOM

Login to App Login to App

Co

mp

on

en

t S

et

Co

mp

on

en

t S

et

Flo

w 1

Navigate to Form

Search Item

Define Revision

Update Item BOM

Navigate to Form

Search Item

Define Revision

Assign Serial TagF

low

2

Define Item Revision

Define Item Revision

Co

mp

on

en

t S

et

Co

mp

on

en

t S

et

Page 72: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Deploy AuT Record Script(s) Add verifications Parametrize Synchronize Stabilize

Record/Playback vs Oracle Flow BuilderSteps to automate a testing

Traditional record / playback

Keyword driven testing with Oracle Flow Builder

(Create Components) Assemble Flows Bind test data Generate Script

Keyword driven testing with Oracle Flow Builder

Page 73: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

What If The Application Changes?How To Handle Changes in Application

Changes in UIonly

Changes in UI only

Changes in UI & transactions/logic

Update component

Where isthe change?• Analyze and identify areas

where application changed

• Update components or onlyCopy flow structure

Enter test data

Generate

script

Update component

Update test data

Generate script

• Update components or

flow structure accordingly

• If required update test data

• Re-generate test automation scripts

Page 74: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Re-record Script(s) Add verifications Parametrize Synchronize Stabilize

Record/Playback vs Oracle Flow BuilderSteps to maintain test automation

Traditional record / playback

Keyword driven testing with Oracle Flow Builder

(Update Components) (Update Flows) (Bind test data) Generate Script

Keyword driven testing with Oracle Flow Builder

Page 75: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Oracle Flow BuilderArchitechture

http

MS Excel for creating components off-line

Web UI for creating components, component Sets,

flows & user management

Application Server

Repository

http

OFT Scripts Generated from Flows

Notifications

Component & Flow Storage

Users can create & upload

Custom Function Libraries to extend

Flow Builder functionality

Page 76: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

ComponentsOracle Flow Builder

PO Header

Page 77: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

ComponentsOracle Flow Builder

PO line type - Goods

PO line type - Service

Page 78: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Component Definition

Page 79: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Graphic Section Divider

DEMO

Page 80: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Addressing The Testing Challenges

• Manual testing takes too long

• Oracle Flow Builder can reduce the need for manual testing

freeing the business users from manual testing

Oracle Flow Builder

����• Difficult to find technical resources for test automation

• Oracle Flow Builder requires less technical resources allowing testing

team to work more efficiently

• Constant business process changes render test assets

obsolete

• Oracle Flow Builder requires a fraction of maintenance compared to

traditional scripts, allowing customers to keep up-to-date

����

����

����

Page 81: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Addressing The Testing Challenges

• Reduce test development effort

• Make use of pre-defined components

• Compress lead time for testing

Oracle Flow Builder

• Compress lead time for testing

• Test script development can begin before application is ready

• Easy maintenance

• Quick and easy changes of components and flows

• AUT* does not have to be available when creating the

scripts

• When AUT* changes testers only have to update

Keywords or flows* Application Under Test

Page 82: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Addressing The Testing Challenges

• Eliminates the major drawbacks of keyword driven

testing

• Pre-defined Keywords

Oracle Flow Builder

• Pre-defined Keywords

• Pre-defined components & flows

Page 83: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

“With Oracle Flow Builder we address the key issue of automating EBS testing content and reusability. We have derived up to 60% savings using Oracle Flow Builder over traditional methods”

Srikanth KrishnanSenior Director,

EBS QA, Oracle.

Oracle Flow Builder over traditional methods”

Page 84: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application

Re-inventing Application Testing

• Optimized testing solutions for Oracle applications

• Jump-start EBS testing with pre-built content

• Allow your organization to become truly agile

Oracle Application Testing Suite

• Allow your organization to become truly agile

• Empower non-technical resources to create test automation flows

• Easy changes of existing components for your customizations

• Keep your testware current with a minimal effort

• Reduce complexity of testing

• Reduce test cycle effort - allows you to test every change!

Page 85: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application
Page 86: Oracle Application Testing Suite Hands -On Workshop · PDF fileOracle Application Testing Suite Hands -On ... you may set the parameter "cursor_sharing" to ... • Oracle Application