powerpoint presentation - idv€¦ · ppt file · web viewranorex soap ui sahi gui testing:...

33
Test Automation in Agile & Migration 2 Selenium

Upload: haquynh

Post on 01-Sep-2018

311 views

Category:

Documents


2 download

TRANSCRIPT

Test Automation in Agile & Migration 2 Selenium

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 2

Agenda

» The Evolution of Testing

» Importance of Test Automation in Agile

» Rise of Open-Source and Low-cost tools

» Growing Popularity of Selenium

» Challenges in Migration and the Options

» Migrate2Selenium

» Q & A

The Evolution of Testing

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 4

Testing with Defined Process

80%

Phased with SDLC

Traditional Manual Testing

Uncover Defects

Test

Simple web ApplicationsStand alone Applications

It was all done by developers

In-house Testing Team

In-house Test Centres

Testing with Enhanced Maturity

SITUAT

Matured Process

CIT

Multi-tier integrated

Applications

Evolution of Testing Early Days Test Automation

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 5

Next Level of Automation with Diversified Tools

Testing Managed Centres

Specialized Centres of Excellence Federated CoEs

Performance Testing & Tuning

Cross Technology integrated Complex

Applications

$

Automation

UI

Service/ APIApplication

Security

Agile Driven Test Engineering

Diversified Complex Applications

Mobility, Digital

QE Transformation with Continuous Delivery

QE, Agile

CI & CDDevOpsPerformanceSecurity

Transformation Era

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 6

Tomorrow's World

Trend Forecast

Aggressive Functional Engineering

Building SMART Automation Platforms

AI Enablement

Hybrid Security Enabled Performance Engineering

Testing Focus

Go Digital

Internet of Things

Virtualization

Enterprise Mobility & Cloud

Technology Focus

Hybrid Model

Envisioned Test Roles

Creative Test Engineers

Test ScientistsDataSecurity Performance

Analytics Specialists

Chief Quality Officer

Digital Assurance Specialist

The Importance of Test Automation in Agile

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 8

Why Agile?

Early Revenue

Speed to Market

Better Quality

More Visibility

Risk Management

High Flexibility

Cost Control

Client Involvement

Right Product

More Enjoyable!

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 9

Importance of Test Automation in Agile

Reusability of Test Cases

Faster Time to Market

Reduction in cost of Defects

Test in pieces rather than the whole product

Early Defect Detection

Faster release of new features to business users

Rapid test coverage

Continuous Integration and Continuous Deployment

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 10

Test Automation - Agile Test Quadrants

Functional TestingStory TestsPrototypesSimulations

Supp

ortin

g th

e te

am Critique Product

Business Facing

Technology Facing

Q1

Q2 Q3

Q4

Automated &Manual

Manual

Automated Tools Automated

Exploratory TestingScenario Based TestingUsability TestingUser Acceptance TestingAlpha/Beta

Performance & Load TestingSecurity Testing‘*ility’ testing

Unit testsAPI testsWeb Services testingComponent Tests

Source: Lisa Crispin, Brian Marick

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 11

Agile Automation Process Workflow

Write Acceptance Test Cases

Decision to Automate Test

Define Acceptance Test Criteria

Yes

Prototype Rinse & Refine Integrate Testing

Iterative design

Design/Update proto types for the Business

Components at UI and API level

Develop/Update the code, User Interface

controls and Unit test cases

Unit testing, integration testing and

do bug fixes

No

User Story

Perform Manual Testing

Coordinate each other for developing Automation suite

Execute API level automation scripts on

continuous integration

environment till Acceptance criteria

is met

Execute end-to-end automation scripts on

developed UI

Design Pseudo codes/Classes for API

Level Automation

Build API Level automation scripts with negative and

positive scenarios

Execute API level automation scripts on every

component of developed code

Design Keywords for UI Level automation

Build automation scripts using Keywords for UI Level

automation

Capture UI Objects properties and integrate

with UI automation scripts

API Level Automation Testing

UI Level Automation Testing

Application Code Development

Perform goal based Exploratory testing

Adopt Hybrid Risk Based Testing for Test

optimization

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 12

Test Automation Trends

API / Mid Tier / Non GUI

AutomationService/ Server Virtualization

Automation in Agile

EnvironmentAutomation in DevOPS

Automation in Cross Platform/

Technology

Micro Services

Selenium + Open Source tools

Automation in BDD/ TDD

Test Automation using Cloud

Platform

Mobile Automation

Agile Practices and Internet of Things are influencing the

shift from GUI to API Testing

Virtualization and automation testing will be managed by policies at a business-

service level, requiring all the groups in an organization to work in harmony

Organizations gradually embrace Agile practices with CI/ CD

framework to reduce time to market and gain the competitive edge

Allows developers, quality assurance and operations to meet customer

needs through Automation

Small, extremely focused services will can be individually tested through

automation and integrated to form a robust application

More and more organizations are embracing open-source test

automation tools that are widely used across the globe

Will lead to closer collaboration between developers & testers

enabling shift left of testing

Automate Application across a variety of browsers/devices/OS in

the cloud to reduce time-to-market, increase release velocity

without sacrificing quality

Almost 35% of mobile app engagements last less than a minute, hence require more focus on Mobile

test Automation for better consistency and user experience

With the rise of IoT, the year 2016 will have more focus to validate cross-device/platform and cross-

technology functionalities

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 13

Rise of Open-Source and Low-cost tools

1994 1997 2003 2006 2009

Journey of Test Automation Tools

SQA Robot

Segue QAPartner

Mercury WinRunner

Rational Robot

Segue QAPartnerCompuware QARun

Mercury WinRunner

IBM Rational Robot

Borland Segue QAPartnerCompuware QARunMicrosoft Visual Studio

Mercury WinRunnerHP QTP

IBM Rational Robot

Borland Segue QAPartnerCompuware QARunMicrosoft Visual Studio

HP WinRunner

IBM Rational Robot

Microfocus BorlandCompuware QARunMicrosoft Visual Studio

HP WinRunnerHP QTP HP QTP

Evolution of Frameworks

New Age Tools

Unit Testing Frameworks:

Cloud Services TestingGridlasticCloudBeesMailosaurSauce LabsTestingBot

Web Testing:SeleniumWatirRanorexSoap UISahi

GUI Testing:RanorexTest CompleteeggplantTest Studio

HybridBPTTDD

Automated Unit Testing GUI Testing API Driven Testing Continuous Testing

API Testing:HPUFTParasoftvRest Postman

JunitTestNG

FrisbyChakramDjango

TRENDS2009 - 2016

NunitXUnitPyUnit

API Testing Frameworks:

Growing Popularity of Selenium

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 15

Selenium vs Top Commercial Tools – Jobs and Interest

Source: Indeed Job Trends Source: Google Trends

Selenium clearly has far higher adoption and interest than any other Commercial Test Tool

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 16

Why Selenium?

» Capability to operate on almost every Operating System (OS)

» Supports multiple languages such as Python, Perl, Ruby,

PHP, .NET, and Java…

» Supports multiple browsers – Opera, Safari, Chrome, IE 6, 7, 8…

and Mozilla Firefox

» Cost effective, being an open source tool

» Has an active developer community for support

» Supports parallel test execution on various browsers across

various devices

» Easy to use development interface

» Provides scalability and sustainability in the long term

Challenges in Migration and the Options

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 18

Challenges in Migration

What do I do with my existing test scripts, libraries & reusable functions?

How do I handle the additional efforts to rewrite the scripts?

How do I manage the additional cost to develop everything from the scratch?

How do I make sure that all the test assets are migrated without any errors?

What about my tool investment cost?

Does the new automation tool integrate with the life cycle tools that I already have?

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 19

What are my Options?

Continue with the existing test automation tool and use Selenium for all the future automation activities

Manually migrate all the existing test scripts, libraries and reusable functions to Selenium

Use an automated tool which migrates all the test assets to Selenium with minimum manual intervention

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 20

Migration Approach

Manual Migration

Automated Migration with Tool

15 times faster and 10 times cost effective compared to manual migration

» Impact on business due to downtime issues

» Lack of training and knowledge for performing the migration

» Huge time involved in migration

» Migration Cost Intricacies

» Retaining the automation coverage

» The entire migration process is accelerated, creating standardized test assets

» Reduced Time, Cost and Efforts

» Needs minimal knowledge transition and less management oversight

» Business remains as usual even while migrationManual migration to Selenium could be quite costly and time consuming.

Some of the major challenges are:

Supports migration from any platform to

Selenium

Migrate2Selenium

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 22

Migrate 2 Selenium - World’s First Selenium Migration tool

Accelerated Selenium Migration

Supports multiple language translation

Language Support

Supports multiple Web browsers

and versions

Application Support

Migrates entire test suites that reside in Quality Center/ALM

Test Management Integration

Migrates all types of object repository models

Object Repository Style

Descriptive Programming

Shared ObjectPer Action

Supports heterogeneous data sources (Excel & DB)

Data Sources

Supports diverse automation frameworks

Design Patterns

Functional decomposition

Keyword driven

Data driven

Migrate 2 Selenium

by Gallop Solutions

converts scripts to

Selenium (Designed

for Agile & DevOps)

World’s FirstSelenium

Migration tool

1

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 23

Script Migration Framework

SourceAutomation Suite

Scripts (Actions)

Environment Variables

Object Repositories

Checkpoints

Data Tables/Excel

Application Library

Built-in Functions

Utility Libraries

Profiler Parser

XML Import/Export

Translator Assembler Validator Logger

Solution

Scripts (Class Files)

Assertions (Class Flies)

Environment Variables

Object Repository

Data Provider

Application Functions (Class Files)

Utility Library (Class Files)

Source Map Files

Target Map Files

Rules

Launch Translator Load OR

Set Parent/Child

Hierarchy

Load Script Files

Convert Script Files Assemble Files Validate

Project

Detailed Log File

Automation Suite

Sample Screenshots

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 25

Migrate 2 Selenium – Application Navigation

a) Launch Screen b) Home Screen

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 26

Migrate 2 Selenium – Application Navigation

c) Select the Java Files d) Select UFT Files

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 27

e) Select Target folder f) Select Target Language & Framework

Migrate 2 Selenium – Application Navigation

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 28

g) Selection Summary h) Analysis Report

Migrate 2 Selenium – Application Navigation

Q & A

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 30

Test Tools Mind Map

Team Management

Tools

Service Virtualization

TDDCloud

Solutions

Continuous Integration

Unit Testing

Code Coverage

Mobile

UI Automation

Thank You

www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 33

Contact Information

630 Freedom Business Center3rd Floor King of Prussia, PA 19406

39899 Balentine Drive, Suite 200Newark, CA 94560

E-Mail : [email protected] : http://www.gallop.net

"The V" Ascendas, Orion Block1st FloorHyderabad- TG 500081