powerpoint presentation - idv€¦ · ppt file · web viewranorex soap ui sahi gui testing:...
TRANSCRIPT
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 2
Agenda
» The Evolution of Testing
» Importance of Test Automation in Agile
» Rise of Open-Source and Low-cost tools
» Growing Popularity of Selenium
» Challenges in Migration and the Options
» Migrate2Selenium
» Q & A
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 4
Testing with Defined Process
80%
Phased with SDLC
Traditional Manual Testing
Uncover Defects
Test
Simple web ApplicationsStand alone Applications
It was all done by developers
In-house Testing Team
In-house Test Centres
Testing with Enhanced Maturity
SITUAT
Matured Process
CIT
Multi-tier integrated
Applications
Evolution of Testing Early Days Test Automation
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 5
Next Level of Automation with Diversified Tools
Testing Managed Centres
Specialized Centres of Excellence Federated CoEs
Performance Testing & Tuning
Cross Technology integrated Complex
Applications
$
Automation
UI
Service/ APIApplication
Security
Agile Driven Test Engineering
Diversified Complex Applications
Mobility, Digital
QE Transformation with Continuous Delivery
QE, Agile
CI & CDDevOpsPerformanceSecurity
Transformation Era
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 6
Tomorrow's World
Trend Forecast
Aggressive Functional Engineering
Building SMART Automation Platforms
AI Enablement
Hybrid Security Enabled Performance Engineering
Testing Focus
Go Digital
Internet of Things
Virtualization
Enterprise Mobility & Cloud
Technology Focus
Hybrid Model
Envisioned Test Roles
Creative Test Engineers
Test ScientistsDataSecurity Performance
Analytics Specialists
Chief Quality Officer
Digital Assurance Specialist
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 8
Why Agile?
Early Revenue
Speed to Market
Better Quality
More Visibility
Risk Management
High Flexibility
Cost Control
Client Involvement
Right Product
More Enjoyable!
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 9
Importance of Test Automation in Agile
Reusability of Test Cases
Faster Time to Market
Reduction in cost of Defects
Test in pieces rather than the whole product
Early Defect Detection
Faster release of new features to business users
Rapid test coverage
Continuous Integration and Continuous Deployment
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 10
Test Automation - Agile Test Quadrants
Functional TestingStory TestsPrototypesSimulations
Supp
ortin
g th
e te
am Critique Product
Business Facing
Technology Facing
Q1
Q2 Q3
Q4
Automated &Manual
Manual
Automated Tools Automated
Exploratory TestingScenario Based TestingUsability TestingUser Acceptance TestingAlpha/Beta
Performance & Load TestingSecurity Testing‘*ility’ testing
Unit testsAPI testsWeb Services testingComponent Tests
Source: Lisa Crispin, Brian Marick
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 11
Agile Automation Process Workflow
Write Acceptance Test Cases
Decision to Automate Test
Define Acceptance Test Criteria
Yes
Prototype Rinse & Refine Integrate Testing
Iterative design
Design/Update proto types for the Business
Components at UI and API level
Develop/Update the code, User Interface
controls and Unit test cases
Unit testing, integration testing and
do bug fixes
No
User Story
Perform Manual Testing
Coordinate each other for developing Automation suite
Execute API level automation scripts on
continuous integration
environment till Acceptance criteria
is met
Execute end-to-end automation scripts on
developed UI
Design Pseudo codes/Classes for API
Level Automation
Build API Level automation scripts with negative and
positive scenarios
Execute API level automation scripts on every
component of developed code
Design Keywords for UI Level automation
Build automation scripts using Keywords for UI Level
automation
Capture UI Objects properties and integrate
with UI automation scripts
API Level Automation Testing
UI Level Automation Testing
Application Code Development
Perform goal based Exploratory testing
Adopt Hybrid Risk Based Testing for Test
optimization
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 12
Test Automation Trends
API / Mid Tier / Non GUI
AutomationService/ Server Virtualization
Automation in Agile
EnvironmentAutomation in DevOPS
Automation in Cross Platform/
Technology
Micro Services
Selenium + Open Source tools
Automation in BDD/ TDD
Test Automation using Cloud
Platform
Mobile Automation
Agile Practices and Internet of Things are influencing the
shift from GUI to API Testing
Virtualization and automation testing will be managed by policies at a business-
service level, requiring all the groups in an organization to work in harmony
Organizations gradually embrace Agile practices with CI/ CD
framework to reduce time to market and gain the competitive edge
Allows developers, quality assurance and operations to meet customer
needs through Automation
Small, extremely focused services will can be individually tested through
automation and integrated to form a robust application
More and more organizations are embracing open-source test
automation tools that are widely used across the globe
Will lead to closer collaboration between developers & testers
enabling shift left of testing
Automate Application across a variety of browsers/devices/OS in
the cloud to reduce time-to-market, increase release velocity
without sacrificing quality
Almost 35% of mobile app engagements last less than a minute, hence require more focus on Mobile
test Automation for better consistency and user experience
With the rise of IoT, the year 2016 will have more focus to validate cross-device/platform and cross-
technology functionalities
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 13
Rise of Open-Source and Low-cost tools
1994 1997 2003 2006 2009
Journey of Test Automation Tools
SQA Robot
Segue QAPartner
Mercury WinRunner
Rational Robot
Segue QAPartnerCompuware QARun
Mercury WinRunner
IBM Rational Robot
Borland Segue QAPartnerCompuware QARunMicrosoft Visual Studio
Mercury WinRunnerHP QTP
IBM Rational Robot
Borland Segue QAPartnerCompuware QARunMicrosoft Visual Studio
HP WinRunner
IBM Rational Robot
Microfocus BorlandCompuware QARunMicrosoft Visual Studio
HP WinRunnerHP QTP HP QTP
Evolution of Frameworks
New Age Tools
Unit Testing Frameworks:
Cloud Services TestingGridlasticCloudBeesMailosaurSauce LabsTestingBot
Web Testing:SeleniumWatirRanorexSoap UISahi
GUI Testing:RanorexTest CompleteeggplantTest Studio
HybridBPTTDD
Automated Unit Testing GUI Testing API Driven Testing Continuous Testing
API Testing:HPUFTParasoftvRest Postman
JunitTestNG
FrisbyChakramDjango
TRENDS2009 - 2016
NunitXUnitPyUnit
API Testing Frameworks:
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 15
Selenium vs Top Commercial Tools – Jobs and Interest
Source: Indeed Job Trends Source: Google Trends
Selenium clearly has far higher adoption and interest than any other Commercial Test Tool
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 16
Why Selenium?
» Capability to operate on almost every Operating System (OS)
» Supports multiple languages such as Python, Perl, Ruby,
PHP, .NET, and Java…
» Supports multiple browsers – Opera, Safari, Chrome, IE 6, 7, 8…
and Mozilla Firefox
» Cost effective, being an open source tool
» Has an active developer community for support
» Supports parallel test execution on various browsers across
various devices
» Easy to use development interface
» Provides scalability and sustainability in the long term
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 18
Challenges in Migration
What do I do with my existing test scripts, libraries & reusable functions?
How do I handle the additional efforts to rewrite the scripts?
How do I manage the additional cost to develop everything from the scratch?
How do I make sure that all the test assets are migrated without any errors?
What about my tool investment cost?
Does the new automation tool integrate with the life cycle tools that I already have?
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 19
What are my Options?
Continue with the existing test automation tool and use Selenium for all the future automation activities
Manually migrate all the existing test scripts, libraries and reusable functions to Selenium
Use an automated tool which migrates all the test assets to Selenium with minimum manual intervention
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 20
Migration Approach
Manual Migration
Automated Migration with Tool
15 times faster and 10 times cost effective compared to manual migration
» Impact on business due to downtime issues
» Lack of training and knowledge for performing the migration
» Huge time involved in migration
» Migration Cost Intricacies
» Retaining the automation coverage
» The entire migration process is accelerated, creating standardized test assets
» Reduced Time, Cost and Efforts
» Needs minimal knowledge transition and less management oversight
» Business remains as usual even while migrationManual migration to Selenium could be quite costly and time consuming.
Some of the major challenges are:
Supports migration from any platform to
Selenium
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 22
Migrate 2 Selenium - World’s First Selenium Migration tool
Accelerated Selenium Migration
Supports multiple language translation
Language Support
Supports multiple Web browsers
and versions
Application Support
Migrates entire test suites that reside in Quality Center/ALM
Test Management Integration
Migrates all types of object repository models
Object Repository Style
Descriptive Programming
Shared ObjectPer Action
Supports heterogeneous data sources (Excel & DB)
Data Sources
Supports diverse automation frameworks
Design Patterns
Functional decomposition
Keyword driven
Data driven
Migrate 2 Selenium
by Gallop Solutions
converts scripts to
Selenium (Designed
for Agile & DevOps)
World’s FirstSelenium
Migration tool
1
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 23
Script Migration Framework
SourceAutomation Suite
Scripts (Actions)
Environment Variables
Object Repositories
Checkpoints
Data Tables/Excel
Application Library
Built-in Functions
Utility Libraries
Profiler Parser
XML Import/Export
Translator Assembler Validator Logger
Solution
Scripts (Class Files)
Assertions (Class Flies)
Environment Variables
Object Repository
Data Provider
Application Functions (Class Files)
Utility Library (Class Files)
Source Map Files
Target Map Files
Rules
Launch Translator Load OR
Set Parent/Child
Hierarchy
Load Script Files
Convert Script Files Assemble Files Validate
Project
Detailed Log File
Automation Suite
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 25
Migrate 2 Selenium – Application Navigation
a) Launch Screen b) Home Screen
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 26
Migrate 2 Selenium – Application Navigation
c) Select the Java Files d) Select UFT Files
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 27
e) Select Target folder f) Select Target Language & Framework
Migrate 2 Selenium – Application Navigation
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 28
g) Selection Summary h) Analysis Report
Migrate 2 Selenium – Application Navigation
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 30
Test Tools Mind Map
Team Management
Tools
Service Virtualization
TDDCloud
Solutions
Continuous Integration
Unit Testing
Code Coverage
Mobile
UI Automation
www.gallop.net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 33
Contact Information
630 Freedom Business Center3rd Floor King of Prussia, PA 19406
39899 Balentine Drive, Suite 200Newark, CA 94560
E-Mail : [email protected] : http://www.gallop.net
"The V" Ascendas, Orion Block1st FloorHyderabad- TG 500081