matrix - maximizing automated testing for retail industry excellence

MATRIX Maximizing Automated Testing for Retail Industry eXcellence

US | UK | BENELUX | ME | INDIA ©1996-2016 Aspire Systems, Inc.

US | UK | BENELUX | ME | IND ©1996-2015 Aspire Systems, Inc.

About Aspire

Global technology services firm with core DNA of software engineering

Specific areas of expertise around Software Engineering, Enterprise

Solutions, Digital Business, Testing and Infrastructure & Application Support

Vertical focus among Independent Software Vendors and Retail, Distribution &

Consumer Products

1600+ employees; 100+ active customers

ISO 9001:2008 and ISO 27001 : 2005 certified

Presence across US, UK, Benelux, Middle East and India

Recognized seven consecutive times as “Best Place to Work for” by GPW Institute

US | UK | BENELUX | ME | INDIA ©1996-2016 Aspire Systems, Inc.

US | UK | BENELUX | ME | IND ©1996-2015 Aspire Systems, Inc. US | UK | BENELUX | ME | INDIA ©1996-2016 Aspire Systems, Inc.

Testing Services Overview

Test Automation

Continuous Automation

Continuous Delivery

Behavior Driven

Development

Acceptance Test Driven

Development

Performance Automation

Lean/Agile Software

Engineering

Testing Solutions In a

Box (TSiB)

Functional Testing

Non Functional

Testing

Security Testing

Test Consulting

Compatibility Testing

Globalization Testing

Next Gen Offerings

Social Integration

Testing

Mobile Testing

Internet of Things Testing

Digital Assurance

SOA Testing & Service

Virtualization

Big Data & Analytics Testing

Testing Solutions In a Box (TSiB)

Cost of Quality

SLA based

Governance

Centralized

Testing

Continuous

Improvement

Test Automation

Accelerators

Frameworks

Center of

Excellence

Innovation Lab


Top eCommerce Testing Challenges and Our Solution


Time to Market Brisk change in functionality and content leads to frequent builds which in turn demands frequent regression testing. Ongoing pressure to hit the market on time with the product enhancements

Browser Compatibility Multiple Browser and Platforms leads to compatibility testing challenge on various Browser and Versions

Multi Device and OS Version To ensure seamless user experience, quality assurance is required on both web and native applications, which results into increased complexity due to multiple Device – OS combinations

Collaboration Issue Involvement of all stakeholders in discussing business use cases is crucial. It becomes a challenge for business people to understand the technical language of development & testing teams. As a result gap in understanding develops and it becomes a challenge for all the stakeholders to stay on the same page.

Easy Maintenance, Flexible Design Our best-in-class framework supports frequent functionality changes as it allows easy and quick script modifications. This enables short test regression cycles hence reduced time to market.

Fully Integrated Cross Browser testing Support Our framework supports multi-browser & multi-threaded execution for various browsers and multiple versions. Hence, reducing the complexities related to cross browser testing

Mobile Testing Support Aspire’s robust automation framework allows to utilize the desktop browser scripts across mobile web and native applications with minimal tweaking. Hence, reducing redundancy and increasing efficiency

Simplicity of Scripting using B`DD approach English language test cases can be re-used as automation test-case scripts. All stakeholders (technical & non-technical) can understand the test cases, review and can give feedback. Helps resolving the collaboration issue to a great extent

Business Challenges Solution through Test Automation

High Cost of Quality Ensuring quality of the products within tight timeline leaves little option but to invest more in testing in the eleventh hour; hence increasing the cost of quality.

Minimize Testing Cost With our tailored solution, we minimize the cost through

automation and maximizing the resource utilization.


MATRIX Framework Design – eCommerce Solution

Feature Files

Test Data

Utilities

Page Objects

Test Execution Reports

Reusable eCommerce Methods

Page Object Model

Data Access Layer

Mobile Support (Appium)

Rake (Parallel Execution)

Test Execution Reports

Browser & Mobile Device Support


POS Testing Challenges and Our Solution

Time to Market Brisk change in functionality and content leads to frequent builds which in turn demands frequent regression testing. Ongoing pressure to hit the market on time with the product enhancements

Testing on Multiple Platforms To ensure seamless POS experience, quality assurance is required on both Desktop and native applications, which results into increased complexity due to multiple Device – OS combinations

Different Configuration Settings Testing effort is required to test various workflows for different configuration settings in the POS Application

Backend system Verification POS Testing requires to verify Journal report once after the every / set of transaction and perform manual calculations to tally the values in the Reports which may result in effort and human error

Easy Maintenance & Flexible design Our best-in-class framework supports frequent functionality changes as it allows easy and quick script modifications. This enables short test regression cycles hence reduced time to market

Mobile Testing Support Aspire’s robust automation framework allows to utilize the desktop POS scripts across mobile native applications with minimal tweaking. Hence, reducing redundancy and increasing efficiency

Frequent Configuration changes Testing The framework provides the flexibility to execute the test scripts for multiple configuration settings. The change in settings can be controlled by the user and accordingly various configuration workflows can be tested effectively

Journal Verification & Calculation Solution The Automation scripts perform the required calculations after every transaction and verifies the backend details which helps out to avoid human calculation errors & efforts

Manual Testing Challenges Solution through Test Automation


MATRIX Framework Design – POS Solution

Desktop & Mobile POS Support

Feature Files

Test data

Page Objects

Business Reusable

Test Reports & Custom Reports

Test Reports Deployment & Execution

Script Development

Test Scripts

Driver Script


Features of MATRIX

Technology

Scalability

Flexibility and Usability

Multi Test Data Execution for a Test Case

Low Complexity Framework with ease of scripting

Test Reports

Test Reports Customization Easy to interpret and delivered to stakeholders inbox after execution

3rd Party Integrations

Automation testing support for 3rd party eCommerce Tools – Taxation, Fraud Management, Loyalty, Customer Interaction Touchpoints

Integrated with Testlink (Test Management Tool) and Jenkins (Continuous Integration)

Integrated with SauceLabs/BrowserStack (Cloud based Platform for browsers and mobile devices)

Tool Stack (eCom) - Webdriver with Cucumber and Ruby in BDD Approach Tool Stack (POS) - Test Complete with Jscript Common Domain Language (Writing test case scripts in natural language in eCom framework)

Regression Testing support for multiple browsers/versions and multiple POS Configurations

Support for mobile devices - Web and Native App

Features


The world of eCommerce Testing

• Home Page

• Featured Products

• Special Offers

• Information Pages

• My Account

• Keyword Search

• Search Engine

Optimization

• Payment Methods

• Taxation validation

• Stores

• Shipping & Billing

Info

• Order Discount

• Order Placement

• Order Review &

Confirmation

• Product Display Page

• Quick View

• Wish List

• Product Reviews

• Social Sites

• Filter & Sort

• Payment Methods

• Taxation validation

• Wallet

• Stores

• Loyalty / Rewards

• Promotions

• Discounts

• Loyalty

• Product title

• Product description

• Product images

• Enlarge image

• 360 degree view of

products

• Product

information,

colours, sizes,

options, extras.

• Add to Bag

Main Pages Product Category

Page Product Search Shopping Bag Checkout & Payment Product Detail Page

Key Reusable Components of eCommerce sites

We have implemented 100+ generic methods to support all of the above eCommerce Website components. We plan to add more components in the next release.


The world of POS Testing

Returns / Exchange

Promotions / Discounts

• Lookup Merch product information

• View in-stock and on order inventory availability

• Lookup Non Merch product information

• Receiving / Transferring the

Products to different Location

• Performs Return Transactions with / Without Receipts

• Performs Exchange Transaction With / Without receipts

• Gathering Customer Information • Instant Credit card Enrollment &

Approvals • Applying Rewards / special

offers to the transaction • Points acquisition details based on

the Transaction

• Apply multiple types of Promotions to the Products.

• Applying Item / Transaction level discount

• Providing Associate Discount / Offers

• Performs different types of Reports like

- EOD Report - Sales Analysis Report - Data Analysis Report - Time Analysis Report - Discounts Report - Tender Report …… Etc.

Tenders Reports

Loyalty Members Product Details

• Providing different types of Tenders like

- Cash - Credit Cards - Debit Cards - Instant Credit - Gift Cards - Foreign Currency - Checks……. Etc. • Requesting for Charity donations (

Round-Up)


Thank You


Annexure


MATRIX Technology Stack

Tools & Technology

Better Stakeholder Collaboration

BDD Approach

Test Case scripting in natural language

Mobile Support (Web & Native)

iOS and Android Platforms Scalable to support Cloud Based Test Automation platform

Data Access Layer

Test data externalization

User’s control over test data

Test Reports

Easy to interpret test execution reports

ATA Framework

WebDriver with Cucumber,Ruby Rake, Appium, TestLink, Jenkins

Design Pattern-Page Object Model

Delivered to your Inbox

Multi browser and multi threaded execution

MATRIX


MATRIX Process Flow

Test Case Management

Failure Analysis

CLIENT 1

Local Copy

CLIENT 1

Local Copy

CLIENT N

Local Copy

DEVELOPMENT MACHINE

TA Script Development

Commit And Update

Polling

E-Commerce UAT Release

QA Team

Failure Analysis

Failure Analysis

Client 1 Smoke pack 1

Functional

Cloud Based

Platform

Browser Compatib

ility

Mobile Support

Regression Suite

Build and Trigger

Report Analysis

ON SUCCESS

Client 1 Smoke pack 2

Client 1 Smoke pack N