continuous testing of ecommerce apps

Continuous Testing of eCommerce Apps

Continuous Testing of eCommerce AppseureQa and Sauce Labs WebinarSeptember 7, 2016

Co-Founder and CEO eureQa, LLC20+ years experience in building, testing and managing Web application projects across multiple industries

[email protected]@sayeureqaSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Changes in an eCommerce siteConstructionPhaseOperationsPhaseRate of ChangeNew Features & WorkflowsUI/CSSIntegration with external systems

Involves Code Changes

Catalog (Product SKU) UpdatesInventory StatusPricingPromotions & Discounts

Involves Data & Rules Changes

September 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Changes in an eCommerce siteNew Features & WorkflowsUI/CSSIntegration with external systems

Involves Code Changes

Catalog (Product SKU) UpdatesInventory StatusPricingPromotions & Discounts

Involves Data, Content & Rules Changes

Both types of changes require different Testing StrategiesSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Testing Code Changes


Testing Code ChangesNew Features & WorkflowsBuild new tests as you goHigh level of reuse across Test Cases/ScenariosScope of TestTest Solutions must be able toSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Planning for Script ReuseCopyright 2016 eureQa, LLC All Rights ReservedManual Test CaseStep 1Step 2Step 3Step 8Step 9BDD ScenarioStatement 1Statement 2Statement 3Statement 8Statement 9GIVENTHENWHENANDANDSeptember 7, 2016

SCRIPT LIBRARYPlanning for Script ReuseCopyright 2016 eureQa, LLC All Rights ReservedTest CaseTest Script 1Test Script 2Test Script 5Test Script 6Test Script 7Step 1Step 2Step 3Step 8Step 9Test ScenarioTest Script bTest Script aTest Script cTest Script xTest Script yTest CaseStep aStep bStep cStep fStep gTest CaseStep aStep bStep cStep fStep gTest ScenarioSeptember 7, 2016

Testing Code ChangesNew Features & WorkflowsBuild new tests as you goHigh level of reuse across Test Cases/ScenariosHandle CSS/UI changes without breaking scriptsTests must be elastic to layout changesCross Browser & Cross Device TestingUI/CSSScope of TestTest Solutions must be able toSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Demo 1: Testing Code ChangesTest Case/ScenarioSearch for a BookSearch for product by KEYWORD and select from result listVerify product ATTRIBUTESAdd selected product to the cartVerify QUANTITY OF ITEMS in CartDelete All items from CartHandling UI/CSS ChangesSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Testing Code ChangesNew Features & WorkflowsBuild new tests as you goHigh level of reuse across Test Cases/ScenariosHandle CSS/UI changes without breaking scriptsTests must be elastic to layout changesCross Browser & Cross Device TestingUI/CSSTrigger automatic execution of testsIntegrate tests with external systems toPull/Push dataTrigger actionsGet Results of TestsIntegration with external systemsScope of TestTest Solutions must be able toSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Demo 2: REST API for IntegrationeureQa REST API SupportStart a testOptionally include test data & Meta DataCheck on Status of test executionGet Results Summary for one or more testsDownload Assets: screenshots, videos, logs etc.Stop/Abort a testJenkins Integration DemoTrigger tests after build & deploymentSend build #Get results summary in JUnit formatDisplay results on Jenkins dashboardSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Testing Data Changes


Testing Data ChangesCatalog (Product SKU) ChangesRun Test for a large set/variety of SKUsCheck product attributes shown on site against Catalog dataMulti-Language, Currency & LocalizationScope of TestTest Solutions must be able toCollect Test Data in a Data FileParameterize Test Scripts to read Test DataRun the Test Scenario for all records in the Data File

Demo 3: Testing Data ChangesSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Testing Data ChangesCatalog (Product SKU) ChangesRun Test for a large set/variety of SKUsCheck product attributes shown on site against Catalog dataMulti-Language, Currency & Localization

Scope of TestTest Solutions must be able toPricingCheck pricing for specific SKUsCheck prices for all SKUs in a very short period of timeDemo 4: Using a sub-set of Test DataDefine Filter CriteriaManual or Automated Filters


Testing Data ChangesCatalog (Product SKU) ChangesRun Test for a large set/variety of SKUsCheck product attributes shown on site against Catalog dataMulti-Language, Currency & Localization

Use real-time inventory (stock status) in test dataGet data feeds or look up databasesClean up test data in database after test executionInventory UpdatesScope of TestTest Solutions must be able toPricingCheck pricing for specific SKUsCheck prices for all SKUs in a very short period of timeDemo 5: Get Test Data from databaseSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Other Common Test Scenarios


Promotions & DiscountsCreate Promotion/ DiscountCreate new rules/ configurationsSKUsUser ProfileUsage PatternTimeLocationGenerate Promotion CodeTrigger Use of Promotion/ DiscountVerify App/Site responseSimulate User ProfileSimulate Usage patternInput promo code Was the code acceptedWere the correct discounts appliedDont forget negative testsSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Promotions & DiscountsCreate Promotion/ DiscountCreate new rules/ configurationsSKUsUser ProfileUsage PatternTimeLocationGenerate Promotion CodeTrigger Use of Promotion/ DiscountVerify App/Site responseSimulate User ProfileSimulate Usage patternInput promo code Was the code acceptedWere the correct discounts appliedDont forget negative testsPromo CodeRun the three steps in a single sequence to test WorkflowTest for different promos & discounts with appropriate Test DataSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights ReservedSend from UI, DB or REST API

B2B Specific ScenariosPartner/Customer specific CatalogsDifferent views of Catalog - Same product, different SKU# or nameLimiting access to specific SKUs in catalogContractsSpecial PricingDiscounts/ RebatesApprovalsMulti-Party TransactionsOrder from manufacturer (Special pricing/ contracts etc.)Shipment from DistributorReconcile transactions between multiple partiesStrong Test Data Management and high level of script are a MUST HAVE to build and effective testing solution for B2B eCommerce September 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

Testing High VolumesRun a simple test (price check) for large data sets (entire product catalog)Read data(in files or db) for hundreds of thousands of SKUsPartition data into smaller setsRun tests in parallel (tens or hundreds) to reduce elapsed test timeCollate ResultsEliminate common problems that lead to increased cart abandonmentIncorrect PricesWrong Content (image etc.) on Product pageSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

In ConclusionTesting eCommerce apps/sites does not stop once the site goes liveContinuous testing is critical to Identify errors in Content, Data and RulesReduce revenue loss due to site quality issuesContinuous testing for eCommerce mustTest all user workflowsIncorporate strong Test Data Sourcing & Management Support on-demand and parallel test executionInclude cross-browser and cross-device testingSeptember 7, 2016Copyright 2016 eureQa, LLC All Rights Reserved

http://www.sayeureqa.comFor more information & to Sign up for a Personal TourCopyright 2016 eureQa, LLC All Rights ReservedSeptember 7, 2016

23

Copyright 2016 eureQa, LLC All Rights ReservedSeptember 7, 2016

continuous testing of ecommerce apps

Technology