agile testing experiment in bis

Upload: leoncioflores

Post on 30-May-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/14/2019 Agile Testing Experiment in BIS

    1/23

    Infor Confidential Copyright 2001-2008 Infor Global Solutions

    Agile Testing Experiment in BIS

  • 8/14/2019 Agile Testing Experiment in BIS

    2/23

    2

    Quick Background Info

    About BIS

    About Automated Testing of BIS

    Lets Start With Whats Agile?

  • 8/14/2019 Agile Testing Experiment in BIS

    3/23

    3 Copyright 2001-2006 Infor Global Solutions

    Agile Means

    Kill Waste

  • 8/14/2019 Agile Testing Experiment in BIS

    4/23

    4 Copyright 2001-2006 Infor Global Solutions

    Whatre Wastes?

    Too MuchToo Early

    Too Little

    Too Late

    Duplicate

  • 8/14/2019 Agile Testing Experiment in BIS

    5/23

    5 Copyright 2001-2006 Infor Global Solutions

    Previously

    Duplicate

    Too Late/Little

  • 8/14/2019 Agile Testing Experiment in BIS

    6/23

    6 Copyright 2001-2006 Infor Global Solutions

    Can You Imagine

    Iteration N

    RELEASE By Every Iteration

  • 8/14/2019 Agile Testing Experiment in BIS

    7/23

    7

    How BIS Does

    IMMEDIATE Scripting

    +

    Keep Scripts ALIVE

  • 8/14/2019 Agile Testing Experiment in BIS

    8/23

    8

    IMMEDIATE Scripting

    Benefit:

    RICHER Done: Both Production Code And Testing Suite

  • 8/14/2019 Agile Testing Experiment in BIS

    9/23

    9

    IMMEDIATE Scripting

    Challenges

    Habits Change: Script Without Test Case Doc

    Much More Time Cost Than Writing Case

    Start Scripting Before Features Done

    Technical Steps/Verifications

    Solution: EASY Scripting

  • 8/14/2019 Agile Testing Experiment in BIS

    10/23

    10

    IMMEDIATE Scripting: EASY Scripting (1)

    Easy DSL Wrapper

    Scripting LIKE Writing Test Case

    Low Level Scripting

    (BIS Testing) Domain Specific Language

  • 8/14/2019 Agile Testing Experiment in BIS

    11/23

    11

    IMMEDIATE Scripting: EASY Scripting (2)

    Easy PRECONDITION FacilityData Driven Without Script

    Standard Template

    Automatic Setup and Teardown

    Ensure Independence of Script No Supposition Before Execution No Pollution After Execution

  • 8/14/2019 Agile Testing Experiment in BIS

    12/23

    12 Copyright 2001-2006 Infor Global Solutions

    IMMEDIATE Scripting: EASY Scripting (3)

    Easy DEVELOPERS Support Build Agile Testing Infrastructure

    Implement UI First in Use Case

    Construction

    Provide Technical Wrapper Methods

    Review Script Demo

  • 8/14/2019 Agile Testing Experiment in BIS

    13/23

    13 Copyright 2001-2006 Infor Global Solutions

    Behind IMMEDIATE Scripting: BIS AT Framework

  • 8/14/2019 Agile Testing Experiment in BIS

    14/23

    14 Copyright 2001-2006 Infor Global Solutions

    Take a Break. 10 Slides Left.

    Coming Next:Keep Scripts ALIVE

  • 8/14/2019 Agile Testing Experiment in BIS

    15/23

    15

    Keep Scripts ALIVE

    Benefit:

    More RELIABLE Done: Not Only Verify New Features,

    But Also Ensure Old Ones Unbroken

    REGRESSION Everyday

  • 8/14/2019 Agile Testing Experiment in BIS

    16/23

    16

    Keep Scripts ALIVE

    Challenges

    Complexity In Running Bulk Scripts

    Large Effort of Result Analysis

    Adapt To Current Development Process

    Solution:CQC(Continuous Quality Checking)

  • 8/14/2019 Agile Testing Experiment in BIS

    17/23

    17

    Keep Scripts ALIVE: CQC Server

    The (N+1)th Tester

    BIS

    Fully Automatic

    Customized Process

    Smart Reporting

  • 8/14/2019 Agile Testing Experiment in BIS

    18/23

    18 Copyright 2001-2006 Infor Global Solutions

    Keep Scripts ALIVE:CQC Process

  • 8/14/2019 Agile Testing Experiment in BIS

    19/23

    19

    Keep Scripts ALIVE: CQC Driven Development

  • 8/14/2019 Agile Testing Experiment in BIS

    20/23

    20

    Thats All?

    People s Improvement

    IMMEDIATE Scripting+

    Keep Scripts ALIVE

    +

    ?

  • 8/14/2019 Agile Testing Experiment in BIS

    21/23

    21

    Peoples Improvement

    Whens the Best Time To Start Automating?

    Can We Really Trust Automated Test?

    Is Finishing Script On Time As Important As

    Finishing Feature Construction?

    Mind Change

    Better Planning

    New Feature First And Bug Fixing Second?

    Is Testing Just Testers Work?

  • 8/14/2019 Agile Testing Experiment in BIS

    22/23

    22

    In the Future, or Soon

    Better DSL With Groovy

    Distributed CQC

    Easier Bug Reporting/Reproducing With CQC

    Scripting For Bug

  • 8/14/2019 Agile Testing Experiment in BIS

    23/23

    23

    Thanks