test automation - pathway for building and sustaining agile teams

www.unicomlearning.com

India Agile Week-2013 25th Oct 2013 - Bengaluru

Building and Sustaining Agile Teams Through Test Automation

Mahesh V G

Technical Manager

Mahindra Comviva

www.agileinbusiness.com

http://www.unicomlearning.com/

http://www.agileinbusiness.com/contest

http://www.agileinbusiness.com/



“Building and Sustaining Agile Teams”

Pathway for BEING AGILE

UNICOM Presents

India Agile Week-2013





www.unicomlearning.com Take Away - I

UNICOM Presents


Understand Context Of Operation

• Is there need for being Agile ?

• How agile (non-agile) are we today ?

• How do we measure progress ?






Our World

Understanding Context of Operations

UNICOM Presents


Consumers Business Needs Environment






Our Goals –

Engineering teams strived for…

UNICOM Presents


On Time Delivery Quality






Our Concerns –

Hangover lessons and sleepless nights…

UNICOM Presents


Delayed Deliveries Quality






Opportunity

UNICOM Presents


•Heterogeneous Software

•Heterogeneous Environments

•Legacy Products

•Conditioned Minds (Not my problem or it is

always done this way)

•Non productive labor

•Insecurity

•Unpredictable schedules

•Non-release mode

•Multiple Stakeholder

•Structural Complexities






Our Teams Agile Journey…

UNICOM Presents


How do we be Agile ?

Why be Agile ?

What’s Agile ?






Agile Manifesto – Value Driven

UNICOM Presents


Process and tools Individuals and

interactions over

Following a plan Responding to change over

Source: www.agilemanifesto.org

Comprehensive documentation

Working software over

Contract negotiation Customer collaboration over





www.unicomlearning.com Take Away - II

UNICOM Presents


Iterate Agile adoption incrementally

• Focus on key practices easy to adopt

• Review the outcome of adoption and adapt






Adopting Agile Methods and Practices…

UNICOM Presents


Source: Version One 7th Annual Agile Survey






Agile Methodologies – suitable for us

UNICOM Presents


Scrum

XP Kanban

MA

NA

GEM

ENT

TECHNICAL PRACTICES






First Scrum Team and its Journey

UNICOM Presents


Sprint # Planned

Scenarios Accomplished

Scenarios

First 500 110

Second 350 391

Third 250 245

Fourth 300 310

Total 1400 1056






Initial Perceptions….

UNICOM Presents







Being Agile – working with Legacy

Products

UNICOM Presents







Change is Hard – Automation as Escape Velocity

UNICOM Presents


Source: Robin Sharma’s EAF program





www.unicomlearning.com Take Away - III

UNICOM Presents


Measure Quality early– setup CI with metrics system

• How healthy is the code?

• How matured is the agile practice ?

• Adopt tools that help measure quality

• CI – jenkins

• Code Quality – Sonar/Findbugs/PMD





www.unicomlearning.com What to be measured ?

UNICOM Presents


Code Quality Complexity

Size of Product/Project

Cohesiveness

Coupling

Code Coverage

Code Smells

Automated tests





www.unicomlearning.com Automation - a step towards technical excellence

UNICOM Presents






www.unicomlearning.com Involve motivated individuals

UNICOM Presents







Legacy Code - Initial metrics

UNICOM Presents







Continuous Integration with Code Metrics

UNICOM Presents







Measuring Agility.. How did we progress ?

UNICOM Presents


Source: ThoughtWorks Agility Assessment results of our team





www.unicomlearning.com Take Away - IV

UNICOM Presents


Automate tests

• Automate user acceptance tests (UAT)

• Identify and adapt test tools

• Build re-usable frameworks






Where to Begin ?

UNICOM Presents







Software Testing – Quality to stake holders

UNICOM Presents


26

For Engineers To Customers

GUI and System Tests (Validation Group)

Functional Tests (Product Units)

Unit Tests (Product Units)

GUI Tests

(High Access and Visibility)

Functional Tests (Medium

Visibility)

Unit Tests (Low

Visibility)






Partner for Tools and Tailor

UNICOM Presents


• Getting out of DIY syndrome

• Go for lightweight tools and Adapt

• Cover Risks

• Win-Win Partner relationship






Tools Evaluation

UNICOM Presents


Feature Selenium Sahi OS (Open

Source) Sahi Pro QTP Jameleon

TestingAnywhere

Watir

Developed into Java Java Java .Net Java Java Ruby

Record and Play Only on Firefox All browsers All browsers Only on IE No Yes No

Playback Yes Yes Yes Yes Yes Yes Yes

Brower support All All All IE IE All All OS/Platform support All All All Windows Windows All All

Language Multiple Javascript, Java, Ruby

Javascript, Java, Ruby VB XML Java,.Net,C++ Ruby

Usability Easy Easy Easy Easy Easy Easy Easy Automation/Maintenance difficulty level Easy Easy Easy Easy Easy Easy Easy

Exception handling Yes

Yes. Has recovery feature & Call back function.

Yes. Has recovery feature & Call back function. Yes Yes Yes Yes

Parallel Testing Yes Yes Yes No No Yes Yes






Partnerships – make vs buy

UNICOM Presents







Web Test Automation - using sahi

UNICOM Presents







Subscriber Creation Call Flow

UNICOM Presents







Automation benefits

UNICOM Presents


Automation execution takes 76 minutes to create subscriber as compared to 2 Person days effort to create it manually






Success Stories.. Published

UNICOM Presents


Unit Solution Test Scenarios Manual

Execution

Automation

Execution

Savings

Unit-1 P1 1500 40.5 Person

Days

15 Hours 95%

Unit-2 P2 230 7 Person

Days

1 Hour 15

Minutes

97%


Days

40 Minutes 96%


Days

7 Minutes 99%

Unit-5 P5 25 1 Person Day 2 Minutes 99%






Functional Testing – ROBOT / RIDE / STAF-

STAX

UNICOM Presents







Functional Test Automation - using RIDE

UNICOM Presents






www.unicomlearning.com Take Away - V

UNICOM Presents


Care for clean code

• Practice TDD (Red Green Clean culture)

• Unit test for reusable modules

• Encourage constant refactoring during change requests/bug fixes






Adoption of TDD and Unit Testing - WIP

UNICOM Presents


Frameworks Used Junit Framework for Java check framework for C CppUnit/XppUnit for applications done in C++/PHP etc Practice Measuring code coverage Test Driven Development for new code written. Refactoring of legacy code – “Extract method” most widely used






Our Journey.. Cheetah way (Agile Hunter)

UNICOM Presents


Agility and rapid acceleration vs. Speed.

Course Corrections and adapting to context during journey

Source: New York Times






Recap - Key Take Away

UNICOM Presents


1. Understand Context Of Operation

• Is there need for being Agile ?

• How agile (non-agile) are we today ?

• How do we measure progress ?

2. Iterate Agile adoption incrementally

• Focus on key practices easy to adopt

• Review the outcome of adoption and adapt

3. Measure Quality early– setup CI with

metrics system

• How healthy is the code?

• How matured is the agile practice ?

• Adopt tools that help measure quality

4. Automate tests

• Automate user acceptance tests (UAT)

• Identify and adapt test tools

• Build re-usable frameworks

5. Care for clean code

• Practice TDD (Red Green Clean culture)

• Unit test for reusable modules

• Encourage constant refactoring during change requests/bug fixes






India Agile Week-2013 Organized by

UNICOM Trainings & Seminars Pvt. Ltd.

[email protected]

Mahesh V G

[email protected]

[email protected]


mailto:[email protected]

mailto:[email protected]




test automation - pathway for building and sustaining agile teams

Technology

agile adoption

agile working

agile methods

agile practice

teams agile journey

agile teams pathway

agile methodologies

agile manifesto value