agile testing in the real world - rbcs, inc€¦ · this webinar isn’t about that purist world,...

Agile Testing in the Real WorldMoving Beyond Theory to Achieve Practicality

[NEED PICTURE HERE]

Agile Testing in the Real World

There are lots of books, articles, and webinars about how great agile isHowever, those often describe purist approaches that adhere to the Agile ManifestoThis webinar isn’t about that purist world, but rather about what happens when agile theory meets the real worldIn the real world, companies are coming up with interesting and creative ways to adapt agile practicesThis creates various opportunities, challenges, risks, and benefits for testing and qualityIn this webinar, we examine those…


www.rbcs-us.com

Copyright (c) RBCS 2008-2016

What Does Agile Look Like?


www.rbcs-us.com


Agile Is the Opposite of What?


www.rbcs-us.com


Agile Test Tools

Good stuff, mostly freex-UnitJenkinsCucumberRubySeleniumFitnessePlus various static code analysis (e.g., Crap4J) and code coverage tools…

Not all is goodJira and Rally are not designed by or for testersOften used as bug and test management tools


www.rbcs-us.com


Agile Test Metrics

Tests completed

Risks addressed (in risk-based testing)

Bugs found, bugs fixed, and bugs remaining open (which can block user story “doneness”)

Some organizations don’t measure bugs during sprints (loss of visibility)

Velocity of sprint (user stories completed)

Number of lines of code added

Code coverage achieved (total and for new code added in the sprint)


www.rbcs-us.com


Agile Testing Challenges

Volume and speed of changeRemaining effective in short iterationsIncreased regression risk and the automation needed to manage itInconsistent or inadequate unit testingPoor, changing, and missing test oraclesA shifting test basisMeeting overloadFailure to understand testing’s place in AgileOver-commitment in the sprintsSprint team siloingAccumulation of technical debtThe agile hype cycle and high expectationsTiming of performance testingFor more, check out my recorded webinar on this topic


www.rbcs-us.com


Agile Testing Opportunities

Automated unit testingStatic code analysisCode coverageContinuous integrationAutomated functional testingRequirements (user story) reviewsTest (acceptance criteria) reviewsReasonable workloadControl of technical debt (via “fix bugs first”)For more, check out my recorded webinar on this topic


www.rbcs-us.com


Testing in “Agilish” Lifecycles

One RBCS client has a “train” lifecycleTrain never stopsReleases are never delayedSeven week overlapping cycle (three week releases)

Is this agile? Purist vs. pragmatist


www.rbcs-us.com


Agile Testing for Systems-of-Systems

System testing of each iterationSystem integration testing by separate teamStabilization sprint at the end to fix bugsIs this agile? Purist vs. pragmatist


www.rbcs-us.com


Testing for Customized Enterprise Software


www.rbcs-us.com


Agile on Outsourced Projects

Some agile founders (e.g., Alistair Cockburn) say collocation is essential

However, many of our clients are doing a lot of outsourced testing and development

Some of these clients are trying to use agile

Some are succeeding, some are not

An on-site point-of-contact is key to success


www.rbcs-us.com


Tester Skill Implications of Agile

In the United States, the trend is towards requiring programming skill in testers

This trend seems to be expanding worldwide

This is especially important on agile projects

Not only is programming skill needed, but test automation skills are also essential

Another important issue is personalityExtroverts generally like agile because of the emphasis on talking over analysis

Introverts often find agile harder to adapt to, and some report feeling bulldozed by extroverts


www.rbcs-us.com


Agile Test Team Organization Options

Fully embedded, testers in each sprint team

Fully independent, testers assigned at the end of each iteration

Matrixed, testers assigned throughout sprint, but part of independent team

Let’s examine each of these options…


www.rbcs-us.com


Fully Embedded


www.rbcs-us.com


Fully Independent


www.rbcs-us.com


Matrixed


www.rbcs-us.com


Agile and Quality

Does agile result in greater quality?

Jury is still out

The use of proven (long before the Agile Manifesto) best practices is promising

However, the tendency not to measure defects during sprints obscures the situation

Some report better quality (e.g., Jones), but metrics are limited

Some of the “proof by assertion” in this area is unhelpful to conducting an objective discussion


www.rbcs-us.com


Conclusions

Agile lifecycles are distinct from sequential lifecycles, in ways that affect testing and quality

A variety of test tools are available for agile (and non-agile) teams

Metrics programs may be taking a step backward in agile projects

Agile lifecycles create testing challenges and opportunities

There are many different—and successful—implementations of agile lifecycles

Opinions differ on whether agile works on outsourced projects, but many are trying

Agile lifecycles have strong implications for tester skills

Carefully choose organizational options for agile test teams

Agile’s effect on quality remains unclear


www.rbcs-us.com



www.rbcs-us.com


For over 20 years, RBCS has delivered consulting, training, and expert services to clients, helping them with software and hardware testing. Employing the industry’s most experienced and recognized consultants, RBCS advises its clients, trains their employees, conducts product testing, builds and improves testing groups, and hires testing staff for hundreds of clients worldwide. Ranging from Fortune 20 companies to start-ups, RBCS clients save time and money through improved product development, decreased tech support calls, improved corporate reputation and more. To learn more about RBCS, visit www.rbcs-us.com.

Address: RBCS, Inc.31520 Beck Road

Bulverde, TX 78163-3911

USAPhone: +1 (830) 438-4830

E-mail: [email protected]: www.rbcs-us.com

Twitter: @RBCS, @MisterSDET, @LaikaTestDog

Facebook: @TestingImprovedbyRBCS

LinkedIn: https://www.linkedin.com/in/rex-blackYouTube: https://www.youtube.com/user/RBCSINC

To Contact RBCS

agile testing in the real world - rbcs, inc€¦ · this webinar isn’t about that purist world,...

Documents