testing trendsfiles.meetup.com/2625872/voke_squad_testing trends and the pivot… · testing...

© 2013 voke media, llc All Rights Reserved. Reproduction and distribution are prohibited.

◉ Testing Trends: The Pivotal Role of the Test Professional

Theresa Lanowitz, voke Founder

Denver, CO | 16 September, 2013


◉ Agenda

• About voke

• Global Trends – The Need for Quality

• Organizational Secrets to Success – Quality Assurance a Critical

Business Partner

• Quality Assurance Roadmap

• Net/Net


๏ About voke


◉ About voke

• Independent industry analyst firm

• Founded in 2006 by Theresa Lanowitz

• Firm focuses on the application lifecycle and its transformation

including virtualization, cloud computing, embedded systems,

mobile and device software

• Provides strategic, independent, and impartial advice and market

observations through qualitative and quantitative research


๏ Global Trends –

The Need for Quality


◉ Current Reality


◉ NASDAQ – August 22, 2013

A “computer malfunction”

froze thousands of

securities listed on the

Nasdaq Stock Market for

three hours. Many of the

country’s most-traded

shares ground to a

standstill as brokers were

unable to execute orders.


◉ Chicago Board Options Exchange – April 25, 2013

Chicago Board Options

Exchange delayed the start of

trading by three hours because

of “an unresolved software

bug”.

Executives of CBOE were

quoted as saying “it was a

tough morning”.


◉ Novopay New Zealand – August 2012 to Present

Novopay, a web-based payment

system for New Zealand teachers

and staff created by Talent2, was

delayed by more than two years.

Once in production users of the

system were either overpaid,

underpaid, or not paid at all.

Defects such as hyphenated

names caused disappearance.

Estimated $5 million remediation

plan and $3.5 million in extra

staffing.


◉ Sabre Holdings – September 11, 2012

American Airlines,

Southwest Airlines,

JetBlue Airways, and

Alaska Airlines lost

access to their

reservation systems

hosted by Sabre Holdings, a global distribution system.


◉ More Software Failures Daily

http://aws.amazon.com/

http://www.ingnycmarathon.org/index.htm


◉ Why Are Software Failures Making Headlines?

• Economy

- Lack of investment during Global Financial Crisis (GFC)

• Faster, faster, faster

- Faster is not equal to better

• Old technology

- Most organizations are not up to date on current software platforms

- Most organizations are not leveraging the power of modern solutions


◉ Audience Question 1

Does your team deliver software with greater quality today vs.

five years ago?

1. Yes, and we know this because we measure

2. Yes, we think we do but do not measure

3. Our quality is about the same as five years ago

4. No, we deliver less quality

5. Not sure


๏Organizational Secrets to

Success

Quality Assurance –

A Critical Business Partner


◉ A Renaissance for Quality Assurance Professionals

“Since our last published report on the testing market in 2010

there has been a renaissance in the testing market by both the

software vendors and the testing professionals themselves.

Testing professionals are far more visible, vocal, and confident

than at any other time in the history of the market. This new

found confidence is based on the value delivered through their

dedication to software excellence.”

voke 2012 Market Mover ArrayTM Report: Testing Platforms


◉ Parity – A Basic Requirement


◉ Parity – A Basic Requirement


◉ Classic Challenge

Cost

Quality Schedule


๏Quality Assurance Roadmap


◉ QA Roadmap – Critical for Business Success

Chaos

Establish

QA Role

Dev and

QA Parity

IT & Biz

Alignment

Change

Agent


◉ QA Roadmap – Recognize the Value in QA

Would you believe

you can gain

“CONTROL” from

“KAOS”? Source: http://en.wikipedia.org/wiki/Get_Smart


◉ QA Roadmap – Establish the Role

Actions Expectations Technology Tips

Seek executive

champion

Evaluate QA model •Internal QA

•Outsourced QA

•Hybrid

Establish a QA team

QA team demonstrates

its value •Metrics

•Results

•Visibility

•Accountability

Be proactive with

manual testing tools •HP Sprinter

•Microsoft Visual Studio

2012 Test Professional


◉ QA Roadmap – Mutual Respect Between Development and QA


Build on previous step

Seek an executive champion

to elevate QA role as a peer

level to development

Promote the QA organization

to a peer level to development

Empower QA to communicate

any potential business risks

that may arise upon release

Development and QA

collaborate to deliver higher

quality

QA is a proactive lifecycle

participant

QA professionals have

equivalent career paths to

development

Eliminate bottlenecks – use

lifecycle virtualization •CA LISA

•HP

•IBM

•Parasoft

Eliminate elusive defects •CA LISA

•Microsoft •Parasoft

Collaborate with development

embrace

development testing •Coverity

•Parasoft

Deliver higher quality with

continuous integration •Electric Cloud

•Microsoft


◉ QA Roadmap - QA Value Recognized


QA takes a leadership role

•Promotes its value

•Puts customers at the forefront

•Advocates the Business

Analyst and strategic

requirements

•Expands reach into

application/software usability

QA is a valued leader in the

organization

QA leverages Centers of

Excellence (CoE)

QA is known as the

customer advocate

Make requirements a central theme

•Evaluate requirements definition

solutions

Protect your data

•Harness the power of service

virtualization to manage test data

across multiple teams

Understand impacts of performance

•Ensure application performance

throughout the lifecycle

•Mobile applications highlight the

importance of performance


◉ QA Roadmap – QA Leads Change for Business Value


Continue with previous

actions

Publicly promote the results

of the QA organization

Continue to emphasize

requirements •Strategic asset to the

business

Lead •Inside QA

•Inside the application lifecycle

•With the line of business and

customers

Focus efforts strategically •Tackle quality issues beyond the

current release

•Identify root cause and solutions

Identify enterprise-wide software

quality issues

Leverage application security

tools to expand expertise and

show more lifecycle value

Mobile applications highlight

the importance of application

security •Coverity

•HP

•IBM

•Parasoft

Extend traceability into the

development environment

Use tools to deliver policy and

governance throughout the

lifecycle


◉ Audience Question 2

Where is your organization on the QA Roadmap?

1. Chaos

2. Establishing the QA role

3. Development and QA parity

4. IT and business alignment

5. Change agent


๏Embracing

Technology


◉ Embrace New Technology – Innovate

Technology Market Vendor/Product Benefit to Quality

Manual Testing • HP Sprinter

• Microsoft Visual Studio 2012

• Dynamic creation of test cases

• Increase testing across platforms

Lifecycle Virtualization • CA Lisa

• HP Service Virtualization

• IBM Rational Test Virtualization Server

• Parasoft Virtualize


• Reduce wait times

• Increase availability of services

• Reduce defects entering production

• Reduce overall software cycle time

• Reduce test cycle time

• Increase code coverage

Development Testing • Coverity Development Testing Platform


• Parasoft Development Testing

• Prevent defects from leaving development

• Increase predictability

• Increase visibility across the lifecycle

• Increase collaboration

Continuous Integration • Electric Cloud Electric Commander


• Prevent broken builds from entering QA

• Automate build/test/deploy process

Requirements • HP Requirements Management

• IBM Rational Requisite Pro


• Provide a single view across lifecycle

• Trace requirements across lifecycle

• Prevent requirements defects from

entering production

Performance • HP Performance Center

• IBM Rational Performance Tester


• Neotys NeoLoad

• Prevent and manage non-functional

defects

• Retain customer engagement

Application Security • Coverity Security Advisor

• HP Security Solution

• IBM Security AppScan

• Parasoft Application Security Solution

• Reduce security vulnerabilities from

entering production

• Manage security risks of applications


๏2012 voke Market Mover ArrayTM Chart

Testing Platforms

Source: voke Market Mover ArrayTM Report: Testing Platforms – June 2012


๏ Net/Net


◉ Net/Net

• Software and the brand are linked

• QA delivers value to the business

• QA is a critical business partner

• Know where you are on the QA Roadmap

- Transform your organization and embrace QA as a customer advocate

- Strive to become a change agent in the organization

• Innovate in your organization


◉ Learn More at www.vokeinc.com

• Become a Research client at www.vokeinc.com

- voke Market Snapshot: Agile Realities

- voke Strategic Brief: Cost of Rework

- voke Market Snapshot: Service Virtualization

- voke Category Snapshot: Lifecycle Virtualization

- voke Market Snapshot: Virtual Lab Management

- voke Market Mover Array: Testing Platforms 2012

- voke Market Mover Array: Application Lifecycle Management

• Follow voke on Twitter: @vokeinc

• Take our surveys

http://www.vokeinc.com/



Thank You!!!


๏ Q&A


◉ voke Contact

voke, inc.

2248 Meridian Boulevard

Suite H

Minden, NV 89423

P: +1.866.895.9045

W: www.vokeinc.com

T: @vokeinc


testing trendsfiles.meetup.com/2625872/voke_squad_testing trends and the pivot… · testing...

Documents