thinking beyond hpqc alm

47
September 25, 2015 Introduction to QASymphony for [INSERT COMPANY NAME] Modern Software Testing 26 th July 2016 Kevin Dunne – QASymphony Thinking Beyond HP Quality Center Join the conversation on Twitter use #moderntesting

Upload: qasymphony

Post on 15-Apr-2017

821 views

Category:

Business


0 download

TRANSCRIPT

Page 1: Thinking Beyond HPQC ALM

September 25, 2015

Introduction to QASymphony for

[INSERT COMPANY NAME]

Modern Software Testing

26th July 2016

Kevin Dunne – QASymphony

Thinking Beyond HP Quality Center

Join the conversation on Twitter use #moderntesting

Page 2: Thinking Beyond HPQC ALM

HOW TO WATCH THIS WEBINAR

• Audio for this webinar is delivered through your computer. Make sure your speakers are turned up or use a set of headphones.

• If your audio quality is choppy, it could be your internet connection.

• You can customize your webinar viewing experience by increasing, decreasing or minimizing the size of the widgets on your screen.

• If you have questions, enter them in the widget on the bottom left.

Join the conversation on Twitter use #moderntesting

Page 3: Thinking Beyond HPQC ALM

Robust test management platform purpose-built to integrate with JIRA and to help agile teams centralize, organize and gain visibility into software

testing

ABOUT QASYMPHONY

Page 4: Thinking Beyond HPQC ALM

Title: Tips, Tricks & Lessons Learned for Hiring Professional Testers

Date: August 18th

Guest Speakers: Huib Schoots

UPCOMING WEBINARS

Title: Evolve or Die: Healthcare IT Testing

Date: August 30th

Guest Speakers: Kevin Dunne & Mike Cooper

Huib Schoots

Kevin Dunne Mike Cooper

Join the conversation on Twitter use #moderntesting

Page 5: Thinking Beyond HPQC ALM

• Kevin Dunne is the VP of Strategy and Business Development at QASymphony, ensuring their continued commitment to innovation and delivering tools to create better software. With a deep interest in the emerging trends in software development and testing, Kevin is dedicated to collaborating with thought leaders in this space. Kevin comes to QASymphony from Deloitte, where he managed testing on large government and Fortune 500 engagements.

OUR PRESENTER

Kevin Dunne

Join the conversation on Twitter use #moderntesting

Page 6: Thinking Beyond HPQC ALM

• This webinar will be recorded and available on-demand a few hours after the webinar is over. You will get an email when it is available.

• Use the Q&A widgets to the left to ask questions during the webinar.

• At the end of the webinar, you will be asked to take a short survey.

HOUSEKEEPING

Join the conversation on Twitter use #moderntesting

Page 7: Thinking Beyond HPQC ALM

• What has changed related to software development and testing since HP Quality Center was released?

• How have recent changes caused HP Quality Center to become a less effective solution for software testing and development?

• What is HP’s strategy for modernizing the Quality Center solution to meet today’s testing demands?

• How can QASymphony help you to better manage my testing and development in today’s environment?

AGENDA

Join the conversation on Twitter use #moderntesting

Page 8: Thinking Beyond HPQC ALM

HP acquires the then market leader in testing tools, Mercury, and its 3000 employees in 2006 for $4.5 billion.

HP software unit doubled with Mercury’s ~$800 million rev.:

Source: http://www.hp.com/hpinfo/investor/financials/annual/2005/05ar-graphics.pdf

WHERE DOES THE STORY BEGIN?

Before acquiring Mercury, HP had $90 billion of revenue, with 1% coming from “software and other”, meaning $1 billion or less in revenues

Join the conversation on Twitter use #moderntesting

Page 9: Thinking Beyond HPQC ALM

Mercury was the market leading developer of testing tools, having produced current HP products such as:

WHO IS MERCURY?

Join the conversation on Twitter use #moderntesting

Page 10: Thinking Beyond HPQC ALM

The acquired Mercury products still continue to be the cash cow for HP’s testing practice, while self-built tools have struggled:

HP STACK

Category Sub Cat. Tool Notes

Test Auto

Functional UFT Mercury Acquisition

Perf/Load Load Runner/Performance Center Mercury Acquisition

Integration Service Tester Mercury Acquisition

Test MgmtAgile Octane (future) Built

Waterfall HP Quality Center Mercury Acquisition

Infra & Setup

Test Cloud StormRunner (Load only) Built

Mobile Device Farm Mobile Center Built

Test Data Mgmt Test Data Management Mercury Acquisition

Environment Mgmt Surgient VQMS Mercury Acquisition

Other Logging/Debug Sprinter Built

Join the conversation on Twitter use #moderntesting

Page 11: Thinking Beyond HPQC ALM

What has Changed Since HP Acquired Mercury?

Join the conversation on Twitter use #moderntesting

Page 12: Thinking Beyond HPQC ALM

HP HAS MADE MANY MORE ACQUISITIONS

HP’s modest growth since 2006 has been achieved through making more acquisitions of high performing companies, not through making meaningful improvements to the software they acquire:

Year Company Revenue

2007 Opsware $100m

2008 Exstream $30m

2011 Autonomy $900m

+Est. 2006 Software Revenue $1.8b

2006 Rev. + Acquired Rev. $2.83b

2015 Annual Report

HP has experienced only 2.5% annual organic growth in software revenue

Join the conversation on Twitter use #moderntesting

Page 13: Thinking Beyond HPQC ALM

FOR STARTERS:

To put things in perspective, the iPhone was released a year after the Mercury acquisition, in 2007:

Join the conversation on Twitter use #moderntesting

Page 14: Thinking Beyond HPQC ALM

1. Agile adoption

2. Adoption of open source

tools/best-of-breed

3. SaaS growth4. Multi-channel development

5. DevOps and Automation

OTHER TRENDS SINCE 2006

Join the conversation on Twitter use #moderntesting

Page 15: Thinking Beyond HPQC ALM

Since 2006, the growth of Agile has been tremendous:

THE GROWTH OF AGILE

2006

39%of organizations practicing Agile

development

2016

95%of organizations practicing Agile

development

Join the conversation on Twitter use #moderntesting

Page 16: Thinking Beyond HPQC ALM

With agile has come a switch to more best of breed tooling:

Source: https://www.planittesting.com/nz/insights/2013/industry-stats-test-tool-utilisation-2012/

SWITCHING TO OPEN SOURCE

Join the conversation on Twitter use #moderntesting

Page 17: Thinking Beyond HPQC ALM

The growth of Atlassian has been incredible to experience:

Source: http://static.amigobulls.com/articles/wp-content/uploads/2015/12/TEAM_Chart-3_121515.png

ATLASSIAN: A TECH UNICORN

Join the conversation on Twitter use #moderntesting

Page 18: Thinking Beyond HPQC ALM

The demand for Selenium automation engineers points to equally impressive growth:

Source: http://1.bp.blogspot.com/-u5tJObxwS2g/Vl9jHto3Z7I/AAAAAAAAAH0/a3LNQxgOJf8/s1600/jobgraph.png

SELENIUM: THE MARKET STANDARD

Join the conversation on Twitter use #moderntesting

Page 19: Thinking Beyond HPQC ALM

The demand for JMeter is growing quickly and has surpassed load runner in job postings:

Source: http://www.indeed.com/trendgraph/jobgraph.png?q=load+runner%2C+jmeter

JMETER: AN EMERGING COMPETITOR

Join the conversation on Twitter use #moderntesting

Page 20: Thinking Beyond HPQC ALM

The growth in new technologies is driven almost entirely by subscription based solutions, rather than traditional licenses:

Source: http://blogs-images.forbes.com/louiscolumbus/files/2015/01/Global-Forecast-Public-Cloud-Forrester.jpg

SAAS RULES THE WORLD

Join the conversation on Twitter use #moderntesting

Page 21: Thinking Beyond HPQC ALM

Chrome, Firefox, and Safari have taken over the world and driven the adoption of Internet Explorer to all-time lows:

Source: http://www.slate.com/content/dam/slate/blogs/moneybox/2012/06/12/the_rise_of_chrome_and_the_fall_of_internet_explorer/1339516947484.jpg.CROP.rectangle3-large.jpg

THE DEATH OF INTERNET EXPLORER

Join the conversation on Twitter use #moderntesting

Page 22: Thinking Beyond HPQC ALM

Seemingly, almost every organization is thinking about DevOps, if they aren’t doing it already:

Source: https://media.licdn.com/mpr/mpr/shrinknp_400_400/AAEAAQAAAAAAAAkLAAAAJGQ4OTgxZDViLTZhZWQtNGU4Mi1iN2NiLWI5ZjBhMDIwMTQzMg.png

THE RISE OF JENKINS

Join the conversation on Twitter use #moderntesting

Page 23: Thinking Beyond HPQC ALM

qTest is Today’s Testing Solution

Join the conversation on Twitter use #moderntesting

Page 24: Thinking Beyond HPQC ALM

1. Agile adoption

2. Adoption of open source

tools/best-of-breed

3. SaaS growth4. Multi-channel development

5. DevOps and Automation

REMINDING US OF TRENDS SINCE 2006

Join the conversation on Twitter use #moderntesting

Page 25: Thinking Beyond HPQC ALM

HP QC has several limitations from its waterfall architecture that prevent it from working well in Agile, including:

WHY HP QC FAILS IN AGILE

Heavy Workflows/UI

A clunky UI and restrictive workflows prevent quick

iterations

Rigid Structure

The rigid, prescriptive workflow doesn’t adapt to

various agile flavors

Expensive Licensing

Expensive licensing prevents collaboration and

team quality

Join the conversation on Twitter use #moderntesting

Page 26: Thinking Beyond HPQC ALM

By building a platform later (in 2011) we were able to build to the then-current Agile process:

QTEST: AGILE TEST CASE MANAGEMENT

Intuitive UI/Workflows

The modern web UI allows you to work quickly and

efficiently

Adaptable Structure

The adaptable structure is embraced by all

methodologies, from waterfall to BDD

Lower Cost of Ownership

Lower licensing cost, with included support and maintenance than HP

Join the conversation on Twitter use #moderntesting

Page 27: Thinking Beyond HPQC ALM

HP QC has lackluster integration to JIRA that causes both process and technology problems when leveraged:

HP’S POOR JIRA INTEGRATION

Join the conversation on Twitter use #moderntesting

Page 28: Thinking Beyond HPQC ALM

We have put intense focus into our unique real-time JIRA integration, which 80%+ of our customers use:

QTEST’S REAL-TIME JIRA INTEGRATION

Join the conversation on Twitter use #moderntesting

Page 29: Thinking Beyond HPQC ALM

SaaS (if implemented properly) has many benefits to organizations, HP’s model captures none of them:

HP ISN’T SAAS, IT’S ON-PREM IN THE CLOUD

qTest HP QCAbility to add extra servers/resources on demand ×No minimum purchase/service fees ×Instant upgrades and hotfixes ×Ability to convert trial data into paying sites ×Access to full features of On-Premise product ×

Join the conversation on Twitter use #moderntesting

Page 30: Thinking Beyond HPQC ALM

We have implemented true multi-tenant architecture, a best-in-class way of optimizing resources across customers: HP QASymphony

Source: http://erpcloudnews.com/wp-content/uploads/2010/06/multi_tenant_versions_2.png

COMPARING THE ARCHITECTURES

Join the conversation on Twitter use #moderntesting

Page 31: Thinking Beyond HPQC ALM

For years, HP QC had no support for Chrome, FireFox, and Safari. Their recent Web client still falls short in many areas:

HPQC DOESN’T SUPPORT MODERN BROWSERS

Requirements Test Cases Test Execution DefectsChrome × × Firefox × × Safari × × IE 10,11

Requires 300MB client

Requires

300MB client

Join the conversation on Twitter use #moderntesting

Page 32: Thinking Beyond HPQC ALM

Unlike HP ALM, qTest offers full functionality in a modern, cross browser web app, with no thick client to install:

QTEST IS A BREATH OF FRESH AIR

Requirements Test Cases Test Execution DefectsChrome Firefox Safari IE 10,11

Join the conversation on Twitter use #moderntesting

Page 33: Thinking Beyond HPQC ALM

When using JIRA for defect and requirements management, their synchronizer provides a clunky 5 step process:

Viewing impact of Defects on User Story Releases

HP IS NOT BUILT FOR DEVOPS

Defect Viewed in

JIRA

Navigate to Defect in

ALM

Link to Test Run in ALM

Link to Requirement

in ALM

Navigate to Requirement

in JIRA

Join the conversation on Twitter use #moderntesting

Page 34: Thinking Beyond HPQC ALM

When using qTest with JIRA, all related executions as well as linked issues and test cases are visible directly in JIRA:

QTEST + JIRA – DEVOPS NIRVANA

Join the conversation on Twitter use #moderntesting

Page 35: Thinking Beyond HPQC ALM

HP’s Future Plans

Join the conversation on Twitter use #moderntesting

Page 36: Thinking Beyond HPQC ALM

At HP Discover this June, HP announced the release of a new ALM offering Octane, which will solve some key problems:

As is common for HP, the specific features/dates are uncertain:

HP’S VISION FOR THE FUTURE

HP OctaneCross Browser Support Gherkin Support Organize tests & requirements by feature Robust REST API’s DevOps workflows

Join the conversation on Twitter use #moderntesting

Page 37: Thinking Beyond HPQC ALM

Though ALM Octane may solve many problems, it will leave many old ones unsolved and create several new ones:

ONE STEP FORWARD, TWO STEPS BACK

No Migration Path

ALM.net users have been told they need to start

completely fresh in Octane

Scheduled Sync with JIRA

HP still sees Octane as the system of record for user

stories and defects

No Bi-Modal Reporting

ALM.net and Octane use separate reporting

architectures with no shared visibility

Join the conversation on Twitter use #moderntesting

Page 38: Thinking Beyond HPQC ALM

Given the uncertainty around HP Octane/ALM, rumors of HP selling off assets are gaining traction once again:

Source: http://www.bloomberg.com/news/articles/2016-07-08/hewlett-packard-enterprise-said-to-mull-selling-software-assets

RUMORS ARE SWIRLING

Join the conversation on Twitter use #moderntesting

Page 39: Thinking Beyond HPQC ALM

The QAS Experience: Why the most HP Users

Choose Us

Join the conversation on Twitter use #moderntesting

Page 40: Thinking Beyond HPQC ALM

qTest offers a viable path forward for large organizations that are ready for a change, but not convinced of HP ALM Octane:

QTEST IS BUILT FOR THE ENTERPRISE

Proven Migration Path• Migrate all relevant assets

yourself or through partners• No additional license or cost

Best In Class Support• Dedicated support rep for

implementation, installs, upgrades, training, etc.

• Support included with no additional cost

Continued Innovation• Monthly releases with input

collected directly from customer base

• Five new products released in 5 years of development

Join the conversation on Twitter use #moderntesting

Page 41: Thinking Beyond HPQC ALM

We’ve migrated dozens of enterprise customers using our best-in-class migration tool. Others lack a cohesive migration tool:

BEST-IN-CLASS MIGRATION

qTest HP Octane ZephyrUsers/Assignees × ×Custom Fields/Values × ×Requirements × ×Links (Req<>TC, DF<> TR, etc.) × ×Test Cases Test Results × ×Defects

(using TaskTop) ×

Join the conversation on Twitter use #moderntesting

Page 42: Thinking Beyond HPQC ALM

You’ll enjoy the level of attention and enablement you receive as part of your qTest subscription:

UPGRADE YOUR CUSTOMER SUPPORT

qTest HP ZephyrAssigned Account Rep × ×Customer Product Council ×Best Practices Webinars × ×Live Installation Support × ×24x5 support coverage × ×1 hour response time × ×Annual User Conference × ×

Join the conversation on Twitter use #moderntesting

Page 43: Thinking Beyond HPQC ALM

Unlike HP, we practice Agile development using our own tools + many others, meaning more functionality, delivered faster:

YOU’RE AGILE, WE’RE AGILE

2016 2017Q1 Q2 Q3 Q4 Q12017

Late Q2

Late Q3

Early Q1

Feb 22 - Mar 28 Armstrong

Mar 28 - May 9

BaffinMay 9 - Jun

6 ColumbusJun 6 - Jul

11 DrakeJul 11 - Aug

15 EricsonAug 15 - Sep

19 FraserSep 19 - Oct

24 GamaOct 24 - Nov

28 HudsonNov 28 -

Jan 9Ingstad

Cloud releases every five weeks with features prioritized by customer requests

On Premise Releases

CloudReleases

Join the conversation on Twitter use #moderntesting

Page 44: Thinking Beyond HPQC ALM

5 Key Takeaways

Join the conversation on Twitter use #moderntesting

Page 45: Thinking Beyond HPQC ALM

IF YOU ONLY REMEMBER ONE SLIDE…

1. HP is not a software company• They still do less than 3% of their revenue on software

2. HP tools have not evolved• Many things have changed drastically since 2006, HP’s stance on testing has not

3. Using HP can hold you back• There are major drawbacks to using outdated testing tools, including operational inefficiencies

and competitive losses

4. HP is trying to evolve, but the vision is unclear• Octane might be a step in the right direction, but many questions are unanswered and the track

record for HP built software is poor

5. QASymphony is the dominant HP replacement option• We’ve build a business on replacing HP and considered the key challenges of moving from HP

from top to bottom – we are the complete solution with the pedigree

Join the conversation on Twitter use #moderntesting

Page 46: Thinking Beyond HPQC ALM

Q&A

Questions?

Join the conversation on Twitter use #moderntesting

Page 47: Thinking Beyond HPQC ALM

Thank you