world quality report: trends in technology, organization ... · pdf file"world quality...

W5 Track 10/7/2009 11:30 AM

"World Quality Report: Trends in Technology, Organization and

Outsourcing"

Presented by:

Charlie Li & Murat Aksu Capgemini

Brought to you by:

330 Corporate Way, Suite 300, Orange Park, FL 32073 888‐268‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com

Charlie Li

The vice president of Global Quality and Testing Services for Capgemini’s Financial Services Sector, Charlie Li helps customers mitigate the risks of IT deployments and reduce the overall cost of IT. He is the author of Optimize Quality for Business Outcomes: A Practical Approach to Software Testing, now in its third edition in both English and Japanese. Charlie has published several white papers in the automated quality software industry and has spoken at leading industry events throughout the country including both the STAREAST and STARWEST conferences.

Murat Aksu Murat Aksu heads Capital Markets Testing for North America in Capgemini. He has played several leadership roles in sales, service delivery, account management, competitive intelligence, product marketing and marketing in his career span of more than 13 years. During the 7 successful years working with HP Mercury Interactive, he was the Manager of Competitive Intelligence and Director of Product Marketing responsible for the Performance Testing and SOA solution tool sets. Prior to joining Capgemini, Murat was the VP of Products and Marketing at Zenoss.

8/10/2009

1

World Quality Report: Trends in Technology, Organization and OutsourcingOutsourcing Charlie Li, VP, Quality Management and TestingMurat Aksu, Practice Head, Quality and Testing

Agenda

Demographics of participants

Tools and Technologygy

State of Quality

Test Organization

Testing Outsourcing

Economic Conditions

2World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with

Trends

8/10/2009

2

Quality Report Profile - Geography

15%15%

20%

15%

50%Asia

Europe

ROW

USA


Quality Report Profile - Industry

24%24%

6%

7%

5%4%5%

47%

Financial Services

Government

Health Care

Manufacturing and Logistics

Others

Research & Education

Telecomm and Media

E


2%0%Energy

Information Technology

8/10/2009

3

Quality Report Profile – Size Of The Company

45%

10%

15%

20%

25%

30%

35%

40%

Enterprise

Large

Mid Size

Small


0%

5%

10%

Total

TOOLS AND TECHNOLOGYAPPLICATION LIFECYCLE MANAGEMENT (ALM) IS THE MARRIAGE OF BUSINESS MANAGEMENT TO SOFTWARE ENGINEERING MADE POSSIBLE BY TOOLS THAT FACILITATE AND INTEGRATE REQUIREMENTS MANAGEMENT, ARCHITECTURE, CODING, TESTING, TRACKING, AND RELEASE MANAGEMENT.*


*WIKIPEDIA

8/10/2009

4

Is Application Complexity Increasing?

88%

80%

90%

100%

30%

40%

50%

60%

70%

Yes

No


12%

0%

10%

20%

Total

Leverage Of Automation Technology Across ALM

25%

22%25%

30%

7%

13%

18%

15%

5%

10%

15%

20%


0%

Business IP‐Domain Management Business Flow Modeling

Requirements Use Case

Test Cases Defect Management

8/10/2009

5

Need For Automation Investment

19%

22%

18% 19%20%

25%

12%

2%5%

10%

15%


0%

Business Flow Modeling Requirements

Test Management and Execution Defect Management

Environments and Data Management None, we have all that we need

Receiving ROI and Fully Leveraging Your Technology Investments?

20%21%

Less than 25%

Up to 50%

Up to 80%

NORTH AMERICA

EUROPEROW

16%

7%

16%54%

18%

13%50%

20%

20%

46%

18%

44%

None

Can't quantify/do not know

EUROPEASIA


7%7%

12%

20%

9%5%

18%

10%7%

8/10/2009

6

STATE OF QUALITY


STATE OF QUALITY

Overall Quality Getting Better? (Last Two Years)

Energy


Health Care


Others


Telecomm and Media

Yes

No


0% 20% 40% 60% 80% 100%

Financial Services

Government

8/10/2009

7

Which ALM Area Poses The Greatest Challenge?

16% 24%

Business consensus on the right investments

Change management

NORTH AMERICA

EUROPE

ROW

28%

14%

34%

23%

10%

3%

44%

3%

9%

6%

50%

14%

35%

Change management

Getting development right

Other (eg. Source Code Control, Build Management)

Testing and validation

ASIA


7%7%10%

3%

10%10% 16% 4%

10%13%

Understanding and capturing business requirements

Organization’s ALM Process Consistently Followed For All Projects?

90%

100%

30%

40%

50%

60%

70%

80%

More than 50% of the time

About 50% of the time

Up to 25% of the time

Less than 10% of the time

Never


0%

10%

20%

Enterprise Large Mid Size Small

8/10/2009

8

% Reuse Of The Quality And Testing Artifacts ALM

90%

100%

30%

40%

50%

60%

70%

80%

50% and above

About 50%

Up to 25%

Less than 10%

None


0%

10%

20%


Benefits From Reusability

Telecomm and MediaEnergy


0% 20% 40% 60% 80% 100%

Financial ServicesGovernmentHealth Care

Manufacturing and LogisticsOthers



Cost reduction

Faster time to market for applications

More testing coverage leading to higher overall quality of the application

Shorter and more agile testing cycles

We are not re‐using any testing artifacts

8/10/2009

9

TEST ORGANIZATION


TEST ORGANIZATION

Testers’ Domain And Business Experience

42%

NORTH AMERICA

EUROPEROW

ASIA

62%

29%

9%

58%

16%

60%27%

23% Some Domain/Business Experience

No Domain/Business Experience

Domain and Business SMEs as Testers


26%

13%

35%

8/10/2009

10

Do Testers Have Business Analyst Experience?

17%43%

NORTH AMERICA

EUROPEROW

ASIA

58%

30%

13%

52%

17%

52%

17%21%

Somewhat

No

Yes


31%31%

36%

45%61%

QA Required To Have Development Experience?

NORTH AMERICA

EUROPEROW

ASIA

35%

23%48%22%

14%

7%

Sometimes

No

Yes


43%30%

40%32%

8/10/2009

11

QA With Dev Background Better QA?

21%

33%

NORTH AMERICA

EUROPEROW

ASIA

39%40%

31%

39%43%

36%33%

Sometimes

No

Yes


23%30%36%

31%

Business Think QA Is Only About Executing Test Scripts?

NORTH AMERICA

EUROPEROW

ASIA

23%

77%30%

70%29%71%

43%

57%

Yes

No


43%

8/10/2009

12

TEST OUTSOURCING


TEST OUTSOURCING

Do You Outsource QA?

NORTH AMERICA

EUROPEROW

ASIA 16%

62%

38%44%

56%52%

48%Yes

No

ASIA


84%

8/10/2009

13

QA Outsourcing Trend

18%17%

17%16%

NORTH AMERICA

EUROPEROW

ASIA18%

58%

8%

16%

32%

6%

47%

7%

38%

17%

Staying the same level

We do not use any outsourced resources for testing

Increasing

Reducing


8%

45%29%

29%

28%

Outsourced Resources With Relevant Industry-Domain And Technology Experience?

NORTH AMERICA

EUROPE

ROW

ASIA

21%

5%50%

24%

34%

29%

41%

38%Somewhat

No

Yes

We do not use any outsourced f i

ASIA


24% 21%

21%15%

15%23%

11%

resources for testing

8/10/2009

14

ALM Automation Reduce Outsourced Resources#?

19% 30%

NORTH AMERICA

EUROPEROW

ASIA

30%

40%

19%

25%

56%

40%36%

30%

54%

Somewhat

No

Yes

ASIA


30%

24%

16%

Increase Leverage Of Testing Outsource For Value Added IP And Solutions?

Telecomm and Media

Energy


Financial Services

Government

Health Care


Others


Telecomm and Media


0% 20% 40% 60% 80% 100%

No, we only need staff augmentation for cost reasons

No, we want their solutions and IP but don’t need their resources

Yes, we need more value‐add from our vendors

8/10/2009

15

ECONOMIC CONDITIONS


ECONOMIC CONDITIONS

Economic Effects Of IT Spending By Industry

Energy


Government

Health Care


Others


Telecomm and Media


0% 20% 40% 60% 80% 100%

Financial Services

Government

I don't know Reduced IT investments Increased IT investments Stayed the same

8/10/2009

16

Economic Effects Of IT Spending

90%

100%

20%

30%

40%

50%

60%

70%

80%

90%


0%

10%

Engineer Senior Engineer Mid Manager Executive

I don't know Reduced IT investments Increased IT investments Stayed the same

Effect Of Economic Crisis On Your Work Load?

90%

100%

Stayed the same

30%

40%

50%

60%

70%

80%Stayed the same

Increased or stayed the same due to cuts in resources

Increased due to new application development projects


0%

10%

20%


Decreased due to project cancellation

8/10/2009

17

More Investment In New App Dev Projects?

NORTH AMERICA

EUROPE

ROW

ASIA

16%

51%

14%71%

9%

10%81%

16%

65%No

Only those that generate ROI in less than 6 months

Yes

ASIA


33%

15%

19%

Expectation Of Apps Project Workload For 2010?

20%

14%NORTH AMERICA

EUROPE

ROW

ASIA 11%0%22%

25%

8%

27%34%

4%32%

Stay the same

Decrease

Increase

Unclear at this point in time

ASIA


67%

40%

5%

41%

50%

8/10/2009

18

TrendsCompanies will increase investment in areas of requirements, test environment and data management

Increased leverage of Agile type of methodologies for shorter application lifecycles

App complexity increases requirements challenges needs to improve ROI willApp complexity increases, requirements challenges, needs to improve ROI will require future QA to be more business focused and have a stronger technology background

QA team to become more skilled, more nimble and smaller teams

Europe is leading in the leverage of outsourcing for testing and expected to outpace other regions in the growth of test outsourcing

Expect IT spending to shift more from Ops to new apps (increased competitive l d l d i ti t )


landscape, legacy modernization, etc.)

Americans lead the world in agreeing with Obama with their inherent optimism that things will get better in 2010 followed by Asians (Note: Kim Jong -Il declined to participate in the report and declared martial law on all North Korean Testers)

world quality report: trends in technology, organization ... · pdf file"world quality...

Documents