microsoft alm support - testing perspective

30
ALM USING VISUAL STUDIO 2013 A TESTING PERSPECTIVE MALINI VALSALA 07-AUG-2014 © Testhouse Ltd Confidential and Proprietary

Upload: deepu-nath

Post on 03-Dec-2014

141 views

Category:

Technology


2 download

DESCRIPTION

GTech Technology Focus Group organised an event on "Trends and Transformations on Quality Assurance & Quality Control"

TRANSCRIPT

Page 1: Microsoft ALM Support - Testing Perspective

ALM USING VISUAL STUDIO 2013 A TESTING PERSPECTIVE

MALINI VALSALA

07-AUG-2014 © Testhouse Ltd Confidential and Proprietary

Page 2: Microsoft ALM Support - Testing Perspective

AGENDA

About us

ALM support in Visual Studio Suite

Visual Studio

Microsoft Test Manager

Team Web Access

Dashboards - Quality

Q&A

© Testhouse Ltd. Confidential and Proprietary

Page 3: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

Headquartered in London with service centres in

UK, India and UAE, Kuwait, United States and

Africa

Gold partnerships with Microsoft & HP

Adoption of Testing Tools across different domains

Sharing and adopting best practices and effective

strategies in multiple locations

ABOUT US

Page 4: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

TESTHOUSE SERVICES

People

Methods

&

Processes

Global Sourcing

• Dedicated testing experts

• Supported by a defined career path

• Aligned to a particular industry

• Actively involved in career-long training (industry-based and testing-based)

• Proven methodologies and processes – (Waterfall, Agile, Scrum etc)

• Informed by best practices and lessons learned from diverse projects

• Consistent application which ensures efficiency, consistency, and quality

• Approach that includes well-coordinated integration and hand-off points

between on and offshore testing functions

• Proven knowledge transfer and migration approaches

Technology • Best of breed tools and assets applied consistently

• Structured approach to identifying what tools to use when

Keys to Success Components

Global provider of software Testing & QA services

Page 5: Microsoft ALM Support - Testing Perspective

ALM BENEFITS FROM VISUAL STUDIO SUITE

© Testhouse India Private Ltd. Confidential and Proprietary

Flexible environment

Adapts to your team’s needs

Removes barriers between roles

Streamlines processes

Delivering high-quality software faster and more efficiently

Plan Develop & Test Release Operate

Page 6: Microsoft ALM Support - Testing Perspective

MICROSOFT ALM SOLUTIONS

© Testhouse Ltd. Confidential and Proprietary

Page 7: Microsoft ALM Support - Testing Perspective

ALM SOLUTIONS FOR QUALITY ENABLEMENT

© Testhouse Ltd. Confidential and Proprietary

Work item tracking Test lab

management Build automation

Extensibility interfaces

SCM Test execution

services Deployment automation

Reporting and BI

Lab infrastructure Test recorders

and runners Build engines

• Actionable feedback

• Exploratory testing

• Requirements management

• Acceptance criteria definition

• Developer testing • Build automation • Actionable

diagnostics

• Test planning and management

• Test execution • Lab management

• Production monitoring

• Integrated incident management

Quality metrics and reporting

Role tailored tools

Role tailored tools

Microsoft Test Manager | Microsoft Visual Studio | Eclipse | Microsoft Feedback client | Microsoft Office | SharePoint | Browser apps | System Center Operations Manager | SQL BI and Reporting

Page 8: Microsoft ALM Support - Testing Perspective

TOOLING

Team Foundation Server Reporting

Generalist Specialist

Manual Testing Some scripting Creates scripts to set up lab, create data

Strong scripting skills Some coding skills

Strong coding Develops automated testing procedures

Expert coding skills

Page 9: Microsoft ALM Support - Testing Perspective

VISUAL STUDIO – PROCESS IN PLACE

Template support to handle diverse SDLC / STLC

processes

Microsoft Visual Studio Scrum 2013

MSF for Agile Software Development 2013

MSF for CMMI Process Improvement 2013

Version Control

Team Foundation Version Control

Git

Build Control and Management

Evaluate new builds and take them into testing

Page 10: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

TEST AUTOMATION

Coded UI Tests

Link Coded UI tests to manual tests created in Test Manager

Data driven with external file

Define test effort

Record manual test cases

Automate using @parameters

Microsoft Test Manager Microsoft Visual Studio

Page 11: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

TEST AUTOMATION CODED UI TESTS

Created in Visual Studio

Generated from:

Existing manual recording

Coded UI recorder

Locate controls to perform actions

Add assertions

Page 12: Microsoft ALM Support - Testing Perspective

MICROSOFT TEST MANAGER

Page 13: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

MTM OVERVIEW – TESTING CENTRE

Testing Centre:

Create and execute test plans

Analyze test results

Enables good interactions within team

Page 14: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

MTM OVERVIEW – LAB CENTER

Lab Centre:

Create and manage test environments

Execute tests on physical or virtual environments

Page 15: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

MICROSOFT TEST MANAGER - PLAN

Test Suites

Test Cases

Test Steps Shared Steps

Parameters

Page 16: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

EXAMPLE -REQUIREMENTS BASED TEST SUITES

Automatically link Test Cases to requirements or user stories

• Add requirement to Test Plan

• Add Test Cases to the requirement

Can also be done manually via Work Item link

Page 17: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

CREATE A NEW TEST CASE

Page 18: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

RUNNING A TEST CASE

Page 19: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

WHAT USUALLY HAPPENS WHEN A TESTER FINDS A BUG?

Submit rich bug reports from the testing session

Data logs to aid devs in diagnosing issue

Graphic by Jeff Atwood (CodingHorror.com)

Works on MY

Machine

Page 20: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

ANALYZE TEST RUNS

Each execution of a test produces results

These results can be analyzed to indicate a ‘Failure type’ and a ‘Resolution’

Bugs can be raised during analysis

Page 21: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

TEST PLAN - TEST RESULTS

Displays test results for the test plan as a whole

How many tests failed / passed / active

Percentage of different Failure types and Resolutions of tests in the plan

Filtered by test suite / tester

Page 22: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

EXPLORATORY TESTING

Let an experienced tester use the application in different user stories.

A bug report can be created that contains all steps in the test.

A test case can also be generated for verification / regression.

A record is kept of every test session. These contain links to added bugs, test cases etc.

Page 23: Microsoft ALM Support - Testing Perspective

TEAM WEB ACCESS & DASHBOARD

Page 24: Microsoft ALM Support - Testing Perspective

TEAM WEB ACCESS

Automatically installed, configured, and updated when TFS is installed or updated

Connect to Visual Studio Team Foundation Server (TFS) through a web browser

Provides much of the functionality that is available through Team Explorer

Tools for project management

Team communications, track team processes, and improve project oversight capabilities

“http:// ServerName:8080/tfs/CollectionName/ProjectName”

© Testhouse Ltd. Confidential and Proprietary

Page 25: Microsoft ALM Support - Testing Perspective

TWA – FOR TESTING TEAMS

© Testhouse Ltd. Confidential and Proprietary

Page 26: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

QUALITY DASHBOARD

Page 27: Microsoft ALM Support - Testing Perspective

© Testhouse Ltd. Confidential and Proprietary

ALM INTEGRATION & TRACEABILITY

In a Nutshell: Visual Studio ALM provides powerful, easy to use tools and reports to manage and track delivery activity and quality throughout the whole development lifecycle.

Page 28: Microsoft ALM Support - Testing Perspective

REFERENCES

Testing with Visual Studio Online

Better Collaboration with Your Test Teams Using Visual Studio 2013

Improve your Automation Testing using VS Coded UI

Streamlining the SDLC using Release Management

Visual Studio Online for Application Insights & Cloud Load Testing

© Testhouse Ltd. Confidential and Proprietary

http://th-ms.com/demo/visual-studio-online

http://th-ms.com/demo/better-collaboration-with-your-test-teams-using-visual-studio-2013/

http://th-ms.com/demo/improve-your-automation-testing-using-vs-coded-ui/

http://th-ms.com/demo/streamlinining-the-sdlc-using-release-management-video/

http://th-ms.com/demo/visual-studio-online-for-application-insights-cloud-load-testing/

Page 29: Microsoft ALM Support - Testing Perspective

QUESTIONS?

© Testhouse Ltd. Confidential and Proprietary

Page 30: Microsoft ALM Support - Testing Perspective

THANK YOU!!!

© Testhouse Ltd. Confidential and Proprietary

CONTACT US: T +91 471 270 0117 M +91 984 622 9995

[email protected]