microsoft alm support - testing perspective
DESCRIPTION
GTech Technology Focus Group organised an event on "Trends and Transformations on Quality Assurance & Quality Control"TRANSCRIPT
ALM USING VISUAL STUDIO 2013 A TESTING PERSPECTIVE
MALINI VALSALA
07-AUG-2014 © Testhouse Ltd Confidential and Proprietary
AGENDA
About us
ALM support in Visual Studio Suite
Visual Studio
Microsoft Test Manager
Team Web Access
Dashboards - Quality
Q&A
© Testhouse Ltd. Confidential and Proprietary
© Testhouse Ltd. Confidential and Proprietary
Headquartered in London with service centres in
UK, India and UAE, Kuwait, United States and
Africa
Gold partnerships with Microsoft & HP
Adoption of Testing Tools across different domains
Sharing and adopting best practices and effective
strategies in multiple locations
ABOUT US
© Testhouse Ltd. Confidential and Proprietary
TESTHOUSE SERVICES
People
Methods
&
Processes
Global Sourcing
• Dedicated testing experts
• Supported by a defined career path
• Aligned to a particular industry
• Actively involved in career-long training (industry-based and testing-based)
• Proven methodologies and processes – (Waterfall, Agile, Scrum etc)
• Informed by best practices and lessons learned from diverse projects
• Consistent application which ensures efficiency, consistency, and quality
• Approach that includes well-coordinated integration and hand-off points
between on and offshore testing functions
• Proven knowledge transfer and migration approaches
Technology • Best of breed tools and assets applied consistently
• Structured approach to identifying what tools to use when
Keys to Success Components
Global provider of software Testing & QA services
ALM BENEFITS FROM VISUAL STUDIO SUITE
© Testhouse India Private Ltd. Confidential and Proprietary
Flexible environment
Adapts to your team’s needs
Removes barriers between roles
Streamlines processes
Delivering high-quality software faster and more efficiently
Plan Develop & Test Release Operate
MICROSOFT ALM SOLUTIONS
© Testhouse Ltd. Confidential and Proprietary
ALM SOLUTIONS FOR QUALITY ENABLEMENT
© Testhouse Ltd. Confidential and Proprietary
Work item tracking Test lab
management Build automation
Extensibility interfaces
SCM Test execution
services Deployment automation
Reporting and BI
Lab infrastructure Test recorders
and runners Build engines
• Actionable feedback
• Exploratory testing
• Requirements management
• Acceptance criteria definition
• Developer testing • Build automation • Actionable
diagnostics
• Test planning and management
• Test execution • Lab management
• Production monitoring
• Integrated incident management
Quality metrics and reporting
Role tailored tools
Role tailored tools
Microsoft Test Manager | Microsoft Visual Studio | Eclipse | Microsoft Feedback client | Microsoft Office | SharePoint | Browser apps | System Center Operations Manager | SQL BI and Reporting
TOOLING
Team Foundation Server Reporting
Generalist Specialist
Manual Testing Some scripting Creates scripts to set up lab, create data
Strong scripting skills Some coding skills
Strong coding Develops automated testing procedures
Expert coding skills
VISUAL STUDIO – PROCESS IN PLACE
Template support to handle diverse SDLC / STLC
processes
Microsoft Visual Studio Scrum 2013
MSF for Agile Software Development 2013
MSF for CMMI Process Improvement 2013
Version Control
Team Foundation Version Control
Git
Build Control and Management
Evaluate new builds and take them into testing
© Testhouse Ltd. Confidential and Proprietary
TEST AUTOMATION
Coded UI Tests
Link Coded UI tests to manual tests created in Test Manager
Data driven with external file
Define test effort
Record manual test cases
Automate using @parameters
Microsoft Test Manager Microsoft Visual Studio
© Testhouse Ltd. Confidential and Proprietary
TEST AUTOMATION CODED UI TESTS
Created in Visual Studio
Generated from:
Existing manual recording
Coded UI recorder
Locate controls to perform actions
Add assertions
MICROSOFT TEST MANAGER
© Testhouse Ltd. Confidential and Proprietary
MTM OVERVIEW – TESTING CENTRE
Testing Centre:
Create and execute test plans
Analyze test results
Enables good interactions within team
© Testhouse Ltd. Confidential and Proprietary
MTM OVERVIEW – LAB CENTER
Lab Centre:
Create and manage test environments
Execute tests on physical or virtual environments
© Testhouse Ltd. Confidential and Proprietary
MICROSOFT TEST MANAGER - PLAN
Test Suites
Test Cases
Test Steps Shared Steps
Parameters
© Testhouse Ltd. Confidential and Proprietary
EXAMPLE -REQUIREMENTS BASED TEST SUITES
Automatically link Test Cases to requirements or user stories
• Add requirement to Test Plan
• Add Test Cases to the requirement
Can also be done manually via Work Item link
© Testhouse Ltd. Confidential and Proprietary
CREATE A NEW TEST CASE
© Testhouse Ltd. Confidential and Proprietary
RUNNING A TEST CASE
© Testhouse Ltd. Confidential and Proprietary
WHAT USUALLY HAPPENS WHEN A TESTER FINDS A BUG?
Submit rich bug reports from the testing session
Data logs to aid devs in diagnosing issue
Graphic by Jeff Atwood (CodingHorror.com)
Works on MY
Machine
© Testhouse Ltd. Confidential and Proprietary
ANALYZE TEST RUNS
Each execution of a test produces results
These results can be analyzed to indicate a ‘Failure type’ and a ‘Resolution’
Bugs can be raised during analysis
© Testhouse Ltd. Confidential and Proprietary
TEST PLAN - TEST RESULTS
Displays test results for the test plan as a whole
How many tests failed / passed / active
Percentage of different Failure types and Resolutions of tests in the plan
Filtered by test suite / tester
© Testhouse Ltd. Confidential and Proprietary
EXPLORATORY TESTING
Let an experienced tester use the application in different user stories.
A bug report can be created that contains all steps in the test.
A test case can also be generated for verification / regression.
A record is kept of every test session. These contain links to added bugs, test cases etc.
TEAM WEB ACCESS & DASHBOARD
TEAM WEB ACCESS
Automatically installed, configured, and updated when TFS is installed or updated
Connect to Visual Studio Team Foundation Server (TFS) through a web browser
Provides much of the functionality that is available through Team Explorer
Tools for project management
Team communications, track team processes, and improve project oversight capabilities
“http:// ServerName:8080/tfs/CollectionName/ProjectName”
© Testhouse Ltd. Confidential and Proprietary
TWA – FOR TESTING TEAMS
© Testhouse Ltd. Confidential and Proprietary
© Testhouse Ltd. Confidential and Proprietary
QUALITY DASHBOARD
© Testhouse Ltd. Confidential and Proprietary
ALM INTEGRATION & TRACEABILITY
In a Nutshell: Visual Studio ALM provides powerful, easy to use tools and reports to manage and track delivery activity and quality throughout the whole development lifecycle.
REFERENCES
Testing with Visual Studio Online
Better Collaboration with Your Test Teams Using Visual Studio 2013
Improve your Automation Testing using VS Coded UI
Streamlining the SDLC using Release Management
Visual Studio Online for Application Insights & Cloud Load Testing
© Testhouse Ltd. Confidential and Proprietary
http://th-ms.com/demo/visual-studio-online
http://th-ms.com/demo/better-collaboration-with-your-test-teams-using-visual-studio-2013/
http://th-ms.com/demo/improve-your-automation-testing-using-vs-coded-ui/
http://th-ms.com/demo/streamlinining-the-sdlc-using-release-management-video/
http://th-ms.com/demo/visual-studio-online-for-application-insights-cloud-load-testing/
QUESTIONS?
© Testhouse Ltd. Confidential and Proprietary
THANK YOU!!!
© Testhouse Ltd. Confidential and Proprietary
CONTACT US: T +91 471 270 0117 M +91 984 622 9995