automating server-based build, qa & test with visual studio 2012 neno loje consultant & mvp...
TRANSCRIPT
Automating Server-based Build, QA & Test withVisual Studio 2012Neno LojeConsultant & MVP for Visual Studio ALM, TFS, and Scrumwww.teamsystempro.com
Based on:
What's Your Cycle Time?
Sprint illustration by Tyler Gibson, Microsoft Corp.
Customer can benefitfrom the feature
Developer checks innew feature or bug fix
Define "Done"
Explicit Definition of Done (DoD)Constant QualityImportant for EstimatesInfluenced by Enterprise StandardsMeasurableAutomated
Step-by-Step Guide to more Quality
Step 1 – Source Control EverythingStep 2 – Automated BuildStep 3 – Continuous Integration (Gated Check-In)Step 4 – Automated Build Verification Test
Unit Tests, Code Coverage, Data-Driven Unit Tests, Code Analysis, Layer Validation
Step 5 – Automated Deployment & Acceptance TestUI Acceptance Tests
demo Automated Checking against the Definition of Done with Visual Studio 2012
Team Explorer 2012 Keyboard Shortcuts
Shortcut Team Explorer Page
Ctrl+0, H Home
Ctrl+0, P Pending Changes
Ctrl+0, M My Work
Ctrl+0, W Work Items
Ctrl+0, B Build
Ctrl+0, R Reports
Ctrl+0, D Documents
Ctrl+0, S Settings
Ctrl+0, A Web Access – team home page
Source: http://blogs.msdn.com/b/buckh/archive/2012/06/06/team-explorer-2012-keyboard-shortcuts.aspx
TransparencyHow well are we doing?
Build Success Over Time ReportHow well is the team testing the code?
Illustration taken from MSDN Library (msdn.microsoft.com)
Build Summary Report
Illustration taken from MSDN Library (msdn.microsoft.com)
Build Quality Indicators ReportIs the team likely to finish on time based on the code and test metrics?
Illustration taken from MSDN Library (msdn.microsoft.com)
Summary / Next Steps
Define Quality (= Create your Definition of Done)
Automate checking against your DoD
Measure your successCycle Time: Idea working software in the user’s handsMean Time To Repair (MTTR): discovery of a problem fix
References
> Using Code Analysis Rule Setshttp://blogs.msdn.com/b/habibh/archive/2009/08/12/create-your-own-code-analysis-rule-set-using-visual-studio-team-system-2010.aspx
> Validate Layer Diagrams during TFS Buildhttp://msdn.microsoft.com/en-us/library/dd409395.aspx
> Blog series on how to customize TFS Build (by Ewald Hofman)http://www.ewaldhofman.nl/post/2010/04/20/Customize-Team-Build-2010-e28093-Part-1-Introduction.aspx
> Free Book Chapter (Chapter 21) about TFS Build (and how to extend it)http://www.wrox.com/WileyCDA/WroxTitle/Professional-Application-Lifecycle-Management-with-Visual-Studio-2010.productCd-0470484268.html
> Ready-to-use Build Process Template: Build Release Deploy (BRDLite)http://blogs.msdn.com/b/willy-peter_schaub/archive/2011/06/06/build-release-deploy-brdlite-what-is-it.aspx
> Visual Studio Lab Management Videoshttp://blogs.msdn.com/b/lab_management/archive/2010/02/11/visual-studio-lab-management-videos.aspx
> Enabling Code Coverage (in TFS 2010)http://www.codewrecks.com/blog/index.php/2010/06/14/running-code-coverage-in-tfs2010-builds/
Book Recommendations – for TFS 2010
> Inside the Microsoft Build Engine: Using MSBuild and Team Foundation BuildAutomated Build & Build Customization
> Professional Team Foundation Server 2010Must have guidance on everything you need to know about TFS 2012
> Professional Application Lifecycle Management with Visual Studio 2010Introduction to ALM with VS & TFS 2010 [see also: Sample chapter]
> Professional Scrum with Team Foundation Server 2010How to do Scrum using TFS 2010
> Software Testing with Visual Studio 2010Testing with VS & TFS 2010
Upcoming books – for TFS 2012
> Visual Studio Team Foundation Server 2012: Adopting Agile Software Practices: From Backlog to Continuous Feedback (3rd Edition)Definitive guide to the application of agile development with Scrum and modern software engineering practices using Visual Studio
> Professional Team Foundation Server 2012Must have guidance on everything you need to know about TFS 2012
> Professional Application Lifecycle Management with Visual Studio 2012Introduction to ALM with VS & TFS 2012
> Professional Scrum Development with Microsoft Visual Studio 2012 (MS Press)How to turn requirements into working software increments with VS + Scrum + Agile practices
Premium Test Professional
Visual Studio 2012 Product Family
Professional
Enhanced Profiling(Tier Interaction)
Code Clone Analysis
Code Metrics
Code Coverage
Ultimate
Web Testing
Unlimited
Load Testing
Team Foundation Server
Unit Testing
For informational purposes only. No guarantee for correctness. All Trademarks owned by Microsoft Corp. Slide: © Neno Loje, www.teamsystempro.com, All rights reserved.
Code Profiler
Code Analysis
UI Test Automation
Microsoft Fakes(Unit Test Isolation)
IntelliTrace Collector
UML Diagrams
Architecture Explorer
Arch. Validation IntelliTrace®
PowerPoint
Storyboarding
Code Review
Feedback
My Work
Backlogs &
Planning
This is all public information taken from: http://www.microsoft.com/visualstudio/11/en-us/products/compare
Team Explorer Everywhere (TEE)
Eclipse Plug-In
Microsoft Test
Manager (MTM)
Related ContentDEV318 Working on an Agile Team with Visual Studio 2012 and Team Foundation Server 2012 – Forum on Wed, 2:45 PM - 4:00 PM
DEV217 Deep Dive Into Team Foundation Server 2012 Agile Management Tools – Emerald Room on Thu, 8:30 AM - 9:45 AM
DEV345 The Accidental Team Foundation Server Admin –Hall 3A on Thu, 8:30 AM - 9:45 AM
DEV340 Taking Your Application Lifecycle Management to the Cloud With the Team Foundation Service – D201 on Thu, 10:15 AM - 11:30 AM
OSP432 Application Lifecycle Management: Automated Builds and Testing for SharePoint projects – Emerald Room on Thu, 12:00 PM - 1:15
DEV324 A Modern Architecture Review: Using the New Code Review Tools –Forum on Fri, 10:15 AM - 11:30 AM
Resources
Connect. Share. Discuss.
http://europe.msteched.com
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
TechNet
Resources for IT Professionals
http://microsoft.com/technet
Resources for Developers
http://microsoft.com/msdn
Evaluations
http://europe.msteched.com/sessions
Submit your evals online
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION.